Jul 24 17:03:34.267611 ip-10-0-137-137 systemd[1]: Starting Kubernetes Kubelet...
Jul 24 17:03:34.648729 ip-10-0-137-137 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 17:03:34.648729 ip-10-0-137-137 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 24 17:03:34.648729 ip-10-0-137-137 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 17:03:34.648729 ip-10-0-137-137 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 24 17:03:34.648729 ip-10-0-137-137 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 17:03:34.651380 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.651221    2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 24 17:03:34.656670 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656649    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 17:03:34.656670 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656665    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 17:03:34.656670 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656669    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 17:03:34.656670 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656672    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 17:03:34.656670 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656675    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 17:03:34.656670 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656679    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 17:03:34.656886 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656682    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 17:03:34.656886 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656685    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 17:03:34.656886 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656688    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 17:03:34.656886 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656691    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 17:03:34.656886 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656694    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 17:03:34.656886 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656696    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 17:03:34.656886 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656699    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 17:03:34.656886 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656701    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 17:03:34.656886 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656704    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 17:03:34.656886 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656707    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 17:03:34.656886 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656709    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 17:03:34.656886 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656712    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 17:03:34.656886 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656714    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 17:03:34.656886 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656717    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 17:03:34.656886 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656719    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 17:03:34.656886 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656722    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 17:03:34.656886 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656724    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 17:03:34.656886 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656727    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 17:03:34.656886 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656729    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 17:03:34.656886 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656732    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 17:03:34.657381 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656735    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 17:03:34.657381 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656738    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 17:03:34.657381 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656740    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 17:03:34.657381 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656743    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 17:03:34.657381 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656745    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 17:03:34.657381 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656748    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 17:03:34.657381 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656751    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 17:03:34.657381 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656753    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 17:03:34.657381 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656756    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 17:03:34.657381 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656758    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 17:03:34.657381 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656761    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 17:03:34.657381 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656763    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 17:03:34.657381 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656766    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 17:03:34.657381 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656770    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 17:03:34.657381 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656772    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 17:03:34.657381 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656775    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 17:03:34.657381 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656778    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 17:03:34.657381 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656780    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 17:03:34.657381 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656783    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 17:03:34.657381 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656786    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 17:03:34.657890 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656789    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 17:03:34.657890 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656792    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 17:03:34.657890 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656794    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 17:03:34.657890 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656797    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 17:03:34.657890 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656799    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 17:03:34.657890 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656802    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 17:03:34.657890 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656804    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 17:03:34.657890 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656809    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 17:03:34.657890 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656813    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 17:03:34.657890 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656817    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 17:03:34.657890 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656821    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 17:03:34.657890 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656824    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 17:03:34.657890 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656827    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 17:03:34.657890 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656830    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 17:03:34.657890 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656833    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 17:03:34.657890 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656836    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 17:03:34.657890 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656839    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 17:03:34.657890 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656842    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 17:03:34.657890 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656846    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 17:03:34.658369 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656848    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 17:03:34.658369 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656851    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 17:03:34.658369 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656853    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 17:03:34.658369 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656856    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 17:03:34.658369 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656859    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 17:03:34.658369 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656861    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 17:03:34.658369 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656865    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 17:03:34.658369 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656867    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 17:03:34.658369 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656870    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 17:03:34.658369 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656873    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 17:03:34.658369 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656875    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 17:03:34.658369 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656878    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 17:03:34.658369 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656880    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 17:03:34.658369 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656883    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 17:03:34.658369 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656885    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 17:03:34.658369 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656888    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 17:03:34.658369 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656891    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 17:03:34.658369 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656893    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 17:03:34.658369 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656898    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 17:03:34.658369 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656900    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 17:03:34.658896 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656903    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 17:03:34.658896 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656907    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 17:03:34.658896 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656911    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 17:03:34.658896 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656914    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 17:03:34.658896 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656917    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 17:03:34.658896 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656920    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 17:03:34.658896 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656922    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 17:03:34.658896 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656925    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 17:03:34.658896 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656928    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 17:03:34.658896 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656931    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 17:03:34.658896 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656933    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 17:03:34.658896 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656936    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 17:03:34.658896 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656938    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 17:03:34.658896 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.656941    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 17:03:34.658896 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657681    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 17:03:34.658896 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657689    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 17:03:34.658896 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657692    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 17:03:34.658896 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657696    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 17:03:34.658896 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657700    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 17:03:34.658896 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657703    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 17:03:34.659396 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657706    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 17:03:34.659396 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657709    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 17:03:34.659396 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657712    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 17:03:34.659396 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657714    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 17:03:34.659396 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657717    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 17:03:34.659396 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657719    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 17:03:34.659396 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657722    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 17:03:34.659396 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657725    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 17:03:34.659396 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657727    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 17:03:34.659396 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657730    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 17:03:34.659396 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657732    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 17:03:34.659396 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657735    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 17:03:34.659396 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657738    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 17:03:34.659396 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657740    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 17:03:34.659396 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657743    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 17:03:34.659396 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657746    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 17:03:34.659396 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657749    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 17:03:34.659396 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657751    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 17:03:34.659396 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657754    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 17:03:34.659396 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657756    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 17:03:34.659891 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657759    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 17:03:34.659891 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657761    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 17:03:34.659891 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657764    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 17:03:34.659891 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657766    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 17:03:34.659891 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657769    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 17:03:34.659891 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657771    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 17:03:34.659891 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657773    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 17:03:34.659891 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657776    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 17:03:34.659891 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657778    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 17:03:34.659891 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657781    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 17:03:34.659891 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657784    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 17:03:34.659891 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657787    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 17:03:34.659891 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657789    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 17:03:34.659891 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657792    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 17:03:34.659891 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657794    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 17:03:34.659891 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657796    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 17:03:34.659891 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657799    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 17:03:34.659891 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657801    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 17:03:34.659891 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657804    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 17:03:34.659891 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657807    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 17:03:34.660400 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657811    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 17:03:34.660400 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657814    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 17:03:34.660400 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657817    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 17:03:34.660400 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657820    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 17:03:34.660400 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657823    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 17:03:34.660400 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657826    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 17:03:34.660400 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657829    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 17:03:34.660400 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657831    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 17:03:34.660400 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657834    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 17:03:34.660400 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657837    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 17:03:34.660400 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657840    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 17:03:34.660400 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657842    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 17:03:34.660400 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657845    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 17:03:34.660400 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657849    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 17:03:34.660400 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657853    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 17:03:34.660400 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657856    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 17:03:34.660400 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657859    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 17:03:34.660400 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657863    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 17:03:34.660835 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657865    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 17:03:34.660835 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657868    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 17:03:34.660835 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657870    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 17:03:34.660835 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657874    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 17:03:34.660835 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657877    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 17:03:34.660835 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657880    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 17:03:34.660835 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657882    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 17:03:34.660835 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657885    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 17:03:34.660835 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657888    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 17:03:34.660835 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657890    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 17:03:34.660835 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657893    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 17:03:34.660835 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657896    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 17:03:34.660835 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657898    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 17:03:34.660835 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657901    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 17:03:34.660835 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657904    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 17:03:34.660835 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657906    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 17:03:34.660835 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657909    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 17:03:34.660835 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657912    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 17:03:34.660835 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657914    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 17:03:34.660835 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657917    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 17:03:34.661322 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657920    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 17:03:34.661322 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657922    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 17:03:34.661322 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657925    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 17:03:34.661322 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657927    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 17:03:34.661322 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657930    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 17:03:34.661322 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657933    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 17:03:34.661322 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657935    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 17:03:34.661322 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657938    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 17:03:34.661322 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657940    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 17:03:34.661322 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657943    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 17:03:34.661322 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657945    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 17:03:34.661322 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657948    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 17:03:34.661322 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657951    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 17:03:34.661322 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657954    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 17:03:34.661322 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.657958    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 17:03:34.661322 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658329    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 17:03:34.661322 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658334    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 17:03:34.661322 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658338    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 17:03:34.661322 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658340    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 17:03:34.661832 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658360    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 17:03:34.661832 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658364    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 17:03:34.661832 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658368    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 17:03:34.661832 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658373    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 17:03:34.661832 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658376    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 17:03:34.661832 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658379    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 17:03:34.661832 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658382    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 17:03:34.661832 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658385    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 17:03:34.661832 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658388    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 17:03:34.661832 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658391    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 17:03:34.661832 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658393    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 17:03:34.661832 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658396    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 17:03:34.661832 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658399    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 17:03:34.661832 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658403    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 17:03:34.661832 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658406    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 17:03:34.661832 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658408    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 17:03:34.661832 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658411    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 17:03:34.661832 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658413    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 17:03:34.661832 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658416    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 17:03:34.661832 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658418    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 17:03:34.662312 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658421    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 17:03:34.662312 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658424    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 17:03:34.662312 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658426    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 17:03:34.662312 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658429    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 17:03:34.662312 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658432    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 17:03:34.662312 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658436    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 17:03:34.662312 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658439    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 17:03:34.662312 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658442    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 17:03:34.662312 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658445    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 17:03:34.662312 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658448    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 17:03:34.662312 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658450    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 17:03:34.662312 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658453    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 17:03:34.662312 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658455    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 17:03:34.662312 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658458    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 17:03:34.662312 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658460    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 17:03:34.662312 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658472    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 17:03:34.662312 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658474    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 17:03:34.662312 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658477    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 17:03:34.662312 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658480    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 17:03:34.662312 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658482    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 17:03:34.662817 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658485    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 17:03:34.662817 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658487    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 17:03:34.662817 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658490    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 17:03:34.662817 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658492    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 17:03:34.662817 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658495    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 17:03:34.662817 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658499    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 17:03:34.662817 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658502    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 17:03:34.662817 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658504    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 17:03:34.662817 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658507    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 17:03:34.662817 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658511    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 17:03:34.662817 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658513    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 17:03:34.662817 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658516    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 17:03:34.662817 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658519    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 17:03:34.662817 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658522    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 17:03:34.662817 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658525    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 17:03:34.662817 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658528    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 17:03:34.662817 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658531    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 17:03:34.662817 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658533    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 17:03:34.662817 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658536    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 17:03:34.662817 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658539    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 17:03:34.663376 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658541    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 17:03:34.663376 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658544    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 17:03:34.663376 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658546    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 17:03:34.663376 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658549    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 17:03:34.663376 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658551    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 17:03:34.663376 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658555    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 17:03:34.663376 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658559    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 17:03:34.663376 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658562    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 17:03:34.663376 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658564    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 17:03:34.663376 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658567    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 17:03:34.663376 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658570    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 17:03:34.663376 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658572    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 17:03:34.663376 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658575    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 17:03:34.663376 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658577    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 17:03:34.663376 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658580    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 17:03:34.663376 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658582    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 17:03:34.663376 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658587    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 17:03:34.663376 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658590    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 17:03:34.663376 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658594    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 17:03:34.663842 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658597    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 17:03:34.663842 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658600    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 17:03:34.663842 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658602    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 17:03:34.663842 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658605    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 17:03:34.663842 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658607    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 17:03:34.663842 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658610    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 17:03:34.663842 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658612    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 17:03:34.663842 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658615    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 17:03:34.663842 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658618    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 17:03:34.663842 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658621    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 17:03:34.663842 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658623    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 17:03:34.663842 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658626    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 17:03:34.663842 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658629    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 17:03:34.663842 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658632    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 17:03:34.663842 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658636    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 17:03:34.663842 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.658639    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 17:03:34.663842 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658707    2561 flags.go:64] FLAG: --address="0.0.0.0"
Jul 24 17:03:34.663842 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658714    2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 24 17:03:34.663842 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658720    2561 flags.go:64] FLAG: --anonymous-auth="true"
Jul 24 17:03:34.663842 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658724    2561 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 24 17:03:34.663842 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658728    2561 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 24 17:03:34.664409 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658731    2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 24 17:03:34.664409 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658735    2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 24 17:03:34.664409 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658739    2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 24 17:03:34.664409 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658742    2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 24 17:03:34.664409 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658745    2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 24 17:03:34.664409 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658748    2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 24 17:03:34.664409 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658751    2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 24 17:03:34.664409 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658754    2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 24 17:03:34.664409 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658759    2561 flags.go:64] FLAG: --cgroup-root=""
Jul 24 17:03:34.664409 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658762    2561 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 24 17:03:34.664409 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658765    2561 flags.go:64] FLAG: --client-ca-file=""
Jul 24 17:03:34.664409 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658768    2561 flags.go:64] FLAG: --cloud-provider="external"
Jul 24 17:03:34.664409 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658772    2561 flags.go:64] FLAG: --cluster-dns="[]"
Jul 24 17:03:34.664409 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658775    2561 flags.go:64] FLAG: --cluster-domain=""
Jul 24 17:03:34.664409 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658778    2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 24 17:03:34.664409 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658781    2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 24 17:03:34.664409 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658786    2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 24 17:03:34.664409 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658789    2561 flags.go:64] FLAG: --container-log-max-files="5"
Jul 24 17:03:34.664409 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658793    2561 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 24 17:03:34.664409 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658795    2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 24 17:03:34.664409 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658798    2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 24 17:03:34.664409 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658802    2561 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 24 17:03:34.664409 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658805    2561 flags.go:64] FLAG: --contention-profiling="false"
Jul 24 17:03:34.664409 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658808    2561 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 24 17:03:34.665003 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658810    2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 24 17:03:34.665003 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658813    2561 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 24 17:03:34.665003 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658816    2561 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 24 17:03:34.665003 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658820    2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 24 17:03:34.665003 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658823    2561 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 24 17:03:34.665003 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658826    2561 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 24 17:03:34.665003 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658829    2561 flags.go:64] FLAG: --enable-load-reader="false"
Jul 24 17:03:34.665003 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658832    2561 flags.go:64] FLAG: --enable-server="true"
Jul 24 17:03:34.665003 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658834    2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 24 17:03:34.665003 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658839    2561 flags.go:64] FLAG: --event-burst="100"
Jul 24 17:03:34.665003 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658842    2561 flags.go:64] FLAG: --event-qps="50"
Jul 24 17:03:34.665003 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658845    2561 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 24 17:03:34.665003 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658848    2561 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 24 17:03:34.665003 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658850    2561 flags.go:64] FLAG: --eviction-hard=""
Jul 24 17:03:34.665003 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658854    2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 24 17:03:34.665003 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658857    2561 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 24 17:03:34.665003 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658861    2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 24 17:03:34.665003 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658864    2561 flags.go:64] FLAG: --eviction-soft=""
Jul 24 17:03:34.665003 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658867    2561 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 24 17:03:34.665003 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658870    2561 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 24 17:03:34.665003 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658873    2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 24 17:03:34.665003 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658876    2561 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 24 17:03:34.665003 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658879    2561 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 24 17:03:34.665003 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658882    2561 flags.go:64] FLAG: --fail-swap-on="true"
Jul 24 17:03:34.665003 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658886    2561 flags.go:64] FLAG: --feature-gates=""
Jul 24 17:03:34.665663 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658894    2561 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 24 17:03:34.665663 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658897    2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 24 17:03:34.665663 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658900    2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 24 17:03:34.665663 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658903    2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 24 17:03:34.665663 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658906    2561 flags.go:64] FLAG: --healthz-port="10248"
Jul 24 17:03:34.665663 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658910    2561 flags.go:64] FLAG: --help="false"
Jul 24 17:03:34.665663 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658912    2561 flags.go:64] FLAG: --hostname-override="ip-10-0-137-137.ec2.internal"
Jul 24 17:03:34.665663 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658916    2561 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 24 17:03:34.665663 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658919    2561 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 24 17:03:34.665663 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658922    2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 24 17:03:34.665663 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658925    2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 24 17:03:34.665663 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658929    2561 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 24 17:03:34.665663 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658932    2561 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 24 17:03:34.665663 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658934    2561 flags.go:64] FLAG: --image-service-endpoint=""
Jul 24 17:03:34.665663 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658937    2561 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 24 17:03:34.665663 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658940    2561 flags.go:64] FLAG: --kube-api-burst="100"
Jul 24 17:03:34.665663 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658943    2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 24 17:03:34.665663 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658946    2561 flags.go:64] FLAG: --kube-api-qps="50"
Jul 24 17:03:34.665663 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658948    2561 flags.go:64] FLAG: --kube-reserved=""
Jul 24 17:03:34.665663 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658951    2561 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 24 17:03:34.665663 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658954    2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 24 17:03:34.665663 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658957    2561 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 24 17:03:34.665663 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658960    2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 24 17:03:34.665663 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658964    2561 flags.go:64] FLAG: --lock-file=""
Jul 24 17:03:34.666253 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658966    2561 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 24 17:03:34.666253 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658969    2561 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 24 17:03:34.666253 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658972    2561 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 24 17:03:34.666253 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658978    2561 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 24 17:03:34.666253 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658981    2561 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 24 17:03:34.666253 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658984    2561 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 24 17:03:34.666253 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658986    2561 flags.go:64] FLAG: --logging-format="text"
Jul 24 17:03:34.666253 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658991    2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 24 17:03:34.666253 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658994    2561 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 24 17:03:34.666253 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658997    2561 flags.go:64] FLAG: --manifest-url=""
Jul 24 17:03:34.666253 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.658999    2561 flags.go:64] FLAG: --manifest-url-header=""
Jul 24 17:03:34.666253 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659003    2561 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 24 17:03:34.666253 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659006    2561 flags.go:64] FLAG: --max-open-files="1000000"
Jul 24 17:03:34.666253 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659010    2561 flags.go:64] FLAG: --max-pods="110"
Jul 24 17:03:34.666253 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659013    2561 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 24 17:03:34.666253 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659016    2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 24 17:03:34.666253 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659019    2561 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 24 17:03:34.666253 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659022    2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 24 17:03:34.666253 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659025    2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 24 17:03:34.666253 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659028    2561 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 24 17:03:34.666253 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659030    2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 24 17:03:34.666253 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659038    2561 flags.go:64] FLAG: --node-status-max-images="50"
Jul 24 17:03:34.666253 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659041    2561 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 24 17:03:34.666253 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659044    2561 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 24 17:03:34.666253 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659047    2561 flags.go:64] FLAG: --pod-cidr=""
Jul 24 17:03:34.666873 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659049    2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 24 17:03:34.666873 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659054    2561 flags.go:64] FLAG: --pod-manifest-path=""
Jul 24 17:03:34.666873 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659057    2561 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 24 17:03:34.666873 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659060    2561 flags.go:64] FLAG: --pods-per-core="0"
Jul 24 17:03:34.666873 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659063    2561 flags.go:64] FLAG: --port="10250"
Jul 24 17:03:34.666873 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659066    2561 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 24 17:03:34.666873 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659070    2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-064a1750a1ff89f5d"
Jul 24 17:03:34.666873 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659073    2561 flags.go:64] FLAG: --qos-reserved=""
Jul 24 17:03:34.666873 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659076    2561 flags.go:64] FLAG: --read-only-port="10255"
Jul 24 17:03:34.666873 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659079    2561 flags.go:64] FLAG: --register-node="true"
Jul 24 17:03:34.666873 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659082    2561 flags.go:64] FLAG: --register-with-taints=""
Jul 24 17:03:34.666873 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659085    2561 flags.go:64] FLAG: --registry-burst="10"
Jul 24 17:03:34.666873 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659089    2561 flags.go:64] FLAG: --registry-qps="5"
Jul 24 17:03:34.666873 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659092    2561 flags.go:64] FLAG: --reserved-cpus=""
Jul 24 17:03:34.666873 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659094    2561 flags.go:64] FLAG: --reserved-memory=""
Jul 24 17:03:34.666873 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659099    2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 24 17:03:34.666873 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659102    2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 24 17:03:34.666873 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659105    2561 flags.go:64] FLAG: --rotate-certificates="false"
Jul 24 17:03:34.666873 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659108    2561 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 24 17:03:34.666873 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659111    2561 flags.go:64] FLAG: --runonce="false"
Jul 24 17:03:34.666873 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659113    2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 24 17:03:34.666873 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659116    2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 24 17:03:34.666873 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659119    2561 flags.go:64] FLAG: --seccomp-default="false"
Jul 24 17:03:34.666873 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659122    2561 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 24 17:03:34.666873 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659125    2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 24 17:03:34.667488 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659128    2561 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 24 17:03:34.667488 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659131    2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 24 17:03:34.667488 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659133    2561 flags.go:64] FLAG: --storage-driver-password="root"
Jul 24 17:03:34.667488 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659136    2561 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 24 17:03:34.667488 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659139    2561 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 24 17:03:34.667488 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659142    2561 flags.go:64] FLAG: --storage-driver-user="root"
Jul 24 17:03:34.667488 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659144    2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 24 17:03:34.667488 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659147    2561 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 24 17:03:34.667488 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659150    2561 flags.go:64] FLAG: --system-cgroups=""
Jul 24 17:03:34.667488 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659153    2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 24 17:03:34.667488 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659158    2561 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 24 17:03:34.667488 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659161    2561 flags.go:64] FLAG: --tls-cert-file=""
Jul 24 17:03:34.667488 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659163    2561 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 24 17:03:34.667488 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659168    2561 flags.go:64] FLAG: --tls-min-version=""
Jul 24 17:03:34.667488 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659170    2561 flags.go:64] FLAG: --tls-private-key-file=""
Jul 24 17:03:34.667488 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659173    2561 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 24 17:03:34.667488 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659176    2561 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 24 17:03:34.667488 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659179    2561 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 24 17:03:34.667488 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659182    2561 flags.go:64] FLAG: --v="2"
Jul 24 17:03:34.667488 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659185    2561 flags.go:64] FLAG: --version="false"
Jul 24 17:03:34.667488 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659190    2561 flags.go:64] FLAG: --vmodule=""
Jul 24 17:03:34.667488 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659194    2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 24 17:03:34.667488 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.659198    2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 24 17:03:34.667488 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659324    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 17:03:34.667488 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659328    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 17:03:34.668137 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659332    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 17:03:34.668137 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659335    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 17:03:34.668137 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659338    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 17:03:34.668137 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659340    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 17:03:34.668137 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659355    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 17:03:34.668137 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659358    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 17:03:34.668137 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659361    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 17:03:34.668137 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659364    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 17:03:34.668137 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659367    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 17:03:34.668137 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659369    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 17:03:34.668137 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659372    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 17:03:34.668137 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659374    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 17:03:34.668137 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659377    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 17:03:34.668137 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659380    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 17:03:34.668137 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659382    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 17:03:34.668137 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659385    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 17:03:34.668137 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659387    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 17:03:34.668137 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659390    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 17:03:34.668137 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659393    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 17:03:34.668137 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659396    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 17:03:34.668645 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659401    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 17:03:34.668645 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659404    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 17:03:34.668645 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659406    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 17:03:34.668645 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659409    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 17:03:34.668645 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659413    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 17:03:34.668645 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659415    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 17:03:34.668645 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659418    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 17:03:34.668645 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659420    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 17:03:34.668645 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659424    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 17:03:34.668645 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659428    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 17:03:34.668645 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659431    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 17:03:34.668645 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659433    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 17:03:34.668645 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659436    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 17:03:34.668645 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659438    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 17:03:34.668645 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659441    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 17:03:34.668645 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659443    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 17:03:34.668645 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659446    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 17:03:34.668645 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659448    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 17:03:34.668645 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659451    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 17:03:34.668645 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659453    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 17:03:34.669134 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659456    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 17:03:34.669134 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659458    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 17:03:34.669134 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659461    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 17:03:34.669134 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659464    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 17:03:34.669134 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659466    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 17:03:34.669134 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659469    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 17:03:34.669134 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659471    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 17:03:34.669134 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659474    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 17:03:34.669134 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659476    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 17:03:34.669134 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659479    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 17:03:34.669134 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659481    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 17:03:34.669134 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659484    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 17:03:34.669134 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659488    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 17:03:34.669134 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659492    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 17:03:34.669134 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659495    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 17:03:34.669134 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659498    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 17:03:34.669134 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659501    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 17:03:34.669134 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659504    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 17:03:34.669134 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659506    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 17:03:34.669134 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659509    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 17:03:34.669736 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659511    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 17:03:34.669736 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659515    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 17:03:34.669736 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659518    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 17:03:34.669736 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659520    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 17:03:34.669736 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659523    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 17:03:34.669736 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659525    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 17:03:34.669736 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659529    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 17:03:34.669736 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659533    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 17:03:34.669736 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659535    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 17:03:34.669736 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659538    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 17:03:34.669736 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659542    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 17:03:34.669736 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659546    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 17:03:34.669736 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659549    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 17:03:34.669736 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659551    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 17:03:34.669736 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659554    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 17:03:34.669736 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659557    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 17:03:34.669736 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659560    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 17:03:34.669736 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659563    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 17:03:34.669736 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659565    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 17:03:34.670198 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659568    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 17:03:34.670198 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659570    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 17:03:34.670198 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659573    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 17:03:34.670198 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659576    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 17:03:34.670198 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659578    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 17:03:34.670198 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659582    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 17:03:34.670198 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659585    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 17:03:34.670198 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659587    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 17:03:34.670198 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659590    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 17:03:34.670198 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659592    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 17:03:34.670198 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659595    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 17:03:34.670198 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659597    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 17:03:34.670198 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659600    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 17:03:34.670198 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659602    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 17:03:34.670198 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659606    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 17:03:34.670198 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659609    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 17:03:34.670198 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659612    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 17:03:34.670198 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.659615    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 17:03:34.670652 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.660245    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 17:03:34.670652 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.666824    2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 24 17:03:34.670652 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.666838    2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 24 17:03:34.670652 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.666858    2561 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 24 17:03:34.670652 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.666867    2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 24 17:03:34.670652 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.666923    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 17:03:34.670652 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.666928    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 17:03:34.670652 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.666931    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 17:03:34.670652 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.666935    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 17:03:34.670652 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.666937    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 17:03:34.670652 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.666940    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 17:03:34.670652 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.666944    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 17:03:34.670652 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.666946    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 17:03:34.670652 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.666949    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 17:03:34.670652 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.666952    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 17:03:34.671026 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.666955    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 17:03:34.671026 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.666957    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 17:03:34.671026 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.666960    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 17:03:34.671026 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.666963    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 17:03:34.671026 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.666965    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 17:03:34.671026 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.666967    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 17:03:34.671026 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.666970    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 17:03:34.671026 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.666973    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 17:03:34.671026 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.666975    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 17:03:34.671026 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.666978    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 17:03:34.671026 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.666980    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 17:03:34.671026 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.666983    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 17:03:34.671026 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.666986    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 17:03:34.671026 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.666988    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 17:03:34.671026 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.666991    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 17:03:34.671026 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.666994    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 17:03:34.671026 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.666996    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 17:03:34.671026 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.666999    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 17:03:34.671026 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667001    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 17:03:34.671026 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667005    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 17:03:34.671524 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667009    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 17:03:34.671524 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667013    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 17:03:34.671524 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667016    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 17:03:34.671524 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667019    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 17:03:34.671524 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667022    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 17:03:34.671524 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667025    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 17:03:34.671524 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667027    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 17:03:34.671524 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667030    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 17:03:34.671524 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667033    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 17:03:34.671524 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667035    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 17:03:34.671524 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667038    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 17:03:34.671524 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667040    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 17:03:34.671524 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667043    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 17:03:34.671524 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667046    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 17:03:34.671524 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667048    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 17:03:34.671524 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667051    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 17:03:34.671524 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667053    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 17:03:34.671524 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667056    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 17:03:34.671524 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667060    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 17:03:34.671984 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667063    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 17:03:34.671984 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667066    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 17:03:34.671984 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667069    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 17:03:34.671984 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667072    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 17:03:34.671984 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667074    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 17:03:34.671984 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667077    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 17:03:34.671984 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667080    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 17:03:34.671984 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667083    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 17:03:34.671984 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667086    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 17:03:34.671984 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667089    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 17:03:34.671984 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667091    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 17:03:34.671984 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667094    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 17:03:34.671984 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667097    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 17:03:34.671984 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667100    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 17:03:34.671984 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667103    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 17:03:34.671984 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667105    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 17:03:34.671984 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667108    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 17:03:34.671984 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667111    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 17:03:34.671984 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667113    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 17:03:34.671984 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667116    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 17:03:34.672568 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667119    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 17:03:34.672568 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667123    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 17:03:34.672568 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667126    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 17:03:34.672568 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667129    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 17:03:34.672568 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667132    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 17:03:34.672568 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667135    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 17:03:34.672568 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667137    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 17:03:34.672568 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667140    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 17:03:34.672568 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667142    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 17:03:34.672568 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667145    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 17:03:34.672568 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667147    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 17:03:34.672568 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667150    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 17:03:34.672568 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667152    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 17:03:34.672568 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667155    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 17:03:34.672568 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667158    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 17:03:34.672568 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667161    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 17:03:34.672568 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667163    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 17:03:34.672568 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667166    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 17:03:34.672568 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667169    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 17:03:34.673017 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667171    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 17:03:34.673017 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667174    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 17:03:34.673017 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667177    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 17:03:34.673017 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667180    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 17:03:34.673017 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667182    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 17:03:34.673017 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667186    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 17:03:34.673017 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667189    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 17:03:34.673017 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667192    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 17:03:34.673017 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667194    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 17:03:34.673017 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667197    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 17:03:34.673017 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667200    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 17:03:34.673017 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.667205    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 17:03:34.673017 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667311    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 17:03:34.673017 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667315    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 17:03:34.673380 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667318    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 17:03:34.673380 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667321    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 17:03:34.673380 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667324    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 17:03:34.673380 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667327    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 17:03:34.673380 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667329    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 17:03:34.673380 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667332    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 17:03:34.673380 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667334    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 17:03:34.673380 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667337    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 17:03:34.673380 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667339    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 17:03:34.673380 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667358    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 17:03:34.673380 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667363    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 17:03:34.673380 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667366    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 17:03:34.673380 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667370    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 17:03:34.673380 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667373    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 17:03:34.673380 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667376    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 17:03:34.673380 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667378    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 17:03:34.673380 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667381    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 17:03:34.673380 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667383    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 17:03:34.673380 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667386    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 17:03:34.673380 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667388    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 17:03:34.673868 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667391    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 17:03:34.673868 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667394    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 17:03:34.673868 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667397    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 17:03:34.673868 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667400    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 17:03:34.673868 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667403    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 17:03:34.673868 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667406    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 17:03:34.673868 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667408    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 17:03:34.673868 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667411    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 17:03:34.673868 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667413    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 17:03:34.673868 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667416    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 17:03:34.673868 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667418    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 17:03:34.673868 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667421    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 17:03:34.673868 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667423    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 17:03:34.673868 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667426    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 17:03:34.673868 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667428    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 17:03:34.673868 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667431    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 17:03:34.673868 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667433    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 17:03:34.673868 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667435    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 17:03:34.673868 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667438    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 17:03:34.673868 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667440    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 17:03:34.674357 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667443    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 17:03:34.674357 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667445    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 17:03:34.674357 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667448    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 17:03:34.674357 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667451    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 17:03:34.674357 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667453    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 17:03:34.674357 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667456    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 17:03:34.674357 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667458    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 17:03:34.674357 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667461    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 17:03:34.674357 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667463    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 17:03:34.674357 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667466    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 17:03:34.674357 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667468    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 17:03:34.674357 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667471    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 17:03:34.674357 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667473    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 17:03:34.674357 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667476    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 17:03:34.674357 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667832    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 17:03:34.674357 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667835    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 17:03:34.674357 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667838    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 17:03:34.674357 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667842    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 17:03:34.674357 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667845    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 17:03:34.674819 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667848    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 17:03:34.674819 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667851    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 17:03:34.674819 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667854    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 17:03:34.674819 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667857    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 17:03:34.674819 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667860    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 17:03:34.674819 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667862    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 17:03:34.674819 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667865    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 17:03:34.674819 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667867    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 17:03:34.674819 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667870    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 17:03:34.674819 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667872    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 17:03:34.674819 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667876    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 17:03:34.674819 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667879    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 17:03:34.674819 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667882    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 17:03:34.674819 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667885    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 17:03:34.674819 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667888    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 17:03:34.674819 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667890    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 17:03:34.674819 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667893    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 17:03:34.674819 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667896    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 17:03:34.674819 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667899    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 17:03:34.674819 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667902    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 17:03:34.675292 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667905    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 17:03:34.675292 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667907    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 17:03:34.675292 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667910    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 17:03:34.675292 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667912    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 17:03:34.675292 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667915    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 17:03:34.675292 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667917    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 17:03:34.675292 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667920    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 17:03:34.675292 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667922    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 17:03:34.675292 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667925    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 17:03:34.675292 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667928    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 17:03:34.675292 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667930    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 17:03:34.675292 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667933    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 17:03:34.675292 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667935    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 17:03:34.675292 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667938    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 17:03:34.675292 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667940    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 17:03:34.675292 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667942    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 17:03:34.675292 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667945    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 17:03:34.675292 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:34.667947    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 17:03:34.675748 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.667952    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 17:03:34.675748 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.668043    2561 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 24 17:03:34.675748 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.669963    2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 24 17:03:34.675748 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.671328    2561 server.go:1019] "Starting client certificate rotation"
Jul 24 17:03:34.675748 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.671436    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 17:03:34.675748 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.671490    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 17:03:34.675748 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.673727    2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 17:03:34.678057 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.678030    2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 17:03:34.687574 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.687559    2561 log.go:25] "Validated CRI v1 runtime API"
Jul 24 17:03:34.689542 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.689528    2561 log.go:25] "Validated CRI v1 image API"
Jul 24 17:03:34.690298 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.690284    2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 24 17:03:34.693310 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.693292    2561 fs.go:135] Filesystem UUIDs: map[30713912-b093-4bb1-a6f1-bc1efd144a57:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 cc93dcf0-f6b4-4979-bb4a-7d12367ff942:/dev/nvme0n1p3]
Jul 24 17:03:34.693414 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.693309    2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 24 17:03:34.696385 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.696365    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 17:03:34.698222 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.698122    2561 manager.go:216] Machine: {Timestamp:2026-07-24 17:03:34.696815161 +0000 UTC m=+0.320392946 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3044549 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2dc89ae783a9783399465cf27c3830 SystemUUID:ec2dc89a-e783-a978-3399-465cf27c3830 BootID:b5be4435-d89a-498f-b61b-d2b70c4d493f Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0b:67:36:30:1b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0b:67:36:30:1b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f6:8a:5f:f3:b7:6b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 24 17:03:34.698222 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.698219    2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 24 17:03:34.698374 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.698287    2561 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 24 17:03:34.701306 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.701277    2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 24 17:03:34.701473 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.701309    2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-137.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 24 17:03:34.701971 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.701959    2561 topology_manager.go:138] "Creating topology manager with none policy"
Jul 24 17:03:34.702025 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.701977    2561 container_manager_linux.go:309] "Creating device plugin manager"
Jul 24 17:03:34.702025 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.701989    2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 17:03:34.702648 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.702636    2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 17:03:34.703394 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.703382    2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 24 17:03:34.705225 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.705212    2561 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 17:03:34.705360 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.705337    2561 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 24 17:03:34.705417 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.705387    2561 kubelet.go:486] "Attempting to sync node with API server"
Jul 24 17:03:34.705417 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.705407    2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 24 17:03:34.705515 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.705428    2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 24 17:03:34.705515 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.705443    2561 kubelet.go:398] "Adding apiserver pod source"
Jul 24 17:03:34.705515 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.705455    2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 24 17:03:34.705799 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.705785    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 17:03:34.705865 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.705808    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 17:03:34.707922 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.707904    2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 24 17:03:34.710030 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.710012    2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 24 17:03:34.710124 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.710051    2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 24 17:03:34.711926 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.711913    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 24 17:03:34.711991 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.711931    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 24 17:03:34.711991 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.711941    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 24 17:03:34.711991 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.711949    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 24 17:03:34.711991 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.711961    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 24 17:03:34.711991 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.711969    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 24 17:03:34.711991 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.711988    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 24 17:03:34.712245 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.711997    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 24 17:03:34.712245 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.712007    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 24 17:03:34.712245 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.712016    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 24 17:03:34.712245 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.712028    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 24 17:03:34.712245 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.712036    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 24 17:03:34.712689 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.712675    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 24 17:03:34.712761 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.712690    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 24 17:03:34.714489 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:34.714444    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 24 17:03:34.714489 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:34.714442    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-137.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 24 17:03:34.714628 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.714575    2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-137.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 17:03:34.715621 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.715606    2561 server.go:1268] "Started kubelet"
Jul 24 17:03:34.716107 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.716046    2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 24 17:03:34.716200 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.716138    2561 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 24 17:03:34.716282 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.715910    2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 24 17:03:34.716686 ip-10-0-137-137 systemd[1]: Started Kubernetes Kubelet.
Jul 24 17:03:34.718620 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.717701    2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 24 17:03:34.719122 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.719104    2561 server.go:310] "Adding debug handlers to kubelet server"
Jul 24 17:03:34.720386 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.720366    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xvndt"
Jul 24 17:03:34.722178 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:34.722160    2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 24 17:03:34.725478 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.725463    2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 24 17:03:34.725554 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.725477    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 24 17:03:34.725605 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:34.725558    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-137.ec2.internal\" not found"
Jul 24 17:03:34.726145 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.726130    2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 24 17:03:34.726145 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.726133    2561 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 24 17:03:34.726266 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.726155    2561 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 24 17:03:34.726310 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.726277    2561 reconstruct.go:97] "Volume reconstruction finished"
Jul 24 17:03:34.726310 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.726285    2561 reconciler.go:29] "Reconciler: start to sync state"
Jul 24 17:03:34.726400 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.726392    2561 factory.go:55] Registering systemd factory
Jul 24 17:03:34.726443 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.726406    2561 factory.go:223] Registration of the systemd container factory successfully
Jul 24 17:03:34.726585 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.726572    2561 factory.go:153] Registering CRI-O factory
Jul 24 17:03:34.726585 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.726585    2561 factory.go:223] Registration of the crio container factory successfully
Jul 24 17:03:34.726694 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.726639    2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 24 17:03:34.726694 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.726661    2561 factory.go:103] Registering Raw factory
Jul 24 17:03:34.726694 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.726676    2561 manager.go:1196] Started watching for new ooms in manager
Jul 24 17:03:34.727040 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.727027    2561 manager.go:349] Starting recovery of all containers
Jul 24 17:03:34.728423 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.728403    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xvndt"
Jul 24 17:03:34.730415 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:34.730388    2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-137.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 24 17:03:34.730508 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:34.730448    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 24 17:03:34.731503 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:34.730530    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-137.ec2.internal.18c54890f33c3821  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-137.ec2.internal,UID:ip-10-0-137-137.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-137.ec2.internal,},FirstTimestamp:2026-07-24 17:03:34.715570209 +0000 UTC m=+0.339147974,LastTimestamp:2026-07-24 17:03:34.715570209 +0000 UTC m=+0.339147974,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-137.ec2.internal,}"
Jul 24 17:03:34.737112 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.737041    2561 manager.go:354] Recovery completed
Jul 24 17:03:34.738397 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:34.738381    2561 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 24 17:03:34.741194 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.741182    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:03:34.742914 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.742900    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-137.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:03:34.743006 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.742929    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-137.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:03:34.743006 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.742943    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-137.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:03:34.743532 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.743405    2561 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 24 17:03:34.743532 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.743419    2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 24 17:03:34.743532 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.743423    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:03:34.743532 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.743436    2561 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 17:03:34.744104 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.744091    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-137.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:03:34.744193 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.744121    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-137.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:03:34.744193 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.744135    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-137.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:03:34.744931 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.744917    2561 policy_none.go:49] "None policy: Start"
Jul 24 17:03:34.744931 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.744933    2561 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 24 17:03:34.745020 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.744943    2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 24 17:03:34.745966 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.745952    2561 policy_none.go:47] "Start"
Jul 24 17:03:34.792000 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.791870    2561 manager.go:337] "Starting Device Plugin manager"
Jul 24 17:03:34.792071 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:34.792016    2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 24 17:03:34.792071 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.792030    2561 server.go:87] "Starting device plugin registration server"
Jul 24 17:03:34.792274 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.792261    2561 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 24 17:03:34.792312 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.792276    2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 24 17:03:34.792421 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.792394    2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 24 17:03:34.792525 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.792493    2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 24 17:03:34.792525 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.792504    2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 24 17:03:34.792992 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:34.792974    2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 24 17:03:34.793057 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:34.793018    2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-137.ec2.internal\" not found"
Jul 24 17:03:34.892571 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.892540    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:03:34.893701 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.893522    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-137.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:03:34.893701 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.893547    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-137.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:03:34.893701 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.893556    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-137.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:03:34.893701 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.893580    2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-137.ec2.internal"
Jul 24 17:03:34.899996 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.899953    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 24 17:03:34.901120 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.901100    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 24 17:03:34.901189 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.901137    2561 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 24 17:03:34.901189 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.901156    2561 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 24 17:03:34.901291 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:34.901188    2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 24 17:03:34.901577 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.901559    2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-137.ec2.internal"
Jul 24 17:03:34.901683 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:34.901582    2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-137.ec2.internal\": node \"ip-10-0-137-137.ec2.internal\" not found"
Jul 24 17:03:34.903316 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:34.903301    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 17:03:34.942143 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:34.942119    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-137.ec2.internal\" not found"
Jul 24 17:03:36.352461 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:36.352430    2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-137-137.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-137.ec2.internal"]
Jul 24 17:03:36.352535 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:36.352507    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:03:36.354412 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:36.354394    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-137.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:03:36.354497 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:36.354424    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-137.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:03:36.354497 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:36.354434    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-137.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:03:36.355705 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:36.355692    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:03:36.355825 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:36.355806    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-137.ec2.internal"
Jul 24 17:03:36.355884 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:36.355843    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:03:36.356361 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:36.356349    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-137.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:03:36.356361 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:36.356357    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-137.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:03:36.356492 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:36.356378    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-137.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:03:36.356492 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:36.356393    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-137.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:03:36.356586 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:36.356380    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-137.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:03:36.356586 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:36.356532    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-137.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:03:36.357826 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:36.357811    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-137.ec2.internal"
Jul 24 17:03:36.357901 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:36.357836    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:03:36.358497 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:36.358478    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-137.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:03:36.358580 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:36.358507    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-137.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:03:36.358580 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:36.358518    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-137.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:03:36.376621 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:36.376601    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-137.ec2.internal\" not found" node="ip-10-0-137-137.ec2.internal"
Jul 24 17:03:36.378269 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:36.378247    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e430400d966265945a7f713410a6d520-config\") pod \"kube-apiserver-proxy-ip-10-0-137-137.ec2.internal\" (UID: \"e430400d966265945a7f713410a6d520\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-137.ec2.internal"
Jul 24 17:03:36.378363 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:36.378281    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8a41629ae4091009408a555ea5339458-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-137.ec2.internal\" (UID: \"8a41629ae4091009408a555ea5339458\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-137.ec2.internal"
Jul 24 17:03:36.378363 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:36.378308    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a41629ae4091009408a555ea5339458-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-137.ec2.internal\" (UID: \"8a41629ae4091009408a555ea5339458\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-137.ec2.internal"
Jul 24 17:03:36.381016 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:36.381001    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-137.ec2.internal\" not found" node="ip-10-0-137-137.ec2.internal"
Jul 24 17:03:36.393331 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:36.393318    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-137.ec2.internal\" not found"
Jul 24 17:03:36.479173 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:36.479151    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e430400d966265945a7f713410a6d520-config\") pod \"kube-apiserver-proxy-ip-10-0-137-137.ec2.internal\" (UID: \"e430400d966265945a7f713410a6d520\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-137.ec2.internal"
Jul 24 17:03:36.479173 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:36.479174    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8a41629ae4091009408a555ea5339458-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-137.ec2.internal\" (UID: \"8a41629ae4091009408a555ea5339458\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-137.ec2.internal"
Jul 24 17:03:36.479300 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:36.479190    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a41629ae4091009408a555ea5339458-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-137.ec2.internal\" (UID: \"8a41629ae4091009408a555ea5339458\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-137.ec2.internal"
Jul 24 17:03:36.479300 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:36.479238    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a41629ae4091009408a555ea5339458-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-137.ec2.internal\" (UID: \"8a41629ae4091009408a555ea5339458\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-137.ec2.internal"
Jul 24 17:03:36.479300 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:36.479258    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e430400d966265945a7f713410a6d520-config\") pod \"kube-apiserver-proxy-ip-10-0-137-137.ec2.internal\" (UID: \"e430400d966265945a7f713410a6d520\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-137.ec2.internal"
Jul 24 17:03:36.479300 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:36.479262    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8a41629ae4091009408a555ea5339458-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-137.ec2.internal\" (UID: \"8a41629ae4091009408a555ea5339458\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-137.ec2.internal"
Jul 24 17:03:36.494280 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:36.494260    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-137.ec2.internal\" not found"
Jul 24 17:03:36.595105 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:36.595020    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-137.ec2.internal\" not found"
Jul 24 17:03:36.679429 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:36.679400    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-137.ec2.internal"
Jul 24 17:03:36.684404 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:36.684388    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-137.ec2.internal"
Jul 24 17:03:36.695270 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:36.695249    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-137.ec2.internal\" not found"
Jul 24 17:03:36.795740 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:36.795712    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-137.ec2.internal\" not found"
Jul 24 17:03:36.896235 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:36.896166    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-137.ec2.internal\" not found"
Jul 24 17:03:36.996613 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:36.996597    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-137.ec2.internal\" not found"
Jul 24 17:03:37.021769 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:37.021749    2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 24 17:03:37.022180 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:37.021889    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 24 17:03:37.083331 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:37.083293    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 16:58:36 +0000 UTC" deadline="2028-01-15 20:48:40.765292151 +0000 UTC"
Jul 24 17:03:37.083331 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:37.083327    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12963h45m3.681969909s"
Jul 24 17:03:37.083844 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:37.083829    2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 17:03:37.097662 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:37.097640    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-137.ec2.internal\" not found"
Jul 24 17:03:37.112821 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:37.112801    2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 17:03:37.197960 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:37.197937    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-137.ec2.internal\" not found"
Jul 24 17:03:37.274797 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:37.274768    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode430400d966265945a7f713410a6d520.slice/crio-2b775dd5c6489dbecea9a96926a40a20b076b7ac0a61878074efe70199510fc6 WatchSource:0}: Error finding container 2b775dd5c6489dbecea9a96926a40a20b076b7ac0a61878074efe70199510fc6: Status 404 returned error can't find the container with id 2b775dd5c6489dbecea9a96926a40a20b076b7ac0a61878074efe70199510fc6
Jul 24 17:03:37.279452 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:37.279437    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 17:03:37.298185 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:37.298159    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-137.ec2.internal\" not found"
Jul 24 17:03:37.398625 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:37.398596    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-137.ec2.internal\" not found"
Jul 24 17:03:37.499181 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:37.499119    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-137.ec2.internal\" not found"
Jul 24 17:03:37.541891 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:37.541866    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a41629ae4091009408a555ea5339458.slice/crio-49dd659c5c1f46738b718b42466ad2740ec81c7f3c119c69fa3c301f661e2296 WatchSource:0}: Error finding container 49dd659c5c1f46738b718b42466ad2740ec81c7f3c119c69fa3c301f661e2296: Status 404 returned error can't find the container with id 49dd659c5c1f46738b718b42466ad2740ec81c7f3c119c69fa3c301f661e2296
Jul 24 17:03:37.600177 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:37.600155    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-137.ec2.internal\" not found"
Jul 24 17:03:37.633154 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:37.633130    2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 17:03:37.676626 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:37.676606    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-137.ec2.internal"
Jul 24 17:03:37.685775 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:37.685759    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 17:03:37.687142 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:37.687130    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-137.ec2.internal"
Jul 24 17:03:37.699873 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:37.699860    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 17:03:38.006220 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.006192    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 17:03:38.057295 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.057271    2561 apiserver.go:52] "Watching apiserver"
Jul 24 17:03:38.071439 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.071406    2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 24 17:03:38.072852 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.072823    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-137-137.ec2.internal","openshift-cluster-node-tuning-operator/tuned-qxhfq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-137.ec2.internal","openshift-network-diagnostics/network-check-target-spwhm","openshift-network-operator/iptables-alerter-jt6gx","kube-system/global-pull-secret-syncer-cb4sr","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nzsz","openshift-dns/node-resolver-jvnt9","openshift-image-registry/node-ca-rq942","openshift-multus/multus-additional-cni-plugins-mx4qq","openshift-multus/multus-d7nwt","openshift-multus/network-metrics-daemon-x9m67","openshift-ovn-kubernetes/ovnkube-node-6h754","kube-system/konnectivity-agent-zfklt"]
Jul 24 17:03:38.075706 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.075176    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nzsz"
Jul 24 17:03:38.076645 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.076626    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 24 17:03:38.076741 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.076684    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.078296 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.078275    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zfklt"
Jul 24 17:03:38.080172 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.079932    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 24 17:03:38.080172 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.079970    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spwhm"
Jul 24 17:03:38.080172 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.080000    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 24 17:03:38.080172 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:38.080035    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spwhm" podUID="4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd"
Jul 24 17:03:38.080172 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.080108    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 24 17:03:38.080172 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.080161    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 24 17:03:38.080725 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.080707    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bbf5x\""
Jul 24 17:03:38.080839 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.080715    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 24 17:03:38.081418 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.081161    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2494t\""
Jul 24 17:03:38.081418 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.081183    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 24 17:03:38.081418 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.081193    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 24 17:03:38.081418 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.081310    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 24 17:03:38.081418 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.081311    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 24 17:03:38.081418 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.081332    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 24 17:03:38.081748 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.081425    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kq2xt\""
Jul 24 17:03:38.081748 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.081467    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 24 17:03:38.082682 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.082661    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jt6gx"
Jul 24 17:03:38.084762 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.084698    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cb4sr"
Jul 24 17:03:38.084888 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:38.084773    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cb4sr" podUID="9dc126a1-da76-4146-95f2-0571132022cc"
Jul 24 17:03:38.085365 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.085347    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 24 17:03:38.086137 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.086093    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rq942"
Jul 24 17:03:38.087266 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.086756    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qm6pz\""
Jul 24 17:03:38.087266 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.086778    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 24 17:03:38.087266 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.087151    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/860ed1fc-612f-4796-8077-72bc6c5d84db-run-systemd\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.087266 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.087176    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcnlg\" (UniqueName: \"kubernetes.io/projected/5f736e3e-403d-4b4e-a90b-af4074d659f9-kube-api-access-gcnlg\") pod \"aws-ebs-csi-driver-node-7nzsz\" (UID: \"5f736e3e-403d-4b4e-a90b-af4074d659f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nzsz"
Jul 24 17:03:38.087266 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.087192    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/860ed1fc-612f-4796-8077-72bc6c5d84db-host-slash\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.087266 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.087210    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/860ed1fc-612f-4796-8077-72bc6c5d84db-var-lib-openvswitch\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.087266 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.087233    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/860ed1fc-612f-4796-8077-72bc6c5d84db-run-openvswitch\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.087266 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.087256    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/860ed1fc-612f-4796-8077-72bc6c5d84db-log-socket\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.087661 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.087277    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/84981543-70cb-4811-b2fc-ea793ef9e2bc-agent-certs\") pod \"konnectivity-agent-zfklt\" (UID: \"84981543-70cb-4811-b2fc-ea793ef9e2bc\") " pod="kube-system/konnectivity-agent-zfklt"
Jul 24 17:03:38.087661 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.087299    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/84981543-70cb-4811-b2fc-ea793ef9e2bc-konnectivity-ca\") pod \"konnectivity-agent-zfklt\" (UID: \"84981543-70cb-4811-b2fc-ea793ef9e2bc\") " pod="kube-system/konnectivity-agent-zfklt"
Jul 24 17:03:38.087661 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.087324    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5f736e3e-403d-4b4e-a90b-af4074d659f9-socket-dir\") pod \"aws-ebs-csi-driver-node-7nzsz\" (UID: \"5f736e3e-403d-4b4e-a90b-af4074d659f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nzsz"
Jul 24 17:03:38.087661 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.087346    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/860ed1fc-612f-4796-8077-72bc6c5d84db-systemd-units\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.087661 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.087368    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/860ed1fc-612f-4796-8077-72bc6c5d84db-ovnkube-config\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.087661 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.087389    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/860ed1fc-612f-4796-8077-72bc6c5d84db-env-overrides\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.087661 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.087412    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/860ed1fc-612f-4796-8077-72bc6c5d84db-ovn-node-metrics-cert\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.087661 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.087434    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5f736e3e-403d-4b4e-a90b-af4074d659f9-registration-dir\") pod \"aws-ebs-csi-driver-node-7nzsz\" (UID: \"5f736e3e-403d-4b4e-a90b-af4074d659f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nzsz"
Jul 24 17:03:38.087661 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.087461    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/860ed1fc-612f-4796-8077-72bc6c5d84db-etc-openvswitch\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.087661 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.087483    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/860ed1fc-612f-4796-8077-72bc6c5d84db-run-ovn\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.087661 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.087505    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5f736e3e-403d-4b4e-a90b-af4074d659f9-device-dir\") pod \"aws-ebs-csi-driver-node-7nzsz\" (UID: \"5f736e3e-403d-4b4e-a90b-af4074d659f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nzsz"
Jul 24 17:03:38.087661 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.087529    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/860ed1fc-612f-4796-8077-72bc6c5d84db-host-kubelet\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.087661 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.087551    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/860ed1fc-612f-4796-8077-72bc6c5d84db-host-run-netns\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.087661 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.087574    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/860ed1fc-612f-4796-8077-72bc6c5d84db-node-log\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.087661 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.087605    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/860ed1fc-612f-4796-8077-72bc6c5d84db-ovnkube-script-lib\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.087661 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.087628    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg55p\" (UniqueName: \"kubernetes.io/projected/860ed1fc-612f-4796-8077-72bc6c5d84db-kube-api-access-lg55p\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.088360 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.087664    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5f736e3e-403d-4b4e-a90b-af4074d659f9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7nzsz\" (UID: \"5f736e3e-403d-4b4e-a90b-af4074d659f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nzsz"
Jul 24 17:03:38.088360 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.087689    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5f736e3e-403d-4b4e-a90b-af4074d659f9-etc-selinux\") pod \"aws-ebs-csi-driver-node-7nzsz\" (UID: \"5f736e3e-403d-4b4e-a90b-af4074d659f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nzsz"
Jul 24 17:03:38.088360 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.087721    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/860ed1fc-612f-4796-8077-72bc6c5d84db-host-cni-bin\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.088360 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.088047    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/860ed1fc-612f-4796-8077-72bc6c5d84db-host-cni-netd\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.088360 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.088101    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5f736e3e-403d-4b4e-a90b-af4074d659f9-sys-fs\") pod \"aws-ebs-csi-driver-node-7nzsz\" (UID: \"5f736e3e-403d-4b4e-a90b-af4074d659f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nzsz"
Jul 24 17:03:38.088360 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.088127    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/860ed1fc-612f-4796-8077-72bc6c5d84db-host-run-ovn-kubernetes\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.088360 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.088152    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/860ed1fc-612f-4796-8077-72bc6c5d84db-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.088360 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.088242    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jvnt9"
Jul 24 17:03:38.090171 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.089932    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qxhfq"
Jul 24 17:03:38.095667 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.095558    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mx4qq"
Jul 24 17:03:38.098237 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.097949    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.099972 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.099692    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x9m67"
Jul 24 17:03:38.099972 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:38.099755    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x9m67" podUID="b20d7f4d-c9f7-4a88-9107-f52a67b5741c"
Jul 24 17:03:38.103991 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.103859    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 24 17:03:38.103991 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.103859    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 24 17:03:38.104552 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.104533    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 24 17:03:38.104639 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.104578    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 24 17:03:38.104739 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.104708    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ckwgn\""
Jul 24 17:03:38.104799 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.104742    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 24 17:03:38.104855 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.104708    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 24 17:03:38.104855 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.104831    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 24 17:03:38.104953 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.104881    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 24 17:03:38.104953 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.104835    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 24 17:03:38.104953 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.104911    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 24 17:03:38.105422 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.105405    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 24 17:03:38.105502 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.105449    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 24 17:03:38.106241 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.106225    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mv8zt\""
Jul 24 17:03:38.106328 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.106267    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9rd98\""
Jul 24 17:03:38.106386 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.106333    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5tpmz\""
Jul 24 17:03:38.106386 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.106225    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kg2bh\""
Jul 24 17:03:38.116006 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.115987    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 24 17:03:38.116237 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.116218    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 24 17:03:38.124413 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.124394    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 17:03:38.137248 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.137227    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-26mjh"
Jul 24 17:03:38.153492 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.153474    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-26mjh"
Jul 24 17:03:38.178056 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.178032    2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 24 17:03:38.188946 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.188920    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/860ed1fc-612f-4796-8077-72bc6c5d84db-host-kubelet\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.189033 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.188947    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/860ed1fc-612f-4796-8077-72bc6c5d84db-host-run-netns\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.189033 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.188979    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/860ed1fc-612f-4796-8077-72bc6c5d84db-ovnkube-script-lib\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.189033 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.188998    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg55p\" (UniqueName: \"kubernetes.io/projected/860ed1fc-612f-4796-8077-72bc6c5d84db-kube-api-access-lg55p\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.189201 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.189025    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/860ed1fc-612f-4796-8077-72bc6c5d84db-host-kubelet\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.189201 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.189019    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/be2e4a02-b1a7-4b45-85d1-86535fb00672-sys\") pod \"tuned-qxhfq\" (UID: \"be2e4a02-b1a7-4b45-85d1-86535fb00672\") " pod="openshift-cluster-node-tuning-operator/tuned-qxhfq"
Jul 24 17:03:38.189201 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.189035    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/860ed1fc-612f-4796-8077-72bc6c5d84db-host-run-netns\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.189201 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.189108    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/14f58e54-2adc-41a3-bc18-a25736900381-os-release\") pod \"multus-additional-cni-plugins-mx4qq\" (UID: \"14f58e54-2adc-41a3-bc18-a25736900381\") " pod="openshift-multus/multus-additional-cni-plugins-mx4qq"
Jul 24 17:03:38.189382 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.189177    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d52800a2-6038-494c-b78a-28579c6898c1-cnibin\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.189382 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.189252    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d52800a2-6038-494c-b78a-28579c6898c1-host-var-lib-cni-multus\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.189382 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.189284    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5f736e3e-403d-4b4e-a90b-af4074d659f9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7nzsz\" (UID: \"5f736e3e-403d-4b4e-a90b-af4074d659f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nzsz"
Jul 24 17:03:38.189382 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.189310    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5f736e3e-403d-4b4e-a90b-af4074d659f9-etc-selinux\") pod \"aws-ebs-csi-driver-node-7nzsz\" (UID: \"5f736e3e-403d-4b4e-a90b-af4074d659f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nzsz"
Jul 24 17:03:38.189382 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.189326    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/860ed1fc-612f-4796-8077-72bc6c5d84db-host-cni-netd\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.189382 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.189361    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/860ed1fc-612f-4796-8077-72bc6c5d84db-host-cni-netd\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.189382 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.189366    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/be2e4a02-b1a7-4b45-85d1-86535fb00672-etc-tuned\") pod \"tuned-qxhfq\" (UID: \"be2e4a02-b1a7-4b45-85d1-86535fb00672\") " pod="openshift-cluster-node-tuning-operator/tuned-qxhfq"
Jul 24 17:03:38.189749 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.189437    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d52800a2-6038-494c-b78a-28579c6898c1-host-run-netns\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.189749 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.189475    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5f736e3e-403d-4b4e-a90b-af4074d659f9-sys-fs\") pod \"aws-ebs-csi-driver-node-7nzsz\" (UID: \"5f736e3e-403d-4b4e-a90b-af4074d659f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nzsz"
Jul 24 17:03:38.189749 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.189440    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5f736e3e-403d-4b4e-a90b-af4074d659f9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7nzsz\" (UID: \"5f736e3e-403d-4b4e-a90b-af4074d659f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nzsz"
Jul 24 17:03:38.189749 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.189520    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/860ed1fc-612f-4796-8077-72bc6c5d84db-host-run-ovn-kubernetes\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.189749 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.189534    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5f736e3e-403d-4b4e-a90b-af4074d659f9-etc-selinux\") pod \"aws-ebs-csi-driver-node-7nzsz\" (UID: \"5f736e3e-403d-4b4e-a90b-af4074d659f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nzsz"
Jul 24 17:03:38.189749 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.189557    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/860ed1fc-612f-4796-8077-72bc6c5d84db-run-systemd\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.189749 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.189584    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsvzr\" (UniqueName: \"kubernetes.io/projected/7127ce91-7986-4e71-9b22-ce42a081f632-kube-api-access-xsvzr\") pod \"node-resolver-jvnt9\" (UID: \"7127ce91-7986-4e71-9b22-ce42a081f632\") " pod="openshift-dns/node-resolver-jvnt9"
Jul 24 17:03:38.189749 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.189584    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5f736e3e-403d-4b4e-a90b-af4074d659f9-sys-fs\") pod \"aws-ebs-csi-driver-node-7nzsz\" (UID: \"5f736e3e-403d-4b4e-a90b-af4074d659f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nzsz"
Jul 24 17:03:38.189749 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.189596    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/860ed1fc-612f-4796-8077-72bc6c5d84db-run-systemd\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.189749 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.189601    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be2e4a02-b1a7-4b45-85d1-86535fb00672-etc-kubernetes\") pod \"tuned-qxhfq\" (UID: \"be2e4a02-b1a7-4b45-85d1-86535fb00672\") " pod="openshift-cluster-node-tuning-operator/tuned-qxhfq"
Jul 24 17:03:38.189749 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.189642    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/be2e4a02-b1a7-4b45-85d1-86535fb00672-lib-modules\") pod \"tuned-qxhfq\" (UID: \"be2e4a02-b1a7-4b45-85d1-86535fb00672\") " pod="openshift-cluster-node-tuning-operator/tuned-qxhfq"
Jul 24 17:03:38.189749 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.189669    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d52800a2-6038-494c-b78a-28579c6898c1-etc-kubernetes\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.189749 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.189668    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/860ed1fc-612f-4796-8077-72bc6c5d84db-host-run-ovn-kubernetes\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.189749 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.189703    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqs9v\" (UniqueName: \"kubernetes.io/projected/be2e4a02-b1a7-4b45-85d1-86535fb00672-kube-api-access-nqs9v\") pod \"tuned-qxhfq\" (UID: \"be2e4a02-b1a7-4b45-85d1-86535fb00672\") " pod="openshift-cluster-node-tuning-operator/tuned-qxhfq"
Jul 24 17:03:38.189749 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.189722    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/860ed1fc-612f-4796-8077-72bc6c5d84db-ovnkube-script-lib\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.189749 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.189732    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14f58e54-2adc-41a3-bc18-a25736900381-system-cni-dir\") pod \"multus-additional-cni-plugins-mx4qq\" (UID: \"14f58e54-2adc-41a3-bc18-a25736900381\") " pod="openshift-multus/multus-additional-cni-plugins-mx4qq"
Jul 24 17:03:38.190444 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.189762    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcnlg\" (UniqueName: \"kubernetes.io/projected/5f736e3e-403d-4b4e-a90b-af4074d659f9-kube-api-access-gcnlg\") pod \"aws-ebs-csi-driver-node-7nzsz\" (UID: \"5f736e3e-403d-4b4e-a90b-af4074d659f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nzsz"
Jul 24 17:03:38.190444 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.189795    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/860ed1fc-612f-4796-8077-72bc6c5d84db-var-lib-openvswitch\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.190444 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.189819    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/860ed1fc-612f-4796-8077-72bc6c5d84db-run-openvswitch\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.190444 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.189844    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9dc126a1-da76-4146-95f2-0571132022cc-dbus\") pod \"global-pull-secret-syncer-cb4sr\" (UID: \"9dc126a1-da76-4146-95f2-0571132022cc\") " pod="kube-system/global-pull-secret-syncer-cb4sr"
Jul 24 17:03:38.190444 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.189859    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/860ed1fc-612f-4796-8077-72bc6c5d84db-var-lib-openvswitch\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.190444 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.189871    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/be2e4a02-b1a7-4b45-85d1-86535fb00672-etc-systemd\") pod \"tuned-qxhfq\" (UID: \"be2e4a02-b1a7-4b45-85d1-86535fb00672\") " pod="openshift-cluster-node-tuning-operator/tuned-qxhfq"
Jul 24 17:03:38.190444 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.189892    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/860ed1fc-612f-4796-8077-72bc6c5d84db-run-openvswitch\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.190444 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.189900    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/860ed1fc-612f-4796-8077-72bc6c5d84db-systemd-units\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.190444 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.189953    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/860ed1fc-612f-4796-8077-72bc6c5d84db-systemd-units\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.190444 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.189959    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/860ed1fc-612f-4796-8077-72bc6c5d84db-ovnkube-config\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.190444 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.189986    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0e01bc14-47b5-47b0-bd9b-7f1fd11fffa9-iptables-alerter-script\") pod \"iptables-alerter-jt6gx\" (UID: \"0e01bc14-47b5-47b0-bd9b-7f1fd11fffa9\") " pod="openshift-network-operator/iptables-alerter-jt6gx"
Jul 24 17:03:38.190444 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.190013    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xgjf\" (UniqueName: \"kubernetes.io/projected/0e01bc14-47b5-47b0-bd9b-7f1fd11fffa9-kube-api-access-5xgjf\") pod \"iptables-alerter-jt6gx\" (UID: \"0e01bc14-47b5-47b0-bd9b-7f1fd11fffa9\") " pod="openshift-network-operator/iptables-alerter-jt6gx"
Jul 24 17:03:38.190444 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.190034    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d52800a2-6038-494c-b78a-28579c6898c1-multus-socket-dir-parent\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.190444 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.190050    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/860ed1fc-612f-4796-8077-72bc6c5d84db-env-overrides\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.190444 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.190095    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/860ed1fc-612f-4796-8077-72bc6c5d84db-ovn-node-metrics-cert\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.190444 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.190374    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/860ed1fc-612f-4796-8077-72bc6c5d84db-ovnkube-config\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.191113 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.190591    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5f736e3e-403d-4b4e-a90b-af4074d659f9-registration-dir\") pod \"aws-ebs-csi-driver-node-7nzsz\" (UID: \"5f736e3e-403d-4b4e-a90b-af4074d659f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nzsz"
Jul 24 17:03:38.191113 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.190629    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9dc126a1-da76-4146-95f2-0571132022cc-kubelet-config\") pod \"global-pull-secret-syncer-cb4sr\" (UID: \"9dc126a1-da76-4146-95f2-0571132022cc\") " pod="kube-system/global-pull-secret-syncer-cb4sr"
Jul 24 17:03:38.191113 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.190655    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/be2e4a02-b1a7-4b45-85d1-86535fb00672-etc-sysctl-d\") pod \"tuned-qxhfq\" (UID: \"be2e4a02-b1a7-4b45-85d1-86535fb00672\") " pod="openshift-cluster-node-tuning-operator/tuned-qxhfq"
Jul 24 17:03:38.191113 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.190680    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2j9n\" (UniqueName: \"kubernetes.io/projected/14f58e54-2adc-41a3-bc18-a25736900381-kube-api-access-c2j9n\") pod \"multus-additional-cni-plugins-mx4qq\" (UID: \"14f58e54-2adc-41a3-bc18-a25736900381\") " pod="openshift-multus/multus-additional-cni-plugins-mx4qq"
Jul 24 17:03:38.191113 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.190698    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5f736e3e-403d-4b4e-a90b-af4074d659f9-registration-dir\") pod \"aws-ebs-csi-driver-node-7nzsz\" (UID: \"5f736e3e-403d-4b4e-a90b-af4074d659f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nzsz"
Jul 24 17:03:38.191113 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.190704    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd24x\" (UniqueName: \"kubernetes.io/projected/b20d7f4d-c9f7-4a88-9107-f52a67b5741c-kube-api-access-kd24x\") pod \"network-metrics-daemon-x9m67\" (UID: \"b20d7f4d-c9f7-4a88-9107-f52a67b5741c\") " pod="openshift-multus/network-metrics-daemon-x9m67"
Jul 24 17:03:38.191113 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.190737    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5f736e3e-403d-4b4e-a90b-af4074d659f9-device-dir\") pod \"aws-ebs-csi-driver-node-7nzsz\" (UID: \"5f736e3e-403d-4b4e-a90b-af4074d659f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nzsz"
Jul 24 17:03:38.191113 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.190774    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/be2e4a02-b1a7-4b45-85d1-86535fb00672-etc-sysctl-conf\") pod \"tuned-qxhfq\" (UID: \"be2e4a02-b1a7-4b45-85d1-86535fb00672\") " pod="openshift-cluster-node-tuning-operator/tuned-qxhfq"
Jul 24 17:03:38.191113 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.190799    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/be2e4a02-b1a7-4b45-85d1-86535fb00672-host\") pod \"tuned-qxhfq\" (UID: \"be2e4a02-b1a7-4b45-85d1-86535fb00672\") " pod="openshift-cluster-node-tuning-operator/tuned-qxhfq"
Jul 24 17:03:38.191113 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.190821    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d52800a2-6038-494c-b78a-28579c6898c1-host-var-lib-cni-bin\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.191113 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.190845    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d52800a2-6038-494c-b78a-28579c6898c1-multus-daemon-config\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.191113 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.190871    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/860ed1fc-612f-4796-8077-72bc6c5d84db-node-log\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.191113 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.190903    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b20d7f4d-c9f7-4a88-9107-f52a67b5741c-metrics-certs\") pod \"network-metrics-daemon-x9m67\" (UID: \"b20d7f4d-c9f7-4a88-9107-f52a67b5741c\") " pod="openshift-multus/network-metrics-daemon-x9m67"
Jul 24 17:03:38.191113 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.190928    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/860ed1fc-612f-4796-8077-72bc6c5d84db-host-cni-bin\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.191113 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.190926    2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 24 17:03:38.191113 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.190939    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5f736e3e-403d-4b4e-a90b-af4074d659f9-device-dir\") pod \"aws-ebs-csi-driver-node-7nzsz\" (UID: \"5f736e3e-403d-4b4e-a90b-af4074d659f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nzsz"
Jul 24 17:03:38.191113 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.190959    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/be2e4a02-b1a7-4b45-85d1-86535fb00672-etc-sysconfig\") pod \"tuned-qxhfq\" (UID: \"be2e4a02-b1a7-4b45-85d1-86535fb00672\") " pod="openshift-cluster-node-tuning-operator/tuned-qxhfq"
Jul 24 17:03:38.191742 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.190988    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/860ed1fc-612f-4796-8077-72bc6c5d84db-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.191742 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.191051    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/860ed1fc-612f-4796-8077-72bc6c5d84db-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.191742 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.191103    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/860ed1fc-612f-4796-8077-72bc6c5d84db-node-log\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.191742 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.191139    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/860ed1fc-612f-4796-8077-72bc6c5d84db-host-cni-bin\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.191742 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.191139    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/860ed1fc-612f-4796-8077-72bc6c5d84db-env-overrides\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.191742 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.191164    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7127ce91-7986-4e71-9b22-ce42a081f632-tmp-dir\") pod \"node-resolver-jvnt9\" (UID: \"7127ce91-7986-4e71-9b22-ce42a081f632\") " pod="openshift-dns/node-resolver-jvnt9"
Jul 24 17:03:38.191742 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.191186    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/be2e4a02-b1a7-4b45-85d1-86535fb00672-etc-modprobe-d\") pod \"tuned-qxhfq\" (UID: \"be2e4a02-b1a7-4b45-85d1-86535fb00672\") " pod="openshift-cluster-node-tuning-operator/tuned-qxhfq"
Jul 24 17:03:38.191742 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.191213    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/be2e4a02-b1a7-4b45-85d1-86535fb00672-run\") pod \"tuned-qxhfq\" (UID: \"be2e4a02-b1a7-4b45-85d1-86535fb00672\") " pod="openshift-cluster-node-tuning-operator/tuned-qxhfq"
Jul 24 17:03:38.191742 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.191240    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/14f58e54-2adc-41a3-bc18-a25736900381-cni-binary-copy\") pod \"multus-additional-cni-plugins-mx4qq\" (UID: \"14f58e54-2adc-41a3-bc18-a25736900381\") " pod="openshift-multus/multus-additional-cni-plugins-mx4qq"
Jul 24 17:03:38.191742 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.191263    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/14f58e54-2adc-41a3-bc18-a25736900381-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mx4qq\" (UID: \"14f58e54-2adc-41a3-bc18-a25736900381\") " pod="openshift-multus/multus-additional-cni-plugins-mx4qq"
Jul 24 17:03:38.191742 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.191285    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d52800a2-6038-494c-b78a-28579c6898c1-host-run-k8s-cni-cncf-io\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.191742 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.191307    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d52800a2-6038-494c-b78a-28579c6898c1-host-run-multus-certs\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.191742 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.191367    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be2e4a02-b1a7-4b45-85d1-86535fb00672-tmp\") pod \"tuned-qxhfq\" (UID: \"be2e4a02-b1a7-4b45-85d1-86535fb00672\") " pod="openshift-cluster-node-tuning-operator/tuned-qxhfq"
Jul 24 17:03:38.191742 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.191384    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/14f58e54-2adc-41a3-bc18-a25736900381-cnibin\") pod \"multus-additional-cni-plugins-mx4qq\" (UID: \"14f58e54-2adc-41a3-bc18-a25736900381\") " pod="openshift-multus/multus-additional-cni-plugins-mx4qq"
Jul 24 17:03:38.191742 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.191420    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d52800a2-6038-494c-b78a-28579c6898c1-multus-cni-dir\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.191742 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.191445    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d52800a2-6038-494c-b78a-28579c6898c1-os-release\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.191742 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.191480    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d52800a2-6038-494c-b78a-28579c6898c1-multus-conf-dir\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.192339 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.191528    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg9xt\" (UniqueName: \"kubernetes.io/projected/4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd-kube-api-access-tg9xt\") pod \"network-check-target-spwhm\" (UID: \"4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd\") " pod="openshift-network-diagnostics/network-check-target-spwhm"
Jul 24 17:03:38.192339 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.191555    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbjmh\" (UniqueName: \"kubernetes.io/projected/ce9e534e-4a16-4593-9bbf-689859d14bb0-kube-api-access-dbjmh\") pod \"node-ca-rq942\" (UID: \"ce9e534e-4a16-4593-9bbf-689859d14bb0\") " pod="openshift-image-registry/node-ca-rq942"
Jul 24 17:03:38.192339 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.191575    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be2e4a02-b1a7-4b45-85d1-86535fb00672-var-lib-kubelet\") pod \"tuned-qxhfq\" (UID: \"be2e4a02-b1a7-4b45-85d1-86535fb00672\") " pod="openshift-cluster-node-tuning-operator/tuned-qxhfq"
Jul 24 17:03:38.192339 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.191611    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/860ed1fc-612f-4796-8077-72bc6c5d84db-host-slash\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.192339 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.191631    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/860ed1fc-612f-4796-8077-72bc6c5d84db-log-socket\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.192339 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.191653    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/84981543-70cb-4811-b2fc-ea793ef9e2bc-agent-certs\") pod \"konnectivity-agent-zfklt\" (UID: \"84981543-70cb-4811-b2fc-ea793ef9e2bc\") " pod="kube-system/konnectivity-agent-zfklt"
Jul 24 17:03:38.192339 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.191674    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/84981543-70cb-4811-b2fc-ea793ef9e2bc-konnectivity-ca\") pod \"konnectivity-agent-zfklt\" (UID: \"84981543-70cb-4811-b2fc-ea793ef9e2bc\") " pod="kube-system/konnectivity-agent-zfklt"
Jul 24 17:03:38.192339 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.191686    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/860ed1fc-612f-4796-8077-72bc6c5d84db-host-slash\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.192339 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.191704    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/14f58e54-2adc-41a3-bc18-a25736900381-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mx4qq\" (UID: \"14f58e54-2adc-41a3-bc18-a25736900381\") " pod="openshift-multus/multus-additional-cni-plugins-mx4qq"
Jul 24 17:03:38.192339 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.191736    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d52800a2-6038-494c-b78a-28579c6898c1-system-cni-dir\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.192339 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.191742    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/860ed1fc-612f-4796-8077-72bc6c5d84db-log-socket\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.192339 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.191758    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d52800a2-6038-494c-b78a-28579c6898c1-cni-binary-copy\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.192339 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.191814    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5f736e3e-403d-4b4e-a90b-af4074d659f9-socket-dir\") pod \"aws-ebs-csi-driver-node-7nzsz\" (UID: \"5f736e3e-403d-4b4e-a90b-af4074d659f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nzsz"
Jul 24 17:03:38.192339 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.191836    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0e01bc14-47b5-47b0-bd9b-7f1fd11fffa9-host-slash\") pod \"iptables-alerter-jt6gx\" (UID: \"0e01bc14-47b5-47b0-bd9b-7f1fd11fffa9\") " pod="openshift-network-operator/iptables-alerter-jt6gx"
Jul 24 17:03:38.192339 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.191889    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce9e534e-4a16-4593-9bbf-689859d14bb0-host\") pod \"node-ca-rq942\" (UID: \"ce9e534e-4a16-4593-9bbf-689859d14bb0\") " pod="openshift-image-registry/node-ca-rq942"
Jul 24 17:03:38.192339 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.191926    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/860ed1fc-612f-4796-8077-72bc6c5d84db-etc-openvswitch\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.192339 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.191953    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/860ed1fc-612f-4796-8077-72bc6c5d84db-run-ovn\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.192894 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.191976    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7127ce91-7986-4e71-9b22-ce42a081f632-hosts-file\") pod \"node-resolver-jvnt9\" (UID: \"7127ce91-7986-4e71-9b22-ce42a081f632\") " pod="openshift-dns/node-resolver-jvnt9"
Jul 24 17:03:38.192894 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.191998    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d52800a2-6038-494c-b78a-28579c6898c1-host-var-lib-kubelet\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.192894 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.192044    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d52800a2-6038-494c-b78a-28579c6898c1-hostroot\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.192894 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.192092    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrnh8\" (UniqueName: \"kubernetes.io/projected/d52800a2-6038-494c-b78a-28579c6898c1-kube-api-access-jrnh8\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.192894 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.192127    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9dc126a1-da76-4146-95f2-0571132022cc-original-pull-secret\") pod \"global-pull-secret-syncer-cb4sr\" (UID: \"9dc126a1-da76-4146-95f2-0571132022cc\") " pod="kube-system/global-pull-secret-syncer-cb4sr"
Jul 24 17:03:38.192894 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.192184    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/14f58e54-2adc-41a3-bc18-a25736900381-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mx4qq\" (UID: \"14f58e54-2adc-41a3-bc18-a25736900381\") " pod="openshift-multus/multus-additional-cni-plugins-mx4qq"
Jul 24 17:03:38.192894 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.192224    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ce9e534e-4a16-4593-9bbf-689859d14bb0-serviceca\") pod \"node-ca-rq942\" (UID: \"ce9e534e-4a16-4593-9bbf-689859d14bb0\") " pod="openshift-image-registry/node-ca-rq942"
Jul 24 17:03:38.192894 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.192313    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/84981543-70cb-4811-b2fc-ea793ef9e2bc-konnectivity-ca\") pod \"konnectivity-agent-zfklt\" (UID: \"84981543-70cb-4811-b2fc-ea793ef9e2bc\") " pod="kube-system/konnectivity-agent-zfklt"
Jul 24 17:03:38.192894 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.192387    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/860ed1fc-612f-4796-8077-72bc6c5d84db-etc-openvswitch\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.192894 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.192381    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5f736e3e-403d-4b4e-a90b-af4074d659f9-socket-dir\") pod \"aws-ebs-csi-driver-node-7nzsz\" (UID: \"5f736e3e-403d-4b4e-a90b-af4074d659f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nzsz"
Jul 24 17:03:38.192894 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.192465    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/860ed1fc-612f-4796-8077-72bc6c5d84db-run-ovn\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.194393 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.194370    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/860ed1fc-612f-4796-8077-72bc6c5d84db-ovn-node-metrics-cert\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.194491 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.194481    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/84981543-70cb-4811-b2fc-ea793ef9e2bc-agent-certs\") pod \"konnectivity-agent-zfklt\" (UID: \"84981543-70cb-4811-b2fc-ea793ef9e2bc\") " pod="kube-system/konnectivity-agent-zfklt"
Jul 24 17:03:38.202791 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.202769    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcnlg\" (UniqueName: \"kubernetes.io/projected/5f736e3e-403d-4b4e-a90b-af4074d659f9-kube-api-access-gcnlg\") pod \"aws-ebs-csi-driver-node-7nzsz\" (UID: \"5f736e3e-403d-4b4e-a90b-af4074d659f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nzsz"
Jul 24 17:03:38.203970 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.203947    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg55p\" (UniqueName: \"kubernetes.io/projected/860ed1fc-612f-4796-8077-72bc6c5d84db-kube-api-access-lg55p\") pod \"ovnkube-node-6h754\" (UID: \"860ed1fc-612f-4796-8077-72bc6c5d84db\") " pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.256624 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.256527    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-137.ec2.internal" event={"ID":"8a41629ae4091009408a555ea5339458","Type":"ContainerStarted","Data":"49dd659c5c1f46738b718b42466ad2740ec81c7f3c119c69fa3c301f661e2296"}
Jul 24 17:03:38.257833 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.257810    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-137.ec2.internal" event={"ID":"e430400d966265945a7f713410a6d520","Type":"ContainerStarted","Data":"2b775dd5c6489dbecea9a96926a40a20b076b7ac0a61878074efe70199510fc6"}
Jul 24 17:03:38.293267 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.293239    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/be2e4a02-b1a7-4b45-85d1-86535fb00672-etc-systemd\") pod \"tuned-qxhfq\" (UID: \"be2e4a02-b1a7-4b45-85d1-86535fb00672\") " pod="openshift-cluster-node-tuning-operator/tuned-qxhfq"
Jul 24 17:03:38.293392 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.293284    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0e01bc14-47b5-47b0-bd9b-7f1fd11fffa9-iptables-alerter-script\") pod \"iptables-alerter-jt6gx\" (UID: \"0e01bc14-47b5-47b0-bd9b-7f1fd11fffa9\") " pod="openshift-network-operator/iptables-alerter-jt6gx"
Jul 24 17:03:38.293392 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.293307    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xgjf\" (UniqueName: \"kubernetes.io/projected/0e01bc14-47b5-47b0-bd9b-7f1fd11fffa9-kube-api-access-5xgjf\") pod \"iptables-alerter-jt6gx\" (UID: \"0e01bc14-47b5-47b0-bd9b-7f1fd11fffa9\") " pod="openshift-network-operator/iptables-alerter-jt6gx"
Jul 24 17:03:38.293392 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.293331    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d52800a2-6038-494c-b78a-28579c6898c1-multus-socket-dir-parent\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.293392 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.293357    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9dc126a1-da76-4146-95f2-0571132022cc-kubelet-config\") pod \"global-pull-secret-syncer-cb4sr\" (UID: \"9dc126a1-da76-4146-95f2-0571132022cc\") " pod="kube-system/global-pull-secret-syncer-cb4sr"
Jul 24 17:03:38.293392 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.293370    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/be2e4a02-b1a7-4b45-85d1-86535fb00672-etc-systemd\") pod \"tuned-qxhfq\" (UID: \"be2e4a02-b1a7-4b45-85d1-86535fb00672\") " pod="openshift-cluster-node-tuning-operator/tuned-qxhfq"
Jul 24 17:03:38.293392 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.293379    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/be2e4a02-b1a7-4b45-85d1-86535fb00672-etc-sysctl-d\") pod \"tuned-qxhfq\" (UID: \"be2e4a02-b1a7-4b45-85d1-86535fb00672\") " pod="openshift-cluster-node-tuning-operator/tuned-qxhfq"
Jul 24 17:03:38.293695 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.293411    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2j9n\" (UniqueName: \"kubernetes.io/projected/14f58e54-2adc-41a3-bc18-a25736900381-kube-api-access-c2j9n\") pod \"multus-additional-cni-plugins-mx4qq\" (UID: \"14f58e54-2adc-41a3-bc18-a25736900381\") " pod="openshift-multus/multus-additional-cni-plugins-mx4qq"
Jul 24 17:03:38.293695 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.293443    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kd24x\" (UniqueName: \"kubernetes.io/projected/b20d7f4d-c9f7-4a88-9107-f52a67b5741c-kube-api-access-kd24x\") pod \"network-metrics-daemon-x9m67\" (UID: \"b20d7f4d-c9f7-4a88-9107-f52a67b5741c\") " pod="openshift-multus/network-metrics-daemon-x9m67"
Jul 24 17:03:38.293695 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.293464    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/be2e4a02-b1a7-4b45-85d1-86535fb00672-etc-sysctl-conf\") pod \"tuned-qxhfq\" (UID: \"be2e4a02-b1a7-4b45-85d1-86535fb00672\") " pod="openshift-cluster-node-tuning-operator/tuned-qxhfq"
Jul 24 17:03:38.293695 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.293482    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/be2e4a02-b1a7-4b45-85d1-86535fb00672-host\") pod \"tuned-qxhfq\" (UID: \"be2e4a02-b1a7-4b45-85d1-86535fb00672\") " pod="openshift-cluster-node-tuning-operator/tuned-qxhfq"
Jul 24 17:03:38.293695 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.293507    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d52800a2-6038-494c-b78a-28579c6898c1-host-var-lib-cni-bin\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.293695 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.293530    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d52800a2-6038-494c-b78a-28579c6898c1-multus-daemon-config\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.293695 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.293555    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b20d7f4d-c9f7-4a88-9107-f52a67b5741c-metrics-certs\") pod \"network-metrics-daemon-x9m67\" (UID: \"b20d7f4d-c9f7-4a88-9107-f52a67b5741c\") " pod="openshift-multus/network-metrics-daemon-x9m67"
Jul 24 17:03:38.293695 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.293579    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/be2e4a02-b1a7-4b45-85d1-86535fb00672-etc-sysconfig\") pod \"tuned-qxhfq\" (UID: \"be2e4a02-b1a7-4b45-85d1-86535fb00672\") " pod="openshift-cluster-node-tuning-operator/tuned-qxhfq"
Jul 24 17:03:38.293695 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.293603    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7127ce91-7986-4e71-9b22-ce42a081f632-tmp-dir\") pod \"node-resolver-jvnt9\" (UID: \"7127ce91-7986-4e71-9b22-ce42a081f632\") " pod="openshift-dns/node-resolver-jvnt9"
Jul 24 17:03:38.293695 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.293624    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/be2e4a02-b1a7-4b45-85d1-86535fb00672-etc-modprobe-d\") pod \"tuned-qxhfq\" (UID: \"be2e4a02-b1a7-4b45-85d1-86535fb00672\") " pod="openshift-cluster-node-tuning-operator/tuned-qxhfq"
Jul 24 17:03:38.293695 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.293644    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/be2e4a02-b1a7-4b45-85d1-86535fb00672-run\") pod \"tuned-qxhfq\" (UID: \"be2e4a02-b1a7-4b45-85d1-86535fb00672\") " pod="openshift-cluster-node-tuning-operator/tuned-qxhfq"
Jul 24 17:03:38.293695 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.293653    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d52800a2-6038-494c-b78a-28579c6898c1-host-var-lib-cni-bin\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.293695 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.293507    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/be2e4a02-b1a7-4b45-85d1-86535fb00672-etc-sysctl-d\") pod \"tuned-qxhfq\" (UID: \"be2e4a02-b1a7-4b45-85d1-86535fb00672\") " pod="openshift-cluster-node-tuning-operator/tuned-qxhfq"
Jul 24 17:03:38.294328 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.293793    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/be2e4a02-b1a7-4b45-85d1-86535fb00672-run\") pod \"tuned-qxhfq\" (UID: \"be2e4a02-b1a7-4b45-85d1-86535fb00672\") " pod="openshift-cluster-node-tuning-operator/tuned-qxhfq"
Jul 24 17:03:38.294328 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.293963    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/be2e4a02-b1a7-4b45-85d1-86535fb00672-etc-sysctl-conf\") pod \"tuned-qxhfq\" (UID: \"be2e4a02-b1a7-4b45-85d1-86535fb00672\") " pod="openshift-cluster-node-tuning-operator/tuned-qxhfq"
Jul 24 17:03:38.294328 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.293967    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/14f58e54-2adc-41a3-bc18-a25736900381-cni-binary-copy\") pod \"multus-additional-cni-plugins-mx4qq\" (UID: \"14f58e54-2adc-41a3-bc18-a25736900381\") " pod="openshift-multus/multus-additional-cni-plugins-mx4qq"
Jul 24 17:03:38.294328 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.293992    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/14f58e54-2adc-41a3-bc18-a25736900381-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mx4qq\" (UID: \"14f58e54-2adc-41a3-bc18-a25736900381\") " pod="openshift-multus/multus-additional-cni-plugins-mx4qq"
Jul 24 17:03:38.294328 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.294009    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d52800a2-6038-494c-b78a-28579c6898c1-host-run-k8s-cni-cncf-io\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.294328 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.294042    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d52800a2-6038-494c-b78a-28579c6898c1-host-run-k8s-cni-cncf-io\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.294328 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.294051    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/be2e4a02-b1a7-4b45-85d1-86535fb00672-host\") pod \"tuned-qxhfq\" (UID: \"be2e4a02-b1a7-4b45-85d1-86535fb00672\") " pod="openshift-cluster-node-tuning-operator/tuned-qxhfq"
Jul 24 17:03:38.294328 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.294101    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d52800a2-6038-494c-b78a-28579c6898c1-host-run-multus-certs\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.294328 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.294106    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0e01bc14-47b5-47b0-bd9b-7f1fd11fffa9-iptables-alerter-script\") pod \"iptables-alerter-jt6gx\" (UID: \"0e01bc14-47b5-47b0-bd9b-7f1fd11fffa9\") " pod="openshift-network-operator/iptables-alerter-jt6gx"
Jul 24 17:03:38.294328 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.294126    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be2e4a02-b1a7-4b45-85d1-86535fb00672-tmp\") pod \"tuned-qxhfq\" (UID: \"be2e4a02-b1a7-4b45-85d1-86535fb00672\") " pod="openshift-cluster-node-tuning-operator/tuned-qxhfq"
Jul 24 17:03:38.294328 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.294142    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/14f58e54-2adc-41a3-bc18-a25736900381-cnibin\") pod \"multus-additional-cni-plugins-mx4qq\" (UID: \"14f58e54-2adc-41a3-bc18-a25736900381\") " pod="openshift-multus/multus-additional-cni-plugins-mx4qq"
Jul 24 17:03:38.294328 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.294158    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d52800a2-6038-494c-b78a-28579c6898c1-multus-cni-dir\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.294328 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.294181    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d52800a2-6038-494c-b78a-28579c6898c1-os-release\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.294328 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.294189    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d52800a2-6038-494c-b78a-28579c6898c1-multus-daemon-config\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.294328 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.294201    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d52800a2-6038-494c-b78a-28579c6898c1-multus-conf-dir\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.294328 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.294220    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg9xt\" (UniqueName: \"kubernetes.io/projected/4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd-kube-api-access-tg9xt\") pod \"network-check-target-spwhm\" (UID: \"4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd\") " pod="openshift-network-diagnostics/network-check-target-spwhm"
Jul 24 17:03:38.294328 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.294240    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbjmh\" (UniqueName: \"kubernetes.io/projected/ce9e534e-4a16-4593-9bbf-689859d14bb0-kube-api-access-dbjmh\") pod \"node-ca-rq942\" (UID: \"ce9e534e-4a16-4593-9bbf-689859d14bb0\") " pod="openshift-image-registry/node-ca-rq942"
Jul 24 17:03:38.294839 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.294255    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be2e4a02-b1a7-4b45-85d1-86535fb00672-var-lib-kubelet\") pod \"tuned-qxhfq\" (UID: \"be2e4a02-b1a7-4b45-85d1-86535fb00672\") " pod="openshift-cluster-node-tuning-operator/tuned-qxhfq"
Jul 24 17:03:38.294839 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:38.294269    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:38.294839 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:38.294350    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b20d7f4d-c9f7-4a88-9107-f52a67b5741c-metrics-certs podName:b20d7f4d-c9f7-4a88-9107-f52a67b5741c nodeName:}" failed. No retries permitted until 2026-07-24 17:03:38.794330485 +0000 UTC m=+3.067190262 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b20d7f4d-c9f7-4a88-9107-f52a67b5741c-metrics-certs") pod "network-metrics-daemon-x9m67" (UID: "b20d7f4d-c9f7-4a88-9107-f52a67b5741c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:38.294839 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.294352    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d52800a2-6038-494c-b78a-28579c6898c1-multus-socket-dir-parent\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.294839 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.294405    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9dc126a1-da76-4146-95f2-0571132022cc-kubelet-config\") pod \"global-pull-secret-syncer-cb4sr\" (UID: \"9dc126a1-da76-4146-95f2-0571132022cc\") " pod="kube-system/global-pull-secret-syncer-cb4sr"
Jul 24 17:03:38.294839 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.294428    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/14f58e54-2adc-41a3-bc18-a25736900381-cni-binary-copy\") pod \"multus-additional-cni-plugins-mx4qq\" (UID: \"14f58e54-2adc-41a3-bc18-a25736900381\") " pod="openshift-multus/multus-additional-cni-plugins-mx4qq"
Jul 24 17:03:38.294839 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.294530    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d52800a2-6038-494c-b78a-28579c6898c1-os-release\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.294839 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.294537    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/be2e4a02-b1a7-4b45-85d1-86535fb00672-etc-sysconfig\") pod \"tuned-qxhfq\" (UID: \"be2e4a02-b1a7-4b45-85d1-86535fb00672\") " pod="openshift-cluster-node-tuning-operator/tuned-qxhfq"
Jul 24 17:03:38.294839 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.294570    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d52800a2-6038-494c-b78a-28579c6898c1-host-run-multus-certs\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.294839 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.294599    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/14f58e54-2adc-41a3-bc18-a25736900381-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mx4qq\" (UID: \"14f58e54-2adc-41a3-bc18-a25736900381\") " pod="openshift-multus/multus-additional-cni-plugins-mx4qq"
Jul 24 17:03:38.294839 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.294636    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d52800a2-6038-494c-b78a-28579c6898c1-multus-conf-dir\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.294839 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.294723    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/14f58e54-2adc-41a3-bc18-a25736900381-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mx4qq\" (UID: \"14f58e54-2adc-41a3-bc18-a25736900381\") " pod="openshift-multus/multus-additional-cni-plugins-mx4qq"
Jul 24 17:03:38.294839 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.294758    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/14f58e54-2adc-41a3-bc18-a25736900381-cnibin\") pod \"multus-additional-cni-plugins-mx4qq\" (UID: \"14f58e54-2adc-41a3-bc18-a25736900381\") " pod="openshift-multus/multus-additional-cni-plugins-mx4qq"
Jul 24 17:03:38.294839 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.294273    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/14f58e54-2adc-41a3-bc18-a25736900381-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mx4qq\" (UID: \"14f58e54-2adc-41a3-bc18-a25736900381\") " pod="openshift-multus/multus-additional-cni-plugins-mx4qq"
Jul 24 17:03:38.294839 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.294782    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d52800a2-6038-494c-b78a-28579c6898c1-system-cni-dir\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.294839 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.294796    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d52800a2-6038-494c-b78a-28579c6898c1-cni-binary-copy\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.294839 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.294814    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0e01bc14-47b5-47b0-bd9b-7f1fd11fffa9-host-slash\") pod \"iptables-alerter-jt6gx\" (UID: \"0e01bc14-47b5-47b0-bd9b-7f1fd11fffa9\") " pod="openshift-network-operator/iptables-alerter-jt6gx"
Jul 24 17:03:38.295634 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.294828    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce9e534e-4a16-4593-9bbf-689859d14bb0-host\") pod \"node-ca-rq942\" (UID: \"ce9e534e-4a16-4593-9bbf-689859d14bb0\") " pod="openshift-image-registry/node-ca-rq942"
Jul 24 17:03:38.295634 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.294844    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7127ce91-7986-4e71-9b22-ce42a081f632-hosts-file\") pod \"node-resolver-jvnt9\" (UID: \"7127ce91-7986-4e71-9b22-ce42a081f632\") " pod="openshift-dns/node-resolver-jvnt9"
Jul 24 17:03:38.295634 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.294844    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7127ce91-7986-4e71-9b22-ce42a081f632-tmp-dir\") pod \"node-resolver-jvnt9\" (UID: \"7127ce91-7986-4e71-9b22-ce42a081f632\") " pod="openshift-dns/node-resolver-jvnt9"
Jul 24 17:03:38.295634 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.294860    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d52800a2-6038-494c-b78a-28579c6898c1-host-var-lib-kubelet\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.295634 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.294876    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d52800a2-6038-494c-b78a-28579c6898c1-hostroot\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.295634 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.294891    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be2e4a02-b1a7-4b45-85d1-86535fb00672-var-lib-kubelet\") pod \"tuned-qxhfq\" (UID: \"be2e4a02-b1a7-4b45-85d1-86535fb00672\") " pod="openshift-cluster-node-tuning-operator/tuned-qxhfq"
Jul 24 17:03:38.295634 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.294904    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrnh8\" (UniqueName: \"kubernetes.io/projected/d52800a2-6038-494c-b78a-28579c6898c1-kube-api-access-jrnh8\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.295634 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.294924    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0e01bc14-47b5-47b0-bd9b-7f1fd11fffa9-host-slash\") pod \"iptables-alerter-jt6gx\" (UID: \"0e01bc14-47b5-47b0-bd9b-7f1fd11fffa9\") " pod="openshift-network-operator/iptables-alerter-jt6gx"
Jul 24 17:03:38.295634 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.294947    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9dc126a1-da76-4146-95f2-0571132022cc-original-pull-secret\") pod \"global-pull-secret-syncer-cb4sr\" (UID: \"9dc126a1-da76-4146-95f2-0571132022cc\") " pod="kube-system/global-pull-secret-syncer-cb4sr"
Jul 24 17:03:38.295634 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.294977    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d52800a2-6038-494c-b78a-28579c6898c1-multus-cni-dir\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.295634 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.295023    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/be2e4a02-b1a7-4b45-85d1-86535fb00672-etc-modprobe-d\") pod \"tuned-qxhfq\" (UID: \"be2e4a02-b1a7-4b45-85d1-86535fb00672\") " pod="openshift-cluster-node-tuning-operator/tuned-qxhfq"
Jul 24 17:03:38.295634 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:38.295050    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:38.295634 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.295083    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d52800a2-6038-494c-b78a-28579c6898c1-system-cni-dir\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.295634 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.295091    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce9e534e-4a16-4593-9bbf-689859d14bb0-host\") pod \"node-ca-rq942\" (UID: \"ce9e534e-4a16-4593-9bbf-689859d14bb0\") " pod="openshift-image-registry/node-ca-rq942"
Jul 24 17:03:38.295634 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.294976    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/14f58e54-2adc-41a3-bc18-a25736900381-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mx4qq\" (UID: \"14f58e54-2adc-41a3-bc18-a25736900381\") " pod="openshift-multus/multus-additional-cni-plugins-mx4qq"
Jul 24 17:03:38.295634 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.295104    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/14f58e54-2adc-41a3-bc18-a25736900381-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mx4qq\" (UID: \"14f58e54-2adc-41a3-bc18-a25736900381\") " pod="openshift-multus/multus-additional-cni-plugins-mx4qq"
Jul 24 17:03:38.295634 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:38.295124    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9dc126a1-da76-4146-95f2-0571132022cc-original-pull-secret podName:9dc126a1-da76-4146-95f2-0571132022cc nodeName:}" failed. No retries permitted until 2026-07-24 17:03:38.795107301 +0000 UTC m=+3.067967074 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9dc126a1-da76-4146-95f2-0571132022cc-original-pull-secret") pod "global-pull-secret-syncer-cb4sr" (UID: "9dc126a1-da76-4146-95f2-0571132022cc") : object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:38.295634 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.295136    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d52800a2-6038-494c-b78a-28579c6898c1-host-var-lib-kubelet\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.296497 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.295160    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ce9e534e-4a16-4593-9bbf-689859d14bb0-serviceca\") pod \"node-ca-rq942\" (UID: \"ce9e534e-4a16-4593-9bbf-689859d14bb0\") " pod="openshift-image-registry/node-ca-rq942"
Jul 24 17:03:38.296497 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.295162    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7127ce91-7986-4e71-9b22-ce42a081f632-hosts-file\") pod \"node-resolver-jvnt9\" (UID: \"7127ce91-7986-4e71-9b22-ce42a081f632\") " pod="openshift-dns/node-resolver-jvnt9"
Jul 24 17:03:38.296497 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.295181    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/be2e4a02-b1a7-4b45-85d1-86535fb00672-sys\") pod \"tuned-qxhfq\" (UID: \"be2e4a02-b1a7-4b45-85d1-86535fb00672\") " pod="openshift-cluster-node-tuning-operator/tuned-qxhfq"
Jul 24 17:03:38.296497 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.295187    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d52800a2-6038-494c-b78a-28579c6898c1-hostroot\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.296497 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.295205    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/14f58e54-2adc-41a3-bc18-a25736900381-os-release\") pod \"multus-additional-cni-plugins-mx4qq\" (UID: \"14f58e54-2adc-41a3-bc18-a25736900381\") " pod="openshift-multus/multus-additional-cni-plugins-mx4qq"
Jul 24 17:03:38.296497 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.295221    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d52800a2-6038-494c-b78a-28579c6898c1-cnibin\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.296497 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.295236    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d52800a2-6038-494c-b78a-28579c6898c1-host-var-lib-cni-multus\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.296497 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.295238    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/be2e4a02-b1a7-4b45-85d1-86535fb00672-sys\") pod \"tuned-qxhfq\" (UID: \"be2e4a02-b1a7-4b45-85d1-86535fb00672\") " pod="openshift-cluster-node-tuning-operator/tuned-qxhfq"
Jul 24 17:03:38.296497 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.295277    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d52800a2-6038-494c-b78a-28579c6898c1-host-var-lib-cni-multus\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.296497 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.295292    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/14f58e54-2adc-41a3-bc18-a25736900381-os-release\") pod \"multus-additional-cni-plugins-mx4qq\" (UID: \"14f58e54-2adc-41a3-bc18-a25736900381\") " pod="openshift-multus/multus-additional-cni-plugins-mx4qq"
Jul 24 17:03:38.296497 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.295304    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/be2e4a02-b1a7-4b45-85d1-86535fb00672-etc-tuned\") pod \"tuned-qxhfq\" (UID: \"be2e4a02-b1a7-4b45-85d1-86535fb00672\") " pod="openshift-cluster-node-tuning-operator/tuned-qxhfq"
Jul 24 17:03:38.296497 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.295331    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d52800a2-6038-494c-b78a-28579c6898c1-host-run-netns\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.296497 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.295294    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d52800a2-6038-494c-b78a-28579c6898c1-cnibin\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.296497 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.295360    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsvzr\" (UniqueName: \"kubernetes.io/projected/7127ce91-7986-4e71-9b22-ce42a081f632-kube-api-access-xsvzr\") pod \"node-resolver-jvnt9\" (UID: \"7127ce91-7986-4e71-9b22-ce42a081f632\") " pod="openshift-dns/node-resolver-jvnt9"
Jul 24 17:03:38.296497 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.295404    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be2e4a02-b1a7-4b45-85d1-86535fb00672-etc-kubernetes\") pod \"tuned-qxhfq\" (UID: \"be2e4a02-b1a7-4b45-85d1-86535fb00672\") " pod="openshift-cluster-node-tuning-operator/tuned-qxhfq"
Jul 24 17:03:38.296497 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.295417    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d52800a2-6038-494c-b78a-28579c6898c1-host-run-netns\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.296497 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.295428    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/be2e4a02-b1a7-4b45-85d1-86535fb00672-lib-modules\") pod \"tuned-qxhfq\" (UID: \"be2e4a02-b1a7-4b45-85d1-86535fb00672\") " pod="openshift-cluster-node-tuning-operator/tuned-qxhfq"
Jul 24 17:03:38.296497 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.295429    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d52800a2-6038-494c-b78a-28579c6898c1-cni-binary-copy\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.297291 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.295461    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d52800a2-6038-494c-b78a-28579c6898c1-etc-kubernetes\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.297291 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.295489    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d52800a2-6038-494c-b78a-28579c6898c1-etc-kubernetes\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.297291 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.295493    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqs9v\" (UniqueName: \"kubernetes.io/projected/be2e4a02-b1a7-4b45-85d1-86535fb00672-kube-api-access-nqs9v\") pod \"tuned-qxhfq\" (UID: \"be2e4a02-b1a7-4b45-85d1-86535fb00672\") " pod="openshift-cluster-node-tuning-operator/tuned-qxhfq"
Jul 24 17:03:38.297291 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.295467    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be2e4a02-b1a7-4b45-85d1-86535fb00672-etc-kubernetes\") pod \"tuned-qxhfq\" (UID: \"be2e4a02-b1a7-4b45-85d1-86535fb00672\") " pod="openshift-cluster-node-tuning-operator/tuned-qxhfq"
Jul 24 17:03:38.297291 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.295546    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/be2e4a02-b1a7-4b45-85d1-86535fb00672-lib-modules\") pod \"tuned-qxhfq\" (UID: \"be2e4a02-b1a7-4b45-85d1-86535fb00672\") " pod="openshift-cluster-node-tuning-operator/tuned-qxhfq"
Jul 24 17:03:38.297291 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.295524    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14f58e54-2adc-41a3-bc18-a25736900381-system-cni-dir\") pod \"multus-additional-cni-plugins-mx4qq\" (UID: \"14f58e54-2adc-41a3-bc18-a25736900381\") " pod="openshift-multus/multus-additional-cni-plugins-mx4qq"
Jul 24 17:03:38.297291 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.295566    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14f58e54-2adc-41a3-bc18-a25736900381-system-cni-dir\") pod \"multus-additional-cni-plugins-mx4qq\" (UID: \"14f58e54-2adc-41a3-bc18-a25736900381\") " pod="openshift-multus/multus-additional-cni-plugins-mx4qq"
Jul 24 17:03:38.297291 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.295584    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9dc126a1-da76-4146-95f2-0571132022cc-dbus\") pod \"global-pull-secret-syncer-cb4sr\" (UID: \"9dc126a1-da76-4146-95f2-0571132022cc\") " pod="kube-system/global-pull-secret-syncer-cb4sr"
Jul 24 17:03:38.297291 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.295659    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9dc126a1-da76-4146-95f2-0571132022cc-dbus\") pod \"global-pull-secret-syncer-cb4sr\" (UID: \"9dc126a1-da76-4146-95f2-0571132022cc\") " pod="kube-system/global-pull-secret-syncer-cb4sr"
Jul 24 17:03:38.297291 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.296153    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ce9e534e-4a16-4593-9bbf-689859d14bb0-serviceca\") pod \"node-ca-rq942\" (UID: \"ce9e534e-4a16-4593-9bbf-689859d14bb0\") " pod="openshift-image-registry/node-ca-rq942"
Jul 24 17:03:38.297291 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.297282    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be2e4a02-b1a7-4b45-85d1-86535fb00672-tmp\") pod \"tuned-qxhfq\" (UID: \"be2e4a02-b1a7-4b45-85d1-86535fb00672\") " pod="openshift-cluster-node-tuning-operator/tuned-qxhfq"
Jul 24 17:03:38.297764 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.297332    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/be2e4a02-b1a7-4b45-85d1-86535fb00672-etc-tuned\") pod \"tuned-qxhfq\" (UID: \"be2e4a02-b1a7-4b45-85d1-86535fb00672\") " pod="openshift-cluster-node-tuning-operator/tuned-qxhfq"
Jul 24 17:03:38.343510 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:38.343487    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 17:03:38.343639 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:38.343518    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 17:03:38.343639 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:38.343533    2561 projected.go:196] Error preparing data for projected volume kube-api-access-tg9xt for pod openshift-network-diagnostics/network-check-target-spwhm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:38.343639 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:38.343597    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd-kube-api-access-tg9xt podName:4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd nodeName:}" failed. No retries permitted until 2026-07-24 17:03:38.843579488 +0000 UTC m=+3.116439291 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tg9xt" (UniqueName: "kubernetes.io/projected/4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd-kube-api-access-tg9xt") pod "network-check-target-spwhm" (UID: "4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:38.348913 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.348887    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2j9n\" (UniqueName: \"kubernetes.io/projected/14f58e54-2adc-41a3-bc18-a25736900381-kube-api-access-c2j9n\") pod \"multus-additional-cni-plugins-mx4qq\" (UID: \"14f58e54-2adc-41a3-bc18-a25736900381\") " pod="openshift-multus/multus-additional-cni-plugins-mx4qq"
Jul 24 17:03:38.349035 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.348989    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsvzr\" (UniqueName: \"kubernetes.io/projected/7127ce91-7986-4e71-9b22-ce42a081f632-kube-api-access-xsvzr\") pod \"node-resolver-jvnt9\" (UID: \"7127ce91-7986-4e71-9b22-ce42a081f632\") " pod="openshift-dns/node-resolver-jvnt9"
Jul 24 17:03:38.349671 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.349647    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd24x\" (UniqueName: \"kubernetes.io/projected/b20d7f4d-c9f7-4a88-9107-f52a67b5741c-kube-api-access-kd24x\") pod \"network-metrics-daemon-x9m67\" (UID: \"b20d7f4d-c9f7-4a88-9107-f52a67b5741c\") " pod="openshift-multus/network-metrics-daemon-x9m67"
Jul 24 17:03:38.351152 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.351129    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqs9v\" (UniqueName: \"kubernetes.io/projected/be2e4a02-b1a7-4b45-85d1-86535fb00672-kube-api-access-nqs9v\") pod \"tuned-qxhfq\" (UID: \"be2e4a02-b1a7-4b45-85d1-86535fb00672\") " pod="openshift-cluster-node-tuning-operator/tuned-qxhfq"
Jul 24 17:03:38.351372 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.351351    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbjmh\" (UniqueName: \"kubernetes.io/projected/ce9e534e-4a16-4593-9bbf-689859d14bb0-kube-api-access-dbjmh\") pod \"node-ca-rq942\" (UID: \"ce9e534e-4a16-4593-9bbf-689859d14bb0\") " pod="openshift-image-registry/node-ca-rq942"
Jul 24 17:03:38.351545 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.351526    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrnh8\" (UniqueName: \"kubernetes.io/projected/d52800a2-6038-494c-b78a-28579c6898c1-kube-api-access-jrnh8\") pod \"multus-d7nwt\" (UID: \"d52800a2-6038-494c-b78a-28579c6898c1\") " pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.352735 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.352718    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xgjf\" (UniqueName: \"kubernetes.io/projected/0e01bc14-47b5-47b0-bd9b-7f1fd11fffa9-kube-api-access-5xgjf\") pod \"iptables-alerter-jt6gx\" (UID: \"0e01bc14-47b5-47b0-bd9b-7f1fd11fffa9\") " pod="openshift-network-operator/iptables-alerter-jt6gx"
Jul 24 17:03:38.387813 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.387719    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nzsz"
Jul 24 17:03:38.399187 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.399168    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:03:38.411159 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.411136    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zfklt"
Jul 24 17:03:38.416579 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.416481    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jt6gx"
Jul 24 17:03:38.424381 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.424361    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rq942"
Jul 24 17:03:38.428306 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.428278    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jvnt9"
Jul 24 17:03:38.435138 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.435117    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qxhfq"
Jul 24 17:03:38.440442 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.440424    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mx4qq"
Jul 24 17:03:38.446086 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.446056    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-d7nwt"
Jul 24 17:03:38.798551 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.798522    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b20d7f4d-c9f7-4a88-9107-f52a67b5741c-metrics-certs\") pod \"network-metrics-daemon-x9m67\" (UID: \"b20d7f4d-c9f7-4a88-9107-f52a67b5741c\") " pod="openshift-multus/network-metrics-daemon-x9m67"
Jul 24 17:03:38.798730 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.798585    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9dc126a1-da76-4146-95f2-0571132022cc-original-pull-secret\") pod \"global-pull-secret-syncer-cb4sr\" (UID: \"9dc126a1-da76-4146-95f2-0571132022cc\") " pod="kube-system/global-pull-secret-syncer-cb4sr"
Jul 24 17:03:38.798730 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:38.798691    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:38.798730 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:38.798709    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:38.798864 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:38.798774    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9dc126a1-da76-4146-95f2-0571132022cc-original-pull-secret podName:9dc126a1-da76-4146-95f2-0571132022cc nodeName:}" failed. No retries permitted until 2026-07-24 17:03:39.798754629 +0000 UTC m=+4.071614403 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9dc126a1-da76-4146-95f2-0571132022cc-original-pull-secret") pod "global-pull-secret-syncer-cb4sr" (UID: "9dc126a1-da76-4146-95f2-0571132022cc") : object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:38.798864 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:38.798795    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b20d7f4d-c9f7-4a88-9107-f52a67b5741c-metrics-certs podName:b20d7f4d-c9f7-4a88-9107-f52a67b5741c nodeName:}" failed. No retries permitted until 2026-07-24 17:03:39.798784609 +0000 UTC m=+4.071644382 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b20d7f4d-c9f7-4a88-9107-f52a67b5741c-metrics-certs") pod "network-metrics-daemon-x9m67" (UID: "b20d7f4d-c9f7-4a88-9107-f52a67b5741c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:38.898892 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:38.898852    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg9xt\" (UniqueName: \"kubernetes.io/projected/4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd-kube-api-access-tg9xt\") pod \"network-check-target-spwhm\" (UID: \"4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd\") " pod="openshift-network-diagnostics/network-check-target-spwhm"
Jul 24 17:03:38.899085 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:38.899016    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 17:03:38.899085 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:38.899035    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 17:03:38.899085 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:38.899046    2561 projected.go:196] Error preparing data for projected volume kube-api-access-tg9xt for pod openshift-network-diagnostics/network-check-target-spwhm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:38.899213 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:38.899111    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd-kube-api-access-tg9xt podName:4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd nodeName:}" failed. No retries permitted until 2026-07-24 17:03:39.899095473 +0000 UTC m=+4.171955250 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tg9xt" (UniqueName: "kubernetes.io/projected/4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd-kube-api-access-tg9xt") pod "network-check-target-spwhm" (UID: "4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:39.104656 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:39.104605    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd52800a2_6038_494c_b78a_28579c6898c1.slice/crio-df25e4f1750c898c0475ce5daeee496fdc71c91aac127b7b18fa708433e3fcff WatchSource:0}: Error finding container df25e4f1750c898c0475ce5daeee496fdc71c91aac127b7b18fa708433e3fcff: Status 404 returned error can't find the container with id df25e4f1750c898c0475ce5daeee496fdc71c91aac127b7b18fa708433e3fcff
Jul 24 17:03:39.105586 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:39.105552    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce9e534e_4a16_4593_9bbf_689859d14bb0.slice/crio-1e2f434e6ca2a499b9276f12231ad9b35e9d97e4bc0908171a4e0a44a2372072 WatchSource:0}: Error finding container 1e2f434e6ca2a499b9276f12231ad9b35e9d97e4bc0908171a4e0a44a2372072: Status 404 returned error can't find the container with id 1e2f434e6ca2a499b9276f12231ad9b35e9d97e4bc0908171a4e0a44a2372072
Jul 24 17:03:39.108230 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:39.108205    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84981543_70cb_4811_b2fc_ea793ef9e2bc.slice/crio-e1ebff1c444b6983a13273aa88e79a5ae173d20d5ad5a44e884ef354395c3986 WatchSource:0}: Error finding container e1ebff1c444b6983a13273aa88e79a5ae173d20d5ad5a44e884ef354395c3986: Status 404 returned error can't find the container with id e1ebff1c444b6983a13273aa88e79a5ae173d20d5ad5a44e884ef354395c3986
Jul 24 17:03:39.110181 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:39.110151    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod860ed1fc_612f_4796_8077_72bc6c5d84db.slice/crio-17ad246f52007904df3d4524c54f72f5d67134c5eed7ae8162e8057a6cd17655 WatchSource:0}: Error finding container 17ad246f52007904df3d4524c54f72f5d67134c5eed7ae8162e8057a6cd17655: Status 404 returned error can't find the container with id 17ad246f52007904df3d4524c54f72f5d67134c5eed7ae8162e8057a6cd17655
Jul 24 17:03:39.110986 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:39.110962    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e01bc14_47b5_47b0_bd9b_7f1fd11fffa9.slice/crio-de83b0fd03235a13b940cecf7ab075ca490c83457b222d80bd2cf0b4a5833e4d WatchSource:0}: Error finding container de83b0fd03235a13b940cecf7ab075ca490c83457b222d80bd2cf0b4a5833e4d: Status 404 returned error can't find the container with id de83b0fd03235a13b940cecf7ab075ca490c83457b222d80bd2cf0b4a5833e4d
Jul 24 17:03:39.111891 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:39.111806    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe2e4a02_b1a7_4b45_85d1_86535fb00672.slice/crio-7014f9515339cc251329ee27dcc036ee7ad01904ad33b596b3060ac01e55ad99 WatchSource:0}: Error finding container 7014f9515339cc251329ee27dcc036ee7ad01904ad33b596b3060ac01e55ad99: Status 404 returned error can't find the container with id 7014f9515339cc251329ee27dcc036ee7ad01904ad33b596b3060ac01e55ad99
Jul 24 17:03:39.112958 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:39.112591    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7127ce91_7986_4e71_9b22_ce42a081f632.slice/crio-4f221c29e08ee59ee8f78f09305084714b372a6f56957a403294be04c8ce1fcf WatchSource:0}: Error finding container 4f221c29e08ee59ee8f78f09305084714b372a6f56957a403294be04c8ce1fcf: Status 404 returned error can't find the container with id 4f221c29e08ee59ee8f78f09305084714b372a6f56957a403294be04c8ce1fcf
Jul 24 17:03:39.114218 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:03:39.113601    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14f58e54_2adc_41a3_bc18_a25736900381.slice/crio-2669ba338f2c147e13bc54cffb1331c63c7c7621346aa5f8a5887982eac04db8 WatchSource:0}: Error finding container 2669ba338f2c147e13bc54cffb1331c63c7c7621346aa5f8a5887982eac04db8: Status 404 returned error can't find the container with id 2669ba338f2c147e13bc54cffb1331c63c7c7621346aa5f8a5887982eac04db8
Jul 24 17:03:39.156648 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:39.156608    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 16:58:38 +0000 UTC" deadline="2028-05-01 13:00:35.661947926 +0000 UTC"
Jul 24 17:03:39.156648 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:39.156646    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15523h56m56.505304154s"
Jul 24 17:03:39.252448 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:39.252314    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x9m67"
Jul 24 17:03:39.252564 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:39.252536    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x9m67" podUID="b20d7f4d-c9f7-4a88-9107-f52a67b5741c"
Jul 24 17:03:39.261128 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:39.261088    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6h754" event={"ID":"860ed1fc-612f-4796-8077-72bc6c5d84db","Type":"ContainerStarted","Data":"17ad246f52007904df3d4524c54f72f5d67134c5eed7ae8162e8057a6cd17655"}
Jul 24 17:03:39.262131 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:39.262094    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-d7nwt" event={"ID":"d52800a2-6038-494c-b78a-28579c6898c1","Type":"ContainerStarted","Data":"df25e4f1750c898c0475ce5daeee496fdc71c91aac127b7b18fa708433e3fcff"}
Jul 24 17:03:39.263866 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:39.263845    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-137.ec2.internal" event={"ID":"e430400d966265945a7f713410a6d520","Type":"ContainerStarted","Data":"f5ab987ec466d48cc1f82148f430483927bf6dd26dd7b92d1554faba3c4b417d"}
Jul 24 17:03:39.264972 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:39.264908    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jt6gx" event={"ID":"0e01bc14-47b5-47b0-bd9b-7f1fd11fffa9","Type":"ContainerStarted","Data":"de83b0fd03235a13b940cecf7ab075ca490c83457b222d80bd2cf0b4a5833e4d"}
Jul 24 17:03:39.266019 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:39.265995    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nzsz" event={"ID":"5f736e3e-403d-4b4e-a90b-af4074d659f9","Type":"ContainerStarted","Data":"7a7be1e4997c6a9eced7fb36c9065026b8de80658e552a5b0e368ac2cb046037"}
Jul 24 17:03:39.267021 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:39.267002    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mx4qq" event={"ID":"14f58e54-2adc-41a3-bc18-a25736900381","Type":"ContainerStarted","Data":"2669ba338f2c147e13bc54cffb1331c63c7c7621346aa5f8a5887982eac04db8"}
Jul 24 17:03:39.267955 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:39.267932    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jvnt9" event={"ID":"7127ce91-7986-4e71-9b22-ce42a081f632","Type":"ContainerStarted","Data":"4f221c29e08ee59ee8f78f09305084714b372a6f56957a403294be04c8ce1fcf"}
Jul 24 17:03:39.269109 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:39.269086    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qxhfq" event={"ID":"be2e4a02-b1a7-4b45-85d1-86535fb00672","Type":"ContainerStarted","Data":"7014f9515339cc251329ee27dcc036ee7ad01904ad33b596b3060ac01e55ad99"}
Jul 24 17:03:39.270215 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:39.270185    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zfklt" event={"ID":"84981543-70cb-4811-b2fc-ea793ef9e2bc","Type":"ContainerStarted","Data":"e1ebff1c444b6983a13273aa88e79a5ae173d20d5ad5a44e884ef354395c3986"}
Jul 24 17:03:39.271287 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:39.271269    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rq942" event={"ID":"ce9e534e-4a16-4593-9bbf-689859d14bb0","Type":"ContainerStarted","Data":"1e2f434e6ca2a499b9276f12231ad9b35e9d97e4bc0908171a4e0a44a2372072"}
Jul 24 17:03:39.277563 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:39.277524    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-137.ec2.internal" podStartSLOduration=2.277513748 podStartE2EDuration="2.277513748s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:03:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:03:39.277407816 +0000 UTC m=+3.550267597" watchObservedRunningTime="2026-07-24 17:03:39.277513748 +0000 UTC m=+3.550373528"
Jul 24 17:03:39.806202 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:39.806165    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9dc126a1-da76-4146-95f2-0571132022cc-original-pull-secret\") pod \"global-pull-secret-syncer-cb4sr\" (UID: \"9dc126a1-da76-4146-95f2-0571132022cc\") " pod="kube-system/global-pull-secret-syncer-cb4sr"
Jul 24 17:03:39.806385 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:39.806236    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b20d7f4d-c9f7-4a88-9107-f52a67b5741c-metrics-certs\") pod \"network-metrics-daemon-x9m67\" (UID: \"b20d7f4d-c9f7-4a88-9107-f52a67b5741c\") " pod="openshift-multus/network-metrics-daemon-x9m67"
Jul 24 17:03:39.806385 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:39.806364    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:39.806493 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:39.806426    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b20d7f4d-c9f7-4a88-9107-f52a67b5741c-metrics-certs podName:b20d7f4d-c9f7-4a88-9107-f52a67b5741c nodeName:}" failed. No retries permitted until 2026-07-24 17:03:41.806404996 +0000 UTC m=+6.079264753 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b20d7f4d-c9f7-4a88-9107-f52a67b5741c-metrics-certs") pod "network-metrics-daemon-x9m67" (UID: "b20d7f4d-c9f7-4a88-9107-f52a67b5741c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:39.806841 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:39.806816    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:39.806956 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:39.806870    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9dc126a1-da76-4146-95f2-0571132022cc-original-pull-secret podName:9dc126a1-da76-4146-95f2-0571132022cc nodeName:}" failed. No retries permitted until 2026-07-24 17:03:41.806855828 +0000 UTC m=+6.079715586 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9dc126a1-da76-4146-95f2-0571132022cc-original-pull-secret") pod "global-pull-secret-syncer-cb4sr" (UID: "9dc126a1-da76-4146-95f2-0571132022cc") : object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:39.907242 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:39.907209    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg9xt\" (UniqueName: \"kubernetes.io/projected/4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd-kube-api-access-tg9xt\") pod \"network-check-target-spwhm\" (UID: \"4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd\") " pod="openshift-network-diagnostics/network-check-target-spwhm"
Jul 24 17:03:39.907394 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:39.907358    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 17:03:39.907394 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:39.907378    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 17:03:39.907394 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:39.907390    2561 projected.go:196] Error preparing data for projected volume kube-api-access-tg9xt for pod openshift-network-diagnostics/network-check-target-spwhm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:39.907547 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:39.907444    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd-kube-api-access-tg9xt podName:4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd nodeName:}" failed. No retries permitted until 2026-07-24 17:03:41.90742669 +0000 UTC m=+6.180286452 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tg9xt" (UniqueName: "kubernetes.io/projected/4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd-kube-api-access-tg9xt") pod "network-check-target-spwhm" (UID: "4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:40.157271 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:40.157165    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 16:58:38 +0000 UTC" deadline="2028-03-25 21:31:10.464961897 +0000 UTC"
Jul 24 17:03:40.157271 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:40.157223    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14644h27m30.307742281s"
Jul 24 17:03:40.254224 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:40.254182    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spwhm"
Jul 24 17:03:40.254402 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:40.254304    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spwhm" podUID="4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd"
Jul 24 17:03:40.254726 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:40.254705    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cb4sr"
Jul 24 17:03:40.254819 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:40.254802    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cb4sr" podUID="9dc126a1-da76-4146-95f2-0571132022cc"
Jul 24 17:03:40.288087 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:40.287614    2561 generic.go:356] "Generic (PLEG): container finished" podID="8a41629ae4091009408a555ea5339458" containerID="7cbfb1657144347207f92d47c6704d198235ecd9286cfee5a1379b7d9a7d010c" exitCode=0
Jul 24 17:03:40.288961 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:40.288849    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-137.ec2.internal" event={"ID":"8a41629ae4091009408a555ea5339458","Type":"ContainerDied","Data":"7cbfb1657144347207f92d47c6704d198235ecd9286cfee5a1379b7d9a7d010c"}
Jul 24 17:03:41.253157 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:41.252544    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x9m67"
Jul 24 17:03:41.253157 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:41.252678    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x9m67" podUID="b20d7f4d-c9f7-4a88-9107-f52a67b5741c"
Jul 24 17:03:41.319004 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:41.318966    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-137.ec2.internal" event={"ID":"8a41629ae4091009408a555ea5339458","Type":"ContainerStarted","Data":"3af6046395b4073293a6f0c99906820441aebcfffb402db67bf7b649b8a91516"}
Jul 24 17:03:41.339376 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:41.339325    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-137.ec2.internal" podStartSLOduration=4.339305629 podStartE2EDuration="4.339305629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:03:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:03:41.338544936 +0000 UTC m=+5.611404716" watchObservedRunningTime="2026-07-24 17:03:41.339305629 +0000 UTC m=+5.612165412"
Jul 24 17:03:41.825600 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:41.825563    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9dc126a1-da76-4146-95f2-0571132022cc-original-pull-secret\") pod \"global-pull-secret-syncer-cb4sr\" (UID: \"9dc126a1-da76-4146-95f2-0571132022cc\") " pod="kube-system/global-pull-secret-syncer-cb4sr"
Jul 24 17:03:41.825786 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:41.825639    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b20d7f4d-c9f7-4a88-9107-f52a67b5741c-metrics-certs\") pod \"network-metrics-daemon-x9m67\" (UID: \"b20d7f4d-c9f7-4a88-9107-f52a67b5741c\") " pod="openshift-multus/network-metrics-daemon-x9m67"
Jul 24 17:03:41.825786 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:41.825768    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:41.825903 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:41.825829    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b20d7f4d-c9f7-4a88-9107-f52a67b5741c-metrics-certs podName:b20d7f4d-c9f7-4a88-9107-f52a67b5741c nodeName:}" failed. No retries permitted until 2026-07-24 17:03:45.825810949 +0000 UTC m=+10.098670713 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b20d7f4d-c9f7-4a88-9107-f52a67b5741c-metrics-certs") pod "network-metrics-daemon-x9m67" (UID: "b20d7f4d-c9f7-4a88-9107-f52a67b5741c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:41.826234 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:41.826217    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:41.826333 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:41.826267    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9dc126a1-da76-4146-95f2-0571132022cc-original-pull-secret podName:9dc126a1-da76-4146-95f2-0571132022cc nodeName:}" failed. No retries permitted until 2026-07-24 17:03:45.826252815 +0000 UTC m=+10.099112576 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9dc126a1-da76-4146-95f2-0571132022cc-original-pull-secret") pod "global-pull-secret-syncer-cb4sr" (UID: "9dc126a1-da76-4146-95f2-0571132022cc") : object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:41.926495 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:41.926461    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg9xt\" (UniqueName: \"kubernetes.io/projected/4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd-kube-api-access-tg9xt\") pod \"network-check-target-spwhm\" (UID: \"4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd\") " pod="openshift-network-diagnostics/network-check-target-spwhm"
Jul 24 17:03:41.926721 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:41.926590    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 17:03:41.926721 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:41.926606    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 17:03:41.926721 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:41.926619    2561 projected.go:196] Error preparing data for projected volume kube-api-access-tg9xt for pod openshift-network-diagnostics/network-check-target-spwhm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:41.926721 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:41.926663    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd-kube-api-access-tg9xt podName:4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd nodeName:}" failed. No retries permitted until 2026-07-24 17:03:45.926650157 +0000 UTC m=+10.199509928 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tg9xt" (UniqueName: "kubernetes.io/projected/4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd-kube-api-access-tg9xt") pod "network-check-target-spwhm" (UID: "4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:42.253670 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:42.253160    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spwhm"
Jul 24 17:03:42.253670 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:42.253292    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spwhm" podUID="4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd"
Jul 24 17:03:42.253670 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:42.253339    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cb4sr"
Jul 24 17:03:42.253670 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:42.253440    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cb4sr" podUID="9dc126a1-da76-4146-95f2-0571132022cc"
Jul 24 17:03:43.253057 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:43.252994    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x9m67"
Jul 24 17:03:43.253239 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:43.253160    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x9m67" podUID="b20d7f4d-c9f7-4a88-9107-f52a67b5741c"
Jul 24 17:03:44.252843 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:44.252543    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spwhm"
Jul 24 17:03:44.252843 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:44.252679    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spwhm" podUID="4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd"
Jul 24 17:03:44.253363 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:44.252968    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cb4sr"
Jul 24 17:03:44.253363 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:44.253094    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cb4sr" podUID="9dc126a1-da76-4146-95f2-0571132022cc"
Jul 24 17:03:45.252636 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:45.252603    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x9m67"
Jul 24 17:03:45.252802 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:45.252746    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x9m67" podUID="b20d7f4d-c9f7-4a88-9107-f52a67b5741c"
Jul 24 17:03:45.861435 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:45.861390    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9dc126a1-da76-4146-95f2-0571132022cc-original-pull-secret\") pod \"global-pull-secret-syncer-cb4sr\" (UID: \"9dc126a1-da76-4146-95f2-0571132022cc\") " pod="kube-system/global-pull-secret-syncer-cb4sr"
Jul 24 17:03:45.861816 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:45.861481    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b20d7f4d-c9f7-4a88-9107-f52a67b5741c-metrics-certs\") pod \"network-metrics-daemon-x9m67\" (UID: \"b20d7f4d-c9f7-4a88-9107-f52a67b5741c\") " pod="openshift-multus/network-metrics-daemon-x9m67"
Jul 24 17:03:45.861816 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:45.861640    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:45.861816 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:45.861698    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b20d7f4d-c9f7-4a88-9107-f52a67b5741c-metrics-certs podName:b20d7f4d-c9f7-4a88-9107-f52a67b5741c nodeName:}" failed. No retries permitted until 2026-07-24 17:03:53.861679323 +0000 UTC m=+18.134539084 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b20d7f4d-c9f7-4a88-9107-f52a67b5741c-metrics-certs") pod "network-metrics-daemon-x9m67" (UID: "b20d7f4d-c9f7-4a88-9107-f52a67b5741c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:45.862138 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:45.862117    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:45.862230 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:45.862182    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9dc126a1-da76-4146-95f2-0571132022cc-original-pull-secret podName:9dc126a1-da76-4146-95f2-0571132022cc nodeName:}" failed. No retries permitted until 2026-07-24 17:03:53.862167017 +0000 UTC m=+18.135026795 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9dc126a1-da76-4146-95f2-0571132022cc-original-pull-secret") pod "global-pull-secret-syncer-cb4sr" (UID: "9dc126a1-da76-4146-95f2-0571132022cc") : object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:45.962278 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:45.962244    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg9xt\" (UniqueName: \"kubernetes.io/projected/4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd-kube-api-access-tg9xt\") pod \"network-check-target-spwhm\" (UID: \"4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd\") " pod="openshift-network-diagnostics/network-check-target-spwhm"
Jul 24 17:03:45.962508 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:45.962417    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 17:03:45.962508 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:45.962440    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 17:03:45.962508 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:45.962452    2561 projected.go:196] Error preparing data for projected volume kube-api-access-tg9xt for pod openshift-network-diagnostics/network-check-target-spwhm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:45.962508 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:45.962510    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd-kube-api-access-tg9xt podName:4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd nodeName:}" failed. No retries permitted until 2026-07-24 17:03:53.962492864 +0000 UTC m=+18.235352635 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tg9xt" (UniqueName: "kubernetes.io/projected/4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd-kube-api-access-tg9xt") pod "network-check-target-spwhm" (UID: "4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:46.253903 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:46.253829    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spwhm"
Jul 24 17:03:46.254074 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:46.253926    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spwhm" podUID="4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd"
Jul 24 17:03:46.254074 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:46.253998    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cb4sr"
Jul 24 17:03:46.254200 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:46.254092    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cb4sr" podUID="9dc126a1-da76-4146-95f2-0571132022cc"
Jul 24 17:03:47.252108 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:47.252077    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x9m67"
Jul 24 17:03:47.252586 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:47.252227    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x9m67" podUID="b20d7f4d-c9f7-4a88-9107-f52a67b5741c"
Jul 24 17:03:48.252661 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:48.252628    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spwhm"
Jul 24 17:03:48.253110 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:48.252748    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spwhm" podUID="4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd"
Jul 24 17:03:48.253110 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:48.252846    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cb4sr"
Jul 24 17:03:48.253110 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:48.252951    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cb4sr" podUID="9dc126a1-da76-4146-95f2-0571132022cc"
Jul 24 17:03:49.252423 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:49.252391    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x9m67"
Jul 24 17:03:49.252600 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:49.252517    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x9m67" podUID="b20d7f4d-c9f7-4a88-9107-f52a67b5741c"
Jul 24 17:03:50.252218 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:50.252185    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cb4sr"
Jul 24 17:03:50.252666 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:50.252194    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spwhm"
Jul 24 17:03:50.252666 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:50.252314    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cb4sr" podUID="9dc126a1-da76-4146-95f2-0571132022cc"
Jul 24 17:03:50.252666 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:50.252394    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spwhm" podUID="4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd"
Jul 24 17:03:51.252705 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:51.252672    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x9m67"
Jul 24 17:03:51.253174 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:51.252821    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x9m67" podUID="b20d7f4d-c9f7-4a88-9107-f52a67b5741c"
Jul 24 17:03:52.252382 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:52.252350    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spwhm"
Jul 24 17:03:52.252562 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:52.252469    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spwhm" podUID="4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd"
Jul 24 17:03:52.252562 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:52.252549    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cb4sr"
Jul 24 17:03:52.252692 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:52.252665    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cb4sr" podUID="9dc126a1-da76-4146-95f2-0571132022cc"
Jul 24 17:03:53.252321 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:53.252290    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x9m67"
Jul 24 17:03:53.252690 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:53.252402    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x9m67" podUID="b20d7f4d-c9f7-4a88-9107-f52a67b5741c"
Jul 24 17:03:53.929823 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:53.929749    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b20d7f4d-c9f7-4a88-9107-f52a67b5741c-metrics-certs\") pod \"network-metrics-daemon-x9m67\" (UID: \"b20d7f4d-c9f7-4a88-9107-f52a67b5741c\") " pod="openshift-multus/network-metrics-daemon-x9m67"
Jul 24 17:03:53.929823 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:53.929808    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9dc126a1-da76-4146-95f2-0571132022cc-original-pull-secret\") pod \"global-pull-secret-syncer-cb4sr\" (UID: \"9dc126a1-da76-4146-95f2-0571132022cc\") " pod="kube-system/global-pull-secret-syncer-cb4sr"
Jul 24 17:03:53.930005 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:53.929908    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:53.930005 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:53.929919    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:53.930005 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:53.929980    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9dc126a1-da76-4146-95f2-0571132022cc-original-pull-secret podName:9dc126a1-da76-4146-95f2-0571132022cc nodeName:}" failed. No retries permitted until 2026-07-24 17:04:09.929963792 +0000 UTC m=+34.202823552 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9dc126a1-da76-4146-95f2-0571132022cc-original-pull-secret") pod "global-pull-secret-syncer-cb4sr" (UID: "9dc126a1-da76-4146-95f2-0571132022cc") : object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:53.930005 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:53.930000    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b20d7f4d-c9f7-4a88-9107-f52a67b5741c-metrics-certs podName:b20d7f4d-c9f7-4a88-9107-f52a67b5741c nodeName:}" failed. No retries permitted until 2026-07-24 17:04:09.929990886 +0000 UTC m=+34.202850643 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b20d7f4d-c9f7-4a88-9107-f52a67b5741c-metrics-certs") pod "network-metrics-daemon-x9m67" (UID: "b20d7f4d-c9f7-4a88-9107-f52a67b5741c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:54.030856 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:54.030810    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg9xt\" (UniqueName: \"kubernetes.io/projected/4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd-kube-api-access-tg9xt\") pod \"network-check-target-spwhm\" (UID: \"4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd\") " pod="openshift-network-diagnostics/network-check-target-spwhm"
Jul 24 17:03:54.031017 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:54.030989    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 17:03:54.031017 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:54.031019    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 17:03:54.031213 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:54.031032    2561 projected.go:196] Error preparing data for projected volume kube-api-access-tg9xt for pod openshift-network-diagnostics/network-check-target-spwhm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:54.031213 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:54.031110    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd-kube-api-access-tg9xt podName:4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd nodeName:}" failed. No retries permitted until 2026-07-24 17:04:10.031092092 +0000 UTC m=+34.303951875 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tg9xt" (UniqueName: "kubernetes.io/projected/4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd-kube-api-access-tg9xt") pod "network-check-target-spwhm" (UID: "4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:54.252210 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:54.252134    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cb4sr"
Jul 24 17:03:54.252376 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:54.252268    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cb4sr" podUID="9dc126a1-da76-4146-95f2-0571132022cc"
Jul 24 17:03:54.252756 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:54.252134    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spwhm"
Jul 24 17:03:54.252756 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:54.252657    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spwhm" podUID="4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd"
Jul 24 17:03:55.252339 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:55.252307    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x9m67"
Jul 24 17:03:55.252495 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:55.252439    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x9m67" podUID="b20d7f4d-c9f7-4a88-9107-f52a67b5741c"
Jul 24 17:03:56.252956 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:56.252916    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spwhm"
Jul 24 17:03:56.253430 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:56.253030    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spwhm" podUID="4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd"
Jul 24 17:03:56.253430 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:56.253116    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cb4sr"
Jul 24 17:03:56.253430 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:56.253292    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cb4sr" podUID="9dc126a1-da76-4146-95f2-0571132022cc"
Jul 24 17:03:57.252641 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:57.252608    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x9m67"
Jul 24 17:03:57.252797 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:57.252749    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x9m67" podUID="b20d7f4d-c9f7-4a88-9107-f52a67b5741c"
Jul 24 17:03:58.252355 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:58.252116    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spwhm"
Jul 24 17:03:58.252822 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:58.252150    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cb4sr"
Jul 24 17:03:58.252822 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:58.252463    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spwhm" podUID="4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd"
Jul 24 17:03:58.252822 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:58.252535    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cb4sr" podUID="9dc126a1-da76-4146-95f2-0571132022cc"
Jul 24 17:03:58.353241 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:58.353137    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nzsz" event={"ID":"5f736e3e-403d-4b4e-a90b-af4074d659f9","Type":"ContainerStarted","Data":"33075c1e60e1fe426f82bfbd602d54f9221e77d35e63cd67b3da82d4b6e500e4"}
Jul 24 17:03:58.354523 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:58.354499    2561 generic.go:356] "Generic (PLEG): container finished" podID="14f58e54-2adc-41a3-bc18-a25736900381" containerID="492bdf7acb6f7d42c977499fbab98cc8af7c402c49c52071808bcef348de1393" exitCode=0
Jul 24 17:03:58.354603 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:58.354578    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mx4qq" event={"ID":"14f58e54-2adc-41a3-bc18-a25736900381","Type":"ContainerDied","Data":"492bdf7acb6f7d42c977499fbab98cc8af7c402c49c52071808bcef348de1393"}
Jul 24 17:03:58.355979 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:58.355949    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jvnt9" event={"ID":"7127ce91-7986-4e71-9b22-ce42a081f632","Type":"ContainerStarted","Data":"4868366ab4bc0fb324095dc414e6aeaf4c3a76bdf7c95b493550ebccb45d65ab"}
Jul 24 17:03:58.357557 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:58.357535    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qxhfq" event={"ID":"be2e4a02-b1a7-4b45-85d1-86535fb00672","Type":"ContainerStarted","Data":"a349a9103b4d41e1605c37bdb3bd0f84cd1ec1cb4167b315b19fc74fabd8c79b"}
Jul 24 17:03:58.358979 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:58.358957    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zfklt" event={"ID":"84981543-70cb-4811-b2fc-ea793ef9e2bc","Type":"ContainerStarted","Data":"f6ba6d46e970f5eef84cc8444616498b76cd1117c188f77d3ecadeb300780345"}
Jul 24 17:03:58.360418 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:58.360393    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rq942" event={"ID":"ce9e534e-4a16-4593-9bbf-689859d14bb0","Type":"ContainerStarted","Data":"82fbeb90e89279816d8498b3a8e70f116b56a5db5ccf5be8132508ecdb87f631"}
Jul 24 17:03:58.363930 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:58.363912    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6h754_860ed1fc-612f-4796-8077-72bc6c5d84db/ovn-acl-logging/0.log"
Jul 24 17:03:58.368576 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:58.368552    2561 generic.go:356] "Generic (PLEG): container finished" podID="860ed1fc-612f-4796-8077-72bc6c5d84db" containerID="bb7d239a531daa57330100bc6cde9d0af46e746001ff47131ec4d8a3f759ebcd" exitCode=1
Jul 24 17:03:58.368662 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:58.368625    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6h754" event={"ID":"860ed1fc-612f-4796-8077-72bc6c5d84db","Type":"ContainerStarted","Data":"0c22ec761ea51dbf7ff0491dece34ed99bc11fcd2b7314cd33a7b08530534e0d"}
Jul 24 17:03:58.368721 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:58.368706    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6h754" event={"ID":"860ed1fc-612f-4796-8077-72bc6c5d84db","Type":"ContainerDied","Data":"bb7d239a531daa57330100bc6cde9d0af46e746001ff47131ec4d8a3f759ebcd"}
Jul 24 17:03:58.368776 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:58.368739    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6h754" event={"ID":"860ed1fc-612f-4796-8077-72bc6c5d84db","Type":"ContainerStarted","Data":"9caac2f7ff83f12e7fbc5a1b7957ae5b9837dc67fe026d2be0229b6364a50adb"}
Jul 24 17:03:58.369958 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:58.369938    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-d7nwt" event={"ID":"d52800a2-6038-494c-b78a-28579c6898c1","Type":"ContainerStarted","Data":"fb057cf239d91e9d57ef4c30520121019da516c26ae0778ea97e56df4abb838f"}
Jul 24 17:03:58.387344 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:58.387307    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rq942" podStartSLOduration=3.688395395 podStartE2EDuration="22.387295226s" totalImagesPullingTime="18.698899831s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:03:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:03:58.387165926 +0000 UTC m=+22.660025706" watchObservedRunningTime="2026-07-24 17:03:58.387295226 +0000 UTC m=+22.660155006"
Jul 24 17:03:58.412095 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:58.412040    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jvnt9" podStartSLOduration=3.770799185 podStartE2EDuration="22.412024775s" totalImagesPullingTime="18.64122559s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:03:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:03:58.399950784 +0000 UTC m=+22.672810563" watchObservedRunningTime="2026-07-24 17:03:58.412024775 +0000 UTC m=+22.684884548"
Jul 24 17:03:58.412466 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:58.412442    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zfklt" podStartSLOduration=3.7660081229999998 podStartE2EDuration="22.412432809s" totalImagesPullingTime="18.646424686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:03:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:03:58.412010194 +0000 UTC m=+22.684869978" watchObservedRunningTime="2026-07-24 17:03:58.412432809 +0000 UTC m=+22.685292589"
Jul 24 17:03:58.424897 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:58.424879    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zfklt"
Jul 24 17:03:58.425456 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:58.425436    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zfklt"
Jul 24 17:03:58.442186 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:58.442150    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-d7nwt" podStartSLOduration=3.7206448610000002 podStartE2EDuration="22.442138145s" totalImagesPullingTime="18.721493284s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:03:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:03:58.441666168 +0000 UTC m=+22.714525977" watchObservedRunningTime="2026-07-24 17:03:58.442138145 +0000 UTC m=+22.714997925"
Jul 24 17:03:58.442436 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:58.442416    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qxhfq" podStartSLOduration=3.748165629 podStartE2EDuration="22.442411243s" totalImagesPullingTime="18.694245614s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:03:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:03:58.426806426 +0000 UTC m=+22.699666206" watchObservedRunningTime="2026-07-24 17:03:58.442411243 +0000 UTC m=+22.715271022"
Jul 24 17:03:59.252969 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:59.252909    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x9m67"
Jul 24 17:03:59.253580 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:03:59.253011    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x9m67" podUID="b20d7f4d-c9f7-4a88-9107-f52a67b5741c"
Jul 24 17:03:59.374561 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:59.374532    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6h754_860ed1fc-612f-4796-8077-72bc6c5d84db/ovn-acl-logging/0.log"
Jul 24 17:03:59.374949 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:59.374920    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6h754" event={"ID":"860ed1fc-612f-4796-8077-72bc6c5d84db","Type":"ContainerStarted","Data":"459ff763709f72b847a70e59a1b821280f4df9f9611b8a49b019705aac2e8116"}
Jul 24 17:03:59.375047 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:59.374986    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6h754" event={"ID":"860ed1fc-612f-4796-8077-72bc6c5d84db","Type":"ContainerStarted","Data":"001f50b592b9ff9b1ed5b16858393a88cbad06c5fb200bbf21d3dbed6331f10d"}
Jul 24 17:03:59.375047 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:59.375036    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6h754" event={"ID":"860ed1fc-612f-4796-8077-72bc6c5d84db","Type":"ContainerStarted","Data":"3a8799d487b2e36d7b614ff1285c1547fb669767857d814dd95f08aab87bb922"}
Jul 24 17:03:59.376296 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:59.376275    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jt6gx" event={"ID":"0e01bc14-47b5-47b0-bd9b-7f1fd11fffa9","Type":"ContainerStarted","Data":"f53848bcef4ab65a797ff1980c138e7263a90cf09f746ea2685dbb39ab06e7a5"}
Jul 24 17:03:59.376950 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:59.376929    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zfklt"
Jul 24 17:03:59.377039 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:59.376979    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zfklt"
Jul 24 17:03:59.391266 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:59.391223    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jt6gx" podStartSLOduration=4.688774556 podStartE2EDuration="23.391212533s" totalImagesPullingTime="18.702437977s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:03:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:03:59.391171639 +0000 UTC m=+23.664031418" watchObservedRunningTime="2026-07-24 17:03:59.391212533 +0000 UTC m=+23.664072313"
Jul 24 17:03:59.577630 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:03:59.577603    2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 24 17:04:00.153533 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:00.153399    2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T17:03:59.57762543Z","UUID":"bb2d6b71-3522-4864-9ad6-82ada8c3de3c","Handler":null,"Name":"","Endpoint":""}
Jul 24 17:04:00.155274 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:00.155250    2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 24 17:04:00.155411 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:00.155296    2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 24 17:04:00.252146 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:00.252116    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cb4sr"
Jul 24 17:04:00.252290 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:00.252116    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spwhm"
Jul 24 17:04:00.252369 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:04:00.252255    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cb4sr" podUID="9dc126a1-da76-4146-95f2-0571132022cc"
Jul 24 17:04:00.252369 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:04:00.252330    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spwhm" podUID="4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd"
Jul 24 17:04:00.379584 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:00.379545    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nzsz" event={"ID":"5f736e3e-403d-4b4e-a90b-af4074d659f9","Type":"ContainerStarted","Data":"f557c80fb689ac4409f527ab2fd3f71759f174cfe58387b82635ccb7dcc1a8e9"}
Jul 24 17:04:01.252421 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:01.252228    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x9m67"
Jul 24 17:04:01.252601 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:04:01.252530    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x9m67" podUID="b20d7f4d-c9f7-4a88-9107-f52a67b5741c"
Jul 24 17:04:01.383797 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:01.383756    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nzsz" event={"ID":"5f736e3e-403d-4b4e-a90b-af4074d659f9","Type":"ContainerStarted","Data":"9a3f1f0826ac512bfd2a84b67bc90bdaae9b2a474392e0b294e74d9f0e133c20"}
Jul 24 17:04:01.387599 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:01.387577    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6h754_860ed1fc-612f-4796-8077-72bc6c5d84db/ovn-acl-logging/0.log"
Jul 24 17:04:01.387948 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:01.387926    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6h754" event={"ID":"860ed1fc-612f-4796-8077-72bc6c5d84db","Type":"ContainerStarted","Data":"e5e1fb03ed6fb2b7d8f50f429b0228251d2266233569df5fd4e235001f23923f"}
Jul 24 17:04:01.401461 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:01.401420    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nzsz" podStartSLOduration=4.098739932 podStartE2EDuration="25.401407237s" totalImagesPullingTime="21.302667305s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:03:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:04:01.400167732 +0000 UTC m=+25.673027537" watchObservedRunningTime="2026-07-24 17:04:01.401407237 +0000 UTC m=+25.674267017"
Jul 24 17:04:02.253110 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:02.253078    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spwhm"
Jul 24 17:04:02.253324 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:02.253083    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cb4sr"
Jul 24 17:04:02.253324 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:04:02.253203    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spwhm" podUID="4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd"
Jul 24 17:04:02.253324 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:04:02.253299    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cb4sr" podUID="9dc126a1-da76-4146-95f2-0571132022cc"
Jul 24 17:04:03.252698 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:03.252616    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x9m67"
Jul 24 17:04:03.253259 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:04:03.252747    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x9m67" podUID="b20d7f4d-c9f7-4a88-9107-f52a67b5741c"
Jul 24 17:04:04.253076 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:04.252881    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spwhm"
Jul 24 17:04:04.253699 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:04.252917    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cb4sr"
Jul 24 17:04:04.253699 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:04:04.253161    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spwhm" podUID="4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd"
Jul 24 17:04:04.253699 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:04:04.253222    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cb4sr" podUID="9dc126a1-da76-4146-95f2-0571132022cc"
Jul 24 17:04:04.397049 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:04.396980    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6h754_860ed1fc-612f-4796-8077-72bc6c5d84db/ovn-acl-logging/0.log"
Jul 24 17:04:04.397370 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:04.397341    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6h754" event={"ID":"860ed1fc-612f-4796-8077-72bc6c5d84db","Type":"ContainerStarted","Data":"2d35513ad935dc4dfe6882fcdfe5cd4e4cfc65d484d8d1c8f431029a3b90bb67"}
Jul 24 17:04:04.397660 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:04.397635    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:04:04.397843 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:04.397826    2561 scope.go:117] "RemoveContainer" containerID="bb7d239a531daa57330100bc6cde9d0af46e746001ff47131ec4d8a3f759ebcd"
Jul 24 17:04:04.399346 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:04.399322    2561 generic.go:356] "Generic (PLEG): container finished" podID="14f58e54-2adc-41a3-bc18-a25736900381" containerID="6bfd9086fa543e9c85622f2c0af120fa5445ee8ee66dd0a3f0cde93a9a9da7b0" exitCode=0
Jul 24 17:04:04.399429 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:04.399369    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mx4qq" event={"ID":"14f58e54-2adc-41a3-bc18-a25736900381","Type":"ContainerDied","Data":"6bfd9086fa543e9c85622f2c0af120fa5445ee8ee66dd0a3f0cde93a9a9da7b0"}
Jul 24 17:04:04.415009 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:04.414991    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:04:05.252348 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:05.252318    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x9m67"
Jul 24 17:04:05.252592 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:04:05.252416    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x9m67" podUID="b20d7f4d-c9f7-4a88-9107-f52a67b5741c"
Jul 24 17:04:05.404271 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:05.404245    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6h754_860ed1fc-612f-4796-8077-72bc6c5d84db/ovn-acl-logging/0.log"
Jul 24 17:04:05.404709 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:05.404568    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6h754" event={"ID":"860ed1fc-612f-4796-8077-72bc6c5d84db","Type":"ContainerStarted","Data":"9e334f53fe3c57fbfb04ab7bc5e268b2e4509a530248c2df39478fc29661fd4d"}
Jul 24 17:04:05.404795 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:05.404769    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:04:05.404919 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:05.404907    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:04:05.419471 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:05.419448    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:04:05.432327 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:05.432292    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6h754" podStartSLOduration=10.504888376 podStartE2EDuration="29.432279078s" totalImagesPullingTime="18.927390702s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:03:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:04:05.431234148 +0000 UTC m=+29.704093949" watchObservedRunningTime="2026-07-24 17:04:05.432279078 +0000 UTC m=+29.705138858"
Jul 24 17:04:06.253149 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:06.253114    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spwhm"
Jul 24 17:04:06.253307 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:04:06.253207    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spwhm" podUID="4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd"
Jul 24 17:04:06.253307 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:06.253295    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cb4sr"
Jul 24 17:04:06.253399 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:04:06.253382    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cb4sr" podUID="9dc126a1-da76-4146-95f2-0571132022cc"
Jul 24 17:04:06.408918 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:06.408884    2561 generic.go:356] "Generic (PLEG): container finished" podID="14f58e54-2adc-41a3-bc18-a25736900381" containerID="1a9a652b0a55b301c9b40b0d652a81b3c159d8bce2c9dda6eac4f009ef95b696" exitCode=0
Jul 24 17:04:06.409293 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:06.408964    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mx4qq" event={"ID":"14f58e54-2adc-41a3-bc18-a25736900381","Type":"ContainerDied","Data":"1a9a652b0a55b301c9b40b0d652a81b3c159d8bce2c9dda6eac4f009ef95b696"}
Jul 24 17:04:07.252170 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:07.252137    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x9m67"
Jul 24 17:04:07.252344 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:04:07.252268    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x9m67" podUID="b20d7f4d-c9f7-4a88-9107-f52a67b5741c"
Jul 24 17:04:08.252188 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:08.252163    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cb4sr"
Jul 24 17:04:08.252587 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:04:08.252273    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cb4sr" podUID="9dc126a1-da76-4146-95f2-0571132022cc"
Jul 24 17:04:08.252587 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:08.252333    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spwhm"
Jul 24 17:04:08.252587 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:04:08.252443    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spwhm" podUID="4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd"
Jul 24 17:04:08.415719 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:08.415685    2561 generic.go:356] "Generic (PLEG): container finished" podID="14f58e54-2adc-41a3-bc18-a25736900381" containerID="1912ab8c026d2c112b5deaa9a67b1e853fe3c5da9c1343fb4090990733c028f8" exitCode=0
Jul 24 17:04:08.415863 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:08.415724    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mx4qq" event={"ID":"14f58e54-2adc-41a3-bc18-a25736900381","Type":"ContainerDied","Data":"1912ab8c026d2c112b5deaa9a67b1e853fe3c5da9c1343fb4090990733c028f8"}
Jul 24 17:04:09.252474 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:09.252440    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x9m67"
Jul 24 17:04:09.252865 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:04:09.252582    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x9m67" podUID="b20d7f4d-c9f7-4a88-9107-f52a67b5741c"
Jul 24 17:04:09.953308 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:09.953271    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9dc126a1-da76-4146-95f2-0571132022cc-original-pull-secret\") pod \"global-pull-secret-syncer-cb4sr\" (UID: \"9dc126a1-da76-4146-95f2-0571132022cc\") " pod="kube-system/global-pull-secret-syncer-cb4sr"
Jul 24 17:04:09.953497 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:09.953341    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b20d7f4d-c9f7-4a88-9107-f52a67b5741c-metrics-certs\") pod \"network-metrics-daemon-x9m67\" (UID: \"b20d7f4d-c9f7-4a88-9107-f52a67b5741c\") " pod="openshift-multus/network-metrics-daemon-x9m67"
Jul 24 17:04:09.953497 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:04:09.953420    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 17:04:09.953497 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:04:09.953442    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:04:09.953497 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:04:09.953485    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9dc126a1-da76-4146-95f2-0571132022cc-original-pull-secret podName:9dc126a1-da76-4146-95f2-0571132022cc nodeName:}" failed. No retries permitted until 2026-07-24 17:04:41.953466493 +0000 UTC m=+66.226326252 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9dc126a1-da76-4146-95f2-0571132022cc-original-pull-secret") pod "global-pull-secret-syncer-cb4sr" (UID: "9dc126a1-da76-4146-95f2-0571132022cc") : object "kube-system"/"original-pull-secret" not registered
Jul 24 17:04:09.953701 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:04:09.953508    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b20d7f4d-c9f7-4a88-9107-f52a67b5741c-metrics-certs podName:b20d7f4d-c9f7-4a88-9107-f52a67b5741c nodeName:}" failed. No retries permitted until 2026-07-24 17:04:41.953496535 +0000 UTC m=+66.226356297 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b20d7f4d-c9f7-4a88-9107-f52a67b5741c-metrics-certs") pod "network-metrics-daemon-x9m67" (UID: "b20d7f4d-c9f7-4a88-9107-f52a67b5741c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:04:10.054538 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:10.054503    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg9xt\" (UniqueName: \"kubernetes.io/projected/4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd-kube-api-access-tg9xt\") pod \"network-check-target-spwhm\" (UID: \"4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd\") " pod="openshift-network-diagnostics/network-check-target-spwhm"
Jul 24 17:04:10.054721 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:04:10.054632    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 17:04:10.054721 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:04:10.054647    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 17:04:10.054721 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:04:10.054655    2561 projected.go:196] Error preparing data for projected volume kube-api-access-tg9xt for pod openshift-network-diagnostics/network-check-target-spwhm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:04:10.054721 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:04:10.054703    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd-kube-api-access-tg9xt podName:4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd nodeName:}" failed. No retries permitted until 2026-07-24 17:04:42.05469026 +0000 UTC m=+66.327550031 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tg9xt" (UniqueName: "kubernetes.io/projected/4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd-kube-api-access-tg9xt") pod "network-check-target-spwhm" (UID: "4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:04:10.252841 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:10.252767    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cb4sr"
Jul 24 17:04:10.253226 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:10.252767    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spwhm"
Jul 24 17:04:10.253226 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:04:10.252877    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cb4sr" podUID="9dc126a1-da76-4146-95f2-0571132022cc"
Jul 24 17:04:10.253226 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:04:10.252961    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spwhm" podUID="4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd"
Jul 24 17:04:11.252736 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:11.252707    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x9m67"
Jul 24 17:04:11.252885 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:04:11.252817    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x9m67" podUID="b20d7f4d-c9f7-4a88-9107-f52a67b5741c"
Jul 24 17:04:12.252452 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:12.252245    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spwhm"
Jul 24 17:04:12.252629 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:12.252264    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cb4sr"
Jul 24 17:04:12.252629 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:04:12.252558    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spwhm" podUID="4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd"
Jul 24 17:04:12.252744 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:04:12.252662    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cb4sr" podUID="9dc126a1-da76-4146-95f2-0571132022cc"
Jul 24 17:04:12.639551 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:12.639514    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-spwhm"]
Jul 24 17:04:12.640158 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:12.639667    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spwhm"
Jul 24 17:04:12.640158 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:04:12.639778    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spwhm" podUID="4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd"
Jul 24 17:04:12.642817 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:12.642782    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cb4sr"]
Jul 24 17:04:12.642931 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:12.642912    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cb4sr"
Jul 24 17:04:12.643041 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:04:12.643021    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cb4sr" podUID="9dc126a1-da76-4146-95f2-0571132022cc"
Jul 24 17:04:12.643898 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:12.643725    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-x9m67"]
Jul 24 17:04:12.643898 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:12.643843    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x9m67"
Jul 24 17:04:12.644049 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:04:12.643976    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x9m67" podUID="b20d7f4d-c9f7-4a88-9107-f52a67b5741c"
Jul 24 17:04:13.429575 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:13.429493    2561 generic.go:356] "Generic (PLEG): container finished" podID="14f58e54-2adc-41a3-bc18-a25736900381" containerID="7e780ac41fdf19b21c95835ba53e2ae1974ede38f0743022030ee701569eaa36" exitCode=0
Jul 24 17:04:13.429575 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:13.429530    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mx4qq" event={"ID":"14f58e54-2adc-41a3-bc18-a25736900381","Type":"ContainerDied","Data":"7e780ac41fdf19b21c95835ba53e2ae1974ede38f0743022030ee701569eaa36"}
Jul 24 17:04:14.255614 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:14.255589    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spwhm"
Jul 24 17:04:14.256151 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:14.255684    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cb4sr"
Jul 24 17:04:14.256151 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:04:14.255688    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spwhm" podUID="4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd"
Jul 24 17:04:14.256151 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:04:14.255769    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cb4sr" podUID="9dc126a1-da76-4146-95f2-0571132022cc"
Jul 24 17:04:14.256151 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:14.255808    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x9m67"
Jul 24 17:04:14.256151 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:04:14.255875    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x9m67" podUID="b20d7f4d-c9f7-4a88-9107-f52a67b5741c"
Jul 24 17:04:14.434884 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:14.434847    2561 generic.go:356] "Generic (PLEG): container finished" podID="14f58e54-2adc-41a3-bc18-a25736900381" containerID="04f5f4bf0cea7fd08c45759631a7fe1c7c028a6e91d80504ff110d9c3ce968ec" exitCode=0
Jul 24 17:04:14.435023 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:14.434916    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mx4qq" event={"ID":"14f58e54-2adc-41a3-bc18-a25736900381","Type":"ContainerDied","Data":"04f5f4bf0cea7fd08c45759631a7fe1c7c028a6e91d80504ff110d9c3ce968ec"}
Jul 24 17:04:15.440659 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:15.440431    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mx4qq" event={"ID":"14f58e54-2adc-41a3-bc18-a25736900381","Type":"ContainerStarted","Data":"829052454d77d4059c5bf7e57fb9556bcbe1dbf529da3d18c544ec285e534544"}
Jul 24 17:04:15.462538 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:15.462496    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mx4qq" podStartSLOduration=9.134856745 podStartE2EDuration="39.462482446s" totalImagesPullingTime="30.327625701s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:03:36 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:04:15.462204677 +0000 UTC m=+39.735064457" watchObservedRunningTime="2026-07-24 17:04:15.462482446 +0000 UTC m=+39.735342225"
Jul 24 17:04:16.253147 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.253118    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x9m67"
Jul 24 17:04:16.253313 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:04:16.253201    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x9m67" podUID="b20d7f4d-c9f7-4a88-9107-f52a67b5741c"
Jul 24 17:04:16.253313 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.253217    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cb4sr"
Jul 24 17:04:16.253313 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.253243    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spwhm"
Jul 24 17:04:16.253409 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:04:16.253313    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cb4sr" podUID="9dc126a1-da76-4146-95f2-0571132022cc"
Jul 24 17:04:16.253409 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:04:16.253360    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spwhm" podUID="4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd"
Jul 24 17:04:16.602981 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.602912    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-137.ec2.internal" event="NodeReady"
Jul 24 17:04:16.603439 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.603038    2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 24 17:04:16.655398 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.655370    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lrxjp"]
Jul 24 17:04:16.680846 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.680822    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mqrd4"]
Jul 24 17:04:16.680980 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.680961    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lrxjp"
Jul 24 17:04:16.683472 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.683442    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 24 17:04:16.683573 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.683482    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 24 17:04:16.683644 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.683626    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 24 17:04:16.683700 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.683651    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 24 17:04:16.683700 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.683651    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bh4kl\""
Jul 24 17:04:16.700962 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.700935    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lrxjp"]
Jul 24 17:04:16.701085 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.700979    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mqrd4"]
Jul 24 17:04:16.701085 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.700999    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qm622"]
Jul 24 17:04:16.701085 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.701044    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mqrd4"
Jul 24 17:04:16.703331 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.703311    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 24 17:04:16.703437 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.703350    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 24 17:04:16.703437 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.703317    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gnbfc\""
Jul 24 17:04:16.715883 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.715863    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dd5047c6-18d1-42cd-9b00-0b86a9b075e8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lrxjp\" (UID: \"dd5047c6-18d1-42cd-9b00-0b86a9b075e8\") " pod="openshift-insights/insights-runtime-extractor-lrxjp"
Jul 24 17:04:16.715967 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.715886    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f4a7c818-7b8a-4e56-9daf-1bbef23e5556-config-volume\") pod \"dns-default-mqrd4\" (UID: \"f4a7c818-7b8a-4e56-9daf-1bbef23e5556\") " pod="openshift-dns/dns-default-mqrd4"
Jul 24 17:04:16.715967 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.715905    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ph9j\" (UniqueName: \"kubernetes.io/projected/dd5047c6-18d1-42cd-9b00-0b86a9b075e8-kube-api-access-9ph9j\") pod \"insights-runtime-extractor-lrxjp\" (UID: \"dd5047c6-18d1-42cd-9b00-0b86a9b075e8\") " pod="openshift-insights/insights-runtime-extractor-lrxjp"
Jul 24 17:04:16.715967 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.715922    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4a7c818-7b8a-4e56-9daf-1bbef23e5556-tmp-dir\") pod \"dns-default-mqrd4\" (UID: \"f4a7c818-7b8a-4e56-9daf-1bbef23e5556\") " pod="openshift-dns/dns-default-mqrd4"
Jul 24 17:04:16.715967 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.715940    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24dzk\" (UniqueName: \"kubernetes.io/projected/f4a7c818-7b8a-4e56-9daf-1bbef23e5556-kube-api-access-24dzk\") pod \"dns-default-mqrd4\" (UID: \"f4a7c818-7b8a-4e56-9daf-1bbef23e5556\") " pod="openshift-dns/dns-default-mqrd4"
Jul 24 17:04:16.716117 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.716024    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dd5047c6-18d1-42cd-9b00-0b86a9b075e8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lrxjp\" (UID: \"dd5047c6-18d1-42cd-9b00-0b86a9b075e8\") " pod="openshift-insights/insights-runtime-extractor-lrxjp"
Jul 24 17:04:16.716117 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.716058    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dd5047c6-18d1-42cd-9b00-0b86a9b075e8-crio-socket\") pod \"insights-runtime-extractor-lrxjp\" (UID: \"dd5047c6-18d1-42cd-9b00-0b86a9b075e8\") " pod="openshift-insights/insights-runtime-extractor-lrxjp"
Jul 24 17:04:16.716117 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.716093    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f4a7c818-7b8a-4e56-9daf-1bbef23e5556-metrics-tls\") pod \"dns-default-mqrd4\" (UID: \"f4a7c818-7b8a-4e56-9daf-1bbef23e5556\") " pod="openshift-dns/dns-default-mqrd4"
Jul 24 17:04:16.716214 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.716122    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dd5047c6-18d1-42cd-9b00-0b86a9b075e8-data-volume\") pod \"insights-runtime-extractor-lrxjp\" (UID: \"dd5047c6-18d1-42cd-9b00-0b86a9b075e8\") " pod="openshift-insights/insights-runtime-extractor-lrxjp"
Jul 24 17:04:16.723138 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.723121    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qm622"]
Jul 24 17:04:16.723266 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.723191    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qm622"
Jul 24 17:04:16.725601 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.725581    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 24 17:04:16.725686 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.725581    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 24 17:04:16.725686 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.725590    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ln2rz\""
Jul 24 17:04:16.725686 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.725631    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 24 17:04:16.817252 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.817227    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dd5047c6-18d1-42cd-9b00-0b86a9b075e8-crio-socket\") pod \"insights-runtime-extractor-lrxjp\" (UID: \"dd5047c6-18d1-42cd-9b00-0b86a9b075e8\") " pod="openshift-insights/insights-runtime-extractor-lrxjp"
Jul 24 17:04:16.817252 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.817253    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f4a7c818-7b8a-4e56-9daf-1bbef23e5556-metrics-tls\") pod \"dns-default-mqrd4\" (UID: \"f4a7c818-7b8a-4e56-9daf-1bbef23e5556\") " pod="openshift-dns/dns-default-mqrd4"
Jul 24 17:04:16.817425 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.817284    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dd5047c6-18d1-42cd-9b00-0b86a9b075e8-data-volume\") pod \"insights-runtime-extractor-lrxjp\" (UID: \"dd5047c6-18d1-42cd-9b00-0b86a9b075e8\") " pod="openshift-insights/insights-runtime-extractor-lrxjp"
Jul 24 17:04:16.817425 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.817330    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/347e062f-f8e0-42fa-8cb6-c2f264d2c099-cert\") pod \"ingress-canary-qm622\" (UID: \"347e062f-f8e0-42fa-8cb6-c2f264d2c099\") " pod="openshift-ingress-canary/ingress-canary-qm622"
Jul 24 17:04:16.817425 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.817371    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dd5047c6-18d1-42cd-9b00-0b86a9b075e8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lrxjp\" (UID: \"dd5047c6-18d1-42cd-9b00-0b86a9b075e8\") " pod="openshift-insights/insights-runtime-extractor-lrxjp"
Jul 24 17:04:16.817425 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.817395    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f4a7c818-7b8a-4e56-9daf-1bbef23e5556-config-volume\") pod \"dns-default-mqrd4\" (UID: \"f4a7c818-7b8a-4e56-9daf-1bbef23e5556\") " pod="openshift-dns/dns-default-mqrd4"
Jul 24 17:04:16.817613 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.817432    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ph9j\" (UniqueName: \"kubernetes.io/projected/dd5047c6-18d1-42cd-9b00-0b86a9b075e8-kube-api-access-9ph9j\") pod \"insights-runtime-extractor-lrxjp\" (UID: \"dd5047c6-18d1-42cd-9b00-0b86a9b075e8\") " pod="openshift-insights/insights-runtime-extractor-lrxjp"
Jul 24 17:04:16.817613 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.817458    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dd5047c6-18d1-42cd-9b00-0b86a9b075e8-crio-socket\") pod \"insights-runtime-extractor-lrxjp\" (UID: \"dd5047c6-18d1-42cd-9b00-0b86a9b075e8\") " pod="openshift-insights/insights-runtime-extractor-lrxjp"
Jul 24 17:04:16.817613 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.817463    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4a7c818-7b8a-4e56-9daf-1bbef23e5556-tmp-dir\") pod \"dns-default-mqrd4\" (UID: \"f4a7c818-7b8a-4e56-9daf-1bbef23e5556\") " pod="openshift-dns/dns-default-mqrd4"
Jul 24 17:04:16.817613 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.817514    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24dzk\" (UniqueName: \"kubernetes.io/projected/f4a7c818-7b8a-4e56-9daf-1bbef23e5556-kube-api-access-24dzk\") pod \"dns-default-mqrd4\" (UID: \"f4a7c818-7b8a-4e56-9daf-1bbef23e5556\") " pod="openshift-dns/dns-default-mqrd4"
Jul 24 17:04:16.817613 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.817543    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66hbl\" (UniqueName: \"kubernetes.io/projected/347e062f-f8e0-42fa-8cb6-c2f264d2c099-kube-api-access-66hbl\") pod \"ingress-canary-qm622\" (UID: \"347e062f-f8e0-42fa-8cb6-c2f264d2c099\") " pod="openshift-ingress-canary/ingress-canary-qm622"
Jul 24 17:04:16.817613 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.817598    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dd5047c6-18d1-42cd-9b00-0b86a9b075e8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lrxjp\" (UID: \"dd5047c6-18d1-42cd-9b00-0b86a9b075e8\") " pod="openshift-insights/insights-runtime-extractor-lrxjp"
Jul 24 17:04:16.817896 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.817664    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dd5047c6-18d1-42cd-9b00-0b86a9b075e8-data-volume\") pod \"insights-runtime-extractor-lrxjp\" (UID: \"dd5047c6-18d1-42cd-9b00-0b86a9b075e8\") " pod="openshift-insights/insights-runtime-extractor-lrxjp"
Jul 24 17:04:16.817953 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.817922    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4a7c818-7b8a-4e56-9daf-1bbef23e5556-tmp-dir\") pod \"dns-default-mqrd4\" (UID: \"f4a7c818-7b8a-4e56-9daf-1bbef23e5556\") " pod="openshift-dns/dns-default-mqrd4"
Jul 24 17:04:16.818038 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.818017    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f4a7c818-7b8a-4e56-9daf-1bbef23e5556-config-volume\") pod \"dns-default-mqrd4\" (UID: \"f4a7c818-7b8a-4e56-9daf-1bbef23e5556\") " pod="openshift-dns/dns-default-mqrd4"
Jul 24 17:04:16.818160 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.818144    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dd5047c6-18d1-42cd-9b00-0b86a9b075e8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lrxjp\" (UID: \"dd5047c6-18d1-42cd-9b00-0b86a9b075e8\") " pod="openshift-insights/insights-runtime-extractor-lrxjp"
Jul 24 17:04:16.822353 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.822329    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f4a7c818-7b8a-4e56-9daf-1bbef23e5556-metrics-tls\") pod \"dns-default-mqrd4\" (UID: \"f4a7c818-7b8a-4e56-9daf-1bbef23e5556\") " pod="openshift-dns/dns-default-mqrd4"
Jul 24 17:04:16.822443 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.822333    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dd5047c6-18d1-42cd-9b00-0b86a9b075e8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lrxjp\" (UID: \"dd5047c6-18d1-42cd-9b00-0b86a9b075e8\") " pod="openshift-insights/insights-runtime-extractor-lrxjp"
Jul 24 17:04:16.824444 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.824424    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24dzk\" (UniqueName: \"kubernetes.io/projected/f4a7c818-7b8a-4e56-9daf-1bbef23e5556-kube-api-access-24dzk\") pod \"dns-default-mqrd4\" (UID: \"f4a7c818-7b8a-4e56-9daf-1bbef23e5556\") " pod="openshift-dns/dns-default-mqrd4"
Jul 24 17:04:16.824596 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.824578    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ph9j\" (UniqueName: \"kubernetes.io/projected/dd5047c6-18d1-42cd-9b00-0b86a9b075e8-kube-api-access-9ph9j\") pod \"insights-runtime-extractor-lrxjp\" (UID: \"dd5047c6-18d1-42cd-9b00-0b86a9b075e8\") " pod="openshift-insights/insights-runtime-extractor-lrxjp"
Jul 24 17:04:16.918808 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.918737    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/347e062f-f8e0-42fa-8cb6-c2f264d2c099-cert\") pod \"ingress-canary-qm622\" (UID: \"347e062f-f8e0-42fa-8cb6-c2f264d2c099\") " pod="openshift-ingress-canary/ingress-canary-qm622"
Jul 24 17:04:16.918808 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.918781    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66hbl\" (UniqueName: \"kubernetes.io/projected/347e062f-f8e0-42fa-8cb6-c2f264d2c099-kube-api-access-66hbl\") pod \"ingress-canary-qm622\" (UID: \"347e062f-f8e0-42fa-8cb6-c2f264d2c099\") " pod="openshift-ingress-canary/ingress-canary-qm622"
Jul 24 17:04:16.921007 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.920989    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/347e062f-f8e0-42fa-8cb6-c2f264d2c099-cert\") pod \"ingress-canary-qm622\" (UID: \"347e062f-f8e0-42fa-8cb6-c2f264d2c099\") " pod="openshift-ingress-canary/ingress-canary-qm622"
Jul 24 17:04:16.926759 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.926741    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66hbl\" (UniqueName: \"kubernetes.io/projected/347e062f-f8e0-42fa-8cb6-c2f264d2c099-kube-api-access-66hbl\") pod \"ingress-canary-qm622\" (UID: \"347e062f-f8e0-42fa-8cb6-c2f264d2c099\") " pod="openshift-ingress-canary/ingress-canary-qm622"
Jul 24 17:04:16.990103 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:16.990085    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lrxjp"
Jul 24 17:04:17.008283 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:17.008264    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mqrd4"
Jul 24 17:04:17.031564 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:17.031546    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qm622"
Jul 24 17:04:17.224219 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:17.224191    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lrxjp"]
Jul 24 17:04:17.227660 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:04:17.227639    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd5047c6_18d1_42cd_9b00_0b86a9b075e8.slice/crio-b71a55bb2e4cf23e1494561f71e02e0a999515ff9203df4fec9c72aa52ca867a WatchSource:0}: Error finding container b71a55bb2e4cf23e1494561f71e02e0a999515ff9203df4fec9c72aa52ca867a: Status 404 returned error can't find the container with id b71a55bb2e4cf23e1494561f71e02e0a999515ff9203df4fec9c72aa52ca867a
Jul 24 17:04:17.441085 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:17.441006    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qm622"]
Jul 24 17:04:17.444238 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:17.444217    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mqrd4"]
Jul 24 17:04:17.444750 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:04:17.444725    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod347e062f_f8e0_42fa_8cb6_c2f264d2c099.slice/crio-7be434c9b3103830346f7bbee764d6f83384cec9b575fece998d2327f543b21d WatchSource:0}: Error finding container 7be434c9b3103830346f7bbee764d6f83384cec9b575fece998d2327f543b21d: Status 404 returned error can't find the container with id 7be434c9b3103830346f7bbee764d6f83384cec9b575fece998d2327f543b21d
Jul 24 17:04:17.446292 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:17.446270    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lrxjp" event={"ID":"dd5047c6-18d1-42cd-9b00-0b86a9b075e8","Type":"ContainerStarted","Data":"b71a55bb2e4cf23e1494561f71e02e0a999515ff9203df4fec9c72aa52ca867a"}
Jul 24 17:04:17.447926 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:04:17.447907    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4a7c818_7b8a_4e56_9daf_1bbef23e5556.slice/crio-907085a1a9562890ac3e88928213aad47947967a867c3d5e2b64538ecbec3903 WatchSource:0}: Error finding container 907085a1a9562890ac3e88928213aad47947967a867c3d5e2b64538ecbec3903: Status 404 returned error can't find the container with id 907085a1a9562890ac3e88928213aad47947967a867c3d5e2b64538ecbec3903
Jul 24 17:04:18.253458 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:18.252766    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spwhm"
Jul 24 17:04:18.253458 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:18.252766    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cb4sr"
Jul 24 17:04:18.253458 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:18.252910    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x9m67"
Jul 24 17:04:18.257844 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:18.257820    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 17:04:18.258141 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:18.258124    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lpvrb\""
Jul 24 17:04:18.258347 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:18.258323    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 17:04:18.258601 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:18.258582    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 17:04:18.258902 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:18.258700    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f7d7c\""
Jul 24 17:04:18.258902 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:18.258784    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 17:04:18.450908 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:18.450820    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qm622" event={"ID":"347e062f-f8e0-42fa-8cb6-c2f264d2c099","Type":"ContainerStarted","Data":"7be434c9b3103830346f7bbee764d6f83384cec9b575fece998d2327f543b21d"}
Jul 24 17:04:18.452479 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:18.452416    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mqrd4" event={"ID":"f4a7c818-7b8a-4e56-9daf-1bbef23e5556","Type":"ContainerStarted","Data":"907085a1a9562890ac3e88928213aad47947967a867c3d5e2b64538ecbec3903"}
Jul 24 17:04:20.008267 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:20.008236    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-kmsz8"]
Jul 24 17:04:20.025156 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:20.024201    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-kmsz8"]
Jul 24 17:04:20.025156 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:20.024331    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-kmsz8"
Jul 24 17:04:20.026730 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:20.026708    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 24 17:04:20.026852 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:20.026731    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-rts9g\""
Jul 24 17:04:20.147367 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:20.147331    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4765bb82-e6fb-44d5-b082-863d36c33ab8-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-kmsz8\" (UID: \"4765bb82-e6fb-44d5-b082-863d36c33ab8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-kmsz8"
Jul 24 17:04:20.247869 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:20.247830    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4765bb82-e6fb-44d5-b082-863d36c33ab8-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-kmsz8\" (UID: \"4765bb82-e6fb-44d5-b082-863d36c33ab8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-kmsz8"
Jul 24 17:04:20.248059 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:04:20.247991    2561 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 24 17:04:20.248059 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:04:20.248077    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4765bb82-e6fb-44d5-b082-863d36c33ab8-tls-certificates podName:4765bb82-e6fb-44d5-b082-863d36c33ab8 nodeName:}" failed. No retries permitted until 2026-07-24 17:04:20.748043665 +0000 UTC m=+45.020903423 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/4765bb82-e6fb-44d5-b082-863d36c33ab8-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-kmsz8" (UID: "4765bb82-e6fb-44d5-b082-863d36c33ab8") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 24 17:04:20.448340 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:20.448312    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56b99dcc7f-8t7ms"]
Jul 24 17:04:20.460325 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:20.460297    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56b99dcc7f-8t7ms"]
Jul 24 17:04:20.460459 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:20.460381    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56b99dcc7f-8t7ms"
Jul 24 17:04:20.462877 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:20.462854    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 24 17:04:20.463000 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:20.462894    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 24 17:04:20.463000 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:20.462919    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 24 17:04:20.463727 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:20.463706    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 24 17:04:20.463829 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:20.463768    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 24 17:04:20.463829 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:20.463714    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 24 17:04:20.463953 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:20.463825    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-b99bk\""
Jul 24 17:04:20.463953 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:20.463931    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 24 17:04:20.467548 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:20.467529    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 24 17:04:20.549822 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:20.549798    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/19766bb7-37d5-4fd4-a463-20fd7a7f89d7-service-ca\") pod \"console-56b99dcc7f-8t7ms\" (UID: \"19766bb7-37d5-4fd4-a463-20fd7a7f89d7\") " pod="openshift-console/console-56b99dcc7f-8t7ms"
Jul 24 17:04:20.549983 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:20.549825    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19766bb7-37d5-4fd4-a463-20fd7a7f89d7-trusted-ca-bundle\") pod \"console-56b99dcc7f-8t7ms\" (UID: \"19766bb7-37d5-4fd4-a463-20fd7a7f89d7\") " pod="openshift-console/console-56b99dcc7f-8t7ms"
Jul 24 17:04:20.549983 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:20.549844    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/19766bb7-37d5-4fd4-a463-20fd7a7f89d7-oauth-serving-cert\") pod \"console-56b99dcc7f-8t7ms\" (UID: \"19766bb7-37d5-4fd4-a463-20fd7a7f89d7\") " pod="openshift-console/console-56b99dcc7f-8t7ms"
Jul 24 17:04:20.549983 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:20.549882    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/19766bb7-37d5-4fd4-a463-20fd7a7f89d7-console-config\") pod \"console-56b99dcc7f-8t7ms\" (UID: \"19766bb7-37d5-4fd4-a463-20fd7a7f89d7\") " pod="openshift-console/console-56b99dcc7f-8t7ms"
Jul 24 17:04:20.549983 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:20.549957    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ss22\" (UniqueName: \"kubernetes.io/projected/19766bb7-37d5-4fd4-a463-20fd7a7f89d7-kube-api-access-7ss22\") pod \"console-56b99dcc7f-8t7ms\" (UID: \"19766bb7-37d5-4fd4-a463-20fd7a7f89d7\") " pod="openshift-console/console-56b99dcc7f-8t7ms"
Jul 24 17:04:20.550190 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:20.550028    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/19766bb7-37d5-4fd4-a463-20fd7a7f89d7-console-serving-cert\") pod \"console-56b99dcc7f-8t7ms\" (UID: \"19766bb7-37d5-4fd4-a463-20fd7a7f89d7\") " pod="openshift-console/console-56b99dcc7f-8t7ms"
Jul 24 17:04:20.550190 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:20.550056    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/19766bb7-37d5-4fd4-a463-20fd7a7f89d7-console-oauth-config\") pod \"console-56b99dcc7f-8t7ms\" (UID: \"19766bb7-37d5-4fd4-a463-20fd7a7f89d7\") " pod="openshift-console/console-56b99dcc7f-8t7ms"
Jul 24 17:04:20.651463 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:20.651434    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/19766bb7-37d5-4fd4-a463-20fd7a7f89d7-service-ca\") pod \"console-56b99dcc7f-8t7ms\" (UID: \"19766bb7-37d5-4fd4-a463-20fd7a7f89d7\") " pod="openshift-console/console-56b99dcc7f-8t7ms"
Jul 24 17:04:20.651463 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:20.651465    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19766bb7-37d5-4fd4-a463-20fd7a7f89d7-trusted-ca-bundle\") pod \"console-56b99dcc7f-8t7ms\" (UID: \"19766bb7-37d5-4fd4-a463-20fd7a7f89d7\") " pod="openshift-console/console-56b99dcc7f-8t7ms"
Jul 24 17:04:20.651680 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:20.651482    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/19766bb7-37d5-4fd4-a463-20fd7a7f89d7-oauth-serving-cert\") pod \"console-56b99dcc7f-8t7ms\" (UID: \"19766bb7-37d5-4fd4-a463-20fd7a7f89d7\") " pod="openshift-console/console-56b99dcc7f-8t7ms"
Jul 24 17:04:20.651680 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:20.651522    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/19766bb7-37d5-4fd4-a463-20fd7a7f89d7-console-config\") pod \"console-56b99dcc7f-8t7ms\" (UID: \"19766bb7-37d5-4fd4-a463-20fd7a7f89d7\") " pod="openshift-console/console-56b99dcc7f-8t7ms"
Jul 24 17:04:20.651680 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:20.651561    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ss22\" (UniqueName: \"kubernetes.io/projected/19766bb7-37d5-4fd4-a463-20fd7a7f89d7-kube-api-access-7ss22\") pod \"console-56b99dcc7f-8t7ms\" (UID: \"19766bb7-37d5-4fd4-a463-20fd7a7f89d7\") " pod="openshift-console/console-56b99dcc7f-8t7ms"
Jul 24 17:04:20.651680 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:20.651618    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/19766bb7-37d5-4fd4-a463-20fd7a7f89d7-console-serving-cert\") pod \"console-56b99dcc7f-8t7ms\" (UID: \"19766bb7-37d5-4fd4-a463-20fd7a7f89d7\") " pod="openshift-console/console-56b99dcc7f-8t7ms"
Jul 24 17:04:20.651680 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:20.651644    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/19766bb7-37d5-4fd4-a463-20fd7a7f89d7-console-oauth-config\") pod \"console-56b99dcc7f-8t7ms\" (UID: \"19766bb7-37d5-4fd4-a463-20fd7a7f89d7\") " pod="openshift-console/console-56b99dcc7f-8t7ms"
Jul 24 17:04:20.652341 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:20.652318    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/19766bb7-37d5-4fd4-a463-20fd7a7f89d7-service-ca\") pod \"console-56b99dcc7f-8t7ms\" (UID: \"19766bb7-37d5-4fd4-a463-20fd7a7f89d7\") " pod="openshift-console/console-56b99dcc7f-8t7ms"
Jul 24 17:04:20.652454 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:20.652433    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/19766bb7-37d5-4fd4-a463-20fd7a7f89d7-oauth-serving-cert\") pod \"console-56b99dcc7f-8t7ms\" (UID: \"19766bb7-37d5-4fd4-a463-20fd7a7f89d7\") " pod="openshift-console/console-56b99dcc7f-8t7ms"
Jul 24 17:04:20.652574 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:20.652554    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19766bb7-37d5-4fd4-a463-20fd7a7f89d7-trusted-ca-bundle\") pod \"console-56b99dcc7f-8t7ms\" (UID: \"19766bb7-37d5-4fd4-a463-20fd7a7f89d7\") " pod="openshift-console/console-56b99dcc7f-8t7ms"
Jul 24 17:04:20.652655 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:20.652632    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/19766bb7-37d5-4fd4-a463-20fd7a7f89d7-console-config\") pod \"console-56b99dcc7f-8t7ms\" (UID: \"19766bb7-37d5-4fd4-a463-20fd7a7f89d7\") " pod="openshift-console/console-56b99dcc7f-8t7ms"
Jul 24 17:04:20.654092 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:20.654054    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/19766bb7-37d5-4fd4-a463-20fd7a7f89d7-console-oauth-config\") pod \"console-56b99dcc7f-8t7ms\" (UID: \"19766bb7-37d5-4fd4-a463-20fd7a7f89d7\") " pod="openshift-console/console-56b99dcc7f-8t7ms"
Jul 24 17:04:20.654280 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:20.654260    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/19766bb7-37d5-4fd4-a463-20fd7a7f89d7-console-serving-cert\") pod \"console-56b99dcc7f-8t7ms\" (UID: \"19766bb7-37d5-4fd4-a463-20fd7a7f89d7\") " pod="openshift-console/console-56b99dcc7f-8t7ms"
Jul 24 17:04:20.660396 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:20.660375    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ss22\" (UniqueName: \"kubernetes.io/projected/19766bb7-37d5-4fd4-a463-20fd7a7f89d7-kube-api-access-7ss22\") pod \"console-56b99dcc7f-8t7ms\" (UID: \"19766bb7-37d5-4fd4-a463-20fd7a7f89d7\") " pod="openshift-console/console-56b99dcc7f-8t7ms"
Jul 24 17:04:20.752897 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:20.752812    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4765bb82-e6fb-44d5-b082-863d36c33ab8-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-kmsz8\" (UID: \"4765bb82-e6fb-44d5-b082-863d36c33ab8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-kmsz8"
Jul 24 17:04:20.755541 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:20.755513    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4765bb82-e6fb-44d5-b082-863d36c33ab8-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-kmsz8\" (UID: \"4765bb82-e6fb-44d5-b082-863d36c33ab8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-kmsz8"
Jul 24 17:04:20.769359 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:20.769328    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56b99dcc7f-8t7ms"
Jul 24 17:04:20.936399 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:20.936359    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-kmsz8"
Jul 24 17:04:24.116225 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:24.116159    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-kmsz8"]
Jul 24 17:04:24.136942 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:24.136920    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56b99dcc7f-8t7ms"]
Jul 24 17:04:24.139840 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:04:24.139819    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19766bb7_37d5_4fd4_a463_20fd7a7f89d7.slice/crio-bf276c1286a6eca5a9c635218f2e641d197b7b361278bfa835b050c76c26a100 WatchSource:0}: Error finding container bf276c1286a6eca5a9c635218f2e641d197b7b361278bfa835b050c76c26a100: Status 404 returned error can't find the container with id bf276c1286a6eca5a9c635218f2e641d197b7b361278bfa835b050c76c26a100
Jul 24 17:04:24.468914 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:24.468883    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56b99dcc7f-8t7ms" event={"ID":"19766bb7-37d5-4fd4-a463-20fd7a7f89d7","Type":"ContainerStarted","Data":"bf276c1286a6eca5a9c635218f2e641d197b7b361278bfa835b050c76c26a100"}
Jul 24 17:04:24.470442 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:24.470411    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mqrd4" event={"ID":"f4a7c818-7b8a-4e56-9daf-1bbef23e5556","Type":"ContainerStarted","Data":"3dd08a7988a5dce2f47cda51e093421e38f729c69092e4368c7adca0d1e0a144"}
Jul 24 17:04:24.470566 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:24.470463    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mqrd4" event={"ID":"f4a7c818-7b8a-4e56-9daf-1bbef23e5556","Type":"ContainerStarted","Data":"f40cf9fa69736143411f0063fe803954319f90f30b843148ac157e1036dcf209"}
Jul 24 17:04:24.470566 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:24.470532    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mqrd4"
Jul 24 17:04:24.471808 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:24.471788    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qm622" event={"ID":"347e062f-f8e0-42fa-8cb6-c2f264d2c099","Type":"ContainerStarted","Data":"e1c57adc99c49ef753b227ff2c55271d2eda56f01780bd5778a6fbe4f8569dad"}
Jul 24 17:04:24.472879 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:24.472862    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-kmsz8" event={"ID":"4765bb82-e6fb-44d5-b082-863d36c33ab8","Type":"ContainerStarted","Data":"596bacb47a6433c757b792673a5917fc23eb67708f16346d585a30e44b253a2c"}
Jul 24 17:04:24.486394 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:24.486355    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-mqrd4" podStartSLOduration=1.9511207750000001 podStartE2EDuration="8.486341579s" totalImagesPullingTime="6.535220804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:04:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:04:24.48579844 +0000 UTC m=+48.758658240" watchObservedRunningTime="2026-07-24 17:04:24.486341579 +0000 UTC m=+48.759201356"
Jul 24 17:04:24.500117 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:24.500047    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qm622" podStartSLOduration=1.960836445 podStartE2EDuration="8.500029231s" totalImagesPullingTime="6.539192786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:04:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:04:24.499480633 +0000 UTC m=+48.772340415" watchObservedRunningTime="2026-07-24 17:04:24.500029231 +0000 UTC m=+48.772888993"
Jul 24 17:04:25.478402 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:25.478367    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lrxjp" event={"ID":"dd5047c6-18d1-42cd-9b00-0b86a9b075e8","Type":"ContainerStarted","Data":"a1e15388fec30ef2c3fdb251d858743545bffd735c3ee1cbf50b797ce1af93a9"}
Jul 24 17:04:30.493831 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:30.493795    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-kmsz8" event={"ID":"4765bb82-e6fb-44d5-b082-863d36c33ab8","Type":"ContainerStarted","Data":"7768b60ffe2ef4464ff7ff49e5d278a63f0e1ed9dccb546bed354e24e5c5d24c"}
Jul 24 17:04:30.494298 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:30.493953    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-kmsz8"
Jul 24 17:04:30.495538 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:30.495508    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56b99dcc7f-8t7ms" event={"ID":"19766bb7-37d5-4fd4-a463-20fd7a7f89d7","Type":"ContainerStarted","Data":"c4f3e3ee36603461e6fcc16d286d2030a10c1a27dbbdf1d15f512ee074f350b4"}
Jul 24 17:04:30.497296 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:30.497275    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lrxjp" event={"ID":"dd5047c6-18d1-42cd-9b00-0b86a9b075e8","Type":"ContainerStarted","Data":"838a2e9253ad890b2654b00513d97a2c4e164a50663181eafc552985356be9a9"}
Jul 24 17:04:30.498872 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:30.498849    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-kmsz8"
Jul 24 17:04:30.507831 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:30.507795    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-kmsz8" podStartSLOduration=5.6099028109999995 podStartE2EDuration="11.507784968s" totalImagesPullingTime="5.897882157s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:04:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:04:30.506982053 +0000 UTC m=+54.779841864" watchObservedRunningTime="2026-07-24 17:04:30.507784968 +0000 UTC m=+54.780644748"
Jul 24 17:04:30.537951 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:30.537911    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56b99dcc7f-8t7ms" podStartSLOduration=4.65485713 podStartE2EDuration="10.537899811s" totalImagesPullingTime="5.883042681s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:04:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:04:30.536607313 +0000 UTC m=+54.809467111" watchObservedRunningTime="2026-07-24 17:04:30.537899811 +0000 UTC m=+54.810759591"
Jul 24 17:04:30.770310 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:30.770273    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56b99dcc7f-8t7ms"
Jul 24 17:04:30.770473 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:30.770331    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56b99dcc7f-8t7ms"
Jul 24 17:04:30.771587 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:30.771564    2561 patch_prober.go:28] interesting pod/console-56b99dcc7f-8t7ms container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.10:8443/health\": dial tcp 10.134.0.10:8443: connect: connection refused" start-of-body=
Jul 24 17:04:30.771642 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:30.771611    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-56b99dcc7f-8t7ms" podUID="19766bb7-37d5-4fd4-a463-20fd7a7f89d7" containerName="console" probeResult="failure" output="Get \"https://10.134.0.10:8443/health\": dial tcp 10.134.0.10:8443: connect: connection refused"
Jul 24 17:04:34.480920 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:34.480887    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mqrd4"
Jul 24 17:04:34.513356 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:34.513328    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lrxjp" event={"ID":"dd5047c6-18d1-42cd-9b00-0b86a9b075e8","Type":"ContainerStarted","Data":"f480ee04f592a8747ddfe55c6bac61f6f989190502ffa6489e343676cffbe9f8"}
Jul 24 17:04:34.529345 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:34.529287    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lrxjp" podStartSLOduration=2.147536804 podStartE2EDuration="18.529268133s" totalImagesPullingTime="16.381731329s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:04:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:04:34.528989228 +0000 UTC m=+58.801849029" watchObservedRunningTime="2026-07-24 17:04:34.529268133 +0000 UTC m=+58.802127914"
Jul 24 17:04:36.384771 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.384739    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-lzn9g"]
Jul 24 17:04:36.392904 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.392883    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lzn9g"
Jul 24 17:04:36.395234 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.395212    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 24 17:04:36.396024 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.396003    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 24 17:04:36.396178 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.396027    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 24 17:04:36.396178 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.396003    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 24 17:04:36.396178 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.396004    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 24 17:04:36.396178 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.396123    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-k6nln\""
Jul 24 17:04:36.397758 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.397714    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-lzn9g"]
Jul 24 17:04:36.434956 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.434926    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vvs5h"]
Jul 24 17:04:36.440490 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.440462    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vvs5h"
Jul 24 17:04:36.442688 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.442661    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 24 17:04:36.442776 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.442765    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 24 17:04:36.442856 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.442767    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 24 17:04:36.443004 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.442992    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-x7dbk\""
Jul 24 17:04:36.476615 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.476585    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1703ffc-11b3-4490-b19a-25d45846e879-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-lzn9g\" (UID: \"f1703ffc-11b3-4490-b19a-25d45846e879\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lzn9g"
Jul 24 17:04:36.476730 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.476623    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1703ffc-11b3-4490-b19a-25d45846e879-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-lzn9g\" (UID: \"f1703ffc-11b3-4490-b19a-25d45846e879\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lzn9g"
Jul 24 17:04:36.476730 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.476716    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1703ffc-11b3-4490-b19a-25d45846e879-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-lzn9g\" (UID: \"f1703ffc-11b3-4490-b19a-25d45846e879\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lzn9g"
Jul 24 17:04:36.476843 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.476770    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvcvt\" (UniqueName: \"kubernetes.io/projected/f1703ffc-11b3-4490-b19a-25d45846e879-kube-api-access-qvcvt\") pod \"openshift-state-metrics-b8f49f5c6-lzn9g\" (UID: \"f1703ffc-11b3-4490-b19a-25d45846e879\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lzn9g"
Jul 24 17:04:36.578053 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.578026    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bc9558a6-efd8-46c7-a5e2-807aca327889-node-exporter-wtmp\") pod \"node-exporter-vvs5h\" (UID: \"bc9558a6-efd8-46c7-a5e2-807aca327889\") " pod="openshift-monitoring/node-exporter-vvs5h"
Jul 24 17:04:36.578216 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.578082    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1703ffc-11b3-4490-b19a-25d45846e879-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-lzn9g\" (UID: \"f1703ffc-11b3-4490-b19a-25d45846e879\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lzn9g"
Jul 24 17:04:36.578216 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.578127    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc9558a6-efd8-46c7-a5e2-807aca327889-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vvs5h\" (UID: \"bc9558a6-efd8-46c7-a5e2-807aca327889\") " pod="openshift-monitoring/node-exporter-vvs5h"
Jul 24 17:04:36.578216 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.578171    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1703ffc-11b3-4490-b19a-25d45846e879-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-lzn9g\" (UID: \"f1703ffc-11b3-4490-b19a-25d45846e879\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lzn9g"
Jul 24 17:04:36.578216 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.578205    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc9558a6-efd8-46c7-a5e2-807aca327889-metrics-client-ca\") pod \"node-exporter-vvs5h\" (UID: \"bc9558a6-efd8-46c7-a5e2-807aca327889\") " pod="openshift-monitoring/node-exporter-vvs5h"
Jul 24 17:04:36.578356 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.578238    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bc9558a6-efd8-46c7-a5e2-807aca327889-node-exporter-tls\") pod \"node-exporter-vvs5h\" (UID: \"bc9558a6-efd8-46c7-a5e2-807aca327889\") " pod="openshift-monitoring/node-exporter-vvs5h"
Jul 24 17:04:36.578356 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.578264    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bc9558a6-efd8-46c7-a5e2-807aca327889-node-exporter-accelerators-collector-config\") pod \"node-exporter-vvs5h\" (UID: \"bc9558a6-efd8-46c7-a5e2-807aca327889\") " pod="openshift-monitoring/node-exporter-vvs5h"
Jul 24 17:04:36.578356 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.578306    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bc9558a6-efd8-46c7-a5e2-807aca327889-root\") pod \"node-exporter-vvs5h\" (UID: \"bc9558a6-efd8-46c7-a5e2-807aca327889\") " pod="openshift-monitoring/node-exporter-vvs5h"
Jul 24 17:04:36.578356 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.578339    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1703ffc-11b3-4490-b19a-25d45846e879-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-lzn9g\" (UID: \"f1703ffc-11b3-4490-b19a-25d45846e879\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lzn9g"
Jul 24 17:04:36.578503 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.578389    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bc9558a6-efd8-46c7-a5e2-807aca327889-node-exporter-textfile\") pod \"node-exporter-vvs5h\" (UID: \"bc9558a6-efd8-46c7-a5e2-807aca327889\") " pod="openshift-monitoring/node-exporter-vvs5h"
Jul 24 17:04:36.578503 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:04:36.578406    2561 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 24 17:04:36.578503 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.578438    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc9558a6-efd8-46c7-a5e2-807aca327889-sys\") pod \"node-exporter-vvs5h\" (UID: \"bc9558a6-efd8-46c7-a5e2-807aca327889\") " pod="openshift-monitoring/node-exporter-vvs5h"
Jul 24 17:04:36.578503 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:04:36.578467    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1703ffc-11b3-4490-b19a-25d45846e879-openshift-state-metrics-tls podName:f1703ffc-11b3-4490-b19a-25d45846e879 nodeName:}" failed. No retries permitted until 2026-07-24 17:04:37.078449993 +0000 UTC m=+61.351309752 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/f1703ffc-11b3-4490-b19a-25d45846e879-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-lzn9g" (UID: "f1703ffc-11b3-4490-b19a-25d45846e879") : secret "openshift-state-metrics-tls" not found
Jul 24 17:04:36.578649 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.578562    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvhwb\" (UniqueName: \"kubernetes.io/projected/bc9558a6-efd8-46c7-a5e2-807aca327889-kube-api-access-jvhwb\") pod \"node-exporter-vvs5h\" (UID: \"bc9558a6-efd8-46c7-a5e2-807aca327889\") " pod="openshift-monitoring/node-exporter-vvs5h"
Jul 24 17:04:36.578649 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.578601    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvcvt\" (UniqueName: \"kubernetes.io/projected/f1703ffc-11b3-4490-b19a-25d45846e879-kube-api-access-qvcvt\") pod \"openshift-state-metrics-b8f49f5c6-lzn9g\" (UID: \"f1703ffc-11b3-4490-b19a-25d45846e879\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lzn9g"
Jul 24 17:04:36.578779 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.578755    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1703ffc-11b3-4490-b19a-25d45846e879-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-lzn9g\" (UID: \"f1703ffc-11b3-4490-b19a-25d45846e879\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lzn9g"
Jul 24 17:04:36.580621 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.580602    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1703ffc-11b3-4490-b19a-25d45846e879-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-lzn9g\" (UID: \"f1703ffc-11b3-4490-b19a-25d45846e879\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lzn9g"
Jul 24 17:04:36.587971 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.587945    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvcvt\" (UniqueName: \"kubernetes.io/projected/f1703ffc-11b3-4490-b19a-25d45846e879-kube-api-access-qvcvt\") pod \"openshift-state-metrics-b8f49f5c6-lzn9g\" (UID: \"f1703ffc-11b3-4490-b19a-25d45846e879\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lzn9g"
Jul 24 17:04:36.679788 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.679714    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bc9558a6-efd8-46c7-a5e2-807aca327889-node-exporter-tls\") pod \"node-exporter-vvs5h\" (UID: \"bc9558a6-efd8-46c7-a5e2-807aca327889\") " pod="openshift-monitoring/node-exporter-vvs5h"
Jul 24 17:04:36.679788 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.679747    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bc9558a6-efd8-46c7-a5e2-807aca327889-node-exporter-accelerators-collector-config\") pod \"node-exporter-vvs5h\" (UID: \"bc9558a6-efd8-46c7-a5e2-807aca327889\") " pod="openshift-monitoring/node-exporter-vvs5h"
Jul 24 17:04:36.679788 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.679765    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bc9558a6-efd8-46c7-a5e2-807aca327889-root\") pod \"node-exporter-vvs5h\" (UID: \"bc9558a6-efd8-46c7-a5e2-807aca327889\") " pod="openshift-monitoring/node-exporter-vvs5h"
Jul 24 17:04:36.680030 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.679846    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bc9558a6-efd8-46c7-a5e2-807aca327889-root\") pod \"node-exporter-vvs5h\" (UID: \"bc9558a6-efd8-46c7-a5e2-807aca327889\") " pod="openshift-monitoring/node-exporter-vvs5h"
Jul 24 17:04:36.680030 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.679882    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bc9558a6-efd8-46c7-a5e2-807aca327889-node-exporter-textfile\") pod \"node-exporter-vvs5h\" (UID: \"bc9558a6-efd8-46c7-a5e2-807aca327889\") " pod="openshift-monitoring/node-exporter-vvs5h"
Jul 24 17:04:36.680030 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.679917    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc9558a6-efd8-46c7-a5e2-807aca327889-sys\") pod \"node-exporter-vvs5h\" (UID: \"bc9558a6-efd8-46c7-a5e2-807aca327889\") " pod="openshift-monitoring/node-exporter-vvs5h"
Jul 24 17:04:36.680030 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.679946    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvhwb\" (UniqueName: \"kubernetes.io/projected/bc9558a6-efd8-46c7-a5e2-807aca327889-kube-api-access-jvhwb\") pod \"node-exporter-vvs5h\" (UID: \"bc9558a6-efd8-46c7-a5e2-807aca327889\") " pod="openshift-monitoring/node-exporter-vvs5h"
Jul 24 17:04:36.680030 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:04:36.679950    2561 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 24 17:04:36.680030 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:04:36.680008    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc9558a6-efd8-46c7-a5e2-807aca327889-node-exporter-tls podName:bc9558a6-efd8-46c7-a5e2-807aca327889 nodeName:}" failed. No retries permitted until 2026-07-24 17:04:37.179989725 +0000 UTC m=+61.452849501 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/bc9558a6-efd8-46c7-a5e2-807aca327889-node-exporter-tls") pod "node-exporter-vvs5h" (UID: "bc9558a6-efd8-46c7-a5e2-807aca327889") : secret "node-exporter-tls" not found
Jul 24 17:04:36.680030 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.680019    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc9558a6-efd8-46c7-a5e2-807aca327889-sys\") pod \"node-exporter-vvs5h\" (UID: \"bc9558a6-efd8-46c7-a5e2-807aca327889\") " pod="openshift-monitoring/node-exporter-vvs5h"
Jul 24 17:04:36.680433 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.680100    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bc9558a6-efd8-46c7-a5e2-807aca327889-node-exporter-wtmp\") pod \"node-exporter-vvs5h\" (UID: \"bc9558a6-efd8-46c7-a5e2-807aca327889\") " pod="openshift-monitoring/node-exporter-vvs5h"
Jul 24 17:04:36.680433 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.680171    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc9558a6-efd8-46c7-a5e2-807aca327889-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vvs5h\" (UID: \"bc9558a6-efd8-46c7-a5e2-807aca327889\") " pod="openshift-monitoring/node-exporter-vvs5h"
Jul 24 17:04:36.680433 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.680233    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc9558a6-efd8-46c7-a5e2-807aca327889-metrics-client-ca\") pod \"node-exporter-vvs5h\" (UID: \"bc9558a6-efd8-46c7-a5e2-807aca327889\") " pod="openshift-monitoring/node-exporter-vvs5h"
Jul 24 17:04:36.680433 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.680299    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bc9558a6-efd8-46c7-a5e2-807aca327889-node-exporter-textfile\") pod \"node-exporter-vvs5h\" (UID: \"bc9558a6-efd8-46c7-a5e2-807aca327889\") " pod="openshift-monitoring/node-exporter-vvs5h"
Jul 24 17:04:36.680433 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.680347    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bc9558a6-efd8-46c7-a5e2-807aca327889-node-exporter-wtmp\") pod \"node-exporter-vvs5h\" (UID: \"bc9558a6-efd8-46c7-a5e2-807aca327889\") " pod="openshift-monitoring/node-exporter-vvs5h"
Jul 24 17:04:36.680433 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.680398    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bc9558a6-efd8-46c7-a5e2-807aca327889-node-exporter-accelerators-collector-config\") pod \"node-exporter-vvs5h\" (UID: \"bc9558a6-efd8-46c7-a5e2-807aca327889\") " pod="openshift-monitoring/node-exporter-vvs5h"
Jul 24 17:04:36.680648 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.680630    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc9558a6-efd8-46c7-a5e2-807aca327889-metrics-client-ca\") pod \"node-exporter-vvs5h\" (UID: \"bc9558a6-efd8-46c7-a5e2-807aca327889\") " pod="openshift-monitoring/node-exporter-vvs5h"
Jul 24 17:04:36.682332 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.682311    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc9558a6-efd8-46c7-a5e2-807aca327889-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vvs5h\" (UID: \"bc9558a6-efd8-46c7-a5e2-807aca327889\") " pod="openshift-monitoring/node-exporter-vvs5h"
Jul 24 17:04:36.688024 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:36.688001    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvhwb\" (UniqueName: \"kubernetes.io/projected/bc9558a6-efd8-46c7-a5e2-807aca327889-kube-api-access-jvhwb\") pod \"node-exporter-vvs5h\" (UID: \"bc9558a6-efd8-46c7-a5e2-807aca327889\") " pod="openshift-monitoring/node-exporter-vvs5h"
Jul 24 17:04:37.084861 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:37.084783    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1703ffc-11b3-4490-b19a-25d45846e879-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-lzn9g\" (UID: \"f1703ffc-11b3-4490-b19a-25d45846e879\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lzn9g"
Jul 24 17:04:37.087111 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:37.087088    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1703ffc-11b3-4490-b19a-25d45846e879-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-lzn9g\" (UID: \"f1703ffc-11b3-4490-b19a-25d45846e879\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lzn9g"
Jul 24 17:04:37.185230 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:37.185199    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bc9558a6-efd8-46c7-a5e2-807aca327889-node-exporter-tls\") pod \"node-exporter-vvs5h\" (UID: \"bc9558a6-efd8-46c7-a5e2-807aca327889\") " pod="openshift-monitoring/node-exporter-vvs5h"
Jul 24 17:04:37.187314 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:37.187298    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bc9558a6-efd8-46c7-a5e2-807aca327889-node-exporter-tls\") pod \"node-exporter-vvs5h\" (UID: \"bc9558a6-efd8-46c7-a5e2-807aca327889\") " pod="openshift-monitoring/node-exporter-vvs5h"
Jul 24 17:04:37.302386 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:37.302348    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lzn9g"
Jul 24 17:04:37.349170 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:37.349146    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vvs5h"
Jul 24 17:04:37.377162 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:04:37.377134    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc9558a6_efd8_46c7_a5e2_807aca327889.slice/crio-a196ac6a0671742f1ae6cf123ffdbee89f3745a17706c4105f257ae12f0a42a6 WatchSource:0}: Error finding container a196ac6a0671742f1ae6cf123ffdbee89f3745a17706c4105f257ae12f0a42a6: Status 404 returned error can't find the container with id a196ac6a0671742f1ae6cf123ffdbee89f3745a17706c4105f257ae12f0a42a6
Jul 24 17:04:37.423976 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:37.423942    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6h754"
Jul 24 17:04:37.457457 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:37.457407    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-lzn9g"]
Jul 24 17:04:37.460758 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:04:37.460736    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1703ffc_11b3_4490_b19a_25d45846e879.slice/crio-6ba820a14ecae09977e8c279f1f3c154342d69a5246af1325d633d35013ac901 WatchSource:0}: Error finding container 6ba820a14ecae09977e8c279f1f3c154342d69a5246af1325d633d35013ac901: Status 404 returned error can't find the container with id 6ba820a14ecae09977e8c279f1f3c154342d69a5246af1325d633d35013ac901
Jul 24 17:04:37.524307 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:37.524279    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lzn9g" event={"ID":"f1703ffc-11b3-4490-b19a-25d45846e879","Type":"ContainerStarted","Data":"6ba820a14ecae09977e8c279f1f3c154342d69a5246af1325d633d35013ac901"}
Jul 24 17:04:37.525311 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:37.525279    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vvs5h" event={"ID":"bc9558a6-efd8-46c7-a5e2-807aca327889","Type":"ContainerStarted","Data":"a196ac6a0671742f1ae6cf123ffdbee89f3745a17706c4105f257ae12f0a42a6"}
Jul 24 17:04:38.531343 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:38.531302    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lzn9g" event={"ID":"f1703ffc-11b3-4490-b19a-25d45846e879","Type":"ContainerStarted","Data":"7090b6ac76f8bd8ef01f35bdcb3450a39a08f48435cac68c93bf116387fb5cff"}
Jul 24 17:04:38.531817 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:38.531377    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lzn9g" event={"ID":"f1703ffc-11b3-4490-b19a-25d45846e879","Type":"ContainerStarted","Data":"7e1f7c75149d5b5512f0ff788aa44e4cad2e3feb54d9f0d1f7a8b91a95141f95"}
Jul 24 17:04:39.392904 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:39.392874    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-65668b444c-5xnm9"]
Jul 24 17:04:39.395237 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:39.395220    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-65668b444c-5xnm9"
Jul 24 17:04:39.397473 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:39.397425    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 24 17:04:39.397473 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:39.397445    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 24 17:04:39.397672 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:39.397463    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-18sipl8odqjub\""
Jul 24 17:04:39.397672 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:39.397571    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-c6mm9\""
Jul 24 17:04:39.397672 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:39.397653    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 24 17:04:39.397828 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:39.397758    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 24 17:04:39.397828 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:39.397809    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 24 17:04:39.407118 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:39.407097    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-65668b444c-5xnm9"]
Jul 24 17:04:39.503698 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:39.503667    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5292d7ba-a5f5-4e59-8f81-a53625204204-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-65668b444c-5xnm9\" (UID: \"5292d7ba-a5f5-4e59-8f81-a53625204204\") " pod="openshift-monitoring/thanos-querier-65668b444c-5xnm9"
Jul 24 17:04:39.503698 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:39.503700    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5292d7ba-a5f5-4e59-8f81-a53625204204-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-65668b444c-5xnm9\" (UID: \"5292d7ba-a5f5-4e59-8f81-a53625204204\") " pod="openshift-monitoring/thanos-querier-65668b444c-5xnm9"
Jul 24 17:04:39.503897 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:39.503734    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkqr9\" (UniqueName: \"kubernetes.io/projected/5292d7ba-a5f5-4e59-8f81-a53625204204-kube-api-access-hkqr9\") pod \"thanos-querier-65668b444c-5xnm9\" (UID: \"5292d7ba-a5f5-4e59-8f81-a53625204204\") " pod="openshift-monitoring/thanos-querier-65668b444c-5xnm9"
Jul 24 17:04:39.503897 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:39.503751    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5292d7ba-a5f5-4e59-8f81-a53625204204-secret-thanos-querier-tls\") pod \"thanos-querier-65668b444c-5xnm9\" (UID: \"5292d7ba-a5f5-4e59-8f81-a53625204204\") " pod="openshift-monitoring/thanos-querier-65668b444c-5xnm9"
Jul 24 17:04:39.503897 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:39.503809    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5292d7ba-a5f5-4e59-8f81-a53625204204-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-65668b444c-5xnm9\" (UID: \"5292d7ba-a5f5-4e59-8f81-a53625204204\") " pod="openshift-monitoring/thanos-querier-65668b444c-5xnm9"
Jul 24 17:04:39.503897 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:39.503838    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5292d7ba-a5f5-4e59-8f81-a53625204204-metrics-client-ca\") pod \"thanos-querier-65668b444c-5xnm9\" (UID: \"5292d7ba-a5f5-4e59-8f81-a53625204204\") " pod="openshift-monitoring/thanos-querier-65668b444c-5xnm9"
Jul 24 17:04:39.503897 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:39.503863    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5292d7ba-a5f5-4e59-8f81-a53625204204-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-65668b444c-5xnm9\" (UID: \"5292d7ba-a5f5-4e59-8f81-a53625204204\") " pod="openshift-monitoring/thanos-querier-65668b444c-5xnm9"
Jul 24 17:04:39.503897 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:39.503882    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5292d7ba-a5f5-4e59-8f81-a53625204204-secret-grpc-tls\") pod \"thanos-querier-65668b444c-5xnm9\" (UID: \"5292d7ba-a5f5-4e59-8f81-a53625204204\") " pod="openshift-monitoring/thanos-querier-65668b444c-5xnm9"
Jul 24 17:04:39.536830 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:39.536800    2561 generic.go:356] "Generic (PLEG): container finished" podID="bc9558a6-efd8-46c7-a5e2-807aca327889" containerID="bc863ae3bc16276a8cd7afdde70995182baef7c897f6c41c37078bcd732e5bfd" exitCode=0
Jul 24 17:04:39.537207 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:39.536889    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vvs5h" event={"ID":"bc9558a6-efd8-46c7-a5e2-807aca327889","Type":"ContainerDied","Data":"bc863ae3bc16276a8cd7afdde70995182baef7c897f6c41c37078bcd732e5bfd"}
Jul 24 17:04:39.539003 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:39.538976    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lzn9g" event={"ID":"f1703ffc-11b3-4490-b19a-25d45846e879","Type":"ContainerStarted","Data":"3bd30ca08258525db07b985b9e873fc0e265d028a72f5485fd32a6d0d5d4f986"}
Jul 24 17:04:39.573661 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:39.573617    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lzn9g" podStartSLOduration=2.60158947 podStartE2EDuration="3.573603608s" totalImagesPullingTime="972.014138ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:04:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:04:39.57332526 +0000 UTC m=+63.846185057" watchObservedRunningTime="2026-07-24 17:04:39.573603608 +0000 UTC m=+63.846463388"
Jul 24 17:04:39.604766 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:39.604744    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5292d7ba-a5f5-4e59-8f81-a53625204204-secret-thanos-querier-tls\") pod \"thanos-querier-65668b444c-5xnm9\" (UID: \"5292d7ba-a5f5-4e59-8f81-a53625204204\") " pod="openshift-monitoring/thanos-querier-65668b444c-5xnm9"
Jul 24 17:04:39.604870 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:39.604817    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5292d7ba-a5f5-4e59-8f81-a53625204204-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-65668b444c-5xnm9\" (UID: \"5292d7ba-a5f5-4e59-8f81-a53625204204\") " pod="openshift-monitoring/thanos-querier-65668b444c-5xnm9"
Jul 24 17:04:39.604993 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:39.604964    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5292d7ba-a5f5-4e59-8f81-a53625204204-metrics-client-ca\") pod \"thanos-querier-65668b444c-5xnm9\" (UID: \"5292d7ba-a5f5-4e59-8f81-a53625204204\") " pod="openshift-monitoring/thanos-querier-65668b444c-5xnm9"
Jul 24 17:04:39.605145 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:39.605041    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5292d7ba-a5f5-4e59-8f81-a53625204204-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-65668b444c-5xnm9\" (UID: \"5292d7ba-a5f5-4e59-8f81-a53625204204\") " pod="openshift-monitoring/thanos-querier-65668b444c-5xnm9"
Jul 24 17:04:39.605145 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:39.605093    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5292d7ba-a5f5-4e59-8f81-a53625204204-secret-grpc-tls\") pod \"thanos-querier-65668b444c-5xnm9\" (UID: \"5292d7ba-a5f5-4e59-8f81-a53625204204\") " pod="openshift-monitoring/thanos-querier-65668b444c-5xnm9"
Jul 24 17:04:39.605285 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:39.605226    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5292d7ba-a5f5-4e59-8f81-a53625204204-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-65668b444c-5xnm9\" (UID: \"5292d7ba-a5f5-4e59-8f81-a53625204204\") " pod="openshift-monitoring/thanos-querier-65668b444c-5xnm9"
Jul 24 17:04:39.605285 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:39.605258    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5292d7ba-a5f5-4e59-8f81-a53625204204-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-65668b444c-5xnm9\" (UID: \"5292d7ba-a5f5-4e59-8f81-a53625204204\") " pod="openshift-monitoring/thanos-querier-65668b444c-5xnm9"
Jul 24 17:04:39.605662 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:39.605639    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkqr9\" (UniqueName: \"kubernetes.io/projected/5292d7ba-a5f5-4e59-8f81-a53625204204-kube-api-access-hkqr9\") pod \"thanos-querier-65668b444c-5xnm9\" (UID: \"5292d7ba-a5f5-4e59-8f81-a53625204204\") " pod="openshift-monitoring/thanos-querier-65668b444c-5xnm9"
Jul 24 17:04:39.606020 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:39.605992    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5292d7ba-a5f5-4e59-8f81-a53625204204-metrics-client-ca\") pod \"thanos-querier-65668b444c-5xnm9\" (UID: \"5292d7ba-a5f5-4e59-8f81-a53625204204\") " pod="openshift-monitoring/thanos-querier-65668b444c-5xnm9"
Jul 24 17:04:39.607712 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:39.607685    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5292d7ba-a5f5-4e59-8f81-a53625204204-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-65668b444c-5xnm9\" (UID: \"5292d7ba-a5f5-4e59-8f81-a53625204204\") " pod="openshift-monitoring/thanos-querier-65668b444c-5xnm9"
Jul 24 17:04:39.608029 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:39.607876    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5292d7ba-a5f5-4e59-8f81-a53625204204-secret-grpc-tls\") pod \"thanos-querier-65668b444c-5xnm9\" (UID: \"5292d7ba-a5f5-4e59-8f81-a53625204204\") " pod="openshift-monitoring/thanos-querier-65668b444c-5xnm9"
Jul 24 17:04:39.608447 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:39.608425    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5292d7ba-a5f5-4e59-8f81-a53625204204-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-65668b444c-5xnm9\" (UID: \"5292d7ba-a5f5-4e59-8f81-a53625204204\") " pod="openshift-monitoring/thanos-querier-65668b444c-5xnm9"
Jul 24 17:04:39.608773 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:39.608750    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5292d7ba-a5f5-4e59-8f81-a53625204204-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-65668b444c-5xnm9\" (UID: \"5292d7ba-a5f5-4e59-8f81-a53625204204\") " pod="openshift-monitoring/thanos-querier-65668b444c-5xnm9"
Jul 24 17:04:39.608809 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:39.608797    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5292d7ba-a5f5-4e59-8f81-a53625204204-secret-thanos-querier-tls\") pod \"thanos-querier-65668b444c-5xnm9\" (UID: \"5292d7ba-a5f5-4e59-8f81-a53625204204\") " pod="openshift-monitoring/thanos-querier-65668b444c-5xnm9"
Jul 24 17:04:39.609403 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:39.609377    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5292d7ba-a5f5-4e59-8f81-a53625204204-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-65668b444c-5xnm9\" (UID: \"5292d7ba-a5f5-4e59-8f81-a53625204204\") " pod="openshift-monitoring/thanos-querier-65668b444c-5xnm9"
Jul 24 17:04:39.613634 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:39.613615    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkqr9\" (UniqueName: \"kubernetes.io/projected/5292d7ba-a5f5-4e59-8f81-a53625204204-kube-api-access-hkqr9\") pod \"thanos-querier-65668b444c-5xnm9\" (UID: \"5292d7ba-a5f5-4e59-8f81-a53625204204\") " pod="openshift-monitoring/thanos-querier-65668b444c-5xnm9"
Jul 24 17:04:39.703828 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:39.703794    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-65668b444c-5xnm9"
Jul 24 17:04:39.830694 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:39.830671    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-65668b444c-5xnm9"]
Jul 24 17:04:39.832803 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:04:39.832778    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5292d7ba_a5f5_4e59_8f81_a53625204204.slice/crio-a208649abc545ffd75ef99cf6bf2d60c56f2c26e4447c7e5f925f93e7dfcb8d9 WatchSource:0}: Error finding container a208649abc545ffd75ef99cf6bf2d60c56f2c26e4447c7e5f925f93e7dfcb8d9: Status 404 returned error can't find the container with id a208649abc545ffd75ef99cf6bf2d60c56f2c26e4447c7e5f925f93e7dfcb8d9
Jul 24 17:04:40.543488 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:40.543453    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-65668b444c-5xnm9" event={"ID":"5292d7ba-a5f5-4e59-8f81-a53625204204","Type":"ContainerStarted","Data":"a208649abc545ffd75ef99cf6bf2d60c56f2c26e4447c7e5f925f93e7dfcb8d9"}
Jul 24 17:04:40.545505 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:40.545475    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vvs5h" event={"ID":"bc9558a6-efd8-46c7-a5e2-807aca327889","Type":"ContainerStarted","Data":"ffcb2220d50e4ea2bd33de761bb1d6c4e3c33eb285870e75e431822f1fba74bc"}
Jul 24 17:04:40.545636 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:40.545524    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vvs5h" event={"ID":"bc9558a6-efd8-46c7-a5e2-807aca327889","Type":"ContainerStarted","Data":"82e6b74ac6b2a664ee895b178badfa83c772a7eaddd9ababde7543176b2f99aa"}
Jul 24 17:04:40.581097 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:40.581027    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vvs5h" podStartSLOduration=3.316714104 podStartE2EDuration="4.581007957s" totalImagesPullingTime="1.199149684s" totalInitContainerRuntime="65.144169ms" isStatefulPod=true podCreationTimestamp="2026-07-24 17:04:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:04:40.580211668 +0000 UTC m=+64.853071461" watchObservedRunningTime="2026-07-24 17:04:40.581007957 +0000 UTC m=+64.853867738"
Jul 24 17:04:40.756385 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:40.756350    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5cb8c7df6c-5xvcw"]
Jul 24 17:04:40.758598 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:40.758565    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5cb8c7df6c-5xvcw"
Jul 24 17:04:40.763514 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:40.763493    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 24 17:04:40.763908 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:40.763825    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-32s8mqtfuvl3m\""
Jul 24 17:04:40.763908 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:40.763893    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 24 17:04:40.764054 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:40.763892    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-t67bf\""
Jul 24 17:04:40.765271 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:40.765251    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 24 17:04:40.769501 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:40.769481    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 24 17:04:40.773892 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:40.773869    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56b99dcc7f-8t7ms"
Jul 24 17:04:40.779123 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:40.779101    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56b99dcc7f-8t7ms"
Jul 24 17:04:40.786234 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:40.786206    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5cb8c7df6c-5xvcw"]
Jul 24 17:04:40.918425 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:40.918394    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f3a1a2e0-45c5-4e2a-891e-5bfb77e0290c-secret-metrics-server-tls\") pod \"metrics-server-5cb8c7df6c-5xvcw\" (UID: \"f3a1a2e0-45c5-4e2a-891e-5bfb77e0290c\") " pod="openshift-monitoring/metrics-server-5cb8c7df6c-5xvcw"
Jul 24 17:04:40.918583 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:40.918462    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f3a1a2e0-45c5-4e2a-891e-5bfb77e0290c-client-ca-bundle\") pod \"metrics-server-5cb8c7df6c-5xvcw\" (UID: \"f3a1a2e0-45c5-4e2a-891e-5bfb77e0290c\") " pod="openshift-monitoring/metrics-server-5cb8c7df6c-5xvcw"
Jul 24 17:04:40.918583 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:40.918553    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f3a1a2e0-45c5-4e2a-891e-5bfb77e0290c-audit-log\") pod \"metrics-server-5cb8c7df6c-5xvcw\" (UID: \"f3a1a2e0-45c5-4e2a-891e-5bfb77e0290c\") " pod="openshift-monitoring/metrics-server-5cb8c7df6c-5xvcw"
Jul 24 17:04:40.918704 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:40.918592    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdlkj\" (UniqueName: \"kubernetes.io/projected/f3a1a2e0-45c5-4e2a-891e-5bfb77e0290c-kube-api-access-xdlkj\") pod \"metrics-server-5cb8c7df6c-5xvcw\" (UID: \"f3a1a2e0-45c5-4e2a-891e-5bfb77e0290c\") " pod="openshift-monitoring/metrics-server-5cb8c7df6c-5xvcw"
Jul 24 17:04:40.918704 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:40.918692    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a1a2e0-45c5-4e2a-891e-5bfb77e0290c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5cb8c7df6c-5xvcw\" (UID: \"f3a1a2e0-45c5-4e2a-891e-5bfb77e0290c\") " pod="openshift-monitoring/metrics-server-5cb8c7df6c-5xvcw"
Jul 24 17:04:40.918800 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:40.918769    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f3a1a2e0-45c5-4e2a-891e-5bfb77e0290c-secret-metrics-server-client-certs\") pod \"metrics-server-5cb8c7df6c-5xvcw\" (UID: \"f3a1a2e0-45c5-4e2a-891e-5bfb77e0290c\") " pod="openshift-monitoring/metrics-server-5cb8c7df6c-5xvcw"
Jul 24 17:04:40.918867 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:40.918837    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f3a1a2e0-45c5-4e2a-891e-5bfb77e0290c-metrics-server-audit-profiles\") pod \"metrics-server-5cb8c7df6c-5xvcw\" (UID: \"f3a1a2e0-45c5-4e2a-891e-5bfb77e0290c\") " pod="openshift-monitoring/metrics-server-5cb8c7df6c-5xvcw"
Jul 24 17:04:41.020133 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.020098    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f3a1a2e0-45c5-4e2a-891e-5bfb77e0290c-client-ca-bundle\") pod \"metrics-server-5cb8c7df6c-5xvcw\" (UID: \"f3a1a2e0-45c5-4e2a-891e-5bfb77e0290c\") " pod="openshift-monitoring/metrics-server-5cb8c7df6c-5xvcw"
Jul 24 17:04:41.020294 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.020265    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f3a1a2e0-45c5-4e2a-891e-5bfb77e0290c-audit-log\") pod \"metrics-server-5cb8c7df6c-5xvcw\" (UID: \"f3a1a2e0-45c5-4e2a-891e-5bfb77e0290c\") " pod="openshift-monitoring/metrics-server-5cb8c7df6c-5xvcw"
Jul 24 17:04:41.020350 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.020308    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdlkj\" (UniqueName: \"kubernetes.io/projected/f3a1a2e0-45c5-4e2a-891e-5bfb77e0290c-kube-api-access-xdlkj\") pod \"metrics-server-5cb8c7df6c-5xvcw\" (UID: \"f3a1a2e0-45c5-4e2a-891e-5bfb77e0290c\") " pod="openshift-monitoring/metrics-server-5cb8c7df6c-5xvcw"
Jul 24 17:04:41.020401 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.020363    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a1a2e0-45c5-4e2a-891e-5bfb77e0290c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5cb8c7df6c-5xvcw\" (UID: \"f3a1a2e0-45c5-4e2a-891e-5bfb77e0290c\") " pod="openshift-monitoring/metrics-server-5cb8c7df6c-5xvcw"
Jul 24 17:04:41.020401 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.020387    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f3a1a2e0-45c5-4e2a-891e-5bfb77e0290c-secret-metrics-server-client-certs\") pod \"metrics-server-5cb8c7df6c-5xvcw\" (UID: \"f3a1a2e0-45c5-4e2a-891e-5bfb77e0290c\") " pod="openshift-monitoring/metrics-server-5cb8c7df6c-5xvcw"
Jul 24 17:04:41.020490 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.020436    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f3a1a2e0-45c5-4e2a-891e-5bfb77e0290c-metrics-server-audit-profiles\") pod \"metrics-server-5cb8c7df6c-5xvcw\" (UID: \"f3a1a2e0-45c5-4e2a-891e-5bfb77e0290c\") " pod="openshift-monitoring/metrics-server-5cb8c7df6c-5xvcw"
Jul 24 17:04:41.020490 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.020468    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f3a1a2e0-45c5-4e2a-891e-5bfb77e0290c-secret-metrics-server-tls\") pod \"metrics-server-5cb8c7df6c-5xvcw\" (UID: \"f3a1a2e0-45c5-4e2a-891e-5bfb77e0290c\") " pod="openshift-monitoring/metrics-server-5cb8c7df6c-5xvcw"
Jul 24 17:04:41.020761 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.020724    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f3a1a2e0-45c5-4e2a-891e-5bfb77e0290c-audit-log\") pod \"metrics-server-5cb8c7df6c-5xvcw\" (UID: \"f3a1a2e0-45c5-4e2a-891e-5bfb77e0290c\") " pod="openshift-monitoring/metrics-server-5cb8c7df6c-5xvcw"
Jul 24 17:04:41.021124 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.021097    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a1a2e0-45c5-4e2a-891e-5bfb77e0290c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5cb8c7df6c-5xvcw\" (UID: \"f3a1a2e0-45c5-4e2a-891e-5bfb77e0290c\") " pod="openshift-monitoring/metrics-server-5cb8c7df6c-5xvcw"
Jul 24 17:04:41.021585 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.021558    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f3a1a2e0-45c5-4e2a-891e-5bfb77e0290c-metrics-server-audit-profiles\") pod \"metrics-server-5cb8c7df6c-5xvcw\" (UID: \"f3a1a2e0-45c5-4e2a-891e-5bfb77e0290c\") " pod="openshift-monitoring/metrics-server-5cb8c7df6c-5xvcw"
Jul 24 17:04:41.022982 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.022960    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f3a1a2e0-45c5-4e2a-891e-5bfb77e0290c-client-ca-bundle\") pod \"metrics-server-5cb8c7df6c-5xvcw\" (UID: \"f3a1a2e0-45c5-4e2a-891e-5bfb77e0290c\") " pod="openshift-monitoring/metrics-server-5cb8c7df6c-5xvcw"
Jul 24 17:04:41.023208 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.023184    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f3a1a2e0-45c5-4e2a-891e-5bfb77e0290c-secret-metrics-server-tls\") pod \"metrics-server-5cb8c7df6c-5xvcw\" (UID: \"f3a1a2e0-45c5-4e2a-891e-5bfb77e0290c\") " pod="openshift-monitoring/metrics-server-5cb8c7df6c-5xvcw"
Jul 24 17:04:41.023337 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.023215    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f3a1a2e0-45c5-4e2a-891e-5bfb77e0290c-secret-metrics-server-client-certs\") pod \"metrics-server-5cb8c7df6c-5xvcw\" (UID: \"f3a1a2e0-45c5-4e2a-891e-5bfb77e0290c\") " pod="openshift-monitoring/metrics-server-5cb8c7df6c-5xvcw"
Jul 24 17:04:41.027811 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.027791    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdlkj\" (UniqueName: \"kubernetes.io/projected/f3a1a2e0-45c5-4e2a-891e-5bfb77e0290c-kube-api-access-xdlkj\") pod \"metrics-server-5cb8c7df6c-5xvcw\" (UID: \"f3a1a2e0-45c5-4e2a-891e-5bfb77e0290c\") " pod="openshift-monitoring/metrics-server-5cb8c7df6c-5xvcw"
Jul 24 17:04:41.069626 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.069605    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5cb8c7df6c-5xvcw"
Jul 24 17:04:41.206861 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.206775    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5cb8c7df6c-5xvcw"]
Jul 24 17:04:41.227547 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.227519    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-xvwdc"]
Jul 24 17:04:41.229766 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.229747    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-xvwdc"
Jul 24 17:04:41.231847 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.231827    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 24 17:04:41.232027 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.231936    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-k8jqp\""
Jul 24 17:04:41.239022 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.239000    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-xvwdc"]
Jul 24 17:04:41.323818 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.323780    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/43e861c2-0ff1-44d1-a581-189b08438cfe-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-xvwdc\" (UID: \"43e861c2-0ff1-44d1-a581-189b08438cfe\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-xvwdc"
Jul 24 17:04:41.323990 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.323851    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n5qn\" (UniqueName: \"kubernetes.io/projected/43e861c2-0ff1-44d1-a581-189b08438cfe-kube-api-access-2n5qn\") pod \"monitoring-plugin-68b7fc9574-xvwdc\" (UID: \"43e861c2-0ff1-44d1-a581-189b08438cfe\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-xvwdc"
Jul 24 17:04:41.425288 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.425210    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/43e861c2-0ff1-44d1-a581-189b08438cfe-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-xvwdc\" (UID: \"43e861c2-0ff1-44d1-a581-189b08438cfe\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-xvwdc"
Jul 24 17:04:41.425288 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.425285    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n5qn\" (UniqueName: \"kubernetes.io/projected/43e861c2-0ff1-44d1-a581-189b08438cfe-kube-api-access-2n5qn\") pod \"monitoring-plugin-68b7fc9574-xvwdc\" (UID: \"43e861c2-0ff1-44d1-a581-189b08438cfe\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-xvwdc"
Jul 24 17:04:41.428185 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.428160    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/43e861c2-0ff1-44d1-a581-189b08438cfe-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-xvwdc\" (UID: \"43e861c2-0ff1-44d1-a581-189b08438cfe\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-xvwdc"
Jul 24 17:04:41.433317 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.433293    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n5qn\" (UniqueName: \"kubernetes.io/projected/43e861c2-0ff1-44d1-a581-189b08438cfe-kube-api-access-2n5qn\") pod \"monitoring-plugin-68b7fc9574-xvwdc\" (UID: \"43e861c2-0ff1-44d1-a581-189b08438cfe\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-xvwdc"
Jul 24 17:04:41.540418 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.540330    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-xvwdc"
Jul 24 17:04:41.653774 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.653736    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5555b8589f-77h7b"]
Jul 24 17:04:41.656378 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.656351    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5555b8589f-77h7b"
Jul 24 17:04:41.660024 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.659489    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 24 17:04:41.660024 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.659786    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 24 17:04:41.660024 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.659823    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 24 17:04:41.660024 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.659873    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 24 17:04:41.660306 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.660186    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 24 17:04:41.660422 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.660401    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-bt6qh\""
Jul 24 17:04:41.665704 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.665684    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 24 17:04:41.672006 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.671985    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5555b8589f-77h7b"]
Jul 24 17:04:41.702819 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:04:41.702793    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3a1a2e0_45c5_4e2a_891e_5bfb77e0290c.slice/crio-0df6e479eccc89345500c846594ba4fdff934e70bf453e4d07d444bf33d2799b WatchSource:0}: Error finding container 0df6e479eccc89345500c846594ba4fdff934e70bf453e4d07d444bf33d2799b: Status 404 returned error can't find the container with id 0df6e479eccc89345500c846594ba4fdff934e70bf453e4d07d444bf33d2799b
Jul 24 17:04:41.827035 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.827011    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-xvwdc"]
Jul 24 17:04:41.830417 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.830393    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxx5s\" (UniqueName: \"kubernetes.io/projected/e919b56f-3fec-452a-b78a-5e8ec355fde2-kube-api-access-sxx5s\") pod \"telemeter-client-5555b8589f-77h7b\" (UID: \"e919b56f-3fec-452a-b78a-5e8ec355fde2\") " pod="openshift-monitoring/telemeter-client-5555b8589f-77h7b"
Jul 24 17:04:41.830485 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.830440    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e919b56f-3fec-452a-b78a-5e8ec355fde2-federate-client-tls\") pod \"telemeter-client-5555b8589f-77h7b\" (UID: \"e919b56f-3fec-452a-b78a-5e8ec355fde2\") " pod="openshift-monitoring/telemeter-client-5555b8589f-77h7b"
Jul 24 17:04:41.830485 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.830479    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e919b56f-3fec-452a-b78a-5e8ec355fde2-secret-telemeter-client\") pod \"telemeter-client-5555b8589f-77h7b\" (UID: \"e919b56f-3fec-452a-b78a-5e8ec355fde2\") " pod="openshift-monitoring/telemeter-client-5555b8589f-77h7b"
Jul 24 17:04:41.830580 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.830561    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e919b56f-3fec-452a-b78a-5e8ec355fde2-metrics-client-ca\") pod \"telemeter-client-5555b8589f-77h7b\" (UID: \"e919b56f-3fec-452a-b78a-5e8ec355fde2\") " pod="openshift-monitoring/telemeter-client-5555b8589f-77h7b"
Jul 24 17:04:41.830636 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.830593    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e919b56f-3fec-452a-b78a-5e8ec355fde2-serving-certs-ca-bundle\") pod \"telemeter-client-5555b8589f-77h7b\" (UID: \"e919b56f-3fec-452a-b78a-5e8ec355fde2\") " pod="openshift-monitoring/telemeter-client-5555b8589f-77h7b"
Jul 24 17:04:41.830682 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.830651    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e919b56f-3fec-452a-b78a-5e8ec355fde2-telemeter-client-tls\") pod \"telemeter-client-5555b8589f-77h7b\" (UID: \"e919b56f-3fec-452a-b78a-5e8ec355fde2\") " pod="openshift-monitoring/telemeter-client-5555b8589f-77h7b"
Jul 24 17:04:41.830733 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.830682    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e919b56f-3fec-452a-b78a-5e8ec355fde2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5555b8589f-77h7b\" (UID: \"e919b56f-3fec-452a-b78a-5e8ec355fde2\") " pod="openshift-monitoring/telemeter-client-5555b8589f-77h7b"
Jul 24 17:04:41.830733 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.830721    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e919b56f-3fec-452a-b78a-5e8ec355fde2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5555b8589f-77h7b\" (UID: \"e919b56f-3fec-452a-b78a-5e8ec355fde2\") " pod="openshift-monitoring/telemeter-client-5555b8589f-77h7b"
Jul 24 17:04:41.831101 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:04:41.831058    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43e861c2_0ff1_44d1_a581_189b08438cfe.slice/crio-27b2097121f6dcc1e54ba316fc80b7bc30b6064003497b3e1cb4bafe957b059a WatchSource:0}: Error finding container 27b2097121f6dcc1e54ba316fc80b7bc30b6064003497b3e1cb4bafe957b059a: Status 404 returned error can't find the container with id 27b2097121f6dcc1e54ba316fc80b7bc30b6064003497b3e1cb4bafe957b059a
Jul 24 17:04:41.931860 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.931381    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e919b56f-3fec-452a-b78a-5e8ec355fde2-telemeter-client-tls\") pod \"telemeter-client-5555b8589f-77h7b\" (UID: \"e919b56f-3fec-452a-b78a-5e8ec355fde2\") " pod="openshift-monitoring/telemeter-client-5555b8589f-77h7b"
Jul 24 17:04:41.931860 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.931435    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e919b56f-3fec-452a-b78a-5e8ec355fde2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5555b8589f-77h7b\" (UID: \"e919b56f-3fec-452a-b78a-5e8ec355fde2\") " pod="openshift-monitoring/telemeter-client-5555b8589f-77h7b"
Jul 24 17:04:41.931860 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.931477    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e919b56f-3fec-452a-b78a-5e8ec355fde2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5555b8589f-77h7b\" (UID: \"e919b56f-3fec-452a-b78a-5e8ec355fde2\") " pod="openshift-monitoring/telemeter-client-5555b8589f-77h7b"
Jul 24 17:04:41.931860 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.931557    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxx5s\" (UniqueName: \"kubernetes.io/projected/e919b56f-3fec-452a-b78a-5e8ec355fde2-kube-api-access-sxx5s\") pod \"telemeter-client-5555b8589f-77h7b\" (UID: \"e919b56f-3fec-452a-b78a-5e8ec355fde2\") " pod="openshift-monitoring/telemeter-client-5555b8589f-77h7b"
Jul 24 17:04:41.931860 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.931584    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e919b56f-3fec-452a-b78a-5e8ec355fde2-federate-client-tls\") pod \"telemeter-client-5555b8589f-77h7b\" (UID: \"e919b56f-3fec-452a-b78a-5e8ec355fde2\") " pod="openshift-monitoring/telemeter-client-5555b8589f-77h7b"
Jul 24 17:04:41.931860 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.931619    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e919b56f-3fec-452a-b78a-5e8ec355fde2-secret-telemeter-client\") pod \"telemeter-client-5555b8589f-77h7b\" (UID: \"e919b56f-3fec-452a-b78a-5e8ec355fde2\") " pod="openshift-monitoring/telemeter-client-5555b8589f-77h7b"
Jul 24 17:04:41.931860 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.931657    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e919b56f-3fec-452a-b78a-5e8ec355fde2-metrics-client-ca\") pod \"telemeter-client-5555b8589f-77h7b\" (UID: \"e919b56f-3fec-452a-b78a-5e8ec355fde2\") " pod="openshift-monitoring/telemeter-client-5555b8589f-77h7b"
Jul 24 17:04:41.931860 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.931687    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e919b56f-3fec-452a-b78a-5e8ec355fde2-serving-certs-ca-bundle\") pod \"telemeter-client-5555b8589f-77h7b\" (UID: \"e919b56f-3fec-452a-b78a-5e8ec355fde2\") " pod="openshift-monitoring/telemeter-client-5555b8589f-77h7b"
Jul 24 17:04:41.932497 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.932472    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e919b56f-3fec-452a-b78a-5e8ec355fde2-serving-certs-ca-bundle\") pod \"telemeter-client-5555b8589f-77h7b\" (UID: \"e919b56f-3fec-452a-b78a-5e8ec355fde2\") " pod="openshift-monitoring/telemeter-client-5555b8589f-77h7b"
Jul 24 17:04:41.932804 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.932777    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e919b56f-3fec-452a-b78a-5e8ec355fde2-metrics-client-ca\") pod \"telemeter-client-5555b8589f-77h7b\" (UID: \"e919b56f-3fec-452a-b78a-5e8ec355fde2\") " pod="openshift-monitoring/telemeter-client-5555b8589f-77h7b"
Jul 24 17:04:41.933210 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.933170    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e919b56f-3fec-452a-b78a-5e8ec355fde2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5555b8589f-77h7b\" (UID: \"e919b56f-3fec-452a-b78a-5e8ec355fde2\") " pod="openshift-monitoring/telemeter-client-5555b8589f-77h7b"
Jul 24 17:04:41.934579 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.934559    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e919b56f-3fec-452a-b78a-5e8ec355fde2-federate-client-tls\") pod \"telemeter-client-5555b8589f-77h7b\" (UID: \"e919b56f-3fec-452a-b78a-5e8ec355fde2\") " pod="openshift-monitoring/telemeter-client-5555b8589f-77h7b"
Jul 24 17:04:41.934896 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.934880    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e919b56f-3fec-452a-b78a-5e8ec355fde2-telemeter-client-tls\") pod \"telemeter-client-5555b8589f-77h7b\" (UID: \"e919b56f-3fec-452a-b78a-5e8ec355fde2\") " pod="openshift-monitoring/telemeter-client-5555b8589f-77h7b"
Jul 24 17:04:41.935077 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.935044    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e919b56f-3fec-452a-b78a-5e8ec355fde2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5555b8589f-77h7b\" (UID: \"e919b56f-3fec-452a-b78a-5e8ec355fde2\") " pod="openshift-monitoring/telemeter-client-5555b8589f-77h7b"
Jul 24 17:04:41.935169 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.935101    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e919b56f-3fec-452a-b78a-5e8ec355fde2-secret-telemeter-client\") pod \"telemeter-client-5555b8589f-77h7b\" (UID: \"e919b56f-3fec-452a-b78a-5e8ec355fde2\") " pod="openshift-monitoring/telemeter-client-5555b8589f-77h7b"
Jul 24 17:04:41.939944 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.939922    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxx5s\" (UniqueName: \"kubernetes.io/projected/e919b56f-3fec-452a-b78a-5e8ec355fde2-kube-api-access-sxx5s\") pod \"telemeter-client-5555b8589f-77h7b\" (UID: \"e919b56f-3fec-452a-b78a-5e8ec355fde2\") " pod="openshift-monitoring/telemeter-client-5555b8589f-77h7b"
Jul 24 17:04:41.970053 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:41.970034    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5555b8589f-77h7b"
Jul 24 17:04:42.032249 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.032220    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9dc126a1-da76-4146-95f2-0571132022cc-original-pull-secret\") pod \"global-pull-secret-syncer-cb4sr\" (UID: \"9dc126a1-da76-4146-95f2-0571132022cc\") " pod="kube-system/global-pull-secret-syncer-cb4sr"
Jul 24 17:04:42.032376 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.032271    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b20d7f4d-c9f7-4a88-9107-f52a67b5741c-metrics-certs\") pod \"network-metrics-daemon-x9m67\" (UID: \"b20d7f4d-c9f7-4a88-9107-f52a67b5741c\") " pod="openshift-multus/network-metrics-daemon-x9m67"
Jul 24 17:04:42.034492 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.034473    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 17:04:42.034595 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.034526    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 17:04:42.046081 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.046039    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9dc126a1-da76-4146-95f2-0571132022cc-original-pull-secret\") pod \"global-pull-secret-syncer-cb4sr\" (UID: \"9dc126a1-da76-4146-95f2-0571132022cc\") " pod="kube-system/global-pull-secret-syncer-cb4sr"
Jul 24 17:04:42.046182 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.046058    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b20d7f4d-c9f7-4a88-9107-f52a67b5741c-metrics-certs\") pod \"network-metrics-daemon-x9m67\" (UID: \"b20d7f4d-c9f7-4a88-9107-f52a67b5741c\") " pod="openshift-multus/network-metrics-daemon-x9m67"
Jul 24 17:04:42.097310 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.097280    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5555b8589f-77h7b"]
Jul 24 17:04:42.100019 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:04:42.099998    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode919b56f_3fec_452a_b78a_5e8ec355fde2.slice/crio-97f70d71012301822bcdad3987e48b788210bdf0129d98a08745d2051a7bc1c3 WatchSource:0}: Error finding container 97f70d71012301822bcdad3987e48b788210bdf0129d98a08745d2051a7bc1c3: Status 404 returned error can't find the container with id 97f70d71012301822bcdad3987e48b788210bdf0129d98a08745d2051a7bc1c3
Jul 24 17:04:42.133492 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.133466    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg9xt\" (UniqueName: \"kubernetes.io/projected/4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd-kube-api-access-tg9xt\") pod \"network-check-target-spwhm\" (UID: \"4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd\") " pod="openshift-network-diagnostics/network-check-target-spwhm"
Jul 24 17:04:42.135621 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.135606    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 17:04:42.146281 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.146259    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 17:04:42.157250 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.157230    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg9xt\" (UniqueName: \"kubernetes.io/projected/4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd-kube-api-access-tg9xt\") pod \"network-check-target-spwhm\" (UID: \"4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd\") " pod="openshift-network-diagnostics/network-check-target-spwhm"
Jul 24 17:04:42.269340 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.269318    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lpvrb\""
Jul 24 17:04:42.277193 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.277177    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cb4sr"
Jul 24 17:04:42.278252 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.278237    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spwhm"
Jul 24 17:04:42.286512 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.286496    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f7d7c\""
Jul 24 17:04:42.295344 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.295291    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x9m67"
Jul 24 17:04:42.446485 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.446449    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-spwhm"]
Jul 24 17:04:42.452627 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:04:42.451007    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4771eeb8_f3a8_40f4_9e6c_24fa5187f0bd.slice/crio-569dac2162ee986dda2dffb3ae8384b8cd2c7dbc2d1a13b632ec8a71194bde6a WatchSource:0}: Error finding container 569dac2162ee986dda2dffb3ae8384b8cd2c7dbc2d1a13b632ec8a71194bde6a: Status 404 returned error can't find the container with id 569dac2162ee986dda2dffb3ae8384b8cd2c7dbc2d1a13b632ec8a71194bde6a
Jul 24 17:04:42.477032 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.477002    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-76b4f64bf4-n8psm"]
Jul 24 17:04:42.480715 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.480684    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cb4sr"]
Jul 24 17:04:42.480823 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.480806    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76b4f64bf4-n8psm"
Jul 24 17:04:42.483438 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:04:42.483399    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dc126a1_da76_4146_95f2_0571132022cc.slice/crio-22e6473b50aae68059c6bf633d213027d102bf61281c50d8e4fd76a7d546acd3 WatchSource:0}: Error finding container 22e6473b50aae68059c6bf633d213027d102bf61281c50d8e4fd76a7d546acd3: Status 404 returned error can't find the container with id 22e6473b50aae68059c6bf633d213027d102bf61281c50d8e4fd76a7d546acd3
Jul 24 17:04:42.490692 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.490669    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76b4f64bf4-n8psm"]
Jul 24 17:04:42.554165 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.554084    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5cb8c7df6c-5xvcw" event={"ID":"f3a1a2e0-45c5-4e2a-891e-5bfb77e0290c","Type":"ContainerStarted","Data":"0df6e479eccc89345500c846594ba4fdff934e70bf453e4d07d444bf33d2799b"}
Jul 24 17:04:42.556390 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.556365    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-65668b444c-5xnm9" event={"ID":"5292d7ba-a5f5-4e59-8f81-a53625204204","Type":"ContainerStarted","Data":"a9fcb579fb6c2dfc88c64049a5a98029b3a4b10e35c57b953583414adc2be517"}
Jul 24 17:04:42.556498 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.556419    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-65668b444c-5xnm9" event={"ID":"5292d7ba-a5f5-4e59-8f81-a53625204204","Type":"ContainerStarted","Data":"37efcd70710fcb188d071b7f1076e5ed0369d6869279c5ae77e39f3df9fa8968"}
Jul 24 17:04:42.556498 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.556446    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-65668b444c-5xnm9" event={"ID":"5292d7ba-a5f5-4e59-8f81-a53625204204","Type":"ContainerStarted","Data":"31faa7f806e7dcc415e995892178782e4487e10ffd110896ef9c2bda0396626d"}
Jul 24 17:04:42.557509 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.557490    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cb4sr" event={"ID":"9dc126a1-da76-4146-95f2-0571132022cc","Type":"ContainerStarted","Data":"22e6473b50aae68059c6bf633d213027d102bf61281c50d8e4fd76a7d546acd3"}
Jul 24 17:04:42.558784 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.558728    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5555b8589f-77h7b" event={"ID":"e919b56f-3fec-452a-b78a-5e8ec355fde2","Type":"ContainerStarted","Data":"97f70d71012301822bcdad3987e48b788210bdf0129d98a08745d2051a7bc1c3"}
Jul 24 17:04:42.559968 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.559943    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-xvwdc" event={"ID":"43e861c2-0ff1-44d1-a581-189b08438cfe","Type":"ContainerStarted","Data":"27b2097121f6dcc1e54ba316fc80b7bc30b6064003497b3e1cb4bafe957b059a"}
Jul 24 17:04:42.560977 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.560952    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-spwhm" event={"ID":"4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd","Type":"ContainerStarted","Data":"569dac2162ee986dda2dffb3ae8384b8cd2c7dbc2d1a13b632ec8a71194bde6a"}
Jul 24 17:04:42.587090 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.587055    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 17:04:42.590149 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.590128    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.593600 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.592723    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 24 17:04:42.593600 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.592734    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 24 17:04:42.593600 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.593310    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 24 17:04:42.593600 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.593561    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 24 17:04:42.593825 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.593687    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 24 17:04:42.593825 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.593757    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 24 17:04:42.593996 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.593967    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 24 17:04:42.594165 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.594127    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-680eqbe71t4k0\""
Jul 24 17:04:42.594430 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.594271    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 24 17:04:42.594430 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.594406    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-7rs2k\""
Jul 24 17:04:42.595328 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.594557    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 24 17:04:42.595328 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.594568    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 24 17:04:42.595328 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.594658    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 24 17:04:42.595328 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.594808    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 24 17:04:42.598343 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.598318    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 24 17:04:42.600313 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.600294    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 24 17:04:42.610699 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.610675    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 17:04:42.640181 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.639147    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fad6f791-b9af-465c-9fb1-5e19e99fef60-console-config\") pod \"console-76b4f64bf4-n8psm\" (UID: \"fad6f791-b9af-465c-9fb1-5e19e99fef60\") " pod="openshift-console/console-76b4f64bf4-n8psm"
Jul 24 17:04:42.640181 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.639188    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fad6f791-b9af-465c-9fb1-5e19e99fef60-trusted-ca-bundle\") pod \"console-76b4f64bf4-n8psm\" (UID: \"fad6f791-b9af-465c-9fb1-5e19e99fef60\") " pod="openshift-console/console-76b4f64bf4-n8psm"
Jul 24 17:04:42.640181 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.639228    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fad6f791-b9af-465c-9fb1-5e19e99fef60-oauth-serving-cert\") pod \"console-76b4f64bf4-n8psm\" (UID: \"fad6f791-b9af-465c-9fb1-5e19e99fef60\") " pod="openshift-console/console-76b4f64bf4-n8psm"
Jul 24 17:04:42.640181 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.639256    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwsw2\" (UniqueName: \"kubernetes.io/projected/fad6f791-b9af-465c-9fb1-5e19e99fef60-kube-api-access-bwsw2\") pod \"console-76b4f64bf4-n8psm\" (UID: \"fad6f791-b9af-465c-9fb1-5e19e99fef60\") " pod="openshift-console/console-76b4f64bf4-n8psm"
Jul 24 17:04:42.640181 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.639315    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fad6f791-b9af-465c-9fb1-5e19e99fef60-console-oauth-config\") pod \"console-76b4f64bf4-n8psm\" (UID: \"fad6f791-b9af-465c-9fb1-5e19e99fef60\") " pod="openshift-console/console-76b4f64bf4-n8psm"
Jul 24 17:04:42.640181 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.639363    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fad6f791-b9af-465c-9fb1-5e19e99fef60-console-serving-cert\") pod \"console-76b4f64bf4-n8psm\" (UID: \"fad6f791-b9af-465c-9fb1-5e19e99fef60\") " pod="openshift-console/console-76b4f64bf4-n8psm"
Jul 24 17:04:42.640181 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.639386    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fad6f791-b9af-465c-9fb1-5e19e99fef60-service-ca\") pod \"console-76b4f64bf4-n8psm\" (UID: \"fad6f791-b9af-465c-9fb1-5e19e99fef60\") " pod="openshift-console/console-76b4f64bf4-n8psm"
Jul 24 17:04:42.673366 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.673299    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-x9m67"]
Jul 24 17:04:42.689743 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:04:42.689716    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb20d7f4d_c9f7_4a88_9107_f52a67b5741c.slice/crio-471a4192b4702e593c1ff3e89b7d721e96c6d2483b0fb0bc24a429648f9ecd75 WatchSource:0}: Error finding container 471a4192b4702e593c1ff3e89b7d721e96c6d2483b0fb0bc24a429648f9ecd75: Status 404 returned error can't find the container with id 471a4192b4702e593c1ff3e89b7d721e96c6d2483b0fb0bc24a429648f9ecd75
Jul 24 17:04:42.740721 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.740694    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/04714f9c-4dd0-48a0-81cc-3e3d42031243-config-out\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.740813 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.740736    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/04714f9c-4dd0-48a0-81cc-3e3d42031243-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.740813 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.740767    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/04714f9c-4dd0-48a0-81cc-3e3d42031243-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.740813 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.740805    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fad6f791-b9af-465c-9fb1-5e19e99fef60-console-config\") pod \"console-76b4f64bf4-n8psm\" (UID: \"fad6f791-b9af-465c-9fb1-5e19e99fef60\") " pod="openshift-console/console-76b4f64bf4-n8psm"
Jul 24 17:04:42.740954 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.740831    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/04714f9c-4dd0-48a0-81cc-3e3d42031243-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.740954 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.740860    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04714f9c-4dd0-48a0-81cc-3e3d42031243-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.740954 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.740884    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fad6f791-b9af-465c-9fb1-5e19e99fef60-trusted-ca-bundle\") pod \"console-76b4f64bf4-n8psm\" (UID: \"fad6f791-b9af-465c-9fb1-5e19e99fef60\") " pod="openshift-console/console-76b4f64bf4-n8psm"
Jul 24 17:04:42.740954 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.740909    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04714f9c-4dd0-48a0-81cc-3e3d42031243-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.740954 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.740934    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/04714f9c-4dd0-48a0-81cc-3e3d42031243-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.741159 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.740968    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxjqn\" (UniqueName: \"kubernetes.io/projected/04714f9c-4dd0-48a0-81cc-3e3d42031243-kube-api-access-gxjqn\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.741159 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.740996    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/04714f9c-4dd0-48a0-81cc-3e3d42031243-config\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.741159 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.741037    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/04714f9c-4dd0-48a0-81cc-3e3d42031243-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.741159 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.741085    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fad6f791-b9af-465c-9fb1-5e19e99fef60-oauth-serving-cert\") pod \"console-76b4f64bf4-n8psm\" (UID: \"fad6f791-b9af-465c-9fb1-5e19e99fef60\") " pod="openshift-console/console-76b4f64bf4-n8psm"
Jul 24 17:04:42.741159 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.741128    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwsw2\" (UniqueName: \"kubernetes.io/projected/fad6f791-b9af-465c-9fb1-5e19e99fef60-kube-api-access-bwsw2\") pod \"console-76b4f64bf4-n8psm\" (UID: \"fad6f791-b9af-465c-9fb1-5e19e99fef60\") " pod="openshift-console/console-76b4f64bf4-n8psm"
Jul 24 17:04:42.741159 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.741156    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/04714f9c-4dd0-48a0-81cc-3e3d42031243-web-config\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.741381 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.741201    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04714f9c-4dd0-48a0-81cc-3e3d42031243-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.741381 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.741234    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/04714f9c-4dd0-48a0-81cc-3e3d42031243-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.741381 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.741262    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04714f9c-4dd0-48a0-81cc-3e3d42031243-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.741381 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.741312    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/04714f9c-4dd0-48a0-81cc-3e3d42031243-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.741381 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.741371    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fad6f791-b9af-465c-9fb1-5e19e99fef60-console-oauth-config\") pod \"console-76b4f64bf4-n8psm\" (UID: \"fad6f791-b9af-465c-9fb1-5e19e99fef60\") " pod="openshift-console/console-76b4f64bf4-n8psm"
Jul 24 17:04:42.741568 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.741405    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/04714f9c-4dd0-48a0-81cc-3e3d42031243-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.741568 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.741434    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/04714f9c-4dd0-48a0-81cc-3e3d42031243-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.741568 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.741467    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/04714f9c-4dd0-48a0-81cc-3e3d42031243-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.741568 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.741494    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/04714f9c-4dd0-48a0-81cc-3e3d42031243-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.741568 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.741519    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/04714f9c-4dd0-48a0-81cc-3e3d42031243-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.741568 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.741564    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fad6f791-b9af-465c-9fb1-5e19e99fef60-console-serving-cert\") pod \"console-76b4f64bf4-n8psm\" (UID: \"fad6f791-b9af-465c-9fb1-5e19e99fef60\") " pod="openshift-console/console-76b4f64bf4-n8psm"
Jul 24 17:04:42.741803 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.741593    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fad6f791-b9af-465c-9fb1-5e19e99fef60-service-ca\") pod \"console-76b4f64bf4-n8psm\" (UID: \"fad6f791-b9af-465c-9fb1-5e19e99fef60\") " pod="openshift-console/console-76b4f64bf4-n8psm"
Jul 24 17:04:42.741803 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.741720    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fad6f791-b9af-465c-9fb1-5e19e99fef60-oauth-serving-cert\") pod \"console-76b4f64bf4-n8psm\" (UID: \"fad6f791-b9af-465c-9fb1-5e19e99fef60\") " pod="openshift-console/console-76b4f64bf4-n8psm"
Jul 24 17:04:42.742359 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.742333    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fad6f791-b9af-465c-9fb1-5e19e99fef60-service-ca\") pod \"console-76b4f64bf4-n8psm\" (UID: \"fad6f791-b9af-465c-9fb1-5e19e99fef60\") " pod="openshift-console/console-76b4f64bf4-n8psm"
Jul 24 17:04:42.742549 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.742514    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fad6f791-b9af-465c-9fb1-5e19e99fef60-trusted-ca-bundle\") pod \"console-76b4f64bf4-n8psm\" (UID: \"fad6f791-b9af-465c-9fb1-5e19e99fef60\") " pod="openshift-console/console-76b4f64bf4-n8psm"
Jul 24 17:04:42.743013 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.742968    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fad6f791-b9af-465c-9fb1-5e19e99fef60-console-config\") pod \"console-76b4f64bf4-n8psm\" (UID: \"fad6f791-b9af-465c-9fb1-5e19e99fef60\") " pod="openshift-console/console-76b4f64bf4-n8psm"
Jul 24 17:04:42.745853 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.745812    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fad6f791-b9af-465c-9fb1-5e19e99fef60-console-oauth-config\") pod \"console-76b4f64bf4-n8psm\" (UID: \"fad6f791-b9af-465c-9fb1-5e19e99fef60\") " pod="openshift-console/console-76b4f64bf4-n8psm"
Jul 24 17:04:42.746506 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.746470    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fad6f791-b9af-465c-9fb1-5e19e99fef60-console-serving-cert\") pod \"console-76b4f64bf4-n8psm\" (UID: \"fad6f791-b9af-465c-9fb1-5e19e99fef60\") " pod="openshift-console/console-76b4f64bf4-n8psm"
Jul 24 17:04:42.750205 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.750185    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwsw2\" (UniqueName: \"kubernetes.io/projected/fad6f791-b9af-465c-9fb1-5e19e99fef60-kube-api-access-bwsw2\") pod \"console-76b4f64bf4-n8psm\" (UID: \"fad6f791-b9af-465c-9fb1-5e19e99fef60\") " pod="openshift-console/console-76b4f64bf4-n8psm"
Jul 24 17:04:42.791907 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.791885    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76b4f64bf4-n8psm"
Jul 24 17:04:42.844631 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.842907    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/04714f9c-4dd0-48a0-81cc-3e3d42031243-config-out\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.844631 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.842947    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/04714f9c-4dd0-48a0-81cc-3e3d42031243-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.844631 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.842977    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/04714f9c-4dd0-48a0-81cc-3e3d42031243-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.844631 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.843012    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/04714f9c-4dd0-48a0-81cc-3e3d42031243-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.844631 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.843039    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04714f9c-4dd0-48a0-81cc-3e3d42031243-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.844631 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.844327    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04714f9c-4dd0-48a0-81cc-3e3d42031243-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.844631 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.844368    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/04714f9c-4dd0-48a0-81cc-3e3d42031243-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.844631 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.844405    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxjqn\" (UniqueName: \"kubernetes.io/projected/04714f9c-4dd0-48a0-81cc-3e3d42031243-kube-api-access-gxjqn\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.844631 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.844434    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/04714f9c-4dd0-48a0-81cc-3e3d42031243-config\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.844631 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.844458    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/04714f9c-4dd0-48a0-81cc-3e3d42031243-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.844631 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.844496    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/04714f9c-4dd0-48a0-81cc-3e3d42031243-web-config\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.844631 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.844541    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04714f9c-4dd0-48a0-81cc-3e3d42031243-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.844631 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.844571    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/04714f9c-4dd0-48a0-81cc-3e3d42031243-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.844631 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.844597    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04714f9c-4dd0-48a0-81cc-3e3d42031243-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.844631 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.844642    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/04714f9c-4dd0-48a0-81cc-3e3d42031243-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.845515 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.844681    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/04714f9c-4dd0-48a0-81cc-3e3d42031243-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.845515 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.844709    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/04714f9c-4dd0-48a0-81cc-3e3d42031243-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.845515 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.844748    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/04714f9c-4dd0-48a0-81cc-3e3d42031243-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.845515 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.844776    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/04714f9c-4dd0-48a0-81cc-3e3d42031243-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.845515 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.844801    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/04714f9c-4dd0-48a0-81cc-3e3d42031243-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.845515 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.844982    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04714f9c-4dd0-48a0-81cc-3e3d42031243-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.855871 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.846019    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04714f9c-4dd0-48a0-81cc-3e3d42031243-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.855871 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.846504    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/04714f9c-4dd0-48a0-81cc-3e3d42031243-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.855871 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.846598    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04714f9c-4dd0-48a0-81cc-3e3d42031243-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.855871 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.848643    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/04714f9c-4dd0-48a0-81cc-3e3d42031243-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.855871 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.852344    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/04714f9c-4dd0-48a0-81cc-3e3d42031243-web-config\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.855871 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.854084    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/04714f9c-4dd0-48a0-81cc-3e3d42031243-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.855871 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.854480    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/04714f9c-4dd0-48a0-81cc-3e3d42031243-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.855871 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.854956    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/04714f9c-4dd0-48a0-81cc-3e3d42031243-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.855871 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.855621    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxjqn\" (UniqueName: \"kubernetes.io/projected/04714f9c-4dd0-48a0-81cc-3e3d42031243-kube-api-access-gxjqn\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.859126 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.856810    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/04714f9c-4dd0-48a0-81cc-3e3d42031243-config\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.859126 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.856959    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/04714f9c-4dd0-48a0-81cc-3e3d42031243-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.859126 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.857809    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04714f9c-4dd0-48a0-81cc-3e3d42031243-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.859126 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.858285    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/04714f9c-4dd0-48a0-81cc-3e3d42031243-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.860625 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.860604    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/04714f9c-4dd0-48a0-81cc-3e3d42031243-config-out\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.860735 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.860634    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/04714f9c-4dd0-48a0-81cc-3e3d42031243-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.860882 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.860860    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/04714f9c-4dd0-48a0-81cc-3e3d42031243-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.861282 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.861259    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/04714f9c-4dd0-48a0-81cc-3e3d42031243-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.861685 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.861661    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/04714f9c-4dd0-48a0-81cc-3e3d42031243-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.863893 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.863545    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/04714f9c-4dd0-48a0-81cc-3e3d42031243-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"04714f9c-4dd0-48a0-81cc-3e3d42031243\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.905406 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.905199    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:42.969892 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:42.969757    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76b4f64bf4-n8psm"]
Jul 24 17:04:42.974169 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:04:42.974141    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfad6f791_b9af_465c_9fb1_5e19e99fef60.slice/crio-4a318a306e113d47d8946b50faa97ca09529497757409d1b385a038b274898ce WatchSource:0}: Error finding container 4a318a306e113d47d8946b50faa97ca09529497757409d1b385a038b274898ce: Status 404 returned error can't find the container with id 4a318a306e113d47d8946b50faa97ca09529497757409d1b385a038b274898ce
Jul 24 17:04:43.106513 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:43.106401    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 17:04:43.115256 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:04:43.114793    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04714f9c_4dd0_48a0_81cc_3e3d42031243.slice/crio-3c47c5c44fc6ca5fd9dd988e71ef70b1ff64185c4e60bb83cb8de8d18289aa5e WatchSource:0}: Error finding container 3c47c5c44fc6ca5fd9dd988e71ef70b1ff64185c4e60bb83cb8de8d18289aa5e: Status 404 returned error can't find the container with id 3c47c5c44fc6ca5fd9dd988e71ef70b1ff64185c4e60bb83cb8de8d18289aa5e
Jul 24 17:04:43.576592 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:43.576459    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"04714f9c-4dd0-48a0-81cc-3e3d42031243","Type":"ContainerStarted","Data":"3c47c5c44fc6ca5fd9dd988e71ef70b1ff64185c4e60bb83cb8de8d18289aa5e"}
Jul 24 17:04:43.581697 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:43.580774    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76b4f64bf4-n8psm" event={"ID":"fad6f791-b9af-465c-9fb1-5e19e99fef60","Type":"ContainerStarted","Data":"6dfc476ad0e2c525efbec6760e129b67b51bffa68f5f13420144af17a4e3bd0a"}
Jul 24 17:04:43.581697 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:43.580825    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76b4f64bf4-n8psm" event={"ID":"fad6f791-b9af-465c-9fb1-5e19e99fef60","Type":"ContainerStarted","Data":"4a318a306e113d47d8946b50faa97ca09529497757409d1b385a038b274898ce"}
Jul 24 17:04:43.585860 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:43.585791    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x9m67" event={"ID":"b20d7f4d-c9f7-4a88-9107-f52a67b5741c","Type":"ContainerStarted","Data":"471a4192b4702e593c1ff3e89b7d721e96c6d2483b0fb0bc24a429648f9ecd75"}
Jul 24 17:04:43.591108 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:43.590690    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-65668b444c-5xnm9" event={"ID":"5292d7ba-a5f5-4e59-8f81-a53625204204","Type":"ContainerStarted","Data":"06f6a59b22a0cac0fcf47bc20e23e0472f23f9d29299da6b7c704f13eaa67eb3"}
Jul 24 17:04:43.591108 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:43.590758    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-65668b444c-5xnm9" event={"ID":"5292d7ba-a5f5-4e59-8f81-a53625204204","Type":"ContainerStarted","Data":"c8230978370918c3c195be5a3cc478406e15d929731f5c81809e6e48052c466b"}
Jul 24 17:04:43.591108 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:43.590802    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-65668b444c-5xnm9" event={"ID":"5292d7ba-a5f5-4e59-8f81-a53625204204","Type":"ContainerStarted","Data":"f34f11637650ba609dbf6b8260bb38a09d1e77304d658c100c9115a54f14dd06"}
Jul 24 17:04:43.591328 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:43.591204    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-65668b444c-5xnm9"
Jul 24 17:04:43.601559 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:43.601365    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-76b4f64bf4-n8psm" podStartSLOduration=1.6013482350000001 podStartE2EDuration="1.601348235s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:04:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:04:43.600365887 +0000 UTC m=+67.873225692" watchObservedRunningTime="2026-07-24 17:04:43.601348235 +0000 UTC m=+67.874208019"
Jul 24 17:04:43.635089 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:43.633583    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-65668b444c-5xnm9" podStartSLOduration=1.918690231 podStartE2EDuration="4.630817905s" totalImagesPullingTime="2.712127674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:04:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:04:43.623662139 +0000 UTC m=+67.896521911" watchObservedRunningTime="2026-07-24 17:04:43.630817905 +0000 UTC m=+67.903677687"
Jul 24 17:04:48.618801 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:48.617971    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cb4sr" event={"ID":"9dc126a1-da76-4146-95f2-0571132022cc","Type":"ContainerStarted","Data":"6e47f527cf2e4cd5be4a8a829f9a58e7effce3993060bb5aa33cc6fbdb7fca16"}
Jul 24 17:04:48.621159 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:48.621088    2561 generic.go:356] "Generic (PLEG): container finished" podID="04714f9c-4dd0-48a0-81cc-3e3d42031243" containerID="4d8b6bd0320456c913d56e8db74dcf08b3ac24e8dff3c7535f99e5091486df5f" exitCode=0
Jul 24 17:04:48.621309 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:48.621196    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"04714f9c-4dd0-48a0-81cc-3e3d42031243","Type":"ContainerDied","Data":"4d8b6bd0320456c913d56e8db74dcf08b3ac24e8dff3c7535f99e5091486df5f"}
Jul 24 17:04:48.632115 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:48.632087    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5555b8589f-77h7b" event={"ID":"e919b56f-3fec-452a-b78a-5e8ec355fde2","Type":"ContainerStarted","Data":"960eaf94615feae0c8b894e3280c5c4b8291022bb92aa9dd905fadc8d2efd3ba"}
Jul 24 17:04:48.632224 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:48.632184    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5555b8589f-77h7b" event={"ID":"e919b56f-3fec-452a-b78a-5e8ec355fde2","Type":"ContainerStarted","Data":"86ec541565de5a9f176fbc815a76f7d4e57a2fd41876847113fa9dde6e4c1ad9"}
Jul 24 17:04:48.632224 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:48.632214    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5555b8589f-77h7b" event={"ID":"e919b56f-3fec-452a-b78a-5e8ec355fde2","Type":"ContainerStarted","Data":"cb5fdde1fe2acd86f6bad27629f2d250656b92b63b4df43bf0503077ef023d48"}
Jul 24 17:04:48.633504 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:48.633473    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-xvwdc" event={"ID":"43e861c2-0ff1-44d1-a581-189b08438cfe","Type":"ContainerStarted","Data":"a916e10758c52b33632a1b87ed4861c34059cbdc1f848173bb209f27c48e4455"}
Jul 24 17:04:48.633844 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:48.633790    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-xvwdc"
Jul 24 17:04:48.635731 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:48.635709    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-spwhm" event={"ID":"4771eeb8-f3a8-40f4-9e6c-24fa5187f0bd","Type":"ContainerStarted","Data":"1e9a4767444279342a98a2f8dd060e3e7a8902df9b1727b536b99da9c75628b7"}
Jul 24 17:04:48.635816 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:48.635774    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-spwhm"
Jul 24 17:04:48.637367 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:48.637325    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-cb4sr" podStartSLOduration=66.825414035 podStartE2EDuration="1m12.637290302s" totalImagesPullingTime="5.811876267s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:03:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:04:48.637236928 +0000 UTC m=+72.910096736" watchObservedRunningTime="2026-07-24 17:04:48.637290302 +0000 UTC m=+72.910150084"
Jul 24 17:04:48.637855 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:48.637802    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5cb8c7df6c-5xvcw" event={"ID":"f3a1a2e0-45c5-4e2a-891e-5bfb77e0290c","Type":"ContainerStarted","Data":"c4cc2367bc652abbef49e61762a412257868325979e1fb674bcd0567df725d82"}
Jul 24 17:04:48.640018 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:48.639998    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-xvwdc"
Jul 24 17:04:48.640561 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:48.640538    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x9m67" event={"ID":"b20d7f4d-c9f7-4a88-9107-f52a67b5741c","Type":"ContainerStarted","Data":"7167617d87ed54dd498f5d8a5344bea7a0e232c46ca43405036ae71653e39b6c"}
Jul 24 17:04:48.640647 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:48.640602    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x9m67" event={"ID":"b20d7f4d-c9f7-4a88-9107-f52a67b5741c","Type":"ContainerStarted","Data":"e504861f0a2a5aac6d054315c41318711a97c908994e0f25ca72d8686912989c"}
Jul 24 17:04:48.688123 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:48.688040    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5555b8589f-77h7b" podStartSLOduration=1.545678197 podStartE2EDuration="7.688019838s" totalImagesPullingTime="6.142341641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:04:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:04:48.686448392 +0000 UTC m=+72.959308192" watchObservedRunningTime="2026-07-24 17:04:48.688019838 +0000 UTC m=+72.960879600"
Jul 24 17:04:48.707680 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:48.707625    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-spwhm" podStartSLOduration=66.886232146 podStartE2EDuration="1m12.707610015s" totalImagesPullingTime="5.821377869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:03:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:04:48.706102492 +0000 UTC m=+72.978962275" watchObservedRunningTime="2026-07-24 17:04:48.707610015 +0000 UTC m=+72.980469832"
Jul 24 17:04:48.723822 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:48.723779    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-xvwdc" podStartSLOduration=1.3126534460000001 podStartE2EDuration="7.72376627s" totalImagesPullingTime="6.411112824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:04:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:04:48.723076394 +0000 UTC m=+72.995936242" watchObservedRunningTime="2026-07-24 17:04:48.72376627 +0000 UTC m=+72.996626096"
Jul 24 17:04:48.738321 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:48.738273    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-x9m67" podStartSLOduration=67.188371231 podStartE2EDuration="1m12.738258094s" totalImagesPullingTime="5.549886863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:03:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:04:48.738190143 +0000 UTC m=+73.011049924" watchObservedRunningTime="2026-07-24 17:04:48.738258094 +0000 UTC m=+73.011117872"
Jul 24 17:04:48.769696 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:48.769606    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5cb8c7df6c-5xvcw" podStartSLOduration=2.230413225 podStartE2EDuration="8.769585016s" totalImagesPullingTime="6.539171791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:04:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:04:48.768394397 +0000 UTC m=+73.041254206" watchObservedRunningTime="2026-07-24 17:04:48.769585016 +0000 UTC m=+73.042444797"
Jul 24 17:04:49.327997 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:49.327962    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76b4f64bf4-n8psm"]
Jul 24 17:04:49.365665 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:49.365632    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5747f7df57-5qfkl"]
Jul 24 17:04:49.367976 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:49.367956    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5747f7df57-5qfkl"
Jul 24 17:04:49.380902 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:49.380877    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5747f7df57-5qfkl"]
Jul 24 17:04:49.508445 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:49.508405    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7f2f8de-f792-44b2-8822-18b7a9de4d67-console-config\") pod \"console-5747f7df57-5qfkl\" (UID: \"d7f2f8de-f792-44b2-8822-18b7a9de4d67\") " pod="openshift-console/console-5747f7df57-5qfkl"
Jul 24 17:04:49.508445 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:49.508444    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7f2f8de-f792-44b2-8822-18b7a9de4d67-trusted-ca-bundle\") pod \"console-5747f7df57-5qfkl\" (UID: \"d7f2f8de-f792-44b2-8822-18b7a9de4d67\") " pod="openshift-console/console-5747f7df57-5qfkl"
Jul 24 17:04:49.508679 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:49.508534    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwcj9\" (UniqueName: \"kubernetes.io/projected/d7f2f8de-f792-44b2-8822-18b7a9de4d67-kube-api-access-nwcj9\") pod \"console-5747f7df57-5qfkl\" (UID: \"d7f2f8de-f792-44b2-8822-18b7a9de4d67\") " pod="openshift-console/console-5747f7df57-5qfkl"
Jul 24 17:04:49.508679 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:49.508569    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7f2f8de-f792-44b2-8822-18b7a9de4d67-oauth-serving-cert\") pod \"console-5747f7df57-5qfkl\" (UID: \"d7f2f8de-f792-44b2-8822-18b7a9de4d67\") " pod="openshift-console/console-5747f7df57-5qfkl"
Jul 24 17:04:49.508679 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:49.508600    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7f2f8de-f792-44b2-8822-18b7a9de4d67-console-oauth-config\") pod \"console-5747f7df57-5qfkl\" (UID: \"d7f2f8de-f792-44b2-8822-18b7a9de4d67\") " pod="openshift-console/console-5747f7df57-5qfkl"
Jul 24 17:04:49.508679 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:49.508629    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7f2f8de-f792-44b2-8822-18b7a9de4d67-service-ca\") pod \"console-5747f7df57-5qfkl\" (UID: \"d7f2f8de-f792-44b2-8822-18b7a9de4d67\") " pod="openshift-console/console-5747f7df57-5qfkl"
Jul 24 17:04:49.508839 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:49.508778    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7f2f8de-f792-44b2-8822-18b7a9de4d67-console-serving-cert\") pod \"console-5747f7df57-5qfkl\" (UID: \"d7f2f8de-f792-44b2-8822-18b7a9de4d67\") " pod="openshift-console/console-5747f7df57-5qfkl"
Jul 24 17:04:49.606518 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:49.606439    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-65668b444c-5xnm9"
Jul 24 17:04:49.609829 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:49.609795    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7f2f8de-f792-44b2-8822-18b7a9de4d67-console-serving-cert\") pod \"console-5747f7df57-5qfkl\" (UID: \"d7f2f8de-f792-44b2-8822-18b7a9de4d67\") " pod="openshift-console/console-5747f7df57-5qfkl"
Jul 24 17:04:49.609975 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:49.609862    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7f2f8de-f792-44b2-8822-18b7a9de4d67-console-config\") pod \"console-5747f7df57-5qfkl\" (UID: \"d7f2f8de-f792-44b2-8822-18b7a9de4d67\") " pod="openshift-console/console-5747f7df57-5qfkl"
Jul 24 17:04:49.609975 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:49.609889    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7f2f8de-f792-44b2-8822-18b7a9de4d67-trusted-ca-bundle\") pod \"console-5747f7df57-5qfkl\" (UID: \"d7f2f8de-f792-44b2-8822-18b7a9de4d67\") " pod="openshift-console/console-5747f7df57-5qfkl"
Jul 24 17:04:49.609975 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:49.609919    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwcj9\" (UniqueName: \"kubernetes.io/projected/d7f2f8de-f792-44b2-8822-18b7a9de4d67-kube-api-access-nwcj9\") pod \"console-5747f7df57-5qfkl\" (UID: \"d7f2f8de-f792-44b2-8822-18b7a9de4d67\") " pod="openshift-console/console-5747f7df57-5qfkl"
Jul 24 17:04:49.609975 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:49.609943    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7f2f8de-f792-44b2-8822-18b7a9de4d67-oauth-serving-cert\") pod \"console-5747f7df57-5qfkl\" (UID: \"d7f2f8de-f792-44b2-8822-18b7a9de4d67\") " pod="openshift-console/console-5747f7df57-5qfkl"
Jul 24 17:04:49.609975 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:49.609969    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7f2f8de-f792-44b2-8822-18b7a9de4d67-console-oauth-config\") pod \"console-5747f7df57-5qfkl\" (UID: \"d7f2f8de-f792-44b2-8822-18b7a9de4d67\") " pod="openshift-console/console-5747f7df57-5qfkl"
Jul 24 17:04:49.610259 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:49.609996    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7f2f8de-f792-44b2-8822-18b7a9de4d67-service-ca\") pod \"console-5747f7df57-5qfkl\" (UID: \"d7f2f8de-f792-44b2-8822-18b7a9de4d67\") " pod="openshift-console/console-5747f7df57-5qfkl"
Jul 24 17:04:49.610723 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:49.610696    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7f2f8de-f792-44b2-8822-18b7a9de4d67-console-config\") pod \"console-5747f7df57-5qfkl\" (UID: \"d7f2f8de-f792-44b2-8822-18b7a9de4d67\") " pod="openshift-console/console-5747f7df57-5qfkl"
Jul 24 17:04:49.610846 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:49.610770    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7f2f8de-f792-44b2-8822-18b7a9de4d67-oauth-serving-cert\") pod \"console-5747f7df57-5qfkl\" (UID: \"d7f2f8de-f792-44b2-8822-18b7a9de4d67\") " pod="openshift-console/console-5747f7df57-5qfkl"
Jul 24 17:04:49.610846 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:49.610779    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7f2f8de-f792-44b2-8822-18b7a9de4d67-service-ca\") pod \"console-5747f7df57-5qfkl\" (UID: \"d7f2f8de-f792-44b2-8822-18b7a9de4d67\") " pod="openshift-console/console-5747f7df57-5qfkl"
Jul 24 17:04:49.610955 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:49.610934    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7f2f8de-f792-44b2-8822-18b7a9de4d67-trusted-ca-bundle\") pod \"console-5747f7df57-5qfkl\" (UID: \"d7f2f8de-f792-44b2-8822-18b7a9de4d67\") " pod="openshift-console/console-5747f7df57-5qfkl"
Jul 24 17:04:49.613130 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:49.613105    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7f2f8de-f792-44b2-8822-18b7a9de4d67-console-oauth-config\") pod \"console-5747f7df57-5qfkl\" (UID: \"d7f2f8de-f792-44b2-8822-18b7a9de4d67\") " pod="openshift-console/console-5747f7df57-5qfkl"
Jul 24 17:04:49.613395 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:49.613376    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7f2f8de-f792-44b2-8822-18b7a9de4d67-console-serving-cert\") pod \"console-5747f7df57-5qfkl\" (UID: \"d7f2f8de-f792-44b2-8822-18b7a9de4d67\") " pod="openshift-console/console-5747f7df57-5qfkl"
Jul 24 17:04:49.624547 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:49.624518    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwcj9\" (UniqueName: \"kubernetes.io/projected/d7f2f8de-f792-44b2-8822-18b7a9de4d67-kube-api-access-nwcj9\") pod \"console-5747f7df57-5qfkl\" (UID: \"d7f2f8de-f792-44b2-8822-18b7a9de4d67\") " pod="openshift-console/console-5747f7df57-5qfkl"
Jul 24 17:04:49.680025 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:49.679986    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5747f7df57-5qfkl"
Jul 24 17:04:49.832210 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:49.832179    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5747f7df57-5qfkl"]
Jul 24 17:04:49.835095 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:04:49.835046    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7f2f8de_f792_44b2_8822_18b7a9de4d67.slice/crio-fd8733b1ae23f1659a40d9f54b590de0fd4e9aee9e6de419d1c9ded7b68db00e WatchSource:0}: Error finding container fd8733b1ae23f1659a40d9f54b590de0fd4e9aee9e6de419d1c9ded7b68db00e: Status 404 returned error can't find the container with id fd8733b1ae23f1659a40d9f54b590de0fd4e9aee9e6de419d1c9ded7b68db00e
Jul 24 17:04:50.652519 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:50.652481    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5747f7df57-5qfkl" event={"ID":"d7f2f8de-f792-44b2-8822-18b7a9de4d67","Type":"ContainerStarted","Data":"8a681e32e2872eed25068ebfb391c183e54cd68959eefad07dae0fc135c260e7"}
Jul 24 17:04:50.652958 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:50.652535    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5747f7df57-5qfkl" event={"ID":"d7f2f8de-f792-44b2-8822-18b7a9de4d67","Type":"ContainerStarted","Data":"fd8733b1ae23f1659a40d9f54b590de0fd4e9aee9e6de419d1c9ded7b68db00e"}
Jul 24 17:04:50.669280 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:50.669221    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5747f7df57-5qfkl" podStartSLOduration=1.6692002929999998 podStartE2EDuration="1.669200293s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:04:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:04:50.668762602 +0000 UTC m=+74.941622404" watchObservedRunningTime="2026-07-24 17:04:50.669200293 +0000 UTC m=+74.942060074"
Jul 24 17:04:52.666076 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:52.666037    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"04714f9c-4dd0-48a0-81cc-3e3d42031243","Type":"ContainerStarted","Data":"aa6a0f067a3fcb0137cde9b219521d8b9e98f865058bdd59dd0f882e38274b84"}
Jul 24 17:04:52.666414 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:52.666131    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"04714f9c-4dd0-48a0-81cc-3e3d42031243","Type":"ContainerStarted","Data":"5a369abcc86b96178d36d0b4c552b512ccdfca50c9f9371daaa2ac3948b4f56d"}
Jul 24 17:04:52.666414 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:52.666180    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"04714f9c-4dd0-48a0-81cc-3e3d42031243","Type":"ContainerStarted","Data":"0ab8af5705cc0a99488efc3f912c32497558b683611a2bae70b588c1415f31ba"}
Jul 24 17:04:52.666414 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:52.666225    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"04714f9c-4dd0-48a0-81cc-3e3d42031243","Type":"ContainerStarted","Data":"f7f335b95ba536111f08ae921120068918151d1263d0963accee908c6fd54170"}
Jul 24 17:04:52.666414 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:52.666265    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"04714f9c-4dd0-48a0-81cc-3e3d42031243","Type":"ContainerStarted","Data":"ee434d35fa0967b8ab449a4386b1fc211487920c8903e7db4013e9e5ba572e08"}
Jul 24 17:04:52.793017 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:52.792926    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76b4f64bf4-n8psm"
Jul 24 17:04:53.673717 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:53.673686    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"04714f9c-4dd0-48a0-81cc-3e3d42031243","Type":"ContainerStarted","Data":"f5cb55afd90156d756a10c8e2c5b9126f293c1513afaf58dd88ed2452b594adb"}
Jul 24 17:04:53.702576 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:53.702520    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.18226844 podStartE2EDuration="11.702499984s" totalImagesPullingTime="8.489917164s" totalInitContainerRuntime="30.31438ms" isStatefulPod=false podCreationTimestamp="2026-07-24 17:04:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:04:53.700252009 +0000 UTC m=+77.973111814" watchObservedRunningTime="2026-07-24 17:04:53.702499984 +0000 UTC m=+77.975359766"
Jul 24 17:04:57.905617 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:57.905502    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:04:59.680358 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:59.680325    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5747f7df57-5qfkl"
Jul 24 17:04:59.680743 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:59.680385    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5747f7df57-5qfkl"
Jul 24 17:04:59.684956 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:59.684935    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5747f7df57-5qfkl"
Jul 24 17:04:59.701966 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:59.701939    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5747f7df57-5qfkl"
Jul 24 17:04:59.743917 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:04:59.743889    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56b99dcc7f-8t7ms"]
Jul 24 17:05:01.070289 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:01.070259    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5cb8c7df6c-5xvcw"
Jul 24 17:05:01.070649 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:01.070339    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5cb8c7df6c-5xvcw"
Jul 24 17:05:14.353928 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:14.353865    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-76b4f64bf4-n8psm" podUID="fad6f791-b9af-465c-9fb1-5e19e99fef60" containerName="console" containerID="cri-o://6dfc476ad0e2c525efbec6760e129b67b51bffa68f5f13420144af17a4e3bd0a" gracePeriod=15
Jul 24 17:05:14.593619 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:14.593592    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76b4f64bf4-n8psm"
Jul 24 17:05:14.734141 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:14.734106    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fad6f791-b9af-465c-9fb1-5e19e99fef60-service-ca\") pod \"fad6f791-b9af-465c-9fb1-5e19e99fef60\" (UID: \"fad6f791-b9af-465c-9fb1-5e19e99fef60\") "
Jul 24 17:05:14.734341 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:14.734152    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fad6f791-b9af-465c-9fb1-5e19e99fef60-console-oauth-config\") pod \"fad6f791-b9af-465c-9fb1-5e19e99fef60\" (UID: \"fad6f791-b9af-465c-9fb1-5e19e99fef60\") "
Jul 24 17:05:14.734341 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:14.734179    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fad6f791-b9af-465c-9fb1-5e19e99fef60-console-serving-cert\") pod \"fad6f791-b9af-465c-9fb1-5e19e99fef60\" (UID: \"fad6f791-b9af-465c-9fb1-5e19e99fef60\") "
Jul 24 17:05:14.734341 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:14.734238    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fad6f791-b9af-465c-9fb1-5e19e99fef60-console-config\") pod \"fad6f791-b9af-465c-9fb1-5e19e99fef60\" (UID: \"fad6f791-b9af-465c-9fb1-5e19e99fef60\") "
Jul 24 17:05:14.734341 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:14.734263    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fad6f791-b9af-465c-9fb1-5e19e99fef60-oauth-serving-cert\") pod \"fad6f791-b9af-465c-9fb1-5e19e99fef60\" (UID: \"fad6f791-b9af-465c-9fb1-5e19e99fef60\") "
Jul 24 17:05:14.734341 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:14.734333    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fad6f791-b9af-465c-9fb1-5e19e99fef60-trusted-ca-bundle\") pod \"fad6f791-b9af-465c-9fb1-5e19e99fef60\" (UID: \"fad6f791-b9af-465c-9fb1-5e19e99fef60\") "
Jul 24 17:05:14.734574 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:14.734359    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwsw2\" (UniqueName: \"kubernetes.io/projected/fad6f791-b9af-465c-9fb1-5e19e99fef60-kube-api-access-bwsw2\") pod \"fad6f791-b9af-465c-9fb1-5e19e99fef60\" (UID: \"fad6f791-b9af-465c-9fb1-5e19e99fef60\") "
Jul 24 17:05:14.734621 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:14.734506    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fad6f791-b9af-465c-9fb1-5e19e99fef60-service-ca" (OuterVolumeSpecName: "service-ca") pod "fad6f791-b9af-465c-9fb1-5e19e99fef60" (UID: "fad6f791-b9af-465c-9fb1-5e19e99fef60"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:05:14.734708 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:14.734676    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fad6f791-b9af-465c-9fb1-5e19e99fef60-console-config" (OuterVolumeSpecName: "console-config") pod "fad6f791-b9af-465c-9fb1-5e19e99fef60" (UID: "fad6f791-b9af-465c-9fb1-5e19e99fef60"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:05:14.735507 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:14.735418    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fad6f791-b9af-465c-9fb1-5e19e99fef60-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fad6f791-b9af-465c-9fb1-5e19e99fef60" (UID: "fad6f791-b9af-465c-9fb1-5e19e99fef60"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:05:14.735655 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:14.735586    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fad6f791-b9af-465c-9fb1-5e19e99fef60-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fad6f791-b9af-465c-9fb1-5e19e99fef60" (UID: "fad6f791-b9af-465c-9fb1-5e19e99fef60"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:05:14.740971 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:14.740711    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fad6f791-b9af-465c-9fb1-5e19e99fef60-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fad6f791-b9af-465c-9fb1-5e19e99fef60" (UID: "fad6f791-b9af-465c-9fb1-5e19e99fef60"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:05:14.740971 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:14.740912    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fad6f791-b9af-465c-9fb1-5e19e99fef60-kube-api-access-bwsw2" (OuterVolumeSpecName: "kube-api-access-bwsw2") pod "fad6f791-b9af-465c-9fb1-5e19e99fef60" (UID: "fad6f791-b9af-465c-9fb1-5e19e99fef60"). InnerVolumeSpecName "kube-api-access-bwsw2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:05:14.741321 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:14.741265    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fad6f791-b9af-465c-9fb1-5e19e99fef60-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fad6f791-b9af-465c-9fb1-5e19e99fef60" (UID: "fad6f791-b9af-465c-9fb1-5e19e99fef60"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:05:14.760513 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:14.760489    2561 generic.go:356] "Generic (PLEG): container finished" podID="fad6f791-b9af-465c-9fb1-5e19e99fef60" containerID="6dfc476ad0e2c525efbec6760e129b67b51bffa68f5f13420144af17a4e3bd0a" exitCode=0
Jul 24 17:05:14.760627 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:14.760545    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76b4f64bf4-n8psm"
Jul 24 17:05:14.760627 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:14.760570    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76b4f64bf4-n8psm" event={"ID":"fad6f791-b9af-465c-9fb1-5e19e99fef60","Type":"ContainerDied","Data":"6dfc476ad0e2c525efbec6760e129b67b51bffa68f5f13420144af17a4e3bd0a"}
Jul 24 17:05:14.760704 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:14.760637    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76b4f64bf4-n8psm" event={"ID":"fad6f791-b9af-465c-9fb1-5e19e99fef60","Type":"ContainerDied","Data":"4a318a306e113d47d8946b50faa97ca09529497757409d1b385a038b274898ce"}
Jul 24 17:05:14.760704 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:14.760666    2561 scope.go:117] "RemoveContainer" containerID="6dfc476ad0e2c525efbec6760e129b67b51bffa68f5f13420144af17a4e3bd0a"
Jul 24 17:05:14.768945 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:14.768927    2561 scope.go:117] "RemoveContainer" containerID="6dfc476ad0e2c525efbec6760e129b67b51bffa68f5f13420144af17a4e3bd0a"
Jul 24 17:05:14.769234 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:05:14.769215    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6dfc476ad0e2c525efbec6760e129b67b51bffa68f5f13420144af17a4e3bd0a\": container with ID starting with 6dfc476ad0e2c525efbec6760e129b67b51bffa68f5f13420144af17a4e3bd0a not found: ID does not exist" containerID="6dfc476ad0e2c525efbec6760e129b67b51bffa68f5f13420144af17a4e3bd0a"
Jul 24 17:05:14.769305 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:14.769243    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dfc476ad0e2c525efbec6760e129b67b51bffa68f5f13420144af17a4e3bd0a"} err="failed to get container status \"6dfc476ad0e2c525efbec6760e129b67b51bffa68f5f13420144af17a4e3bd0a\": rpc error: code = NotFound desc = could not find container \"6dfc476ad0e2c525efbec6760e129b67b51bffa68f5f13420144af17a4e3bd0a\": container with ID starting with 6dfc476ad0e2c525efbec6760e129b67b51bffa68f5f13420144af17a4e3bd0a not found: ID does not exist"
Jul 24 17:05:14.780209 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:14.780155    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76b4f64bf4-n8psm"]
Jul 24 17:05:14.781980 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:14.781960    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-76b4f64bf4-n8psm"]
Jul 24 17:05:14.835946 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:14.835917    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fad6f791-b9af-465c-9fb1-5e19e99fef60-console-config\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:05:14.835946 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:14.835944    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fad6f791-b9af-465c-9fb1-5e19e99fef60-oauth-serving-cert\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:05:14.836138 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:14.835954    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fad6f791-b9af-465c-9fb1-5e19e99fef60-trusted-ca-bundle\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:05:14.836138 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:14.835966    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwsw2\" (UniqueName: \"kubernetes.io/projected/fad6f791-b9af-465c-9fb1-5e19e99fef60-kube-api-access-bwsw2\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:05:14.836138 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:14.835975    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fad6f791-b9af-465c-9fb1-5e19e99fef60-service-ca\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:05:14.836138 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:14.835982    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fad6f791-b9af-465c-9fb1-5e19e99fef60-console-oauth-config\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:05:14.836138 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:14.835990    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fad6f791-b9af-465c-9fb1-5e19e99fef60-console-serving-cert\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:05:16.257710 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:16.257677    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fad6f791-b9af-465c-9fb1-5e19e99fef60" path="/var/lib/kubelet/pods/fad6f791-b9af-465c-9fb1-5e19e99fef60/volumes"
Jul 24 17:05:19.647893 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:19.647864    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-spwhm"
Jul 24 17:05:21.075516 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:21.075486    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5cb8c7df6c-5xvcw"
Jul 24 17:05:21.079192 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:21.079173    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5cb8c7df6c-5xvcw"
Jul 24 17:05:24.763609 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:24.763571    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-56b99dcc7f-8t7ms" podUID="19766bb7-37d5-4fd4-a463-20fd7a7f89d7" containerName="console" containerID="cri-o://c4f3e3ee36603461e6fcc16d286d2030a10c1a27dbbdf1d15f512ee074f350b4" gracePeriod=15
Jul 24 17:05:25.037434 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:25.037361    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56b99dcc7f-8t7ms"
Jul 24 17:05:25.129140 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:25.129104    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7ss22\" (UniqueName: \"kubernetes.io/projected/19766bb7-37d5-4fd4-a463-20fd7a7f89d7-kube-api-access-7ss22\") pod \"19766bb7-37d5-4fd4-a463-20fd7a7f89d7\" (UID: \"19766bb7-37d5-4fd4-a463-20fd7a7f89d7\") "
Jul 24 17:05:25.129353 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:25.129158    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/19766bb7-37d5-4fd4-a463-20fd7a7f89d7-console-config\") pod \"19766bb7-37d5-4fd4-a463-20fd7a7f89d7\" (UID: \"19766bb7-37d5-4fd4-a463-20fd7a7f89d7\") "
Jul 24 17:05:25.129353 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:25.129194    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/19766bb7-37d5-4fd4-a463-20fd7a7f89d7-oauth-serving-cert\") pod \"19766bb7-37d5-4fd4-a463-20fd7a7f89d7\" (UID: \"19766bb7-37d5-4fd4-a463-20fd7a7f89d7\") "
Jul 24 17:05:25.129353 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:25.129216    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/19766bb7-37d5-4fd4-a463-20fd7a7f89d7-service-ca\") pod \"19766bb7-37d5-4fd4-a463-20fd7a7f89d7\" (UID: \"19766bb7-37d5-4fd4-a463-20fd7a7f89d7\") "
Jul 24 17:05:25.129353 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:25.129238    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19766bb7-37d5-4fd4-a463-20fd7a7f89d7-trusted-ca-bundle\") pod \"19766bb7-37d5-4fd4-a463-20fd7a7f89d7\" (UID: \"19766bb7-37d5-4fd4-a463-20fd7a7f89d7\") "
Jul 24 17:05:25.129353 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:25.129315    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/19766bb7-37d5-4fd4-a463-20fd7a7f89d7-console-serving-cert\") pod \"19766bb7-37d5-4fd4-a463-20fd7a7f89d7\" (UID: \"19766bb7-37d5-4fd4-a463-20fd7a7f89d7\") "
Jul 24 17:05:25.129353 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:25.129338    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/19766bb7-37d5-4fd4-a463-20fd7a7f89d7-console-oauth-config\") pod \"19766bb7-37d5-4fd4-a463-20fd7a7f89d7\" (UID: \"19766bb7-37d5-4fd4-a463-20fd7a7f89d7\") "
Jul 24 17:05:25.129718 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:25.129663    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19766bb7-37d5-4fd4-a463-20fd7a7f89d7-service-ca" (OuterVolumeSpecName: "service-ca") pod "19766bb7-37d5-4fd4-a463-20fd7a7f89d7" (UID: "19766bb7-37d5-4fd4-a463-20fd7a7f89d7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:05:25.129718 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:25.129678    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19766bb7-37d5-4fd4-a463-20fd7a7f89d7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "19766bb7-37d5-4fd4-a463-20fd7a7f89d7" (UID: "19766bb7-37d5-4fd4-a463-20fd7a7f89d7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:05:25.129718 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:25.129669    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19766bb7-37d5-4fd4-a463-20fd7a7f89d7-console-config" (OuterVolumeSpecName: "console-config") pod "19766bb7-37d5-4fd4-a463-20fd7a7f89d7" (UID: "19766bb7-37d5-4fd4-a463-20fd7a7f89d7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:05:25.129947 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:25.129733    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19766bb7-37d5-4fd4-a463-20fd7a7f89d7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "19766bb7-37d5-4fd4-a463-20fd7a7f89d7" (UID: "19766bb7-37d5-4fd4-a463-20fd7a7f89d7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:05:25.131648 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:25.131622    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19766bb7-37d5-4fd4-a463-20fd7a7f89d7-kube-api-access-7ss22" (OuterVolumeSpecName: "kube-api-access-7ss22") pod "19766bb7-37d5-4fd4-a463-20fd7a7f89d7" (UID: "19766bb7-37d5-4fd4-a463-20fd7a7f89d7"). InnerVolumeSpecName "kube-api-access-7ss22". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:05:25.131732 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:25.131625    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19766bb7-37d5-4fd4-a463-20fd7a7f89d7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "19766bb7-37d5-4fd4-a463-20fd7a7f89d7" (UID: "19766bb7-37d5-4fd4-a463-20fd7a7f89d7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:05:25.131732 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:25.131675    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19766bb7-37d5-4fd4-a463-20fd7a7f89d7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "19766bb7-37d5-4fd4-a463-20fd7a7f89d7" (UID: "19766bb7-37d5-4fd4-a463-20fd7a7f89d7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:05:25.230227 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:25.230197    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/19766bb7-37d5-4fd4-a463-20fd7a7f89d7-console-config\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:05:25.230227 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:25.230224    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/19766bb7-37d5-4fd4-a463-20fd7a7f89d7-oauth-serving-cert\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:05:25.230227 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:25.230235    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/19766bb7-37d5-4fd4-a463-20fd7a7f89d7-service-ca\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:05:25.230458 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:25.230243    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19766bb7-37d5-4fd4-a463-20fd7a7f89d7-trusted-ca-bundle\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:05:25.230458 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:25.230252    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/19766bb7-37d5-4fd4-a463-20fd7a7f89d7-console-serving-cert\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:05:25.230458 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:25.230260    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/19766bb7-37d5-4fd4-a463-20fd7a7f89d7-console-oauth-config\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:05:25.230458 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:25.230268    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7ss22\" (UniqueName: \"kubernetes.io/projected/19766bb7-37d5-4fd4-a463-20fd7a7f89d7-kube-api-access-7ss22\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:05:25.809399 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:25.809365    2561 generic.go:356] "Generic (PLEG): container finished" podID="19766bb7-37d5-4fd4-a463-20fd7a7f89d7" containerID="c4f3e3ee36603461e6fcc16d286d2030a10c1a27dbbdf1d15f512ee074f350b4" exitCode=0
Jul 24 17:05:25.809399 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:25.809402    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56b99dcc7f-8t7ms" event={"ID":"19766bb7-37d5-4fd4-a463-20fd7a7f89d7","Type":"ContainerDied","Data":"c4f3e3ee36603461e6fcc16d286d2030a10c1a27dbbdf1d15f512ee074f350b4"}
Jul 24 17:05:25.809848 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:25.809414    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56b99dcc7f-8t7ms"
Jul 24 17:05:25.809848 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:25.809437    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56b99dcc7f-8t7ms" event={"ID":"19766bb7-37d5-4fd4-a463-20fd7a7f89d7","Type":"ContainerDied","Data":"bf276c1286a6eca5a9c635218f2e641d197b7b361278bfa835b050c76c26a100"}
Jul 24 17:05:25.809848 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:25.809456    2561 scope.go:117] "RemoveContainer" containerID="c4f3e3ee36603461e6fcc16d286d2030a10c1a27dbbdf1d15f512ee074f350b4"
Jul 24 17:05:25.818043 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:25.818026    2561 scope.go:117] "RemoveContainer" containerID="c4f3e3ee36603461e6fcc16d286d2030a10c1a27dbbdf1d15f512ee074f350b4"
Jul 24 17:05:25.818336 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:05:25.818319    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4f3e3ee36603461e6fcc16d286d2030a10c1a27dbbdf1d15f512ee074f350b4\": container with ID starting with c4f3e3ee36603461e6fcc16d286d2030a10c1a27dbbdf1d15f512ee074f350b4 not found: ID does not exist" containerID="c4f3e3ee36603461e6fcc16d286d2030a10c1a27dbbdf1d15f512ee074f350b4"
Jul 24 17:05:25.818382 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:25.818343    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4f3e3ee36603461e6fcc16d286d2030a10c1a27dbbdf1d15f512ee074f350b4"} err="failed to get container status \"c4f3e3ee36603461e6fcc16d286d2030a10c1a27dbbdf1d15f512ee074f350b4\": rpc error: code = NotFound desc = could not find container \"c4f3e3ee36603461e6fcc16d286d2030a10c1a27dbbdf1d15f512ee074f350b4\": container with ID starting with c4f3e3ee36603461e6fcc16d286d2030a10c1a27dbbdf1d15f512ee074f350b4 not found: ID does not exist"
Jul 24 17:05:25.829207 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:25.829181    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56b99dcc7f-8t7ms"]
Jul 24 17:05:25.833112 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:25.833088    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56b99dcc7f-8t7ms"]
Jul 24 17:05:26.257577 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:26.257541    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19766bb7-37d5-4fd4-a463-20fd7a7f89d7" path="/var/lib/kubelet/pods/19766bb7-37d5-4fd4-a463-20fd7a7f89d7/volumes"
Jul 24 17:05:42.906008 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:42.905978    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:05:42.924816 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:42.924790    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:05:43.894136 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:43.894109    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:05:59.351286 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:59.351257    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f7d57fb6-rc8xd"]
Jul 24 17:05:59.351759 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:59.351583    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fad6f791-b9af-465c-9fb1-5e19e99fef60" containerName="console"
Jul 24 17:05:59.351759 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:59.351595    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="fad6f791-b9af-465c-9fb1-5e19e99fef60" containerName="console"
Jul 24 17:05:59.351759 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:59.351608    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19766bb7-37d5-4fd4-a463-20fd7a7f89d7" containerName="console"
Jul 24 17:05:59.351759 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:59.351613    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="19766bb7-37d5-4fd4-a463-20fd7a7f89d7" containerName="console"
Jul 24 17:05:59.351759 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:59.351664    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="fad6f791-b9af-465c-9fb1-5e19e99fef60" containerName="console"
Jul 24 17:05:59.351759 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:59.351672    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="19766bb7-37d5-4fd4-a463-20fd7a7f89d7" containerName="console"
Jul 24 17:05:59.353327 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:59.353312    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f7d57fb6-rc8xd"
Jul 24 17:05:59.364406 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:59.364382    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f7d57fb6-rc8xd"]
Jul 24 17:05:59.396827 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:59.396802    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6cb808ca-8cb9-48e7-8304-bc160dc4cd7d-service-ca\") pod \"console-7f7d57fb6-rc8xd\" (UID: \"6cb808ca-8cb9-48e7-8304-bc160dc4cd7d\") " pod="openshift-console/console-7f7d57fb6-rc8xd"
Jul 24 17:05:59.396934 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:59.396837    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6cb808ca-8cb9-48e7-8304-bc160dc4cd7d-trusted-ca-bundle\") pod \"console-7f7d57fb6-rc8xd\" (UID: \"6cb808ca-8cb9-48e7-8304-bc160dc4cd7d\") " pod="openshift-console/console-7f7d57fb6-rc8xd"
Jul 24 17:05:59.396934 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:59.396868    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6cb808ca-8cb9-48e7-8304-bc160dc4cd7d-console-oauth-config\") pod \"console-7f7d57fb6-rc8xd\" (UID: \"6cb808ca-8cb9-48e7-8304-bc160dc4cd7d\") " pod="openshift-console/console-7f7d57fb6-rc8xd"
Jul 24 17:05:59.396934 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:59.396893    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4gtw\" (UniqueName: \"kubernetes.io/projected/6cb808ca-8cb9-48e7-8304-bc160dc4cd7d-kube-api-access-r4gtw\") pod \"console-7f7d57fb6-rc8xd\" (UID: \"6cb808ca-8cb9-48e7-8304-bc160dc4cd7d\") " pod="openshift-console/console-7f7d57fb6-rc8xd"
Jul 24 17:05:59.396934 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:59.396920    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6cb808ca-8cb9-48e7-8304-bc160dc4cd7d-console-config\") pod \"console-7f7d57fb6-rc8xd\" (UID: \"6cb808ca-8cb9-48e7-8304-bc160dc4cd7d\") " pod="openshift-console/console-7f7d57fb6-rc8xd"
Jul 24 17:05:59.397088 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:59.396964    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6cb808ca-8cb9-48e7-8304-bc160dc4cd7d-oauth-serving-cert\") pod \"console-7f7d57fb6-rc8xd\" (UID: \"6cb808ca-8cb9-48e7-8304-bc160dc4cd7d\") " pod="openshift-console/console-7f7d57fb6-rc8xd"
Jul 24 17:05:59.397088 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:59.397013    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6cb808ca-8cb9-48e7-8304-bc160dc4cd7d-console-serving-cert\") pod \"console-7f7d57fb6-rc8xd\" (UID: \"6cb808ca-8cb9-48e7-8304-bc160dc4cd7d\") " pod="openshift-console/console-7f7d57fb6-rc8xd"
Jul 24 17:05:59.498245 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:59.498215    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6cb808ca-8cb9-48e7-8304-bc160dc4cd7d-service-ca\") pod \"console-7f7d57fb6-rc8xd\" (UID: \"6cb808ca-8cb9-48e7-8304-bc160dc4cd7d\") " pod="openshift-console/console-7f7d57fb6-rc8xd"
Jul 24 17:05:59.498374 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:59.498250    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6cb808ca-8cb9-48e7-8304-bc160dc4cd7d-trusted-ca-bundle\") pod \"console-7f7d57fb6-rc8xd\" (UID: \"6cb808ca-8cb9-48e7-8304-bc160dc4cd7d\") " pod="openshift-console/console-7f7d57fb6-rc8xd"
Jul 24 17:05:59.498374 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:59.498286    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6cb808ca-8cb9-48e7-8304-bc160dc4cd7d-console-oauth-config\") pod \"console-7f7d57fb6-rc8xd\" (UID: \"6cb808ca-8cb9-48e7-8304-bc160dc4cd7d\") " pod="openshift-console/console-7f7d57fb6-rc8xd"
Jul 24 17:05:59.498374 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:59.498315    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4gtw\" (UniqueName: \"kubernetes.io/projected/6cb808ca-8cb9-48e7-8304-bc160dc4cd7d-kube-api-access-r4gtw\") pod \"console-7f7d57fb6-rc8xd\" (UID: \"6cb808ca-8cb9-48e7-8304-bc160dc4cd7d\") " pod="openshift-console/console-7f7d57fb6-rc8xd"
Jul 24 17:05:59.498374 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:59.498334    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6cb808ca-8cb9-48e7-8304-bc160dc4cd7d-console-config\") pod \"console-7f7d57fb6-rc8xd\" (UID: \"6cb808ca-8cb9-48e7-8304-bc160dc4cd7d\") " pod="openshift-console/console-7f7d57fb6-rc8xd"
Jul 24 17:05:59.498374 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:59.498352    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6cb808ca-8cb9-48e7-8304-bc160dc4cd7d-oauth-serving-cert\") pod \"console-7f7d57fb6-rc8xd\" (UID: \"6cb808ca-8cb9-48e7-8304-bc160dc4cd7d\") " pod="openshift-console/console-7f7d57fb6-rc8xd"
Jul 24 17:05:59.498583 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:59.498535    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6cb808ca-8cb9-48e7-8304-bc160dc4cd7d-console-serving-cert\") pod \"console-7f7d57fb6-rc8xd\" (UID: \"6cb808ca-8cb9-48e7-8304-bc160dc4cd7d\") " pod="openshift-console/console-7f7d57fb6-rc8xd"
Jul 24 17:05:59.499162 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:59.499136    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6cb808ca-8cb9-48e7-8304-bc160dc4cd7d-oauth-serving-cert\") pod \"console-7f7d57fb6-rc8xd\" (UID: \"6cb808ca-8cb9-48e7-8304-bc160dc4cd7d\") " pod="openshift-console/console-7f7d57fb6-rc8xd"
Jul 24 17:05:59.499162 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:59.499155    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6cb808ca-8cb9-48e7-8304-bc160dc4cd7d-trusted-ca-bundle\") pod \"console-7f7d57fb6-rc8xd\" (UID: \"6cb808ca-8cb9-48e7-8304-bc160dc4cd7d\") " pod="openshift-console/console-7f7d57fb6-rc8xd"
Jul 24 17:05:59.499335 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:59.499138    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6cb808ca-8cb9-48e7-8304-bc160dc4cd7d-service-ca\") pod \"console-7f7d57fb6-rc8xd\" (UID: \"6cb808ca-8cb9-48e7-8304-bc160dc4cd7d\") " pod="openshift-console/console-7f7d57fb6-rc8xd"
Jul 24 17:05:59.499335 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:59.499204    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6cb808ca-8cb9-48e7-8304-bc160dc4cd7d-console-config\") pod \"console-7f7d57fb6-rc8xd\" (UID: \"6cb808ca-8cb9-48e7-8304-bc160dc4cd7d\") " pod="openshift-console/console-7f7d57fb6-rc8xd"
Jul 24 17:05:59.500794 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:59.500777    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6cb808ca-8cb9-48e7-8304-bc160dc4cd7d-console-oauth-config\") pod \"console-7f7d57fb6-rc8xd\" (UID: \"6cb808ca-8cb9-48e7-8304-bc160dc4cd7d\") " pod="openshift-console/console-7f7d57fb6-rc8xd"
Jul 24 17:05:59.500885 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:59.500868    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6cb808ca-8cb9-48e7-8304-bc160dc4cd7d-console-serving-cert\") pod \"console-7f7d57fb6-rc8xd\" (UID: \"6cb808ca-8cb9-48e7-8304-bc160dc4cd7d\") " pod="openshift-console/console-7f7d57fb6-rc8xd"
Jul 24 17:05:59.506341 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:59.506322    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4gtw\" (UniqueName: \"kubernetes.io/projected/6cb808ca-8cb9-48e7-8304-bc160dc4cd7d-kube-api-access-r4gtw\") pod \"console-7f7d57fb6-rc8xd\" (UID: \"6cb808ca-8cb9-48e7-8304-bc160dc4cd7d\") " pod="openshift-console/console-7f7d57fb6-rc8xd"
Jul 24 17:05:59.662216 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:59.662189    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f7d57fb6-rc8xd"
Jul 24 17:05:59.792251 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:59.792109    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f7d57fb6-rc8xd"]
Jul 24 17:05:59.794964 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:05:59.794934    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cb808ca_8cb9_48e7_8304_bc160dc4cd7d.slice/crio-297cedf2ff45f52e3a44bdb2da66b8872e56eb70760bb5ca315cf26d623ad5bd WatchSource:0}: Error finding container 297cedf2ff45f52e3a44bdb2da66b8872e56eb70760bb5ca315cf26d623ad5bd: Status 404 returned error can't find the container with id 297cedf2ff45f52e3a44bdb2da66b8872e56eb70760bb5ca315cf26d623ad5bd
Jul 24 17:05:59.942903 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:59.942816    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f7d57fb6-rc8xd" event={"ID":"6cb808ca-8cb9-48e7-8304-bc160dc4cd7d","Type":"ContainerStarted","Data":"d146d8258fca41f37a057da7c40bb78f6e3663401d637d7b1be87d5509f09882"}
Jul 24 17:05:59.942903 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:59.942870    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f7d57fb6-rc8xd" event={"ID":"6cb808ca-8cb9-48e7-8304-bc160dc4cd7d","Type":"ContainerStarted","Data":"297cedf2ff45f52e3a44bdb2da66b8872e56eb70760bb5ca315cf26d623ad5bd"}
Jul 24 17:05:59.962426 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:05:59.962375    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f7d57fb6-rc8xd" podStartSLOduration=0.962359199 podStartE2EDuration="962.359199ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:05:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:05:59.960501603 +0000 UTC m=+144.233361408" watchObservedRunningTime="2026-07-24 17:05:59.962359199 +0000 UTC m=+144.235218979"
Jul 24 17:06:09.662696 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:06:09.662657    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f7d57fb6-rc8xd"
Jul 24 17:06:09.663154 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:06:09.662718    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f7d57fb6-rc8xd"
Jul 24 17:06:09.667454 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:06:09.667431    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f7d57fb6-rc8xd"
Jul 24 17:06:09.984327 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:06:09.984251    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f7d57fb6-rc8xd"
Jul 24 17:06:10.037030 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:06:10.036990    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5747f7df57-5qfkl"]
Jul 24 17:06:35.056256 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:06:35.056148    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5747f7df57-5qfkl" podUID="d7f2f8de-f792-44b2-8822-18b7a9de4d67" containerName="console" containerID="cri-o://8a681e32e2872eed25068ebfb391c183e54cd68959eefad07dae0fc135c260e7" gracePeriod=15
Jul 24 17:06:35.289724 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:06:35.289702    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5747f7df57-5qfkl"
Jul 24 17:06:35.407441 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:06:35.407413    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7f2f8de-f792-44b2-8822-18b7a9de4d67-trusted-ca-bundle\") pod \"d7f2f8de-f792-44b2-8822-18b7a9de4d67\" (UID: \"d7f2f8de-f792-44b2-8822-18b7a9de4d67\") "
Jul 24 17:06:35.407594 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:06:35.407453    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7f2f8de-f792-44b2-8822-18b7a9de4d67-service-ca\") pod \"d7f2f8de-f792-44b2-8822-18b7a9de4d67\" (UID: \"d7f2f8de-f792-44b2-8822-18b7a9de4d67\") "
Jul 24 17:06:35.407594 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:06:35.407472    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7f2f8de-f792-44b2-8822-18b7a9de4d67-console-oauth-config\") pod \"d7f2f8de-f792-44b2-8822-18b7a9de4d67\" (UID: \"d7f2f8de-f792-44b2-8822-18b7a9de4d67\") "
Jul 24 17:06:35.407594 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:06:35.407488    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7f2f8de-f792-44b2-8822-18b7a9de4d67-console-serving-cert\") pod \"d7f2f8de-f792-44b2-8822-18b7a9de4d67\" (UID: \"d7f2f8de-f792-44b2-8822-18b7a9de4d67\") "
Jul 24 17:06:35.407756 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:06:35.407589    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nwcj9\" (UniqueName: \"kubernetes.io/projected/d7f2f8de-f792-44b2-8822-18b7a9de4d67-kube-api-access-nwcj9\") pod \"d7f2f8de-f792-44b2-8822-18b7a9de4d67\" (UID: \"d7f2f8de-f792-44b2-8822-18b7a9de4d67\") "
Jul 24 17:06:35.407756 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:06:35.407665    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7f2f8de-f792-44b2-8822-18b7a9de4d67-oauth-serving-cert\") pod \"d7f2f8de-f792-44b2-8822-18b7a9de4d67\" (UID: \"d7f2f8de-f792-44b2-8822-18b7a9de4d67\") "
Jul 24 17:06:35.407756 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:06:35.407699    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7f2f8de-f792-44b2-8822-18b7a9de4d67-console-config\") pod \"d7f2f8de-f792-44b2-8822-18b7a9de4d67\" (UID: \"d7f2f8de-f792-44b2-8822-18b7a9de4d67\") "
Jul 24 17:06:35.407896 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:06:35.407811    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7f2f8de-f792-44b2-8822-18b7a9de4d67-service-ca" (OuterVolumeSpecName: "service-ca") pod "d7f2f8de-f792-44b2-8822-18b7a9de4d67" (UID: "d7f2f8de-f792-44b2-8822-18b7a9de4d67"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:06:35.407896 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:06:35.407846    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7f2f8de-f792-44b2-8822-18b7a9de4d67-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d7f2f8de-f792-44b2-8822-18b7a9de4d67" (UID: "d7f2f8de-f792-44b2-8822-18b7a9de4d67"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:06:35.408138 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:06:35.408113    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7f2f8de-f792-44b2-8822-18b7a9de4d67-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d7f2f8de-f792-44b2-8822-18b7a9de4d67" (UID: "d7f2f8de-f792-44b2-8822-18b7a9de4d67"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:06:35.408256 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:06:35.408138    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7f2f8de-f792-44b2-8822-18b7a9de4d67-trusted-ca-bundle\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:06:35.408256 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:06:35.408144    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7f2f8de-f792-44b2-8822-18b7a9de4d67-console-config" (OuterVolumeSpecName: "console-config") pod "d7f2f8de-f792-44b2-8822-18b7a9de4d67" (UID: "d7f2f8de-f792-44b2-8822-18b7a9de4d67"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:06:35.408256 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:06:35.408159    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7f2f8de-f792-44b2-8822-18b7a9de4d67-service-ca\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:06:35.409549 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:06:35.409524    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7f2f8de-f792-44b2-8822-18b7a9de4d67-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d7f2f8de-f792-44b2-8822-18b7a9de4d67" (UID: "d7f2f8de-f792-44b2-8822-18b7a9de4d67"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:06:35.409782 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:06:35.409768    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7f2f8de-f792-44b2-8822-18b7a9de4d67-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d7f2f8de-f792-44b2-8822-18b7a9de4d67" (UID: "d7f2f8de-f792-44b2-8822-18b7a9de4d67"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:06:35.410012 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:06:35.409992    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7f2f8de-f792-44b2-8822-18b7a9de4d67-kube-api-access-nwcj9" (OuterVolumeSpecName: "kube-api-access-nwcj9") pod "d7f2f8de-f792-44b2-8822-18b7a9de4d67" (UID: "d7f2f8de-f792-44b2-8822-18b7a9de4d67"). InnerVolumeSpecName "kube-api-access-nwcj9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:06:35.508851 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:06:35.508821    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7f2f8de-f792-44b2-8822-18b7a9de4d67-oauth-serving-cert\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:06:35.508851 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:06:35.508843    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7f2f8de-f792-44b2-8822-18b7a9de4d67-console-config\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:06:35.508851 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:06:35.508852    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7f2f8de-f792-44b2-8822-18b7a9de4d67-console-oauth-config\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:06:35.509022 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:06:35.508861    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7f2f8de-f792-44b2-8822-18b7a9de4d67-console-serving-cert\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:06:35.509022 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:06:35.508870    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwcj9\" (UniqueName: \"kubernetes.io/projected/d7f2f8de-f792-44b2-8822-18b7a9de4d67-kube-api-access-nwcj9\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:06:36.078935 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:06:36.078900    2561 generic.go:356] "Generic (PLEG): container finished" podID="d7f2f8de-f792-44b2-8822-18b7a9de4d67" containerID="8a681e32e2872eed25068ebfb391c183e54cd68959eefad07dae0fc135c260e7" exitCode=0
Jul 24 17:06:36.079398 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:06:36.078947    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5747f7df57-5qfkl"
Jul 24 17:06:36.079398 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:06:36.078981    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5747f7df57-5qfkl" event={"ID":"d7f2f8de-f792-44b2-8822-18b7a9de4d67","Type":"ContainerDied","Data":"8a681e32e2872eed25068ebfb391c183e54cd68959eefad07dae0fc135c260e7"}
Jul 24 17:06:36.079398 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:06:36.079100    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5747f7df57-5qfkl" event={"ID":"d7f2f8de-f792-44b2-8822-18b7a9de4d67","Type":"ContainerDied","Data":"fd8733b1ae23f1659a40d9f54b590de0fd4e9aee9e6de419d1c9ded7b68db00e"}
Jul 24 17:06:36.079398 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:06:36.079132    2561 scope.go:117] "RemoveContainer" containerID="8a681e32e2872eed25068ebfb391c183e54cd68959eefad07dae0fc135c260e7"
Jul 24 17:06:36.087453 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:06:36.087437    2561 scope.go:117] "RemoveContainer" containerID="8a681e32e2872eed25068ebfb391c183e54cd68959eefad07dae0fc135c260e7"
Jul 24 17:06:36.087684 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:06:36.087665    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a681e32e2872eed25068ebfb391c183e54cd68959eefad07dae0fc135c260e7\": container with ID starting with 8a681e32e2872eed25068ebfb391c183e54cd68959eefad07dae0fc135c260e7 not found: ID does not exist" containerID="8a681e32e2872eed25068ebfb391c183e54cd68959eefad07dae0fc135c260e7"
Jul 24 17:06:36.087744 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:06:36.087690    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a681e32e2872eed25068ebfb391c183e54cd68959eefad07dae0fc135c260e7"} err="failed to get container status \"8a681e32e2872eed25068ebfb391c183e54cd68959eefad07dae0fc135c260e7\": rpc error: code = NotFound desc = could not find container \"8a681e32e2872eed25068ebfb391c183e54cd68959eefad07dae0fc135c260e7\": container with ID starting with 8a681e32e2872eed25068ebfb391c183e54cd68959eefad07dae0fc135c260e7 not found: ID does not exist"
Jul 24 17:06:36.099191 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:06:36.099173    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5747f7df57-5qfkl"]
Jul 24 17:06:36.101271 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:06:36.101250    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5747f7df57-5qfkl"]
Jul 24 17:06:36.257218 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:06:36.257190    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7f2f8de-f792-44b2-8822-18b7a9de4d67" path="/var/lib/kubelet/pods/d7f2f8de-f792-44b2-8822-18b7a9de4d67/volumes"
Jul 24 17:07:26.011152 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:26.011103    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-dpgzn"]
Jul 24 17:07:26.011557 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:26.011412    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7f2f8de-f792-44b2-8822-18b7a9de4d67" containerName="console"
Jul 24 17:07:26.011557 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:26.011422    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7f2f8de-f792-44b2-8822-18b7a9de4d67" containerName="console"
Jul 24 17:07:26.011557 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:26.011481    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7f2f8de-f792-44b2-8822-18b7a9de4d67" containerName="console"
Jul 24 17:07:26.013590 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:26.013569    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-dpgzn"
Jul 24 17:07:26.015905 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:26.015886    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 24 17:07:26.015998 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:26.015973    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 24 17:07:26.016713 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:26.016700    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-zzqjx\""
Jul 24 17:07:26.021972 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:26.021950    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-dpgzn"]
Jul 24 17:07:26.114701 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:26.114665    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e39d3657-295d-4713-83ec-85080d5bd56a-bound-sa-token\") pod \"cert-manager-55b4d954d5-dpgzn\" (UID: \"e39d3657-295d-4713-83ec-85080d5bd56a\") " pod="cert-manager/cert-manager-55b4d954d5-dpgzn"
Jul 24 17:07:26.114865 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:26.114735    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwb8s\" (UniqueName: \"kubernetes.io/projected/e39d3657-295d-4713-83ec-85080d5bd56a-kube-api-access-pwb8s\") pod \"cert-manager-55b4d954d5-dpgzn\" (UID: \"e39d3657-295d-4713-83ec-85080d5bd56a\") " pod="cert-manager/cert-manager-55b4d954d5-dpgzn"
Jul 24 17:07:26.215757 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:26.215726    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e39d3657-295d-4713-83ec-85080d5bd56a-bound-sa-token\") pod \"cert-manager-55b4d954d5-dpgzn\" (UID: \"e39d3657-295d-4713-83ec-85080d5bd56a\") " pod="cert-manager/cert-manager-55b4d954d5-dpgzn"
Jul 24 17:07:26.215938 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:26.215783    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwb8s\" (UniqueName: \"kubernetes.io/projected/e39d3657-295d-4713-83ec-85080d5bd56a-kube-api-access-pwb8s\") pod \"cert-manager-55b4d954d5-dpgzn\" (UID: \"e39d3657-295d-4713-83ec-85080d5bd56a\") " pod="cert-manager/cert-manager-55b4d954d5-dpgzn"
Jul 24 17:07:26.224486 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:26.224455    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e39d3657-295d-4713-83ec-85080d5bd56a-bound-sa-token\") pod \"cert-manager-55b4d954d5-dpgzn\" (UID: \"e39d3657-295d-4713-83ec-85080d5bd56a\") " pod="cert-manager/cert-manager-55b4d954d5-dpgzn"
Jul 24 17:07:26.224584 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:26.224519    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwb8s\" (UniqueName: \"kubernetes.io/projected/e39d3657-295d-4713-83ec-85080d5bd56a-kube-api-access-pwb8s\") pod \"cert-manager-55b4d954d5-dpgzn\" (UID: \"e39d3657-295d-4713-83ec-85080d5bd56a\") " pod="cert-manager/cert-manager-55b4d954d5-dpgzn"
Jul 24 17:07:26.339154 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:26.339086    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-dpgzn"
Jul 24 17:07:26.462448 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:26.462417    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-dpgzn"]
Jul 24 17:07:26.465158 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:07:26.465130    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode39d3657_295d_4713_83ec_85080d5bd56a.slice/crio-0c2fb2ab0b0b65b448187a232210b071a1f7ca8092df7b37c3e4b75693aafd29 WatchSource:0}: Error finding container 0c2fb2ab0b0b65b448187a232210b071a1f7ca8092df7b37c3e4b75693aafd29: Status 404 returned error can't find the container with id 0c2fb2ab0b0b65b448187a232210b071a1f7ca8092df7b37c3e4b75693aafd29
Jul 24 17:07:27.267182 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:27.267143    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-dpgzn" event={"ID":"e39d3657-295d-4713-83ec-85080d5bd56a","Type":"ContainerStarted","Data":"0c2fb2ab0b0b65b448187a232210b071a1f7ca8092df7b37c3e4b75693aafd29"}
Jul 24 17:07:30.279237 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:30.279206    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-dpgzn" event={"ID":"e39d3657-295d-4713-83ec-85080d5bd56a","Type":"ContainerStarted","Data":"9b23f70cb68f9acead572a7ab1baa9e80f2c9737766b2dfaa69c022fc0b864dc"}
Jul 24 17:07:34.083305 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:34.083248    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-dpgzn" podStartSLOduration=5.905995693 podStartE2EDuration="9.083230646s" totalImagesPullingTime="3.177234953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:07:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:07:30.295140484 +0000 UTC m=+234.568000264" watchObservedRunningTime="2026-07-24 17:07:34.083230646 +0000 UTC m=+238.356090426"
Jul 24 17:07:34.083682 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:34.083497    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-65shk"]
Jul 24 17:07:34.085588 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:34.085572    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-65shk"
Jul 24 17:07:34.087646 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:34.087624    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 24 17:07:34.088336 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:34.088319    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 24 17:07:34.088336 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:34.088329    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-nlk79\""
Jul 24 17:07:34.094352 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:34.094333    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-65shk"]
Jul 24 17:07:34.182711 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:34.182678    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ngkl\" (UniqueName: \"kubernetes.io/projected/1268e7be-96da-4645-9832-f86f232f3458-kube-api-access-4ngkl\") pod \"openshift-lws-operator-fd8ccff4c-65shk\" (UID: \"1268e7be-96da-4645-9832-f86f232f3458\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-65shk"
Jul 24 17:07:34.182881 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:34.182722    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1268e7be-96da-4645-9832-f86f232f3458-tmp\") pod \"openshift-lws-operator-fd8ccff4c-65shk\" (UID: \"1268e7be-96da-4645-9832-f86f232f3458\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-65shk"
Jul 24 17:07:34.283302 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:34.283265    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ngkl\" (UniqueName: \"kubernetes.io/projected/1268e7be-96da-4645-9832-f86f232f3458-kube-api-access-4ngkl\") pod \"openshift-lws-operator-fd8ccff4c-65shk\" (UID: \"1268e7be-96da-4645-9832-f86f232f3458\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-65shk"
Jul 24 17:07:34.283302 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:34.283307    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1268e7be-96da-4645-9832-f86f232f3458-tmp\") pod \"openshift-lws-operator-fd8ccff4c-65shk\" (UID: \"1268e7be-96da-4645-9832-f86f232f3458\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-65shk"
Jul 24 17:07:34.283667 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:34.283651    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1268e7be-96da-4645-9832-f86f232f3458-tmp\") pod \"openshift-lws-operator-fd8ccff4c-65shk\" (UID: \"1268e7be-96da-4645-9832-f86f232f3458\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-65shk"
Jul 24 17:07:34.292696 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:34.292667    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ngkl\" (UniqueName: \"kubernetes.io/projected/1268e7be-96da-4645-9832-f86f232f3458-kube-api-access-4ngkl\") pod \"openshift-lws-operator-fd8ccff4c-65shk\" (UID: \"1268e7be-96da-4645-9832-f86f232f3458\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-65shk"
Jul 24 17:07:34.394788 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:34.394742    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-65shk"
Jul 24 17:07:34.518831 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:34.518801    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-65shk"]
Jul 24 17:07:34.521967 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:07:34.521935    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1268e7be_96da_4645_9832_f86f232f3458.slice/crio-e32bde67a1336f7013bbfaeb3bb892de00477cac72fd7eef202a7693b1898629 WatchSource:0}: Error finding container e32bde67a1336f7013bbfaeb3bb892de00477cac72fd7eef202a7693b1898629: Status 404 returned error can't find the container with id e32bde67a1336f7013bbfaeb3bb892de00477cac72fd7eef202a7693b1898629
Jul 24 17:07:35.302660 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:35.302625    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-65shk" event={"ID":"1268e7be-96da-4645-9832-f86f232f3458","Type":"ContainerStarted","Data":"e32bde67a1336f7013bbfaeb3bb892de00477cac72fd7eef202a7693b1898629"}
Jul 24 17:07:38.316977 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:38.316943    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-65shk" event={"ID":"1268e7be-96da-4645-9832-f86f232f3458","Type":"ContainerStarted","Data":"313a1e7096fab13f0764b5bb3ceb7ed49d8605b331a172892310cb1fd5850f11"}
Jul 24 17:07:38.333169 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:38.333120    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-65shk" podStartSLOduration=1.384448276 podStartE2EDuration="4.333106551s" totalImagesPullingTime="2.948658275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:07:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:07:38.332175765 +0000 UTC m=+242.605035546" watchObservedRunningTime="2026-07-24 17:07:38.333106551 +0000 UTC m=+242.605966330"
Jul 24 17:07:51.414269 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:51.414232    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-65bbc66f6-jwp9d"]
Jul 24 17:07:51.416499 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:51.416481    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-65bbc66f6-jwp9d"
Jul 24 17:07:51.420265 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:51.420243    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 24 17:07:51.420412 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:51.420260    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 24 17:07:51.420412 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:51.420295    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 24 17:07:51.420412 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:51.420264    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-5q9x7\""
Jul 24 17:07:51.426850 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:51.426829    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-65bbc66f6-jwp9d"]
Jul 24 17:07:51.535156 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:51.535122    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d952e704-9d9d-4bcd-863d-3ea06e0a5726-manager-config\") pod \"lws-controller-manager-65bbc66f6-jwp9d\" (UID: \"d952e704-9d9d-4bcd-863d-3ea06e0a5726\") " pod="openshift-lws-operator/lws-controller-manager-65bbc66f6-jwp9d"
Jul 24 17:07:51.535156 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:51.535167    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d952e704-9d9d-4bcd-863d-3ea06e0a5726-metrics-cert\") pod \"lws-controller-manager-65bbc66f6-jwp9d\" (UID: \"d952e704-9d9d-4bcd-863d-3ea06e0a5726\") " pod="openshift-lws-operator/lws-controller-manager-65bbc66f6-jwp9d"
Jul 24 17:07:51.535361 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:51.535257    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d952e704-9d9d-4bcd-863d-3ea06e0a5726-cert\") pod \"lws-controller-manager-65bbc66f6-jwp9d\" (UID: \"d952e704-9d9d-4bcd-863d-3ea06e0a5726\") " pod="openshift-lws-operator/lws-controller-manager-65bbc66f6-jwp9d"
Jul 24 17:07:51.535361 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:51.535307    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s7nt\" (UniqueName: \"kubernetes.io/projected/d952e704-9d9d-4bcd-863d-3ea06e0a5726-kube-api-access-6s7nt\") pod \"lws-controller-manager-65bbc66f6-jwp9d\" (UID: \"d952e704-9d9d-4bcd-863d-3ea06e0a5726\") " pod="openshift-lws-operator/lws-controller-manager-65bbc66f6-jwp9d"
Jul 24 17:07:51.636160 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:51.636119    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s7nt\" (UniqueName: \"kubernetes.io/projected/d952e704-9d9d-4bcd-863d-3ea06e0a5726-kube-api-access-6s7nt\") pod \"lws-controller-manager-65bbc66f6-jwp9d\" (UID: \"d952e704-9d9d-4bcd-863d-3ea06e0a5726\") " pod="openshift-lws-operator/lws-controller-manager-65bbc66f6-jwp9d"
Jul 24 17:07:51.636355 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:51.636181    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d952e704-9d9d-4bcd-863d-3ea06e0a5726-manager-config\") pod \"lws-controller-manager-65bbc66f6-jwp9d\" (UID: \"d952e704-9d9d-4bcd-863d-3ea06e0a5726\") " pod="openshift-lws-operator/lws-controller-manager-65bbc66f6-jwp9d"
Jul 24 17:07:51.636355 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:51.636219    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d952e704-9d9d-4bcd-863d-3ea06e0a5726-metrics-cert\") pod \"lws-controller-manager-65bbc66f6-jwp9d\" (UID: \"d952e704-9d9d-4bcd-863d-3ea06e0a5726\") " pod="openshift-lws-operator/lws-controller-manager-65bbc66f6-jwp9d"
Jul 24 17:07:51.636355 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:51.636277    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d952e704-9d9d-4bcd-863d-3ea06e0a5726-cert\") pod \"lws-controller-manager-65bbc66f6-jwp9d\" (UID: \"d952e704-9d9d-4bcd-863d-3ea06e0a5726\") " pod="openshift-lws-operator/lws-controller-manager-65bbc66f6-jwp9d"
Jul 24 17:07:51.636948 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:51.636912    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d952e704-9d9d-4bcd-863d-3ea06e0a5726-manager-config\") pod \"lws-controller-manager-65bbc66f6-jwp9d\" (UID: \"d952e704-9d9d-4bcd-863d-3ea06e0a5726\") " pod="openshift-lws-operator/lws-controller-manager-65bbc66f6-jwp9d"
Jul 24 17:07:51.638883 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:51.638853    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d952e704-9d9d-4bcd-863d-3ea06e0a5726-metrics-cert\") pod \"lws-controller-manager-65bbc66f6-jwp9d\" (UID: \"d952e704-9d9d-4bcd-863d-3ea06e0a5726\") " pod="openshift-lws-operator/lws-controller-manager-65bbc66f6-jwp9d"
Jul 24 17:07:51.638973 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:51.638895    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d952e704-9d9d-4bcd-863d-3ea06e0a5726-cert\") pod \"lws-controller-manager-65bbc66f6-jwp9d\" (UID: \"d952e704-9d9d-4bcd-863d-3ea06e0a5726\") " pod="openshift-lws-operator/lws-controller-manager-65bbc66f6-jwp9d"
Jul 24 17:07:51.652822 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:51.652802    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s7nt\" (UniqueName: \"kubernetes.io/projected/d952e704-9d9d-4bcd-863d-3ea06e0a5726-kube-api-access-6s7nt\") pod \"lws-controller-manager-65bbc66f6-jwp9d\" (UID: \"d952e704-9d9d-4bcd-863d-3ea06e0a5726\") " pod="openshift-lws-operator/lws-controller-manager-65bbc66f6-jwp9d"
Jul 24 17:07:51.725948 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:51.725859    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-65bbc66f6-jwp9d"
Jul 24 17:07:51.855129 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:51.855106    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-65bbc66f6-jwp9d"]
Jul 24 17:07:51.857538 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:07:51.857501    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd952e704_9d9d_4bcd_863d_3ea06e0a5726.slice/crio-845f9836bbdef8fdd3a4682c0e5a2ca29695a43f80728b3f6da7ec7172229eaf WatchSource:0}: Error finding container 845f9836bbdef8fdd3a4682c0e5a2ca29695a43f80728b3f6da7ec7172229eaf: Status 404 returned error can't find the container with id 845f9836bbdef8fdd3a4682c0e5a2ca29695a43f80728b3f6da7ec7172229eaf
Jul 24 17:07:52.371749 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:52.371712    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-65bbc66f6-jwp9d" event={"ID":"d952e704-9d9d-4bcd-863d-3ea06e0a5726","Type":"ContainerStarted","Data":"845f9836bbdef8fdd3a4682c0e5a2ca29695a43f80728b3f6da7ec7172229eaf"}
Jul 24 17:07:53.990694 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:53.990655    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-k45wz"]
Jul 24 17:07:53.992956 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:53.992939    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-k45wz"
Jul 24 17:07:53.995390 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:53.995371    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 24 17:07:53.995499 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:53.995409    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ltj8k\""
Jul 24 17:07:53.995852 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:53.995828    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 24 17:07:53.995960 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:53.995865    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 24 17:07:53.996028 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:53.995981    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 24 17:07:54.015529 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:54.015508    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-k45wz"]
Jul 24 17:07:54.159405 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:54.159360    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c2a23b89-a681-4cf6-87f0-d26575452a98-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bc8c4649b-k45wz\" (UID: \"c2a23b89-a681-4cf6-87f0-d26575452a98\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-k45wz"
Jul 24 17:07:54.159584 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:54.159482    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c2a23b89-a681-4cf6-87f0-d26575452a98-manifests\") pod \"opendatahub-operator-controller-manager-6bc8c4649b-k45wz\" (UID: \"c2a23b89-a681-4cf6-87f0-d26575452a98\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-k45wz"
Jul 24 17:07:54.159584 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:54.159530    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2a23b89-a681-4cf6-87f0-d26575452a98-tmp\") pod \"opendatahub-operator-controller-manager-6bc8c4649b-k45wz\" (UID: \"c2a23b89-a681-4cf6-87f0-d26575452a98\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-k45wz"
Jul 24 17:07:54.159584 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:54.159550    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c2a23b89-a681-4cf6-87f0-d26575452a98-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bc8c4649b-k45wz\" (UID: \"c2a23b89-a681-4cf6-87f0-d26575452a98\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-k45wz"
Jul 24 17:07:54.159584 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:54.159573    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdmgk\" (UniqueName: \"kubernetes.io/projected/c2a23b89-a681-4cf6-87f0-d26575452a98-kube-api-access-rdmgk\") pod \"opendatahub-operator-controller-manager-6bc8c4649b-k45wz\" (UID: \"c2a23b89-a681-4cf6-87f0-d26575452a98\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-k45wz"
Jul 24 17:07:54.260544 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:54.260467    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c2a23b89-a681-4cf6-87f0-d26575452a98-manifests\") pod \"opendatahub-operator-controller-manager-6bc8c4649b-k45wz\" (UID: \"c2a23b89-a681-4cf6-87f0-d26575452a98\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-k45wz"
Jul 24 17:07:54.260544 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:54.260508    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2a23b89-a681-4cf6-87f0-d26575452a98-tmp\") pod \"opendatahub-operator-controller-manager-6bc8c4649b-k45wz\" (UID: \"c2a23b89-a681-4cf6-87f0-d26575452a98\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-k45wz"
Jul 24 17:07:54.260544 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:54.260531    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c2a23b89-a681-4cf6-87f0-d26575452a98-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bc8c4649b-k45wz\" (UID: \"c2a23b89-a681-4cf6-87f0-d26575452a98\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-k45wz"
Jul 24 17:07:54.260788 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:54.260561    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdmgk\" (UniqueName: \"kubernetes.io/projected/c2a23b89-a681-4cf6-87f0-d26575452a98-kube-api-access-rdmgk\") pod \"opendatahub-operator-controller-manager-6bc8c4649b-k45wz\" (UID: \"c2a23b89-a681-4cf6-87f0-d26575452a98\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-k45wz"
Jul 24 17:07:54.260788 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:54.260658    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c2a23b89-a681-4cf6-87f0-d26575452a98-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bc8c4649b-k45wz\" (UID: \"c2a23b89-a681-4cf6-87f0-d26575452a98\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-k45wz"
Jul 24 17:07:54.260874 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:54.260855    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c2a23b89-a681-4cf6-87f0-d26575452a98-manifests\") pod \"opendatahub-operator-controller-manager-6bc8c4649b-k45wz\" (UID: \"c2a23b89-a681-4cf6-87f0-d26575452a98\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-k45wz"
Jul 24 17:07:54.262873 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:54.262844    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2a23b89-a681-4cf6-87f0-d26575452a98-tmp\") pod \"opendatahub-operator-controller-manager-6bc8c4649b-k45wz\" (UID: \"c2a23b89-a681-4cf6-87f0-d26575452a98\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-k45wz"
Jul 24 17:07:54.262978 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:54.262948    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c2a23b89-a681-4cf6-87f0-d26575452a98-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bc8c4649b-k45wz\" (UID: \"c2a23b89-a681-4cf6-87f0-d26575452a98\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-k45wz"
Jul 24 17:07:54.263026 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:54.262973    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c2a23b89-a681-4cf6-87f0-d26575452a98-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bc8c4649b-k45wz\" (UID: \"c2a23b89-a681-4cf6-87f0-d26575452a98\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-k45wz"
Jul 24 17:07:54.268411 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:54.268387    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdmgk\" (UniqueName: \"kubernetes.io/projected/c2a23b89-a681-4cf6-87f0-d26575452a98-kube-api-access-rdmgk\") pod \"opendatahub-operator-controller-manager-6bc8c4649b-k45wz\" (UID: \"c2a23b89-a681-4cf6-87f0-d26575452a98\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-k45wz"
Jul 24 17:07:54.302527 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:54.302488    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-k45wz"
Jul 24 17:07:54.380323 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:54.380292    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-65bbc66f6-jwp9d" event={"ID":"d952e704-9d9d-4bcd-863d-3ea06e0a5726","Type":"ContainerStarted","Data":"cf236b2e145ef8c4cfc388be2c1c34b118499a7c035485002d84c022b38389d2"}
Jul 24 17:07:54.380483 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:54.380358    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-65bbc66f6-jwp9d"
Jul 24 17:07:54.397382 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:54.397333    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-65bbc66f6-jwp9d" podStartSLOduration=1.888640066 podStartE2EDuration="3.397315902s" totalImagesPullingTime="1.508675836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:07:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:07:54.396325664 +0000 UTC m=+258.669185444" watchObservedRunningTime="2026-07-24 17:07:54.397315902 +0000 UTC m=+258.670175682"
Jul 24 17:07:54.438229 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:54.438199    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-k45wz"]
Jul 24 17:07:54.441672 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:07:54.441643    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2a23b89_a681_4cf6_87f0_d26575452a98.slice/crio-4a3b4f734cdb82fd220691b475002ed370850aa44dc11b5e6926c5cae4889415 WatchSource:0}: Error finding container 4a3b4f734cdb82fd220691b475002ed370850aa44dc11b5e6926c5cae4889415: Status 404 returned error can't find the container with id 4a3b4f734cdb82fd220691b475002ed370850aa44dc11b5e6926c5cae4889415
Jul 24 17:07:55.388717 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:55.388669    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-k45wz" event={"ID":"c2a23b89-a681-4cf6-87f0-d26575452a98","Type":"ContainerStarted","Data":"4a3b4f734cdb82fd220691b475002ed370850aa44dc11b5e6926c5cae4889415"}
Jul 24 17:07:58.403004 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:58.402968    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-k45wz" event={"ID":"c2a23b89-a681-4cf6-87f0-d26575452a98","Type":"ContainerStarted","Data":"282aef86e4c38a17995fc95e3e3a0109d1514df5f164af5f03a7dae02a5f19ba"}
Jul 24 17:07:59.413757 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:59.413728    2561 generic.go:356] "Generic (PLEG): container finished" podID="c2a23b89-a681-4cf6-87f0-d26575452a98" containerID="282aef86e4c38a17995fc95e3e3a0109d1514df5f164af5f03a7dae02a5f19ba" exitCode=0
Jul 24 17:07:59.414141 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:07:59.413793    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-k45wz" event={"ID":"c2a23b89-a681-4cf6-87f0-d26575452a98","Type":"ContainerDied","Data":"282aef86e4c38a17995fc95e3e3a0109d1514df5f164af5f03a7dae02a5f19ba"}
Jul 24 17:08:00.419248 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:08:00.419213    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-k45wz" event={"ID":"c2a23b89-a681-4cf6-87f0-d26575452a98","Type":"ContainerStarted","Data":"57b186e28b236703f2267f1313f7b94abea7cc672f702ec1177b47e1c3b1fdee"}
Jul 24 17:08:00.419612 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:08:00.419320    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-k45wz"
Jul 24 17:08:00.441305 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:08:00.441259    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-k45wz" podStartSLOduration=2.956071266 podStartE2EDuration="7.4412423s" totalImagesPullingTime="3.458941937s" totalInitContainerRuntime="1.026229097s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:07:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:08:00.439692295 +0000 UTC m=+264.712552081" watchObservedRunningTime="2026-07-24 17:08:00.4412423 +0000 UTC m=+264.714102079"
Jul 24 17:08:05.391217 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:08:05.391181    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-65bbc66f6-jwp9d"
Jul 24 17:08:11.425700 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:08:11.425671    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-k45wz"
Jul 24 17:08:23.977974 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:08:23.977939    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6d6f9cf76-dxns9"]
Jul 24 17:08:23.987358 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:08:23.987333    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6d6f9cf76-dxns9"
Jul 24 17:08:23.990012 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:08:23.989988    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 24 17:08:23.990012 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:08:23.990012    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 24 17:08:23.990214 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:08:23.990020    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 24 17:08:23.990214 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:08:23.990098    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 24 17:08:23.990214 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:08:23.990128    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-bmcwf\""
Jul 24 17:08:24.002104 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:08:24.002077    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6d6f9cf76-dxns9"]
Jul 24 17:08:24.125186 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:08:24.125148    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtnvn\" (UniqueName: \"kubernetes.io/projected/19a0a0a6-a5ff-47ba-ab95-f0ecb6297bcd-kube-api-access-dtnvn\") pod \"kube-auth-proxy-6d6f9cf76-dxns9\" (UID: \"19a0a0a6-a5ff-47ba-ab95-f0ecb6297bcd\") " pod="openshift-ingress/kube-auth-proxy-6d6f9cf76-dxns9"
Jul 24 17:08:24.125389 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:08:24.125206    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19a0a0a6-a5ff-47ba-ab95-f0ecb6297bcd-tmp\") pod \"kube-auth-proxy-6d6f9cf76-dxns9\" (UID: \"19a0a0a6-a5ff-47ba-ab95-f0ecb6297bcd\") " pod="openshift-ingress/kube-auth-proxy-6d6f9cf76-dxns9"
Jul 24 17:08:24.125389 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:08:24.125337    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19a0a0a6-a5ff-47ba-ab95-f0ecb6297bcd-tls-certs\") pod \"kube-auth-proxy-6d6f9cf76-dxns9\" (UID: \"19a0a0a6-a5ff-47ba-ab95-f0ecb6297bcd\") " pod="openshift-ingress/kube-auth-proxy-6d6f9cf76-dxns9"
Jul 24 17:08:24.226799 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:08:24.226755    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtnvn\" (UniqueName: \"kubernetes.io/projected/19a0a0a6-a5ff-47ba-ab95-f0ecb6297bcd-kube-api-access-dtnvn\") pod \"kube-auth-proxy-6d6f9cf76-dxns9\" (UID: \"19a0a0a6-a5ff-47ba-ab95-f0ecb6297bcd\") " pod="openshift-ingress/kube-auth-proxy-6d6f9cf76-dxns9"
Jul 24 17:08:24.226950 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:08:24.226821    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19a0a0a6-a5ff-47ba-ab95-f0ecb6297bcd-tmp\") pod \"kube-auth-proxy-6d6f9cf76-dxns9\" (UID: \"19a0a0a6-a5ff-47ba-ab95-f0ecb6297bcd\") " pod="openshift-ingress/kube-auth-proxy-6d6f9cf76-dxns9"
Jul 24 17:08:24.226950 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:08:24.226869    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19a0a0a6-a5ff-47ba-ab95-f0ecb6297bcd-tls-certs\") pod \"kube-auth-proxy-6d6f9cf76-dxns9\" (UID: \"19a0a0a6-a5ff-47ba-ab95-f0ecb6297bcd\") " pod="openshift-ingress/kube-auth-proxy-6d6f9cf76-dxns9"
Jul 24 17:08:24.229236 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:08:24.229174    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19a0a0a6-a5ff-47ba-ab95-f0ecb6297bcd-tmp\") pod \"kube-auth-proxy-6d6f9cf76-dxns9\" (UID: \"19a0a0a6-a5ff-47ba-ab95-f0ecb6297bcd\") " pod="openshift-ingress/kube-auth-proxy-6d6f9cf76-dxns9"
Jul 24 17:08:24.229405 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:08:24.229388    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19a0a0a6-a5ff-47ba-ab95-f0ecb6297bcd-tls-certs\") pod \"kube-auth-proxy-6d6f9cf76-dxns9\" (UID: \"19a0a0a6-a5ff-47ba-ab95-f0ecb6297bcd\") " pod="openshift-ingress/kube-auth-proxy-6d6f9cf76-dxns9"
Jul 24 17:08:24.235714 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:08:24.235683    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtnvn\" (UniqueName: \"kubernetes.io/projected/19a0a0a6-a5ff-47ba-ab95-f0ecb6297bcd-kube-api-access-dtnvn\") pod \"kube-auth-proxy-6d6f9cf76-dxns9\" (UID: \"19a0a0a6-a5ff-47ba-ab95-f0ecb6297bcd\") " pod="openshift-ingress/kube-auth-proxy-6d6f9cf76-dxns9"
Jul 24 17:08:24.299214 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:08:24.299172    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6d6f9cf76-dxns9"
Jul 24 17:08:24.425652 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:08:24.425631    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6d6f9cf76-dxns9"]
Jul 24 17:08:24.428105 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:08:24.428078    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19a0a0a6_a5ff_47ba_ab95_f0ecb6297bcd.slice/crio-f3780db1169c5cc8e799e0780cb6bda8a75b26837625ab59de301973ff86629a WatchSource:0}: Error finding container f3780db1169c5cc8e799e0780cb6bda8a75b26837625ab59de301973ff86629a: Status 404 returned error can't find the container with id f3780db1169c5cc8e799e0780cb6bda8a75b26837625ab59de301973ff86629a
Jul 24 17:08:24.518678 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:08:24.518604    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6d6f9cf76-dxns9" event={"ID":"19a0a0a6-a5ff-47ba-ab95-f0ecb6297bcd","Type":"ContainerStarted","Data":"f3780db1169c5cc8e799e0780cb6bda8a75b26837625ab59de301973ff86629a"}
Jul 24 17:08:27.536582 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:08:27.536549    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6d6f9cf76-dxns9" event={"ID":"19a0a0a6-a5ff-47ba-ab95-f0ecb6297bcd","Type":"ContainerStarted","Data":"836979ccf52ce59aee2fe391539822ac22cc0d2727b3f713a971432079c9b216"}
Jul 24 17:08:27.554241 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:08:27.554192    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6d6f9cf76-dxns9" podStartSLOduration=1.541356774 podStartE2EDuration="4.55417855s" totalImagesPullingTime="3.012821776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:08:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:08:27.5524991 +0000 UTC m=+291.825358881" watchObservedRunningTime="2026-07-24 17:08:27.55417855 +0000 UTC m=+291.827038329"
Jul 24 17:08:36.099739 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:08:36.099706    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6h754_860ed1fc-612f-4796-8077-72bc6c5d84db/ovn-acl-logging/0.log"
Jul 24 17:08:36.102100 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:08:36.102077    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6h754_860ed1fc-612f-4796-8077-72bc6c5d84db/ovn-acl-logging/0.log"
Jul 24 17:08:36.103500 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:08:36.103480    2561 kubelet.go:1648] "Image garbage collection succeeded"
Jul 24 17:09:53.770345 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:53.770262    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57976c8db5-22j9z"]
Jul 24 17:09:53.773547 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:53.773526    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57976c8db5-22j9z"
Jul 24 17:09:53.784488 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:53.784466    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57976c8db5-22j9z"]
Jul 24 17:09:53.867297 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:53.867270    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c75a52a-1152-4d4a-9763-fb258ee18fc6-service-ca\") pod \"console-57976c8db5-22j9z\" (UID: \"5c75a52a-1152-4d4a-9763-fb258ee18fc6\") " pod="openshift-console/console-57976c8db5-22j9z"
Jul 24 17:09:53.867297 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:53.867299    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c75a52a-1152-4d4a-9763-fb258ee18fc6-trusted-ca-bundle\") pod \"console-57976c8db5-22j9z\" (UID: \"5c75a52a-1152-4d4a-9763-fb258ee18fc6\") " pod="openshift-console/console-57976c8db5-22j9z"
Jul 24 17:09:53.867463 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:53.867319    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swmb7\" (UniqueName: \"kubernetes.io/projected/5c75a52a-1152-4d4a-9763-fb258ee18fc6-kube-api-access-swmb7\") pod \"console-57976c8db5-22j9z\" (UID: \"5c75a52a-1152-4d4a-9763-fb258ee18fc6\") " pod="openshift-console/console-57976c8db5-22j9z"
Jul 24 17:09:53.867463 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:53.867344    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c75a52a-1152-4d4a-9763-fb258ee18fc6-console-serving-cert\") pod \"console-57976c8db5-22j9z\" (UID: \"5c75a52a-1152-4d4a-9763-fb258ee18fc6\") " pod="openshift-console/console-57976c8db5-22j9z"
Jul 24 17:09:53.867463 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:53.867384    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c75a52a-1152-4d4a-9763-fb258ee18fc6-console-config\") pod \"console-57976c8db5-22j9z\" (UID: \"5c75a52a-1152-4d4a-9763-fb258ee18fc6\") " pod="openshift-console/console-57976c8db5-22j9z"
Jul 24 17:09:53.867568 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:53.867461    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c75a52a-1152-4d4a-9763-fb258ee18fc6-console-oauth-config\") pod \"console-57976c8db5-22j9z\" (UID: \"5c75a52a-1152-4d4a-9763-fb258ee18fc6\") " pod="openshift-console/console-57976c8db5-22j9z"
Jul 24 17:09:53.867568 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:53.867523    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c75a52a-1152-4d4a-9763-fb258ee18fc6-oauth-serving-cert\") pod \"console-57976c8db5-22j9z\" (UID: \"5c75a52a-1152-4d4a-9763-fb258ee18fc6\") " pod="openshift-console/console-57976c8db5-22j9z"
Jul 24 17:09:53.948145 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:53.948115    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9srb9"]
Jul 24 17:09:53.951699 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:53.951678    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9srb9"
Jul 24 17:09:53.953934 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:53.953907    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 24 17:09:53.954058 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:53.954029    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 24 17:09:53.954058 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:53.954035    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 24 17:09:53.954202 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:53.954077    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 24 17:09:53.954202 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:53.954109    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6lscw\""
Jul 24 17:09:53.960492 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:53.960472    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9srb9"]
Jul 24 17:09:53.968340 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:53.968322    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c75a52a-1152-4d4a-9763-fb258ee18fc6-service-ca\") pod \"console-57976c8db5-22j9z\" (UID: \"5c75a52a-1152-4d4a-9763-fb258ee18fc6\") " pod="openshift-console/console-57976c8db5-22j9z"
Jul 24 17:09:53.968442 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:53.968381    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c75a52a-1152-4d4a-9763-fb258ee18fc6-trusted-ca-bundle\") pod \"console-57976c8db5-22j9z\" (UID: \"5c75a52a-1152-4d4a-9763-fb258ee18fc6\") " pod="openshift-console/console-57976c8db5-22j9z"
Jul 24 17:09:53.968442 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:53.968426    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swmb7\" (UniqueName: \"kubernetes.io/projected/5c75a52a-1152-4d4a-9763-fb258ee18fc6-kube-api-access-swmb7\") pod \"console-57976c8db5-22j9z\" (UID: \"5c75a52a-1152-4d4a-9763-fb258ee18fc6\") " pod="openshift-console/console-57976c8db5-22j9z"
Jul 24 17:09:53.968551 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:53.968473    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c75a52a-1152-4d4a-9763-fb258ee18fc6-console-serving-cert\") pod \"console-57976c8db5-22j9z\" (UID: \"5c75a52a-1152-4d4a-9763-fb258ee18fc6\") " pod="openshift-console/console-57976c8db5-22j9z"
Jul 24 17:09:53.968551 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:53.968502    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c75a52a-1152-4d4a-9763-fb258ee18fc6-console-config\") pod \"console-57976c8db5-22j9z\" (UID: \"5c75a52a-1152-4d4a-9763-fb258ee18fc6\") " pod="openshift-console/console-57976c8db5-22j9z"
Jul 24 17:09:53.968648 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:53.968549    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c75a52a-1152-4d4a-9763-fb258ee18fc6-console-oauth-config\") pod \"console-57976c8db5-22j9z\" (UID: \"5c75a52a-1152-4d4a-9763-fb258ee18fc6\") " pod="openshift-console/console-57976c8db5-22j9z"
Jul 24 17:09:53.968702 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:53.968660    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c75a52a-1152-4d4a-9763-fb258ee18fc6-oauth-serving-cert\") pod \"console-57976c8db5-22j9z\" (UID: \"5c75a52a-1152-4d4a-9763-fb258ee18fc6\") " pod="openshift-console/console-57976c8db5-22j9z"
Jul 24 17:09:53.969179 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:53.969154    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c75a52a-1152-4d4a-9763-fb258ee18fc6-service-ca\") pod \"console-57976c8db5-22j9z\" (UID: \"5c75a52a-1152-4d4a-9763-fb258ee18fc6\") " pod="openshift-console/console-57976c8db5-22j9z"
Jul 24 17:09:53.969531 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:53.969507    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c75a52a-1152-4d4a-9763-fb258ee18fc6-oauth-serving-cert\") pod \"console-57976c8db5-22j9z\" (UID: \"5c75a52a-1152-4d4a-9763-fb258ee18fc6\") " pod="openshift-console/console-57976c8db5-22j9z"
Jul 24 17:09:53.969621 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:53.969593    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c75a52a-1152-4d4a-9763-fb258ee18fc6-trusted-ca-bundle\") pod \"console-57976c8db5-22j9z\" (UID: \"5c75a52a-1152-4d4a-9763-fb258ee18fc6\") " pod="openshift-console/console-57976c8db5-22j9z"
Jul 24 17:09:53.969621 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:53.969599    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c75a52a-1152-4d4a-9763-fb258ee18fc6-console-config\") pod \"console-57976c8db5-22j9z\" (UID: \"5c75a52a-1152-4d4a-9763-fb258ee18fc6\") " pod="openshift-console/console-57976c8db5-22j9z"
Jul 24 17:09:53.971052 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:53.971029    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c75a52a-1152-4d4a-9763-fb258ee18fc6-console-serving-cert\") pod \"console-57976c8db5-22j9z\" (UID: \"5c75a52a-1152-4d4a-9763-fb258ee18fc6\") " pod="openshift-console/console-57976c8db5-22j9z"
Jul 24 17:09:53.971794 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:53.971774    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c75a52a-1152-4d4a-9763-fb258ee18fc6-console-oauth-config\") pod \"console-57976c8db5-22j9z\" (UID: \"5c75a52a-1152-4d4a-9763-fb258ee18fc6\") " pod="openshift-console/console-57976c8db5-22j9z"
Jul 24 17:09:53.976696 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:53.976670    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swmb7\" (UniqueName: \"kubernetes.io/projected/5c75a52a-1152-4d4a-9763-fb258ee18fc6-kube-api-access-swmb7\") pod \"console-57976c8db5-22j9z\" (UID: \"5c75a52a-1152-4d4a-9763-fb258ee18fc6\") " pod="openshift-console/console-57976c8db5-22j9z"
Jul 24 17:09:54.069194 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:54.069118    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7d9m\" (UniqueName: \"kubernetes.io/projected/17cce661-6425-481c-bec6-aa11fcf5283a-kube-api-access-m7d9m\") pod \"kuadrant-console-plugin-66b5774985-9srb9\" (UID: \"17cce661-6425-481c-bec6-aa11fcf5283a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9srb9"
Jul 24 17:09:54.069194 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:54.069180    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/17cce661-6425-481c-bec6-aa11fcf5283a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9srb9\" (UID: \"17cce661-6425-481c-bec6-aa11fcf5283a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9srb9"
Jul 24 17:09:54.069380 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:54.069303    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/17cce661-6425-481c-bec6-aa11fcf5283a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9srb9\" (UID: \"17cce661-6425-481c-bec6-aa11fcf5283a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9srb9"
Jul 24 17:09:54.082147 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:54.082116    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57976c8db5-22j9z"
Jul 24 17:09:54.170329 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:54.170301    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7d9m\" (UniqueName: \"kubernetes.io/projected/17cce661-6425-481c-bec6-aa11fcf5283a-kube-api-access-m7d9m\") pod \"kuadrant-console-plugin-66b5774985-9srb9\" (UID: \"17cce661-6425-481c-bec6-aa11fcf5283a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9srb9"
Jul 24 17:09:54.170453 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:54.170360    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/17cce661-6425-481c-bec6-aa11fcf5283a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9srb9\" (UID: \"17cce661-6425-481c-bec6-aa11fcf5283a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9srb9"
Jul 24 17:09:54.170453 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:54.170415    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/17cce661-6425-481c-bec6-aa11fcf5283a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9srb9\" (UID: \"17cce661-6425-481c-bec6-aa11fcf5283a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9srb9"
Jul 24 17:09:54.171237 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:54.171206    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/17cce661-6425-481c-bec6-aa11fcf5283a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9srb9\" (UID: \"17cce661-6425-481c-bec6-aa11fcf5283a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9srb9"
Jul 24 17:09:54.172734 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:54.172713    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/17cce661-6425-481c-bec6-aa11fcf5283a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9srb9\" (UID: \"17cce661-6425-481c-bec6-aa11fcf5283a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9srb9"
Jul 24 17:09:54.180542 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:54.180520    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7d9m\" (UniqueName: \"kubernetes.io/projected/17cce661-6425-481c-bec6-aa11fcf5283a-kube-api-access-m7d9m\") pod \"kuadrant-console-plugin-66b5774985-9srb9\" (UID: \"17cce661-6425-481c-bec6-aa11fcf5283a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9srb9"
Jul 24 17:09:54.206860 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:54.206813    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57976c8db5-22j9z"]
Jul 24 17:09:54.212189 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:09:54.209834    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c75a52a_1152_4d4a_9763_fb258ee18fc6.slice/crio-4321a129844cfb76ccfd5b8be4d344acfb6250c18b1b7a0ad7e7f4d1f3e0e43f WatchSource:0}: Error finding container 4321a129844cfb76ccfd5b8be4d344acfb6250c18b1b7a0ad7e7f4d1f3e0e43f: Status 404 returned error can't find the container with id 4321a129844cfb76ccfd5b8be4d344acfb6250c18b1b7a0ad7e7f4d1f3e0e43f
Jul 24 17:09:54.260998 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:54.260978    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9srb9"
Jul 24 17:09:54.389020 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:54.389000    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9srb9"]
Jul 24 17:09:54.391084 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:09:54.391043    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod17cce661_6425_481c_bec6_aa11fcf5283a.slice/crio-824eb1908a9b481d3a40ad94f6c49ff7b345280eda04a457610dac2832f4d6e2 WatchSource:0}: Error finding container 824eb1908a9b481d3a40ad94f6c49ff7b345280eda04a457610dac2832f4d6e2: Status 404 returned error can't find the container with id 824eb1908a9b481d3a40ad94f6c49ff7b345280eda04a457610dac2832f4d6e2
Jul 24 17:09:54.392483 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:54.392467    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 17:09:54.912320 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:54.912287    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57976c8db5-22j9z" event={"ID":"5c75a52a-1152-4d4a-9763-fb258ee18fc6","Type":"ContainerStarted","Data":"cf8a3c2d85b933b05ee6375654abe02f8e3135143ea7c57d53c6274a354967ba"}
Jul 24 17:09:54.912774 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:54.912339    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57976c8db5-22j9z" event={"ID":"5c75a52a-1152-4d4a-9763-fb258ee18fc6","Type":"ContainerStarted","Data":"4321a129844cfb76ccfd5b8be4d344acfb6250c18b1b7a0ad7e7f4d1f3e0e43f"}
Jul 24 17:09:54.913449 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:54.913424    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9srb9" event={"ID":"17cce661-6425-481c-bec6-aa11fcf5283a","Type":"ContainerStarted","Data":"824eb1908a9b481d3a40ad94f6c49ff7b345280eda04a457610dac2832f4d6e2"}
Jul 24 17:09:54.931263 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:09:54.931214    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57976c8db5-22j9z" podStartSLOduration=1.9311999279999998 podStartE2EDuration="1.931199928s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:09:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:09:54.930340129 +0000 UTC m=+379.203199927" watchObservedRunningTime="2026-07-24 17:09:54.931199928 +0000 UTC m=+379.204059708"
Jul 24 17:10:04.083319 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:04.083262    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57976c8db5-22j9z"
Jul 24 17:10:04.083726 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:04.083391    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57976c8db5-22j9z"
Jul 24 17:10:04.088602 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:04.088577    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57976c8db5-22j9z"
Jul 24 17:10:04.276762 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:04.276729    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dppgh"]
Jul 24 17:10:04.297255 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:04.297228    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dppgh"]
Jul 24 17:10:04.297421 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:04.297341    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dppgh"
Jul 24 17:10:04.299804 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:04.299780    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wjdgd\""
Jul 24 17:10:04.372331 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:04.372296    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nd4kz\" (UniqueName: \"kubernetes.io/projected/05ab5919-367b-46d9-8346-3b011a67c4c1-kube-api-access-nd4kz\") pod \"kuadrant-operator-controller-manager-55467d9f7-dppgh\" (UID: \"05ab5919-367b-46d9-8346-3b011a67c4c1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dppgh"
Jul 24 17:10:04.372510 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:04.372421    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05ab5919-367b-46d9-8346-3b011a67c4c1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-dppgh\" (UID: \"05ab5919-367b-46d9-8346-3b011a67c4c1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dppgh"
Jul 24 17:10:04.472931 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:04.472889    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05ab5919-367b-46d9-8346-3b011a67c4c1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-dppgh\" (UID: \"05ab5919-367b-46d9-8346-3b011a67c4c1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dppgh"
Jul 24 17:10:04.473119 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:04.472991    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd4kz\" (UniqueName: \"kubernetes.io/projected/05ab5919-367b-46d9-8346-3b011a67c4c1-kube-api-access-nd4kz\") pod \"kuadrant-operator-controller-manager-55467d9f7-dppgh\" (UID: \"05ab5919-367b-46d9-8346-3b011a67c4c1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dppgh"
Jul 24 17:10:04.473381 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:04.473357    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05ab5919-367b-46d9-8346-3b011a67c4c1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-dppgh\" (UID: \"05ab5919-367b-46d9-8346-3b011a67c4c1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dppgh"
Jul 24 17:10:04.481366 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:04.481339    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nd4kz\" (UniqueName: \"kubernetes.io/projected/05ab5919-367b-46d9-8346-3b011a67c4c1-kube-api-access-nd4kz\") pod \"kuadrant-operator-controller-manager-55467d9f7-dppgh\" (UID: \"05ab5919-367b-46d9-8346-3b011a67c4c1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dppgh"
Jul 24 17:10:04.609552 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:04.609521    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dppgh"
Jul 24 17:10:04.714085 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:04.713991    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dppgh"]
Jul 24 17:10:04.720587 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:04.720558    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dppgh"]
Jul 24 17:10:04.738645 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:04.738618    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qd8p4"]
Jul 24 17:10:04.744412 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:04.744382    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qd8p4"
Jul 24 17:10:04.754151 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:04.754129    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qd8p4"]
Jul 24 17:10:04.876041 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:04.876002    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6c5z9\" (UniqueName: \"kubernetes.io/projected/d2c409dd-f22a-4c60-b9e7-f44929e88e61-kube-api-access-6c5z9\") pod \"kuadrant-operator-controller-manager-55467d9f7-qd8p4\" (UID: \"d2c409dd-f22a-4c60-b9e7-f44929e88e61\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qd8p4"
Jul 24 17:10:04.876224 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:04.876201    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d2c409dd-f22a-4c60-b9e7-f44929e88e61-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-qd8p4\" (UID: \"d2c409dd-f22a-4c60-b9e7-f44929e88e61\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qd8p4"
Jul 24 17:10:04.972819 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:04.972721    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57976c8db5-22j9z"
Jul 24 17:10:04.976736 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:04.976706    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d2c409dd-f22a-4c60-b9e7-f44929e88e61-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-qd8p4\" (UID: \"d2c409dd-f22a-4c60-b9e7-f44929e88e61\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qd8p4"
Jul 24 17:10:04.976883 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:04.976791    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6c5z9\" (UniqueName: \"kubernetes.io/projected/d2c409dd-f22a-4c60-b9e7-f44929e88e61-kube-api-access-6c5z9\") pod \"kuadrant-operator-controller-manager-55467d9f7-qd8p4\" (UID: \"d2c409dd-f22a-4c60-b9e7-f44929e88e61\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qd8p4"
Jul 24 17:10:04.977103 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:04.977059    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d2c409dd-f22a-4c60-b9e7-f44929e88e61-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-qd8p4\" (UID: \"d2c409dd-f22a-4c60-b9e7-f44929e88e61\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qd8p4"
Jul 24 17:10:04.985518 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:04.985495    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6c5z9\" (UniqueName: \"kubernetes.io/projected/d2c409dd-f22a-4c60-b9e7-f44929e88e61-kube-api-access-6c5z9\") pod \"kuadrant-operator-controller-manager-55467d9f7-qd8p4\" (UID: \"d2c409dd-f22a-4c60-b9e7-f44929e88e61\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qd8p4"
Jul 24 17:10:05.024301 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:05.024263    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f7d57fb6-rc8xd"]
Jul 24 17:10:05.059083 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:05.059041    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qd8p4"
Jul 24 17:10:17.163879 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:17.163851    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qd8p4"]
Jul 24 17:10:17.166590 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:10:17.166556    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2c409dd_f22a_4c60_b9e7_f44929e88e61.slice/crio-667911eb9ab1eab9a96d3fb8c69dc9f945e148684f4474cf7fd5a8517090ea5f WatchSource:0}: Error finding container 667911eb9ab1eab9a96d3fb8c69dc9f945e148684f4474cf7fd5a8517090ea5f: Status 404 returned error can't find the container with id 667911eb9ab1eab9a96d3fb8c69dc9f945e148684f4474cf7fd5a8517090ea5f
Jul 24 17:10:18.037099 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:18.037033    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9srb9" event={"ID":"17cce661-6425-481c-bec6-aa11fcf5283a","Type":"ContainerStarted","Data":"f5973783fc4d6b233641d8b86771e5bbc17f090771355aa455d04d39cfbdbc46"}
Jul 24 17:10:18.038807 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:18.038780    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qd8p4" event={"ID":"d2c409dd-f22a-4c60-b9e7-f44929e88e61","Type":"ContainerStarted","Data":"667911eb9ab1eab9a96d3fb8c69dc9f945e148684f4474cf7fd5a8517090ea5f"}
Jul 24 17:10:18.053205 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:18.053164    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9srb9" podStartSLOduration=1.995319745 podStartE2EDuration="25.053148696s" totalImagesPullingTime="23.057828951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:09:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:10:18.05216933 +0000 UTC m=+402.325029109" watchObservedRunningTime="2026-07-24 17:10:18.053148696 +0000 UTC m=+402.326008477"
Jul 24 17:10:19.816790 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:10:19.816748    2561 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-dppgh_kuadrant-system_05ab5919-367b-46d9-8346-3b011a67c4c1_0(64294135b3b0793716fd455f34d22ab0c373de9a30ade6b6c612393503847879): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-dppgh to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Jul 24 17:10:19.817087 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:10:19.816820    2561 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-dppgh_kuadrant-system_05ab5919-367b-46d9-8346-3b011a67c4c1_0(64294135b3b0793716fd455f34d22ab0c373de9a30ade6b6c612393503847879): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-dppgh to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dppgh"
Jul 24 17:10:20.049331 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:20.049295    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dppgh"
Jul 24 17:10:20.054452 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:10:20.054413    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-dppgh\" is forbidden: User \"system:node:ip-10-0-137-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-137.ec2.internal' and this object" podUID="05ab5919-367b-46d9-8346-3b011a67c4c1" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dppgh"
Jul 24 17:10:20.061893 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:20.061853    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dppgh"
Jul 24 17:10:20.064131 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:10:20.064094    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-dppgh\" is forbidden: User \"system:node:ip-10-0-137-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-137.ec2.internal' and this object" podUID="05ab5919-367b-46d9-8346-3b011a67c4c1" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dppgh"
Jul 24 17:10:20.219141 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:20.219108    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05ab5919-367b-46d9-8346-3b011a67c4c1-extensions-socket-volume\") pod \"05ab5919-367b-46d9-8346-3b011a67c4c1\" (UID: \"05ab5919-367b-46d9-8346-3b011a67c4c1\") "
Jul 24 17:10:20.219377 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:20.219163    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nd4kz\" (UniqueName: \"kubernetes.io/projected/05ab5919-367b-46d9-8346-3b011a67c4c1-kube-api-access-nd4kz\") pod \"05ab5919-367b-46d9-8346-3b011a67c4c1\" (UID: \"05ab5919-367b-46d9-8346-3b011a67c4c1\") "
Jul 24 17:10:20.219431 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:20.219399    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05ab5919-367b-46d9-8346-3b011a67c4c1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "05ab5919-367b-46d9-8346-3b011a67c4c1" (UID: "05ab5919-367b-46d9-8346-3b011a67c4c1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:10:20.221481 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:20.221455    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05ab5919-367b-46d9-8346-3b011a67c4c1-kube-api-access-nd4kz" (OuterVolumeSpecName: "kube-api-access-nd4kz") pod "05ab5919-367b-46d9-8346-3b011a67c4c1" (UID: "05ab5919-367b-46d9-8346-3b011a67c4c1"). InnerVolumeSpecName "kube-api-access-nd4kz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:10:20.259495 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:20.259470    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05ab5919-367b-46d9-8346-3b011a67c4c1" path="/var/lib/kubelet/pods/05ab5919-367b-46d9-8346-3b011a67c4c1/volumes"
Jul 24 17:10:20.319973 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:20.319943    2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05ab5919-367b-46d9-8346-3b011a67c4c1-extensions-socket-volume\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:10:20.319973 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:20.319973    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nd4kz\" (UniqueName: \"kubernetes.io/projected/05ab5919-367b-46d9-8346-3b011a67c4c1-kube-api-access-nd4kz\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:10:21.053853 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:21.053821    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dppgh"
Jul 24 17:10:21.056180 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:10:21.056151    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-dppgh\" is forbidden: User \"system:node:ip-10-0-137-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-137.ec2.internal' and this object" podUID="05ab5919-367b-46d9-8346-3b011a67c4c1" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dppgh"
Jul 24 17:10:21.057816 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:10:21.057797    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-dppgh\" is forbidden: User \"system:node:ip-10-0-137-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-137.ec2.internal' and this object" podUID="05ab5919-367b-46d9-8346-3b011a67c4c1" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dppgh"
Jul 24 17:10:25.074586 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:25.074553    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qd8p4" event={"ID":"d2c409dd-f22a-4c60-b9e7-f44929e88e61","Type":"ContainerStarted","Data":"d9c64ff6549343949a0182cb0e6400ee198e6156589afacd42f3b94e9e4adb21"}
Jul 24 17:10:25.074981 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:25.074649    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qd8p4"
Jul 24 17:10:25.092176 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:25.092132    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qd8p4" podStartSLOduration=14.281532235 podStartE2EDuration="21.092119828s" totalImagesPullingTime="6.810587593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:10:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:10:25.091150963 +0000 UTC m=+409.364010781" watchObservedRunningTime="2026-07-24 17:10:25.092119828 +0000 UTC m=+409.364979608"
Jul 24 17:10:30.047693 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:30.047654    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7f7d57fb6-rc8xd" podUID="6cb808ca-8cb9-48e7-8304-bc160dc4cd7d" containerName="console" containerID="cri-o://d146d8258fca41f37a057da7c40bb78f6e3663401d637d7b1be87d5509f09882" gracePeriod=15
Jul 24 17:10:30.286374 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:30.286352    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f7d57fb6-rc8xd"
Jul 24 17:10:30.309226 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:30.309164    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6cb808ca-8cb9-48e7-8304-bc160dc4cd7d-service-ca\") pod \"6cb808ca-8cb9-48e7-8304-bc160dc4cd7d\" (UID: \"6cb808ca-8cb9-48e7-8304-bc160dc4cd7d\") "
Jul 24 17:10:30.309226 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:30.309217    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4gtw\" (UniqueName: \"kubernetes.io/projected/6cb808ca-8cb9-48e7-8304-bc160dc4cd7d-kube-api-access-r4gtw\") pod \"6cb808ca-8cb9-48e7-8304-bc160dc4cd7d\" (UID: \"6cb808ca-8cb9-48e7-8304-bc160dc4cd7d\") "
Jul 24 17:10:30.309394 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:30.309262    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6cb808ca-8cb9-48e7-8304-bc160dc4cd7d-trusted-ca-bundle\") pod \"6cb808ca-8cb9-48e7-8304-bc160dc4cd7d\" (UID: \"6cb808ca-8cb9-48e7-8304-bc160dc4cd7d\") "
Jul 24 17:10:30.309394 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:30.309320    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6cb808ca-8cb9-48e7-8304-bc160dc4cd7d-oauth-serving-cert\") pod \"6cb808ca-8cb9-48e7-8304-bc160dc4cd7d\" (UID: \"6cb808ca-8cb9-48e7-8304-bc160dc4cd7d\") "
Jul 24 17:10:30.309394 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:30.309353    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6cb808ca-8cb9-48e7-8304-bc160dc4cd7d-console-oauth-config\") pod \"6cb808ca-8cb9-48e7-8304-bc160dc4cd7d\" (UID: \"6cb808ca-8cb9-48e7-8304-bc160dc4cd7d\") "
Jul 24 17:10:30.309394 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:30.309378    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6cb808ca-8cb9-48e7-8304-bc160dc4cd7d-console-serving-cert\") pod \"6cb808ca-8cb9-48e7-8304-bc160dc4cd7d\" (UID: \"6cb808ca-8cb9-48e7-8304-bc160dc4cd7d\") "
Jul 24 17:10:30.309588 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:30.309414    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6cb808ca-8cb9-48e7-8304-bc160dc4cd7d-console-config\") pod \"6cb808ca-8cb9-48e7-8304-bc160dc4cd7d\" (UID: \"6cb808ca-8cb9-48e7-8304-bc160dc4cd7d\") "
Jul 24 17:10:30.309588 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:30.309480    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cb808ca-8cb9-48e7-8304-bc160dc4cd7d-service-ca" (OuterVolumeSpecName: "service-ca") pod "6cb808ca-8cb9-48e7-8304-bc160dc4cd7d" (UID: "6cb808ca-8cb9-48e7-8304-bc160dc4cd7d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:10:30.309805 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:30.309697    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6cb808ca-8cb9-48e7-8304-bc160dc4cd7d-service-ca\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:10:30.309918 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:30.309800    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cb808ca-8cb9-48e7-8304-bc160dc4cd7d-console-config" (OuterVolumeSpecName: "console-config") pod "6cb808ca-8cb9-48e7-8304-bc160dc4cd7d" (UID: "6cb808ca-8cb9-48e7-8304-bc160dc4cd7d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:10:30.310029 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:30.309950    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cb808ca-8cb9-48e7-8304-bc160dc4cd7d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6cb808ca-8cb9-48e7-8304-bc160dc4cd7d" (UID: "6cb808ca-8cb9-48e7-8304-bc160dc4cd7d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:10:30.310029 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:30.309969    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cb808ca-8cb9-48e7-8304-bc160dc4cd7d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6cb808ca-8cb9-48e7-8304-bc160dc4cd7d" (UID: "6cb808ca-8cb9-48e7-8304-bc160dc4cd7d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:10:30.311651 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:30.311627    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cb808ca-8cb9-48e7-8304-bc160dc4cd7d-kube-api-access-r4gtw" (OuterVolumeSpecName: "kube-api-access-r4gtw") pod "6cb808ca-8cb9-48e7-8304-bc160dc4cd7d" (UID: "6cb808ca-8cb9-48e7-8304-bc160dc4cd7d"). InnerVolumeSpecName "kube-api-access-r4gtw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:10:30.312349 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:30.312312    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6cb808ca-8cb9-48e7-8304-bc160dc4cd7d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6cb808ca-8cb9-48e7-8304-bc160dc4cd7d" (UID: "6cb808ca-8cb9-48e7-8304-bc160dc4cd7d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:10:30.312465 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:30.312395    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6cb808ca-8cb9-48e7-8304-bc160dc4cd7d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6cb808ca-8cb9-48e7-8304-bc160dc4cd7d" (UID: "6cb808ca-8cb9-48e7-8304-bc160dc4cd7d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:10:30.410247 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:30.410224    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4gtw\" (UniqueName: \"kubernetes.io/projected/6cb808ca-8cb9-48e7-8304-bc160dc4cd7d-kube-api-access-r4gtw\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:10:30.410247 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:30.410245    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6cb808ca-8cb9-48e7-8304-bc160dc4cd7d-trusted-ca-bundle\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:10:30.410374 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:30.410254    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6cb808ca-8cb9-48e7-8304-bc160dc4cd7d-oauth-serving-cert\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:10:30.410374 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:30.410263    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6cb808ca-8cb9-48e7-8304-bc160dc4cd7d-console-oauth-config\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:10:30.410374 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:30.410271    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6cb808ca-8cb9-48e7-8304-bc160dc4cd7d-console-serving-cert\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:10:30.410374 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:30.410280    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6cb808ca-8cb9-48e7-8304-bc160dc4cd7d-console-config\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:10:31.101510 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:31.101471    2561 generic.go:356] "Generic (PLEG): container finished" podID="6cb808ca-8cb9-48e7-8304-bc160dc4cd7d" containerID="d146d8258fca41f37a057da7c40bb78f6e3663401d637d7b1be87d5509f09882" exitCode=0
Jul 24 17:10:31.101510 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:31.101512    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f7d57fb6-rc8xd"
Jul 24 17:10:31.101964 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:31.101522    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f7d57fb6-rc8xd" event={"ID":"6cb808ca-8cb9-48e7-8304-bc160dc4cd7d","Type":"ContainerDied","Data":"d146d8258fca41f37a057da7c40bb78f6e3663401d637d7b1be87d5509f09882"}
Jul 24 17:10:31.101964 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:31.101568    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f7d57fb6-rc8xd" event={"ID":"6cb808ca-8cb9-48e7-8304-bc160dc4cd7d","Type":"ContainerDied","Data":"297cedf2ff45f52e3a44bdb2da66b8872e56eb70760bb5ca315cf26d623ad5bd"}
Jul 24 17:10:31.101964 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:31.101590    2561 scope.go:117] "RemoveContainer" containerID="d146d8258fca41f37a057da7c40bb78f6e3663401d637d7b1be87d5509f09882"
Jul 24 17:10:31.110557 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:31.110540    2561 scope.go:117] "RemoveContainer" containerID="d146d8258fca41f37a057da7c40bb78f6e3663401d637d7b1be87d5509f09882"
Jul 24 17:10:31.110799 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:10:31.110782    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d146d8258fca41f37a057da7c40bb78f6e3663401d637d7b1be87d5509f09882\": container with ID starting with d146d8258fca41f37a057da7c40bb78f6e3663401d637d7b1be87d5509f09882 not found: ID does not exist" containerID="d146d8258fca41f37a057da7c40bb78f6e3663401d637d7b1be87d5509f09882"
Jul 24 17:10:31.110850 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:31.110807    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d146d8258fca41f37a057da7c40bb78f6e3663401d637d7b1be87d5509f09882"} err="failed to get container status \"d146d8258fca41f37a057da7c40bb78f6e3663401d637d7b1be87d5509f09882\": rpc error: code = NotFound desc = could not find container \"d146d8258fca41f37a057da7c40bb78f6e3663401d637d7b1be87d5509f09882\": container with ID starting with d146d8258fca41f37a057da7c40bb78f6e3663401d637d7b1be87d5509f09882 not found: ID does not exist"
Jul 24 17:10:31.129951 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:31.129927    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f7d57fb6-rc8xd"]
Jul 24 17:10:31.137027 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:31.136996    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f7d57fb6-rc8xd"]
Jul 24 17:10:32.257630 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:32.257599    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cb808ca-8cb9-48e7-8304-bc160dc4cd7d" path="/var/lib/kubelet/pods/6cb808ca-8cb9-48e7-8304-bc160dc4cd7d/volumes"
Jul 24 17:10:36.080650 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:36.080620    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qd8p4"
Jul 24 17:10:48.262917 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:48.262881    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qd8p4"]
Jul 24 17:10:48.263410 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:48.263125    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qd8p4" podUID="d2c409dd-f22a-4c60-b9e7-f44929e88e61" containerName="manager" containerID="cri-o://d9c64ff6549343949a0182cb0e6400ee198e6156589afacd42f3b94e9e4adb21" gracePeriod=10
Jul 24 17:10:48.514314 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:48.514258    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qd8p4"
Jul 24 17:10:48.664135 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:48.664098    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6c5z9\" (UniqueName: \"kubernetes.io/projected/d2c409dd-f22a-4c60-b9e7-f44929e88e61-kube-api-access-6c5z9\") pod \"d2c409dd-f22a-4c60-b9e7-f44929e88e61\" (UID: \"d2c409dd-f22a-4c60-b9e7-f44929e88e61\") "
Jul 24 17:10:48.664327 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:48.664179    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d2c409dd-f22a-4c60-b9e7-f44929e88e61-extensions-socket-volume\") pod \"d2c409dd-f22a-4c60-b9e7-f44929e88e61\" (UID: \"d2c409dd-f22a-4c60-b9e7-f44929e88e61\") "
Jul 24 17:10:48.664543 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:48.664516    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2c409dd-f22a-4c60-b9e7-f44929e88e61-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d2c409dd-f22a-4c60-b9e7-f44929e88e61" (UID: "d2c409dd-f22a-4c60-b9e7-f44929e88e61"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:10:48.666334 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:48.666317    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2c409dd-f22a-4c60-b9e7-f44929e88e61-kube-api-access-6c5z9" (OuterVolumeSpecName: "kube-api-access-6c5z9") pod "d2c409dd-f22a-4c60-b9e7-f44929e88e61" (UID: "d2c409dd-f22a-4c60-b9e7-f44929e88e61"). InnerVolumeSpecName "kube-api-access-6c5z9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:10:48.765763 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:48.765662    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6c5z9\" (UniqueName: \"kubernetes.io/projected/d2c409dd-f22a-4c60-b9e7-f44929e88e61-kube-api-access-6c5z9\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:10:48.765763 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:48.765708    2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d2c409dd-f22a-4c60-b9e7-f44929e88e61-extensions-socket-volume\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:10:49.180950 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:49.180913    2561 generic.go:356] "Generic (PLEG): container finished" podID="d2c409dd-f22a-4c60-b9e7-f44929e88e61" containerID="d9c64ff6549343949a0182cb0e6400ee198e6156589afacd42f3b94e9e4adb21" exitCode=0
Jul 24 17:10:49.181137 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:49.180954    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qd8p4"
Jul 24 17:10:49.181137 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:49.181001    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qd8p4" event={"ID":"d2c409dd-f22a-4c60-b9e7-f44929e88e61","Type":"ContainerDied","Data":"d9c64ff6549343949a0182cb0e6400ee198e6156589afacd42f3b94e9e4adb21"}
Jul 24 17:10:49.181137 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:49.181106    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qd8p4" event={"ID":"d2c409dd-f22a-4c60-b9e7-f44929e88e61","Type":"ContainerDied","Data":"667911eb9ab1eab9a96d3fb8c69dc9f945e148684f4474cf7fd5a8517090ea5f"}
Jul 24 17:10:49.181137 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:49.181133    2561 scope.go:117] "RemoveContainer" containerID="d9c64ff6549343949a0182cb0e6400ee198e6156589afacd42f3b94e9e4adb21"
Jul 24 17:10:49.190331 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:49.190314    2561 scope.go:117] "RemoveContainer" containerID="d9c64ff6549343949a0182cb0e6400ee198e6156589afacd42f3b94e9e4adb21"
Jul 24 17:10:49.190627 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:10:49.190608    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9c64ff6549343949a0182cb0e6400ee198e6156589afacd42f3b94e9e4adb21\": container with ID starting with d9c64ff6549343949a0182cb0e6400ee198e6156589afacd42f3b94e9e4adb21 not found: ID does not exist" containerID="d9c64ff6549343949a0182cb0e6400ee198e6156589afacd42f3b94e9e4adb21"
Jul 24 17:10:49.190674 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:49.190638    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9c64ff6549343949a0182cb0e6400ee198e6156589afacd42f3b94e9e4adb21"} err="failed to get container status \"d9c64ff6549343949a0182cb0e6400ee198e6156589afacd42f3b94e9e4adb21\": rpc error: code = NotFound desc = could not find container \"d9c64ff6549343949a0182cb0e6400ee198e6156589afacd42f3b94e9e4adb21\": container with ID starting with d9c64ff6549343949a0182cb0e6400ee198e6156589afacd42f3b94e9e4adb21 not found: ID does not exist"
Jul 24 17:10:49.209024 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:49.208999    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qd8p4"]
Jul 24 17:10:49.215305 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:49.215274    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qd8p4"]
Jul 24 17:10:50.258332 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:50.258303    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2c409dd-f22a-4c60-b9e7-f44929e88e61" path="/var/lib/kubelet/pods/d2c409dd-f22a-4c60-b9e7-f44929e88e61/volumes"
Jul 24 17:10:55.675452 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:55.675418    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-nd4zz"]
Jul 24 17:10:55.675831 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:55.675730    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2c409dd-f22a-4c60-b9e7-f44929e88e61" containerName="manager"
Jul 24 17:10:55.675831 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:55.675741    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2c409dd-f22a-4c60-b9e7-f44929e88e61" containerName="manager"
Jul 24 17:10:55.675831 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:55.675756    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cb808ca-8cb9-48e7-8304-bc160dc4cd7d" containerName="console"
Jul 24 17:10:55.675831 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:55.675762    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cb808ca-8cb9-48e7-8304-bc160dc4cd7d" containerName="console"
Jul 24 17:10:55.675831 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:55.675818    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cb808ca-8cb9-48e7-8304-bc160dc4cd7d" containerName="console"
Jul 24 17:10:55.675831 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:55.675827    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2c409dd-f22a-4c60-b9e7-f44929e88e61" containerName="manager"
Jul 24 17:10:55.680131 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:55.680111    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-nd4zz"
Jul 24 17:10:55.682541 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:55.682523    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 24 17:10:55.686148 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:55.686127    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-nd4zz"]
Jul 24 17:10:55.772391 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:55.772354    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-nd4zz"]
Jul 24 17:10:55.835867 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:55.835841    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b011005d-0992-4077-972a-37fe40ad1aba-config-file\") pod \"limitador-limitador-64c94fd64f-nd4zz\" (UID: \"b011005d-0992-4077-972a-37fe40ad1aba\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-nd4zz"
Jul 24 17:10:55.836005 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:55.835889    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6tjg\" (UniqueName: \"kubernetes.io/projected/b011005d-0992-4077-972a-37fe40ad1aba-kube-api-access-r6tjg\") pod \"limitador-limitador-64c94fd64f-nd4zz\" (UID: \"b011005d-0992-4077-972a-37fe40ad1aba\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-nd4zz"
Jul 24 17:10:55.937241 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:55.937155    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b011005d-0992-4077-972a-37fe40ad1aba-config-file\") pod \"limitador-limitador-64c94fd64f-nd4zz\" (UID: \"b011005d-0992-4077-972a-37fe40ad1aba\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-nd4zz"
Jul 24 17:10:55.937241 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:55.937228    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6tjg\" (UniqueName: \"kubernetes.io/projected/b011005d-0992-4077-972a-37fe40ad1aba-kube-api-access-r6tjg\") pod \"limitador-limitador-64c94fd64f-nd4zz\" (UID: \"b011005d-0992-4077-972a-37fe40ad1aba\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-nd4zz"
Jul 24 17:10:55.937855 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:55.937834    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b011005d-0992-4077-972a-37fe40ad1aba-config-file\") pod \"limitador-limitador-64c94fd64f-nd4zz\" (UID: \"b011005d-0992-4077-972a-37fe40ad1aba\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-nd4zz"
Jul 24 17:10:55.945622 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:55.945594    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6tjg\" (UniqueName: \"kubernetes.io/projected/b011005d-0992-4077-972a-37fe40ad1aba-kube-api-access-r6tjg\") pod \"limitador-limitador-64c94fd64f-nd4zz\" (UID: \"b011005d-0992-4077-972a-37fe40ad1aba\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-nd4zz"
Jul 24 17:10:55.990432 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:55.990403    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-nd4zz"
Jul 24 17:10:56.115473 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:56.115442    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-nd4zz"]
Jul 24 17:10:56.118442 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:10:56.118418    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb011005d_0992_4077_972a_37fe40ad1aba.slice/crio-8700e4bf94de83aa082ac247953c1c4a93e61e51395b74441a68f5adda4e4fcb WatchSource:0}: Error finding container 8700e4bf94de83aa082ac247953c1c4a93e61e51395b74441a68f5adda4e4fcb: Status 404 returned error can't find the container with id 8700e4bf94de83aa082ac247953c1c4a93e61e51395b74441a68f5adda4e4fcb
Jul 24 17:10:56.213132 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:56.213072    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-nd4zz" event={"ID":"b011005d-0992-4077-972a-37fe40ad1aba","Type":"ContainerStarted","Data":"8700e4bf94de83aa082ac247953c1c4a93e61e51395b74441a68f5adda4e4fcb"}
Jul 24 17:10:56.481982 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:56.481907    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-sd7q9"]
Jul 24 17:10:56.484651 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:56.484635    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-sd7q9"
Jul 24 17:10:56.486702 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:56.486682    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-vxxvf\""
Jul 24 17:10:56.492846 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:56.492827    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-sd7q9"]
Jul 24 17:10:56.642481 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:56.642453    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqnc9\" (UniqueName: \"kubernetes.io/projected/840d9902-eac5-4e0b-94e6-2fcb0317fe03-kube-api-access-qqnc9\") pod \"authorino-58cd955675-sd7q9\" (UID: \"840d9902-eac5-4e0b-94e6-2fcb0317fe03\") " pod="kuadrant-system/authorino-58cd955675-sd7q9"
Jul 24 17:10:56.743767 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:56.743698    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqnc9\" (UniqueName: \"kubernetes.io/projected/840d9902-eac5-4e0b-94e6-2fcb0317fe03-kube-api-access-qqnc9\") pod \"authorino-58cd955675-sd7q9\" (UID: \"840d9902-eac5-4e0b-94e6-2fcb0317fe03\") " pod="kuadrant-system/authorino-58cd955675-sd7q9"
Jul 24 17:10:56.751835 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:56.751800    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqnc9\" (UniqueName: \"kubernetes.io/projected/840d9902-eac5-4e0b-94e6-2fcb0317fe03-kube-api-access-qqnc9\") pod \"authorino-58cd955675-sd7q9\" (UID: \"840d9902-eac5-4e0b-94e6-2fcb0317fe03\") " pod="kuadrant-system/authorino-58cd955675-sd7q9"
Jul 24 17:10:56.794181 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:56.794150    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-sd7q9"
Jul 24 17:10:56.968619 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:56.968551    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-sd7q9"]
Jul 24 17:10:57.219397 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:10:57.219360    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-sd7q9" event={"ID":"840d9902-eac5-4e0b-94e6-2fcb0317fe03","Type":"ContainerStarted","Data":"54159a17adb7ed0ec7ec8e5efea838eb864be1ceebb6f9f45b060f0fcf7ec771"}
Jul 24 17:11:00.388489 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:00.388460    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-sd7q9"]
Jul 24 17:11:01.245083 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:01.245031    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-nd4zz" event={"ID":"b011005d-0992-4077-972a-37fe40ad1aba","Type":"ContainerStarted","Data":"c6fef6ea7316a7172e8a251440995c65107f82de915078646d487e263e04853b"}
Jul 24 17:11:01.245334 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:01.245144    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-nd4zz"
Jul 24 17:11:01.246464 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:01.246441    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-sd7q9" event={"ID":"840d9902-eac5-4e0b-94e6-2fcb0317fe03","Type":"ContainerStarted","Data":"ade2fc974d68d21f68318c7d35409546c4630849d218ac2dcfff32a54f0134b7"}
Jul 24 17:11:01.246577 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:01.246472    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-sd7q9" podUID="840d9902-eac5-4e0b-94e6-2fcb0317fe03" containerName="authorino" containerID="cri-o://ade2fc974d68d21f68318c7d35409546c4630849d218ac2dcfff32a54f0134b7" gracePeriod=30
Jul 24 17:11:01.267685 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:01.267645    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-nd4zz" podStartSLOduration=1.789595257 podStartE2EDuration="6.267630645s" totalImagesPullingTime="4.478035388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:10:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:11:01.266142291 +0000 UTC m=+445.539002088" watchObservedRunningTime="2026-07-24 17:11:01.267630645 +0000 UTC m=+445.540490472"
Jul 24 17:11:01.286395 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:01.286356    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-sd7q9" podStartSLOduration=1.628938048 podStartE2EDuration="5.286341577s" totalImagesPullingTime="3.657403529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:11:01.284895277 +0000 UTC m=+445.557755058" watchObservedRunningTime="2026-07-24 17:11:01.286341577 +0000 UTC m=+445.559201357"
Jul 24 17:11:01.490313 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:01.490291    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-sd7q9"
Jul 24 17:11:01.591639 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:01.591570    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqnc9\" (UniqueName: \"kubernetes.io/projected/840d9902-eac5-4e0b-94e6-2fcb0317fe03-kube-api-access-qqnc9\") pod \"840d9902-eac5-4e0b-94e6-2fcb0317fe03\" (UID: \"840d9902-eac5-4e0b-94e6-2fcb0317fe03\") "
Jul 24 17:11:01.593532 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:01.593510    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/840d9902-eac5-4e0b-94e6-2fcb0317fe03-kube-api-access-qqnc9" (OuterVolumeSpecName: "kube-api-access-qqnc9") pod "840d9902-eac5-4e0b-94e6-2fcb0317fe03" (UID: "840d9902-eac5-4e0b-94e6-2fcb0317fe03"). InnerVolumeSpecName "kube-api-access-qqnc9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:11:01.692840 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:01.692810    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqnc9\" (UniqueName: \"kubernetes.io/projected/840d9902-eac5-4e0b-94e6-2fcb0317fe03-kube-api-access-qqnc9\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:11:02.252359 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:02.252327    2561 generic.go:356] "Generic (PLEG): container finished" podID="840d9902-eac5-4e0b-94e6-2fcb0317fe03" containerID="ade2fc974d68d21f68318c7d35409546c4630849d218ac2dcfff32a54f0134b7" exitCode=0
Jul 24 17:11:02.252571 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:02.252414    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-sd7q9"
Jul 24 17:11:02.257361 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:02.257337    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-sd7q9" event={"ID":"840d9902-eac5-4e0b-94e6-2fcb0317fe03","Type":"ContainerDied","Data":"ade2fc974d68d21f68318c7d35409546c4630849d218ac2dcfff32a54f0134b7"}
Jul 24 17:11:02.257478 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:02.257367    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-sd7q9" event={"ID":"840d9902-eac5-4e0b-94e6-2fcb0317fe03","Type":"ContainerDied","Data":"54159a17adb7ed0ec7ec8e5efea838eb864be1ceebb6f9f45b060f0fcf7ec771"}
Jul 24 17:11:02.257478 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:02.257384    2561 scope.go:117] "RemoveContainer" containerID="ade2fc974d68d21f68318c7d35409546c4630849d218ac2dcfff32a54f0134b7"
Jul 24 17:11:02.265780 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:02.265762    2561 scope.go:117] "RemoveContainer" containerID="ade2fc974d68d21f68318c7d35409546c4630849d218ac2dcfff32a54f0134b7"
Jul 24 17:11:02.266012 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:11:02.265992    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ade2fc974d68d21f68318c7d35409546c4630849d218ac2dcfff32a54f0134b7\": container with ID starting with ade2fc974d68d21f68318c7d35409546c4630849d218ac2dcfff32a54f0134b7 not found: ID does not exist" containerID="ade2fc974d68d21f68318c7d35409546c4630849d218ac2dcfff32a54f0134b7"
Jul 24 17:11:02.266057 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:02.266020    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ade2fc974d68d21f68318c7d35409546c4630849d218ac2dcfff32a54f0134b7"} err="failed to get container status \"ade2fc974d68d21f68318c7d35409546c4630849d218ac2dcfff32a54f0134b7\": rpc error: code = NotFound desc = could not find container \"ade2fc974d68d21f68318c7d35409546c4630849d218ac2dcfff32a54f0134b7\": container with ID starting with ade2fc974d68d21f68318c7d35409546c4630849d218ac2dcfff32a54f0134b7 not found: ID does not exist"
Jul 24 17:11:02.274278 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:02.274256    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-sd7q9"]
Jul 24 17:11:02.276309 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:02.276289    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-sd7q9"]
Jul 24 17:11:04.257390 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:04.257353    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="840d9902-eac5-4e0b-94e6-2fcb0317fe03" path="/var/lib/kubelet/pods/840d9902-eac5-4e0b-94e6-2fcb0317fe03/volumes"
Jul 24 17:11:10.803643 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:10.803607    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-nd4zz"]
Jul 24 17:11:10.804122 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:10.803850    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-nd4zz" podUID="b011005d-0992-4077-972a-37fe40ad1aba" containerName="limitador" containerID="cri-o://c6fef6ea7316a7172e8a251440995c65107f82de915078646d487e263e04853b" gracePeriod=30
Jul 24 17:11:10.804527 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:10.804499    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-nd4zz"
Jul 24 17:11:11.294541 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:11.294503    2561 generic.go:356] "Generic (PLEG): container finished" podID="b011005d-0992-4077-972a-37fe40ad1aba" containerID="c6fef6ea7316a7172e8a251440995c65107f82de915078646d487e263e04853b" exitCode=0
Jul 24 17:11:11.294715 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:11.294582    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-nd4zz" event={"ID":"b011005d-0992-4077-972a-37fe40ad1aba","Type":"ContainerDied","Data":"c6fef6ea7316a7172e8a251440995c65107f82de915078646d487e263e04853b"}
Jul 24 17:11:11.346050 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:11.346024    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-nd4zz"
Jul 24 17:11:11.379050 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:11.379024    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6tjg\" (UniqueName: \"kubernetes.io/projected/b011005d-0992-4077-972a-37fe40ad1aba-kube-api-access-r6tjg\") pod \"b011005d-0992-4077-972a-37fe40ad1aba\" (UID: \"b011005d-0992-4077-972a-37fe40ad1aba\") "
Jul 24 17:11:11.379232 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:11.379107    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b011005d-0992-4077-972a-37fe40ad1aba-config-file\") pod \"b011005d-0992-4077-972a-37fe40ad1aba\" (UID: \"b011005d-0992-4077-972a-37fe40ad1aba\") "
Jul 24 17:11:11.379493 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:11.379466    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b011005d-0992-4077-972a-37fe40ad1aba-config-file" (OuterVolumeSpecName: "config-file") pod "b011005d-0992-4077-972a-37fe40ad1aba" (UID: "b011005d-0992-4077-972a-37fe40ad1aba"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:11:11.381373 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:11.381338    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b011005d-0992-4077-972a-37fe40ad1aba-kube-api-access-r6tjg" (OuterVolumeSpecName: "kube-api-access-r6tjg") pod "b011005d-0992-4077-972a-37fe40ad1aba" (UID: "b011005d-0992-4077-972a-37fe40ad1aba"). InnerVolumeSpecName "kube-api-access-r6tjg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:11:11.480321 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:11.480288    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6tjg\" (UniqueName: \"kubernetes.io/projected/b011005d-0992-4077-972a-37fe40ad1aba-kube-api-access-r6tjg\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:11:11.480321 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:11.480316    2561 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b011005d-0992-4077-972a-37fe40ad1aba-config-file\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:11:12.300438 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:12.300409    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-nd4zz" event={"ID":"b011005d-0992-4077-972a-37fe40ad1aba","Type":"ContainerDied","Data":"8700e4bf94de83aa082ac247953c1c4a93e61e51395b74441a68f5adda4e4fcb"}
Jul 24 17:11:12.300788 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:12.300463    2561 scope.go:117] "RemoveContainer" containerID="c6fef6ea7316a7172e8a251440995c65107f82de915078646d487e263e04853b"
Jul 24 17:11:12.300788 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:12.300418    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-nd4zz"
Jul 24 17:11:12.330472 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:12.330448    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-nd4zz"]
Jul 24 17:11:12.332677 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:12.332657    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-nd4zz"]
Jul 24 17:11:14.258215 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:14.258181    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b011005d-0992-4077-972a-37fe40ad1aba" path="/var/lib/kubelet/pods/b011005d-0992-4077-972a-37fe40ad1aba/volumes"
Jul 24 17:11:16.053345 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:16.053309    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-n4gkz"]
Jul 24 17:11:16.053827 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:16.053808    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b011005d-0992-4077-972a-37fe40ad1aba" containerName="limitador"
Jul 24 17:11:16.053879 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:16.053832    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b011005d-0992-4077-972a-37fe40ad1aba" containerName="limitador"
Jul 24 17:11:16.053879 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:16.053847    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="840d9902-eac5-4e0b-94e6-2fcb0317fe03" containerName="authorino"
Jul 24 17:11:16.053879 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:16.053854    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="840d9902-eac5-4e0b-94e6-2fcb0317fe03" containerName="authorino"
Jul 24 17:11:16.053982 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:16.053918    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="840d9902-eac5-4e0b-94e6-2fcb0317fe03" containerName="authorino"
Jul 24 17:11:16.053982 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:16.053931    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b011005d-0992-4077-972a-37fe40ad1aba" containerName="limitador"
Jul 24 17:11:16.056658 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:16.056635    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-n4gkz"
Jul 24 17:11:16.059217 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:16.059191    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 17:11:16.059217 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:16.059213    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-2jmsv\""
Jul 24 17:11:16.059382 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:16.059225    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 24 17:11:16.059382 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:16.059193    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 24 17:11:16.064154 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:16.064134    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-n4gkz"]
Jul 24 17:11:16.122295 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:16.122260    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cf688127-37be-462b-b440-df3c76568622-data\") pod \"postgres-69fb4594cf-n4gkz\" (UID: \"cf688127-37be-462b-b440-df3c76568622\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-n4gkz"
Jul 24 17:11:16.122295 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:16.122301    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnqj8\" (UniqueName: \"kubernetes.io/projected/cf688127-37be-462b-b440-df3c76568622-kube-api-access-pnqj8\") pod \"postgres-69fb4594cf-n4gkz\" (UID: \"cf688127-37be-462b-b440-df3c76568622\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-n4gkz"
Jul 24 17:11:16.223471 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:16.223434    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cf688127-37be-462b-b440-df3c76568622-data\") pod \"postgres-69fb4594cf-n4gkz\" (UID: \"cf688127-37be-462b-b440-df3c76568622\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-n4gkz"
Jul 24 17:11:16.223631 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:16.223478    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnqj8\" (UniqueName: \"kubernetes.io/projected/cf688127-37be-462b-b440-df3c76568622-kube-api-access-pnqj8\") pod \"postgres-69fb4594cf-n4gkz\" (UID: \"cf688127-37be-462b-b440-df3c76568622\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-n4gkz"
Jul 24 17:11:16.223824 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:16.223803    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cf688127-37be-462b-b440-df3c76568622-data\") pod \"postgres-69fb4594cf-n4gkz\" (UID: \"cf688127-37be-462b-b440-df3c76568622\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-n4gkz"
Jul 24 17:11:16.232156 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:16.232126    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnqj8\" (UniqueName: \"kubernetes.io/projected/cf688127-37be-462b-b440-df3c76568622-kube-api-access-pnqj8\") pod \"postgres-69fb4594cf-n4gkz\" (UID: \"cf688127-37be-462b-b440-df3c76568622\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-n4gkz"
Jul 24 17:11:16.367633 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:16.367534    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-n4gkz"
Jul 24 17:11:16.497002 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:16.496940    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-n4gkz"]
Jul 24 17:11:16.499363 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:11:16.499328    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf688127_37be_462b_b440_df3c76568622.slice/crio-84b6a70409bf56b7a04ff784361d0a771cad12e4df46e3093bd9a27ebe2aa2fb WatchSource:0}: Error finding container 84b6a70409bf56b7a04ff784361d0a771cad12e4df46e3093bd9a27ebe2aa2fb: Status 404 returned error can't find the container with id 84b6a70409bf56b7a04ff784361d0a771cad12e4df46e3093bd9a27ebe2aa2fb
Jul 24 17:11:17.325663 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:17.325628    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-n4gkz" event={"ID":"cf688127-37be-462b-b440-df3c76568622","Type":"ContainerStarted","Data":"84b6a70409bf56b7a04ff784361d0a771cad12e4df46e3093bd9a27ebe2aa2fb"}
Jul 24 17:11:22.350162 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:22.350122    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-n4gkz" event={"ID":"cf688127-37be-462b-b440-df3c76568622","Type":"ContainerStarted","Data":"1f6206bb8e2b6b8b2dc8d88e8c0448ecfe685d517df23cba3456f0cd3c3423b9"}
Jul 24 17:11:22.350547 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:22.350208    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-n4gkz"
Jul 24 17:11:22.368382 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:22.368334    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-n4gkz" podStartSLOduration=1.484663649 podStartE2EDuration="6.368318654s" totalImagesPullingTime="4.883655005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:11:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:11:22.366495841 +0000 UTC m=+466.639355634" watchObservedRunningTime="2026-07-24 17:11:22.368318654 +0000 UTC m=+466.641178434"
Jul 24 17:11:28.382085 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:28.382039    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-n4gkz"
Jul 24 17:11:28.935658 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:28.935627    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vp59x"]
Jul 24 17:11:28.938579 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:28.938562    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-vp59x"
Jul 24 17:11:28.940922 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:28.940899    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-vxxvf\""
Jul 24 17:11:28.946585 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:28.946559    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vp59x"]
Jul 24 17:11:29.041715 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:29.041680    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67zw4\" (UniqueName: \"kubernetes.io/projected/b3d28b46-cc74-44ff-b2bd-a98af0e7da02-kube-api-access-67zw4\") pod \"authorino-5d4b67c446-vp59x\" (UID: \"b3d28b46-cc74-44ff-b2bd-a98af0e7da02\") " pod="kuadrant-system/authorino-5d4b67c446-vp59x"
Jul 24 17:11:29.143126 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:29.143096    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67zw4\" (UniqueName: \"kubernetes.io/projected/b3d28b46-cc74-44ff-b2bd-a98af0e7da02-kube-api-access-67zw4\") pod \"authorino-5d4b67c446-vp59x\" (UID: \"b3d28b46-cc74-44ff-b2bd-a98af0e7da02\") " pod="kuadrant-system/authorino-5d4b67c446-vp59x"
Jul 24 17:11:29.162007 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:29.161983    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67zw4\" (UniqueName: \"kubernetes.io/projected/b3d28b46-cc74-44ff-b2bd-a98af0e7da02-kube-api-access-67zw4\") pod \"authorino-5d4b67c446-vp59x\" (UID: \"b3d28b46-cc74-44ff-b2bd-a98af0e7da02\") " pod="kuadrant-system/authorino-5d4b67c446-vp59x"
Jul 24 17:11:29.218731 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:29.218647    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vp59x"]
Jul 24 17:11:29.218925 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:29.218913    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-vp59x"
Jul 24 17:11:29.262795 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:29.262762    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-647fc4d765-f28s9"]
Jul 24 17:11:29.272808 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:29.266560    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-647fc4d765-f28s9"
Jul 24 17:11:29.280634 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:29.280579    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-647fc4d765-f28s9"]
Jul 24 17:11:29.344649 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:29.344621    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm755\" (UniqueName: \"kubernetes.io/projected/2126a080-491a-4901-9c8f-30223bcbe1a3-kube-api-access-gm755\") pod \"authorino-647fc4d765-f28s9\" (UID: \"2126a080-491a-4901-9c8f-30223bcbe1a3\") " pod="kuadrant-system/authorino-647fc4d765-f28s9"
Jul 24 17:11:29.374219 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:29.374144    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vp59x"]
Jul 24 17:11:29.377004 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:11:29.376975    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb3d28b46_cc74_44ff_b2bd_a98af0e7da02.slice/crio-0866e548b96163a4ddd4bbe6eb9cf5a980bff8c26bcd27642d3da3189fb570a5 WatchSource:0}: Error finding container 0866e548b96163a4ddd4bbe6eb9cf5a980bff8c26bcd27642d3da3189fb570a5: Status 404 returned error can't find the container with id 0866e548b96163a4ddd4bbe6eb9cf5a980bff8c26bcd27642d3da3189fb570a5
Jul 24 17:11:29.388041 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:29.388010    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-vp59x" event={"ID":"b3d28b46-cc74-44ff-b2bd-a98af0e7da02","Type":"ContainerStarted","Data":"0866e548b96163a4ddd4bbe6eb9cf5a980bff8c26bcd27642d3da3189fb570a5"}
Jul 24 17:11:29.445627 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:29.445599    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm755\" (UniqueName: \"kubernetes.io/projected/2126a080-491a-4901-9c8f-30223bcbe1a3-kube-api-access-gm755\") pod \"authorino-647fc4d765-f28s9\" (UID: \"2126a080-491a-4901-9c8f-30223bcbe1a3\") " pod="kuadrant-system/authorino-647fc4d765-f28s9"
Jul 24 17:11:29.454191 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:29.454167    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm755\" (UniqueName: \"kubernetes.io/projected/2126a080-491a-4901-9c8f-30223bcbe1a3-kube-api-access-gm755\") pod \"authorino-647fc4d765-f28s9\" (UID: \"2126a080-491a-4901-9c8f-30223bcbe1a3\") " pod="kuadrant-system/authorino-647fc4d765-f28s9"
Jul 24 17:11:29.463994 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:29.463970    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-647fc4d765-f28s9"]
Jul 24 17:11:29.464194 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:29.464182    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-647fc4d765-f28s9"
Jul 24 17:11:29.487297 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:29.487272    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-694685d449-ljcvg"]
Jul 24 17:11:29.491280 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:29.491261    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-694685d449-ljcvg"
Jul 24 17:11:29.493618 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:29.493600    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 24 17:11:29.497831 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:29.497810    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-694685d449-ljcvg"]
Jul 24 17:11:29.589937 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:29.589913    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-647fc4d765-f28s9"]
Jul 24 17:11:29.592465 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:11:29.592436    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2126a080_491a_4901_9c8f_30223bcbe1a3.slice/crio-e6a371fbd0cb2e2a1b96275a1a518c7d8789083162437592fbd8e77a1d075f15 WatchSource:0}: Error finding container e6a371fbd0cb2e2a1b96275a1a518c7d8789083162437592fbd8e77a1d075f15: Status 404 returned error can't find the container with id e6a371fbd0cb2e2a1b96275a1a518c7d8789083162437592fbd8e77a1d075f15
Jul 24 17:11:29.647784 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:29.647755    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmbkb\" (UniqueName: \"kubernetes.io/projected/287c7eb8-ca25-49e9-b886-0a1e1e4d8ce2-kube-api-access-tmbkb\") pod \"authorino-694685d449-ljcvg\" (UID: \"287c7eb8-ca25-49e9-b886-0a1e1e4d8ce2\") " pod="kuadrant-system/authorino-694685d449-ljcvg"
Jul 24 17:11:29.647878 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:29.647851    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/287c7eb8-ca25-49e9-b886-0a1e1e4d8ce2-tls-cert\") pod \"authorino-694685d449-ljcvg\" (UID: \"287c7eb8-ca25-49e9-b886-0a1e1e4d8ce2\") " pod="kuadrant-system/authorino-694685d449-ljcvg"
Jul 24 17:11:29.748394 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:29.748297    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/287c7eb8-ca25-49e9-b886-0a1e1e4d8ce2-tls-cert\") pod \"authorino-694685d449-ljcvg\" (UID: \"287c7eb8-ca25-49e9-b886-0a1e1e4d8ce2\") " pod="kuadrant-system/authorino-694685d449-ljcvg"
Jul 24 17:11:29.748394 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:29.748361    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmbkb\" (UniqueName: \"kubernetes.io/projected/287c7eb8-ca25-49e9-b886-0a1e1e4d8ce2-kube-api-access-tmbkb\") pod \"authorino-694685d449-ljcvg\" (UID: \"287c7eb8-ca25-49e9-b886-0a1e1e4d8ce2\") " pod="kuadrant-system/authorino-694685d449-ljcvg"
Jul 24 17:11:29.750645 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:29.750622    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/287c7eb8-ca25-49e9-b886-0a1e1e4d8ce2-tls-cert\") pod \"authorino-694685d449-ljcvg\" (UID: \"287c7eb8-ca25-49e9-b886-0a1e1e4d8ce2\") " pod="kuadrant-system/authorino-694685d449-ljcvg"
Jul 24 17:11:29.756553 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:29.756529    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmbkb\" (UniqueName: \"kubernetes.io/projected/287c7eb8-ca25-49e9-b886-0a1e1e4d8ce2-kube-api-access-tmbkb\") pod \"authorino-694685d449-ljcvg\" (UID: \"287c7eb8-ca25-49e9-b886-0a1e1e4d8ce2\") " pod="kuadrant-system/authorino-694685d449-ljcvg"
Jul 24 17:11:29.802547 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:29.802512    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-694685d449-ljcvg"
Jul 24 17:11:29.929897 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:29.929875    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-694685d449-ljcvg"]
Jul 24 17:11:29.932245 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:11:29.932220    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod287c7eb8_ca25_49e9_b886_0a1e1e4d8ce2.slice/crio-824e88ed04cea1de63bf4b93e482720334bdeb9c323caf3859f2554a5a7a1087 WatchSource:0}: Error finding container 824e88ed04cea1de63bf4b93e482720334bdeb9c323caf3859f2554a5a7a1087: Status 404 returned error can't find the container with id 824e88ed04cea1de63bf4b93e482720334bdeb9c323caf3859f2554a5a7a1087
Jul 24 17:11:30.394128 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:30.394091    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-647fc4d765-f28s9" event={"ID":"2126a080-491a-4901-9c8f-30223bcbe1a3","Type":"ContainerStarted","Data":"5722e92624fa21c9629ea0bbe452284b86d05078dc580abd542faf6803d487a1"}
Jul 24 17:11:30.394538 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:30.394137    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-647fc4d765-f28s9" event={"ID":"2126a080-491a-4901-9c8f-30223bcbe1a3","Type":"ContainerStarted","Data":"e6a371fbd0cb2e2a1b96275a1a518c7d8789083162437592fbd8e77a1d075f15"}
Jul 24 17:11:30.394538 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:30.394160    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-647fc4d765-f28s9" podUID="2126a080-491a-4901-9c8f-30223bcbe1a3" containerName="authorino" containerID="cri-o://5722e92624fa21c9629ea0bbe452284b86d05078dc580abd542faf6803d487a1" gracePeriod=30
Jul 24 17:11:30.395990 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:30.395961    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-694685d449-ljcvg" event={"ID":"287c7eb8-ca25-49e9-b886-0a1e1e4d8ce2","Type":"ContainerStarted","Data":"b805e4ee8b81430544df00c8c740d8248a9f5be42983922a8a619cd7a2e79649"}
Jul 24 17:11:30.396149 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:30.396002    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-694685d449-ljcvg" event={"ID":"287c7eb8-ca25-49e9-b886-0a1e1e4d8ce2","Type":"ContainerStarted","Data":"824e88ed04cea1de63bf4b93e482720334bdeb9c323caf3859f2554a5a7a1087"}
Jul 24 17:11:30.397744 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:30.397719    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-vp59x" event={"ID":"b3d28b46-cc74-44ff-b2bd-a98af0e7da02","Type":"ContainerStarted","Data":"7865d4bcbf8b7c26c3ca905549fa6ab8f8e5897ad6c127b4f19c857b5f7e500d"}
Jul 24 17:11:30.397852 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:30.397794    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-vp59x" podUID="b3d28b46-cc74-44ff-b2bd-a98af0e7da02" containerName="authorino" containerID="cri-o://7865d4bcbf8b7c26c3ca905549fa6ab8f8e5897ad6c127b4f19c857b5f7e500d" gracePeriod=30
Jul 24 17:11:30.411241 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:30.411194    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-647fc4d765-f28s9" podStartSLOduration=1.078014311 podStartE2EDuration="1.411178493s" totalImagesPullingTime="333.164182ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:11:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:11:30.409427263 +0000 UTC m=+474.682287044" watchObservedRunningTime="2026-07-24 17:11:30.411178493 +0000 UTC m=+474.684038271"
Jul 24 17:11:30.427484 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:30.427441    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-vp59x" podStartSLOduration=2.136560484 podStartE2EDuration="2.427425265s" totalImagesPullingTime="290.864781ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:11:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:11:30.426217668 +0000 UTC m=+474.699077448" watchObservedRunningTime="2026-07-24 17:11:30.427425265 +0000 UTC m=+474.700285065"
Jul 24 17:11:30.441801 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:30.441749    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-694685d449-ljcvg" podStartSLOduration=1.077328303 podStartE2EDuration="1.441731958s" totalImagesPullingTime="364.403655ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:11:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:11:30.441201288 +0000 UTC m=+474.714061067" watchObservedRunningTime="2026-07-24 17:11:30.441731958 +0000 UTC m=+474.714591738"
Jul 24 17:11:30.647377 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:30.647351    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-647fc4d765-f28s9"
Jul 24 17:11:30.660885 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:30.660863    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-vp59x"
Jul 24 17:11:30.756615 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:30.756580    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gm755\" (UniqueName: \"kubernetes.io/projected/2126a080-491a-4901-9c8f-30223bcbe1a3-kube-api-access-gm755\") pod \"2126a080-491a-4901-9c8f-30223bcbe1a3\" (UID: \"2126a080-491a-4901-9c8f-30223bcbe1a3\") "
Jul 24 17:11:30.756768 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:30.756670    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67zw4\" (UniqueName: \"kubernetes.io/projected/b3d28b46-cc74-44ff-b2bd-a98af0e7da02-kube-api-access-67zw4\") pod \"b3d28b46-cc74-44ff-b2bd-a98af0e7da02\" (UID: \"b3d28b46-cc74-44ff-b2bd-a98af0e7da02\") "
Jul 24 17:11:30.758700 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:30.758664    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2126a080-491a-4901-9c8f-30223bcbe1a3-kube-api-access-gm755" (OuterVolumeSpecName: "kube-api-access-gm755") pod "2126a080-491a-4901-9c8f-30223bcbe1a3" (UID: "2126a080-491a-4901-9c8f-30223bcbe1a3"). InnerVolumeSpecName "kube-api-access-gm755". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:11:30.758817 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:30.758787    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3d28b46-cc74-44ff-b2bd-a98af0e7da02-kube-api-access-67zw4" (OuterVolumeSpecName: "kube-api-access-67zw4") pod "b3d28b46-cc74-44ff-b2bd-a98af0e7da02" (UID: "b3d28b46-cc74-44ff-b2bd-a98af0e7da02"). InnerVolumeSpecName "kube-api-access-67zw4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:11:30.858008 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:30.857931    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gm755\" (UniqueName: \"kubernetes.io/projected/2126a080-491a-4901-9c8f-30223bcbe1a3-kube-api-access-gm755\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:11:30.858008 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:30.857957    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67zw4\" (UniqueName: \"kubernetes.io/projected/b3d28b46-cc74-44ff-b2bd-a98af0e7da02-kube-api-access-67zw4\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:11:31.403616 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:31.403584    2561 generic.go:356] "Generic (PLEG): container finished" podID="2126a080-491a-4901-9c8f-30223bcbe1a3" containerID="5722e92624fa21c9629ea0bbe452284b86d05078dc580abd542faf6803d487a1" exitCode=0
Jul 24 17:11:31.403982 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:31.403625    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-647fc4d765-f28s9"
Jul 24 17:11:31.403982 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:31.403664    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-647fc4d765-f28s9" event={"ID":"2126a080-491a-4901-9c8f-30223bcbe1a3","Type":"ContainerDied","Data":"5722e92624fa21c9629ea0bbe452284b86d05078dc580abd542faf6803d487a1"}
Jul 24 17:11:31.403982 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:31.403699    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-647fc4d765-f28s9" event={"ID":"2126a080-491a-4901-9c8f-30223bcbe1a3","Type":"ContainerDied","Data":"e6a371fbd0cb2e2a1b96275a1a518c7d8789083162437592fbd8e77a1d075f15"}
Jul 24 17:11:31.403982 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:31.403716    2561 scope.go:117] "RemoveContainer" containerID="5722e92624fa21c9629ea0bbe452284b86d05078dc580abd542faf6803d487a1"
Jul 24 17:11:31.404988 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:31.404963    2561 generic.go:356] "Generic (PLEG): container finished" podID="b3d28b46-cc74-44ff-b2bd-a98af0e7da02" containerID="7865d4bcbf8b7c26c3ca905549fa6ab8f8e5897ad6c127b4f19c857b5f7e500d" exitCode=0
Jul 24 17:11:31.405056 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:31.405010    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-vp59x"
Jul 24 17:11:31.405056 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:31.405034    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-vp59x" event={"ID":"b3d28b46-cc74-44ff-b2bd-a98af0e7da02","Type":"ContainerDied","Data":"7865d4bcbf8b7c26c3ca905549fa6ab8f8e5897ad6c127b4f19c857b5f7e500d"}
Jul 24 17:11:31.405214 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:31.405082    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-vp59x" event={"ID":"b3d28b46-cc74-44ff-b2bd-a98af0e7da02","Type":"ContainerDied","Data":"0866e548b96163a4ddd4bbe6eb9cf5a980bff8c26bcd27642d3da3189fb570a5"}
Jul 24 17:11:31.412834 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:31.412813    2561 scope.go:117] "RemoveContainer" containerID="5722e92624fa21c9629ea0bbe452284b86d05078dc580abd542faf6803d487a1"
Jul 24 17:11:31.413124 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:11:31.413100    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5722e92624fa21c9629ea0bbe452284b86d05078dc580abd542faf6803d487a1\": container with ID starting with 5722e92624fa21c9629ea0bbe452284b86d05078dc580abd542faf6803d487a1 not found: ID does not exist" containerID="5722e92624fa21c9629ea0bbe452284b86d05078dc580abd542faf6803d487a1"
Jul 24 17:11:31.413207 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:31.413130    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5722e92624fa21c9629ea0bbe452284b86d05078dc580abd542faf6803d487a1"} err="failed to get container status \"5722e92624fa21c9629ea0bbe452284b86d05078dc580abd542faf6803d487a1\": rpc error: code = NotFound desc = could not find container \"5722e92624fa21c9629ea0bbe452284b86d05078dc580abd542faf6803d487a1\": container with ID starting with 5722e92624fa21c9629ea0bbe452284b86d05078dc580abd542faf6803d487a1 not found: ID does not exist"
Jul 24 17:11:31.413207 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:31.413147    2561 scope.go:117] "RemoveContainer" containerID="7865d4bcbf8b7c26c3ca905549fa6ab8f8e5897ad6c127b4f19c857b5f7e500d"
Jul 24 17:11:31.420641 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:31.420624    2561 scope.go:117] "RemoveContainer" containerID="7865d4bcbf8b7c26c3ca905549fa6ab8f8e5897ad6c127b4f19c857b5f7e500d"
Jul 24 17:11:31.420874 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:11:31.420857    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7865d4bcbf8b7c26c3ca905549fa6ab8f8e5897ad6c127b4f19c857b5f7e500d\": container with ID starting with 7865d4bcbf8b7c26c3ca905549fa6ab8f8e5897ad6c127b4f19c857b5f7e500d not found: ID does not exist" containerID="7865d4bcbf8b7c26c3ca905549fa6ab8f8e5897ad6c127b4f19c857b5f7e500d"
Jul 24 17:11:31.420909 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:31.420881    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7865d4bcbf8b7c26c3ca905549fa6ab8f8e5897ad6c127b4f19c857b5f7e500d"} err="failed to get container status \"7865d4bcbf8b7c26c3ca905549fa6ab8f8e5897ad6c127b4f19c857b5f7e500d\": rpc error: code = NotFound desc = could not find container \"7865d4bcbf8b7c26c3ca905549fa6ab8f8e5897ad6c127b4f19c857b5f7e500d\": container with ID starting with 7865d4bcbf8b7c26c3ca905549fa6ab8f8e5897ad6c127b4f19c857b5f7e500d not found: ID does not exist"
Jul 24 17:11:31.427799 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:31.427777    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vp59x"]
Jul 24 17:11:31.432564 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:31.432546    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vp59x"]
Jul 24 17:11:31.442536 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:31.442515    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-647fc4d765-f28s9"]
Jul 24 17:11:31.446695 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:31.446674    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-647fc4d765-f28s9"]
Jul 24 17:11:32.258003 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:32.257972    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2126a080-491a-4901-9c8f-30223bcbe1a3" path="/var/lib/kubelet/pods/2126a080-491a-4901-9c8f-30223bcbe1a3/volumes"
Jul 24 17:11:32.258335 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:32.258321    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3d28b46-cc74-44ff-b2bd-a98af0e7da02" path="/var/lib/kubelet/pods/b3d28b46-cc74-44ff-b2bd-a98af0e7da02/volumes"
Jul 24 17:11:35.223800 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:35.223768    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6466b46b8b-qgzm4"]
Jul 24 17:11:35.224262 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:35.224103    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2126a080-491a-4901-9c8f-30223bcbe1a3" containerName="authorino"
Jul 24 17:11:35.224262 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:35.224114    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2126a080-491a-4901-9c8f-30223bcbe1a3" containerName="authorino"
Jul 24 17:11:35.224262 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:35.224124    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3d28b46-cc74-44ff-b2bd-a98af0e7da02" containerName="authorino"
Jul 24 17:11:35.224262 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:35.224129    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3d28b46-cc74-44ff-b2bd-a98af0e7da02" containerName="authorino"
Jul 24 17:11:35.224262 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:35.224196    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2126a080-491a-4901-9c8f-30223bcbe1a3" containerName="authorino"
Jul 24 17:11:35.224262 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:35.224206    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3d28b46-cc74-44ff-b2bd-a98af0e7da02" containerName="authorino"
Jul 24 17:11:35.408951 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:35.408917    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6466b46b8b-qgzm4"]
Jul 24 17:11:35.409162 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:35.409019    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6466b46b8b-qgzm4"
Jul 24 17:11:35.412374 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:35.412350    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 24 17:11:35.412508 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:35.412350    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 24 17:11:35.412508 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:35.412420    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-brxpq\""
Jul 24 17:11:35.436241 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:35.436217    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-75f9bdd58d-xf4g8"]
Jul 24 17:11:35.452100 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:35.452058    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75f9bdd58d-xf4g8"]
Jul 24 17:11:35.452215 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:35.452144    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75f9bdd58d-xf4g8"
Jul 24 17:11:35.501393 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:35.501323    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvjz9\" (UniqueName: \"kubernetes.io/projected/0edcee08-b88a-4fc8-a921-889bbd218ca3-kube-api-access-wvjz9\") pod \"maas-controller-6466b46b8b-qgzm4\" (UID: \"0edcee08-b88a-4fc8-a921-889bbd218ca3\") " pod="opendatahub/maas-controller-6466b46b8b-qgzm4"
Jul 24 17:11:35.501393 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:35.501363    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0edcee08-b88a-4fc8-a921-889bbd218ca3-webhook-cert\") pod \"maas-controller-6466b46b8b-qgzm4\" (UID: \"0edcee08-b88a-4fc8-a921-889bbd218ca3\") " pod="opendatahub/maas-controller-6466b46b8b-qgzm4"
Jul 24 17:11:35.601845 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:35.601805    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnmw2\" (UniqueName: \"kubernetes.io/projected/edade610-8f64-4e6d-b203-db81e7465b54-kube-api-access-jnmw2\") pod \"maas-controller-75f9bdd58d-xf4g8\" (UID: \"edade610-8f64-4e6d-b203-db81e7465b54\") " pod="opendatahub/maas-controller-75f9bdd58d-xf4g8"
Jul 24 17:11:35.602009 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:35.601860    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/edade610-8f64-4e6d-b203-db81e7465b54-webhook-cert\") pod \"maas-controller-75f9bdd58d-xf4g8\" (UID: \"edade610-8f64-4e6d-b203-db81e7465b54\") " pod="opendatahub/maas-controller-75f9bdd58d-xf4g8"
Jul 24 17:11:35.602009 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:35.601958    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvjz9\" (UniqueName: \"kubernetes.io/projected/0edcee08-b88a-4fc8-a921-889bbd218ca3-kube-api-access-wvjz9\") pod \"maas-controller-6466b46b8b-qgzm4\" (UID: \"0edcee08-b88a-4fc8-a921-889bbd218ca3\") " pod="opendatahub/maas-controller-6466b46b8b-qgzm4"
Jul 24 17:11:35.602009 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:35.601995    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0edcee08-b88a-4fc8-a921-889bbd218ca3-webhook-cert\") pod \"maas-controller-6466b46b8b-qgzm4\" (UID: \"0edcee08-b88a-4fc8-a921-889bbd218ca3\") " pod="opendatahub/maas-controller-6466b46b8b-qgzm4"
Jul 24 17:11:35.604394 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:35.604375    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0edcee08-b88a-4fc8-a921-889bbd218ca3-webhook-cert\") pod \"maas-controller-6466b46b8b-qgzm4\" (UID: \"0edcee08-b88a-4fc8-a921-889bbd218ca3\") " pod="opendatahub/maas-controller-6466b46b8b-qgzm4"
Jul 24 17:11:35.612686 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:35.612654    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvjz9\" (UniqueName: \"kubernetes.io/projected/0edcee08-b88a-4fc8-a921-889bbd218ca3-kube-api-access-wvjz9\") pod \"maas-controller-6466b46b8b-qgzm4\" (UID: \"0edcee08-b88a-4fc8-a921-889bbd218ca3\") " pod="opendatahub/maas-controller-6466b46b8b-qgzm4"
Jul 24 17:11:35.703385 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:35.703350    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnmw2\" (UniqueName: \"kubernetes.io/projected/edade610-8f64-4e6d-b203-db81e7465b54-kube-api-access-jnmw2\") pod \"maas-controller-75f9bdd58d-xf4g8\" (UID: \"edade610-8f64-4e6d-b203-db81e7465b54\") " pod="opendatahub/maas-controller-75f9bdd58d-xf4g8"
Jul 24 17:11:35.703543 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:35.703416    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/edade610-8f64-4e6d-b203-db81e7465b54-webhook-cert\") pod \"maas-controller-75f9bdd58d-xf4g8\" (UID: \"edade610-8f64-4e6d-b203-db81e7465b54\") " pod="opendatahub/maas-controller-75f9bdd58d-xf4g8"
Jul 24 17:11:35.705840 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:35.705819    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/edade610-8f64-4e6d-b203-db81e7465b54-webhook-cert\") pod \"maas-controller-75f9bdd58d-xf4g8\" (UID: \"edade610-8f64-4e6d-b203-db81e7465b54\") " pod="opendatahub/maas-controller-75f9bdd58d-xf4g8"
Jul 24 17:11:35.712811 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:35.712783    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnmw2\" (UniqueName: \"kubernetes.io/projected/edade610-8f64-4e6d-b203-db81e7465b54-kube-api-access-jnmw2\") pod \"maas-controller-75f9bdd58d-xf4g8\" (UID: \"edade610-8f64-4e6d-b203-db81e7465b54\") " pod="opendatahub/maas-controller-75f9bdd58d-xf4g8"
Jul 24 17:11:35.721462 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:35.721441    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6466b46b8b-qgzm4"
Jul 24 17:11:35.765510 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:35.765437    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75f9bdd58d-xf4g8"
Jul 24 17:11:35.882303 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:35.882273    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6466b46b8b-qgzm4"]
Jul 24 17:11:35.883982 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:11:35.883943    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0edcee08_b88a_4fc8_a921_889bbd218ca3.slice/crio-2b7c5f05ad16e1da6afd71736930260e2909ea2ed1ff9d77fa99b45c42cb3e8a WatchSource:0}: Error finding container 2b7c5f05ad16e1da6afd71736930260e2909ea2ed1ff9d77fa99b45c42cb3e8a: Status 404 returned error can't find the container with id 2b7c5f05ad16e1da6afd71736930260e2909ea2ed1ff9d77fa99b45c42cb3e8a
Jul 24 17:11:35.922334 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:35.922311    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75f9bdd58d-xf4g8"]
Jul 24 17:11:35.924685 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:11:35.924658    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedade610_8f64_4e6d_b203_db81e7465b54.slice/crio-fd9dd850b78b1e7aa85b1c2efa8e611718d4fd9ea7b07ba6711993aa27ded54c WatchSource:0}: Error finding container fd9dd850b78b1e7aa85b1c2efa8e611718d4fd9ea7b07ba6711993aa27ded54c: Status 404 returned error can't find the container with id fd9dd850b78b1e7aa85b1c2efa8e611718d4fd9ea7b07ba6711993aa27ded54c
Jul 24 17:11:36.433400 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:36.433308    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6466b46b8b-qgzm4" event={"ID":"0edcee08-b88a-4fc8-a921-889bbd218ca3","Type":"ContainerStarted","Data":"2b7c5f05ad16e1da6afd71736930260e2909ea2ed1ff9d77fa99b45c42cb3e8a"}
Jul 24 17:11:36.434895 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:36.434862    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75f9bdd58d-xf4g8" event={"ID":"edade610-8f64-4e6d-b203-db81e7465b54","Type":"ContainerStarted","Data":"fd9dd850b78b1e7aa85b1c2efa8e611718d4fd9ea7b07ba6711993aa27ded54c"}
Jul 24 17:11:38.299549 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:38.299526    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 24 17:11:38.446104 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:38.446048    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6466b46b8b-qgzm4" event={"ID":"0edcee08-b88a-4fc8-a921-889bbd218ca3","Type":"ContainerStarted","Data":"d9b2f5050878c1208a929a4514fd7ab370d02383aeeabfc6884b6733c1072302"}
Jul 24 17:11:38.446297 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:38.446127    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6466b46b8b-qgzm4"
Jul 24 17:11:38.447604 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:38.447571    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75f9bdd58d-xf4g8" event={"ID":"edade610-8f64-4e6d-b203-db81e7465b54","Type":"ContainerStarted","Data":"548c28358ea169b39b2285bfc27fa94f7703f3375c9c77aaaab8328b90610de9"}
Jul 24 17:11:38.447717 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:38.447634    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-75f9bdd58d-xf4g8"
Jul 24 17:11:38.514683 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:38.514621    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6466b46b8b-qgzm4" podStartSLOduration=1.098555128 podStartE2EDuration="3.514599648s" totalImagesPullingTime="2.41604452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:11:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:11:38.512811667 +0000 UTC m=+482.785671476" watchObservedRunningTime="2026-07-24 17:11:38.514599648 +0000 UTC m=+482.787459429"
Jul 24 17:11:38.547981 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:38.547890    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-75f9bdd58d-xf4g8" podStartSLOduration=1.176935633 podStartE2EDuration="3.547874468s" totalImagesPullingTime="2.370938835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:11:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:11:38.546047455 +0000 UTC m=+482.818907298" watchObservedRunningTime="2026-07-24 17:11:38.547874468 +0000 UTC m=+482.820734248"
Jul 24 17:11:49.454509 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:49.454474    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-75f9bdd58d-xf4g8"
Jul 24 17:11:49.455017 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:49.454569    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6466b46b8b-qgzm4"
Jul 24 17:11:49.518879 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:49.518833    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6466b46b8b-qgzm4"]
Jul 24 17:11:49.519108 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:49.519081    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6466b46b8b-qgzm4" podUID="0edcee08-b88a-4fc8-a921-889bbd218ca3" containerName="manager" containerID="cri-o://d9b2f5050878c1208a929a4514fd7ab370d02383aeeabfc6884b6733c1072302" gracePeriod=30
Jul 24 17:11:49.765358 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:49.765331    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6466b46b8b-qgzm4"
Jul 24 17:11:49.827721 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:49.827692    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0edcee08-b88a-4fc8-a921-889bbd218ca3-webhook-cert\") pod \"0edcee08-b88a-4fc8-a921-889bbd218ca3\" (UID: \"0edcee08-b88a-4fc8-a921-889bbd218ca3\") "
Jul 24 17:11:49.827853 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:49.827742    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wvjz9\" (UniqueName: \"kubernetes.io/projected/0edcee08-b88a-4fc8-a921-889bbd218ca3-kube-api-access-wvjz9\") pod \"0edcee08-b88a-4fc8-a921-889bbd218ca3\" (UID: \"0edcee08-b88a-4fc8-a921-889bbd218ca3\") "
Jul 24 17:11:49.829839 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:49.829811    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0edcee08-b88a-4fc8-a921-889bbd218ca3-kube-api-access-wvjz9" (OuterVolumeSpecName: "kube-api-access-wvjz9") pod "0edcee08-b88a-4fc8-a921-889bbd218ca3" (UID: "0edcee08-b88a-4fc8-a921-889bbd218ca3"). InnerVolumeSpecName "kube-api-access-wvjz9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:11:49.829956 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:49.829912    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0edcee08-b88a-4fc8-a921-889bbd218ca3-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0edcee08-b88a-4fc8-a921-889bbd218ca3" (UID: "0edcee08-b88a-4fc8-a921-889bbd218ca3"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:11:49.928461 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:49.928429    2561 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0edcee08-b88a-4fc8-a921-889bbd218ca3-webhook-cert\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:11:49.928461 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:49.928457    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wvjz9\" (UniqueName: \"kubernetes.io/projected/0edcee08-b88a-4fc8-a921-889bbd218ca3-kube-api-access-wvjz9\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:11:50.502674 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:50.502644    2561 generic.go:356] "Generic (PLEG): container finished" podID="0edcee08-b88a-4fc8-a921-889bbd218ca3" containerID="d9b2f5050878c1208a929a4514fd7ab370d02383aeeabfc6884b6733c1072302" exitCode=0
Jul 24 17:11:50.503167 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:50.502687    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6466b46b8b-qgzm4"
Jul 24 17:11:50.503167 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:50.502731    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6466b46b8b-qgzm4" event={"ID":"0edcee08-b88a-4fc8-a921-889bbd218ca3","Type":"ContainerDied","Data":"d9b2f5050878c1208a929a4514fd7ab370d02383aeeabfc6884b6733c1072302"}
Jul 24 17:11:50.503167 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:50.502785    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6466b46b8b-qgzm4" event={"ID":"0edcee08-b88a-4fc8-a921-889bbd218ca3","Type":"ContainerDied","Data":"2b7c5f05ad16e1da6afd71736930260e2909ea2ed1ff9d77fa99b45c42cb3e8a"}
Jul 24 17:11:50.503167 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:50.502808    2561 scope.go:117] "RemoveContainer" containerID="d9b2f5050878c1208a929a4514fd7ab370d02383aeeabfc6884b6733c1072302"
Jul 24 17:11:50.510842 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:50.510818    2561 scope.go:117] "RemoveContainer" containerID="d9b2f5050878c1208a929a4514fd7ab370d02383aeeabfc6884b6733c1072302"
Jul 24 17:11:50.511158 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:11:50.511140    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9b2f5050878c1208a929a4514fd7ab370d02383aeeabfc6884b6733c1072302\": container with ID starting with d9b2f5050878c1208a929a4514fd7ab370d02383aeeabfc6884b6733c1072302 not found: ID does not exist" containerID="d9b2f5050878c1208a929a4514fd7ab370d02383aeeabfc6884b6733c1072302"
Jul 24 17:11:50.511209 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:50.511167    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9b2f5050878c1208a929a4514fd7ab370d02383aeeabfc6884b6733c1072302"} err="failed to get container status \"d9b2f5050878c1208a929a4514fd7ab370d02383aeeabfc6884b6733c1072302\": rpc error: code = NotFound desc = could not find container \"d9b2f5050878c1208a929a4514fd7ab370d02383aeeabfc6884b6733c1072302\": container with ID starting with d9b2f5050878c1208a929a4514fd7ab370d02383aeeabfc6884b6733c1072302 not found: ID does not exist"
Jul 24 17:11:50.518029 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:50.517981    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6466b46b8b-qgzm4"]
Jul 24 17:11:50.520662 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:50.520639    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6466b46b8b-qgzm4"]
Jul 24 17:11:52.258288 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:11:52.258257    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0edcee08-b88a-4fc8-a921-889bbd218ca3" path="/var/lib/kubelet/pods/0edcee08-b88a-4fc8-a921-889bbd218ca3/volumes"
Jul 24 17:12:11.558428 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:11.558397    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-tcv7b"]
Jul 24 17:12:11.558879 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:11.558753    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0edcee08-b88a-4fc8-a921-889bbd218ca3" containerName="manager"
Jul 24 17:12:11.558879 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:11.558764    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0edcee08-b88a-4fc8-a921-889bbd218ca3" containerName="manager"
Jul 24 17:12:11.558879 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:11.558818    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0edcee08-b88a-4fc8-a921-889bbd218ca3" containerName="manager"
Jul 24 17:12:11.562029 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:11.562007    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tcv7b"
Jul 24 17:12:11.564453 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:11.564433    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-995vp\""
Jul 24 17:12:11.564541 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:11.564472    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 24 17:12:11.575826 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:11.575806    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-tcv7b"]
Jul 24 17:12:11.613447 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:11.613422    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j49p\" (UniqueName: \"kubernetes.io/projected/4ddec504-5e0c-48b7-bdfa-a2f2a6439453-kube-api-access-9j49p\") pod \"payload-pre-processing-687dbb6cf6-tcv7b\" (UID: \"4ddec504-5e0c-48b7-bdfa-a2f2a6439453\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tcv7b"
Jul 24 17:12:11.613551 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:11.613482    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ddec504-5e0c-48b7-bdfa-a2f2a6439453-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-tcv7b\" (UID: \"4ddec504-5e0c-48b7-bdfa-a2f2a6439453\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tcv7b"
Jul 24 17:12:11.714419 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:11.714384    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9j49p\" (UniqueName: \"kubernetes.io/projected/4ddec504-5e0c-48b7-bdfa-a2f2a6439453-kube-api-access-9j49p\") pod \"payload-pre-processing-687dbb6cf6-tcv7b\" (UID: \"4ddec504-5e0c-48b7-bdfa-a2f2a6439453\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tcv7b"
Jul 24 17:12:11.714561 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:11.714458    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ddec504-5e0c-48b7-bdfa-a2f2a6439453-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-tcv7b\" (UID: \"4ddec504-5e0c-48b7-bdfa-a2f2a6439453\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tcv7b"
Jul 24 17:12:11.715130 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:11.715110    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ddec504-5e0c-48b7-bdfa-a2f2a6439453-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-tcv7b\" (UID: \"4ddec504-5e0c-48b7-bdfa-a2f2a6439453\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tcv7b"
Jul 24 17:12:11.734601 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:11.734572    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j49p\" (UniqueName: \"kubernetes.io/projected/4ddec504-5e0c-48b7-bdfa-a2f2a6439453-kube-api-access-9j49p\") pod \"payload-pre-processing-687dbb6cf6-tcv7b\" (UID: \"4ddec504-5e0c-48b7-bdfa-a2f2a6439453\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tcv7b"
Jul 24 17:12:11.872398 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:11.872367    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tcv7b"
Jul 24 17:12:12.009898 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:12.009868    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-tcv7b"]
Jul 24 17:12:12.012521 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:12:12.012489    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ddec504_5e0c_48b7_bdfa_a2f2a6439453.slice/crio-e01fa6b5dd06123581e7517792cd4911b7d9b3a491c8a59ea4d4ecaaf8344e76 WatchSource:0}: Error finding container e01fa6b5dd06123581e7517792cd4911b7d9b3a491c8a59ea4d4ecaaf8344e76: Status 404 returned error can't find the container with id e01fa6b5dd06123581e7517792cd4911b7d9b3a491c8a59ea4d4ecaaf8344e76
Jul 24 17:12:12.601366 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:12.601324    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tcv7b" event={"ID":"4ddec504-5e0c-48b7-bdfa-a2f2a6439453","Type":"ContainerStarted","Data":"e01fa6b5dd06123581e7517792cd4911b7d9b3a491c8a59ea4d4ecaaf8344e76"}
Jul 24 17:12:13.607333 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:13.607299    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tcv7b" event={"ID":"4ddec504-5e0c-48b7-bdfa-a2f2a6439453","Type":"ContainerStarted","Data":"8fc5f49c399773f60b78dd39d60d784e5c73863169205011cdb3ce73f89884b9"}
Jul 24 17:12:13.607656 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:13.607442    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tcv7b"
Jul 24 17:12:13.624243 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:13.624177    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tcv7b" podStartSLOduration=1.118183755 podStartE2EDuration="2.624159016s" totalImagesPullingTime="1.505975261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:12:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:12:13.623668995 +0000 UTC m=+517.896528798" watchObservedRunningTime="2026-07-24 17:12:13.624159016 +0000 UTC m=+517.897018799"
Jul 24 17:12:24.613988 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:24.613959    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tcv7b"
Jul 24 17:12:29.283883 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:29.283803    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfgzg"]
Jul 24 17:12:29.287109 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:29.287091    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfgzg"
Jul 24 17:12:29.290217 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:29.290195    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 24 17:12:29.290342 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:29.290224    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 24 17:12:29.290342 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:29.290269    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 24 17:12:29.290342 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:29.290270    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-85ddw\""
Jul 24 17:12:29.296000 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:29.295975    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfgzg"]
Jul 24 17:12:29.472472 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:29.472438    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5acbbe26-d973-45e6-b91d-879724bb05d2-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfgzg\" (UID: \"5acbbe26-d973-45e6-b91d-879724bb05d2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfgzg"
Jul 24 17:12:29.472617 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:29.472483    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5acbbe26-d973-45e6-b91d-879724bb05d2-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfgzg\" (UID: \"5acbbe26-d973-45e6-b91d-879724bb05d2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfgzg"
Jul 24 17:12:29.472617 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:29.472527    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5acbbe26-d973-45e6-b91d-879724bb05d2-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfgzg\" (UID: \"5acbbe26-d973-45e6-b91d-879724bb05d2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfgzg"
Jul 24 17:12:29.472617 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:29.472556    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5acbbe26-d973-45e6-b91d-879724bb05d2-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfgzg\" (UID: \"5acbbe26-d973-45e6-b91d-879724bb05d2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfgzg"
Jul 24 17:12:29.472617 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:29.472590    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5acbbe26-d973-45e6-b91d-879724bb05d2-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfgzg\" (UID: \"5acbbe26-d973-45e6-b91d-879724bb05d2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfgzg"
Jul 24 17:12:29.472617 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:29.472608    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld4r4\" (UniqueName: \"kubernetes.io/projected/5acbbe26-d973-45e6-b91d-879724bb05d2-kube-api-access-ld4r4\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfgzg\" (UID: \"5acbbe26-d973-45e6-b91d-879724bb05d2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfgzg"
Jul 24 17:12:29.573736 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:29.573668    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5acbbe26-d973-45e6-b91d-879724bb05d2-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfgzg\" (UID: \"5acbbe26-d973-45e6-b91d-879724bb05d2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfgzg"
Jul 24 17:12:29.573736 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:29.573709    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5acbbe26-d973-45e6-b91d-879724bb05d2-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfgzg\" (UID: \"5acbbe26-d973-45e6-b91d-879724bb05d2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfgzg"
Jul 24 17:12:29.573940 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:29.573737    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld4r4\" (UniqueName: \"kubernetes.io/projected/5acbbe26-d973-45e6-b91d-879724bb05d2-kube-api-access-ld4r4\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfgzg\" (UID: \"5acbbe26-d973-45e6-b91d-879724bb05d2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfgzg"
Jul 24 17:12:29.573940 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:29.573777    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5acbbe26-d973-45e6-b91d-879724bb05d2-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfgzg\" (UID: \"5acbbe26-d973-45e6-b91d-879724bb05d2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfgzg"
Jul 24 17:12:29.573940 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:29.573796    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5acbbe26-d973-45e6-b91d-879724bb05d2-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfgzg\" (UID: \"5acbbe26-d973-45e6-b91d-879724bb05d2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfgzg"
Jul 24 17:12:29.573940 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:29.573849    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5acbbe26-d973-45e6-b91d-879724bb05d2-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfgzg\" (UID: \"5acbbe26-d973-45e6-b91d-879724bb05d2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfgzg"
Jul 24 17:12:29.574176 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:29.574153    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5acbbe26-d973-45e6-b91d-879724bb05d2-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfgzg\" (UID: \"5acbbe26-d973-45e6-b91d-879724bb05d2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfgzg"
Jul 24 17:12:29.574234 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:29.574184    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5acbbe26-d973-45e6-b91d-879724bb05d2-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfgzg\" (UID: \"5acbbe26-d973-45e6-b91d-879724bb05d2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfgzg"
Jul 24 17:12:29.574316 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:29.574228    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5acbbe26-d973-45e6-b91d-879724bb05d2-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfgzg\" (UID: \"5acbbe26-d973-45e6-b91d-879724bb05d2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfgzg"
Jul 24 17:12:29.576089 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:29.576042    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5acbbe26-d973-45e6-b91d-879724bb05d2-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfgzg\" (UID: \"5acbbe26-d973-45e6-b91d-879724bb05d2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfgzg"
Jul 24 17:12:29.576282 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:29.576267    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5acbbe26-d973-45e6-b91d-879724bb05d2-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfgzg\" (UID: \"5acbbe26-d973-45e6-b91d-879724bb05d2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfgzg"
Jul 24 17:12:29.581877 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:29.581854    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld4r4\" (UniqueName: \"kubernetes.io/projected/5acbbe26-d973-45e6-b91d-879724bb05d2-kube-api-access-ld4r4\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfgzg\" (UID: \"5acbbe26-d973-45e6-b91d-879724bb05d2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfgzg"
Jul 24 17:12:29.596780 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:29.596755    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfgzg"
Jul 24 17:12:29.723559 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:29.723535    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfgzg"]
Jul 24 17:12:29.725818 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:12:29.725791    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5acbbe26_d973_45e6_b91d_879724bb05d2.slice/crio-47fb11b0fc5b8eea640a348fd4d430ed9dedc9e1bb282dd3628e7e8403eae050 WatchSource:0}: Error finding container 47fb11b0fc5b8eea640a348fd4d430ed9dedc9e1bb282dd3628e7e8403eae050: Status 404 returned error can't find the container with id 47fb11b0fc5b8eea640a348fd4d430ed9dedc9e1bb282dd3628e7e8403eae050
Jul 24 17:12:30.690577 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:30.690538    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfgzg" event={"ID":"5acbbe26-d973-45e6-b91d-879724bb05d2","Type":"ContainerStarted","Data":"47fb11b0fc5b8eea640a348fd4d430ed9dedc9e1bb282dd3628e7e8403eae050"}
Jul 24 17:12:31.697327 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:31.697290    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfgzg" event={"ID":"5acbbe26-d973-45e6-b91d-879724bb05d2","Type":"ContainerStarted","Data":"7199d3a1f1c2cdf0b03d54c4688765de92d15738f586c492687083528a42a60e"}
Jul 24 17:12:31.716765 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:31.716713    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfgzg" podStartSLOduration=1.42334492 podStartE2EDuration="2.716695316s" totalImagesPullingTime="1.293350396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:12:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:12:31.715308681 +0000 UTC m=+535.988168460" watchObservedRunningTime="2026-07-24 17:12:31.716695316 +0000 UTC m=+535.989555095"
Jul 24 17:12:39.596930 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:39.596893    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfgzg"
Jul 24 17:12:39.597417 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:39.596984    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfgzg"
Jul 24 17:12:39.610416 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:39.610395    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfgzg"
Jul 24 17:12:39.744683 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:39.744656    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfgzg"
Jul 24 17:12:42.497059 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:42.497026    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-wbrg4"]
Jul 24 17:12:42.501702 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:42.501680    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbrg4"
Jul 24 17:12:42.506669 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:42.506651    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 24 17:12:42.523119 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:42.523085    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-wbrg4"]
Jul 24 17:12:42.582029 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:42.581988    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljll9\" (UniqueName: \"kubernetes.io/projected/539f073c-e8b9-48a2-92a0-399cce1ec28f-kube-api-access-ljll9\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wbrg4\" (UID: \"539f073c-e8b9-48a2-92a0-399cce1ec28f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbrg4"
Jul 24 17:12:42.582221 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:42.582046    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/539f073c-e8b9-48a2-92a0-399cce1ec28f-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wbrg4\" (UID: \"539f073c-e8b9-48a2-92a0-399cce1ec28f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbrg4"
Jul 24 17:12:42.582221 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:42.582107    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/539f073c-e8b9-48a2-92a0-399cce1ec28f-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wbrg4\" (UID: \"539f073c-e8b9-48a2-92a0-399cce1ec28f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbrg4"
Jul 24 17:12:42.582221 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:42.582170    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/539f073c-e8b9-48a2-92a0-399cce1ec28f-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wbrg4\" (UID: \"539f073c-e8b9-48a2-92a0-399cce1ec28f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbrg4"
Jul 24 17:12:42.582221 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:42.582214    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/539f073c-e8b9-48a2-92a0-399cce1ec28f-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wbrg4\" (UID: \"539f073c-e8b9-48a2-92a0-399cce1ec28f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbrg4"
Jul 24 17:12:42.582363 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:42.582249    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/539f073c-e8b9-48a2-92a0-399cce1ec28f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wbrg4\" (UID: \"539f073c-e8b9-48a2-92a0-399cce1ec28f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbrg4"
Jul 24 17:12:42.683115 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:42.683056    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/539f073c-e8b9-48a2-92a0-399cce1ec28f-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wbrg4\" (UID: \"539f073c-e8b9-48a2-92a0-399cce1ec28f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbrg4"
Jul 24 17:12:42.683376 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:42.683141    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/539f073c-e8b9-48a2-92a0-399cce1ec28f-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wbrg4\" (UID: \"539f073c-e8b9-48a2-92a0-399cce1ec28f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbrg4"
Jul 24 17:12:42.683376 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:42.683172    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/539f073c-e8b9-48a2-92a0-399cce1ec28f-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wbrg4\" (UID: \"539f073c-e8b9-48a2-92a0-399cce1ec28f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbrg4"
Jul 24 17:12:42.683376 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:42.683211    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/539f073c-e8b9-48a2-92a0-399cce1ec28f-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wbrg4\" (UID: \"539f073c-e8b9-48a2-92a0-399cce1ec28f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbrg4"
Jul 24 17:12:42.683376 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:42.683253    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/539f073c-e8b9-48a2-92a0-399cce1ec28f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wbrg4\" (UID: \"539f073c-e8b9-48a2-92a0-399cce1ec28f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbrg4"
Jul 24 17:12:42.683376 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:42.683319    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljll9\" (UniqueName: \"kubernetes.io/projected/539f073c-e8b9-48a2-92a0-399cce1ec28f-kube-api-access-ljll9\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wbrg4\" (UID: \"539f073c-e8b9-48a2-92a0-399cce1ec28f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbrg4"
Jul 24 17:12:42.683648 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:42.683608    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/539f073c-e8b9-48a2-92a0-399cce1ec28f-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wbrg4\" (UID: \"539f073c-e8b9-48a2-92a0-399cce1ec28f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbrg4"
Jul 24 17:12:42.683703 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:42.683648    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/539f073c-e8b9-48a2-92a0-399cce1ec28f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wbrg4\" (UID: \"539f073c-e8b9-48a2-92a0-399cce1ec28f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbrg4"
Jul 24 17:12:42.683827 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:42.683807    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/539f073c-e8b9-48a2-92a0-399cce1ec28f-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wbrg4\" (UID: \"539f073c-e8b9-48a2-92a0-399cce1ec28f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbrg4"
Jul 24 17:12:42.685455 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:42.685431    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/539f073c-e8b9-48a2-92a0-399cce1ec28f-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wbrg4\" (UID: \"539f073c-e8b9-48a2-92a0-399cce1ec28f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbrg4"
Jul 24 17:12:42.685598 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:42.685580    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/539f073c-e8b9-48a2-92a0-399cce1ec28f-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wbrg4\" (UID: \"539f073c-e8b9-48a2-92a0-399cce1ec28f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbrg4"
Jul 24 17:12:42.691844 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:42.691824    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljll9\" (UniqueName: \"kubernetes.io/projected/539f073c-e8b9-48a2-92a0-399cce1ec28f-kube-api-access-ljll9\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wbrg4\" (UID: \"539f073c-e8b9-48a2-92a0-399cce1ec28f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbrg4"
Jul 24 17:12:42.813100 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:42.812999    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbrg4"
Jul 24 17:12:42.945561 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:42.945538    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-wbrg4"]
Jul 24 17:12:42.947025 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:12:42.946998    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod539f073c_e8b9_48a2_92a0_399cce1ec28f.slice/crio-4a590ed14c384184c1b6515201dfa46f74b7b24e633311a194f1a3142077a340 WatchSource:0}: Error finding container 4a590ed14c384184c1b6515201dfa46f74b7b24e633311a194f1a3142077a340: Status 404 returned error can't find the container with id 4a590ed14c384184c1b6515201dfa46f74b7b24e633311a194f1a3142077a340
Jul 24 17:12:43.753994 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:43.753954    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbrg4" event={"ID":"539f073c-e8b9-48a2-92a0-399cce1ec28f","Type":"ContainerStarted","Data":"0997aece304259c6b97b7faf08af6e609aed3fa89187c58962421c91ac0e0a71"}
Jul 24 17:12:43.754470 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:43.754015    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbrg4" event={"ID":"539f073c-e8b9-48a2-92a0-399cce1ec28f","Type":"ContainerStarted","Data":"4a590ed14c384184c1b6515201dfa46f74b7b24e633311a194f1a3142077a340"}
Jul 24 17:12:43.775491 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:43.775435    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbrg4" podStartSLOduration=1.5470262830000001 podStartE2EDuration="1.775417858s" totalImagesPullingTime="228.391575ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:12:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:12:43.773118834 +0000 UTC m=+548.045978638" watchObservedRunningTime="2026-07-24 17:12:43.775417858 +0000 UTC m=+548.048277637"
Jul 24 17:12:52.813880 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:52.813842    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbrg4"
Jul 24 17:12:52.814287 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:52.813909    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbrg4"
Jul 24 17:12:52.826359 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:52.826333    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbrg4"
Jul 24 17:12:53.810101 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:12:53.810047    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbrg4"
Jul 24 17:13:10.003784 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:13:10.003750    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-zkjqh"]
Jul 24 17:13:10.009472 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:13:10.009453    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zkjqh"
Jul 24 17:13:10.013748 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:13:10.013728    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 24 17:13:10.029627 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:13:10.029182    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-zkjqh"]
Jul 24 17:13:10.126170 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:13:10.126136    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7xkc\" (UniqueName: \"kubernetes.io/projected/7ae3a26d-98e6-4b63-bb13-d72dfa5dd9fc-kube-api-access-l7xkc\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zkjqh\" (UID: \"7ae3a26d-98e6-4b63-bb13-d72dfa5dd9fc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zkjqh"
Jul 24 17:13:10.126170 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:13:10.126177    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ae3a26d-98e6-4b63-bb13-d72dfa5dd9fc-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zkjqh\" (UID: \"7ae3a26d-98e6-4b63-bb13-d72dfa5dd9fc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zkjqh"
Jul 24 17:13:10.126401 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:13:10.126225    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ae3a26d-98e6-4b63-bb13-d72dfa5dd9fc-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zkjqh\" (UID: \"7ae3a26d-98e6-4b63-bb13-d72dfa5dd9fc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zkjqh"
Jul 24 17:13:10.126401 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:13:10.126274    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ae3a26d-98e6-4b63-bb13-d72dfa5dd9fc-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zkjqh\" (UID: \"7ae3a26d-98e6-4b63-bb13-d72dfa5dd9fc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zkjqh"
Jul 24 17:13:10.126401 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:13:10.126309    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ae3a26d-98e6-4b63-bb13-d72dfa5dd9fc-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zkjqh\" (UID: \"7ae3a26d-98e6-4b63-bb13-d72dfa5dd9fc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zkjqh"
Jul 24 17:13:10.126571 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:13:10.126413    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ae3a26d-98e6-4b63-bb13-d72dfa5dd9fc-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zkjqh\" (UID: \"7ae3a26d-98e6-4b63-bb13-d72dfa5dd9fc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zkjqh"
Jul 24 17:13:10.229520 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:13:10.227947    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ae3a26d-98e6-4b63-bb13-d72dfa5dd9fc-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zkjqh\" (UID: \"7ae3a26d-98e6-4b63-bb13-d72dfa5dd9fc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zkjqh"
Jul 24 17:13:10.229520 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:13:10.227999    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ae3a26d-98e6-4b63-bb13-d72dfa5dd9fc-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zkjqh\" (UID: \"7ae3a26d-98e6-4b63-bb13-d72dfa5dd9fc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zkjqh"
Jul 24 17:13:10.229520 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:13:10.228038    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ae3a26d-98e6-4b63-bb13-d72dfa5dd9fc-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zkjqh\" (UID: \"7ae3a26d-98e6-4b63-bb13-d72dfa5dd9fc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zkjqh"
Jul 24 17:13:10.229520 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:13:10.228149    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ae3a26d-98e6-4b63-bb13-d72dfa5dd9fc-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zkjqh\" (UID: \"7ae3a26d-98e6-4b63-bb13-d72dfa5dd9fc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zkjqh"
Jul 24 17:13:10.229520 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:13:10.228228    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7xkc\" (UniqueName: \"kubernetes.io/projected/7ae3a26d-98e6-4b63-bb13-d72dfa5dd9fc-kube-api-access-l7xkc\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zkjqh\" (UID: \"7ae3a26d-98e6-4b63-bb13-d72dfa5dd9fc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zkjqh"
Jul 24 17:13:10.229520 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:13:10.228261    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ae3a26d-98e6-4b63-bb13-d72dfa5dd9fc-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zkjqh\" (UID: \"7ae3a26d-98e6-4b63-bb13-d72dfa5dd9fc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zkjqh"
Jul 24 17:13:10.229520 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:13:10.228699    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ae3a26d-98e6-4b63-bb13-d72dfa5dd9fc-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zkjqh\" (UID: \"7ae3a26d-98e6-4b63-bb13-d72dfa5dd9fc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zkjqh"
Jul 24 17:13:10.229520 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:13:10.229048    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ae3a26d-98e6-4b63-bb13-d72dfa5dd9fc-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zkjqh\" (UID: \"7ae3a26d-98e6-4b63-bb13-d72dfa5dd9fc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zkjqh"
Jul 24 17:13:10.229520 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:13:10.229079    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ae3a26d-98e6-4b63-bb13-d72dfa5dd9fc-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zkjqh\" (UID: \"7ae3a26d-98e6-4b63-bb13-d72dfa5dd9fc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zkjqh"
Jul 24 17:13:10.235131 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:13:10.232506    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ae3a26d-98e6-4b63-bb13-d72dfa5dd9fc-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zkjqh\" (UID: \"7ae3a26d-98e6-4b63-bb13-d72dfa5dd9fc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zkjqh"
Jul 24 17:13:10.237593 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:13:10.237566    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ae3a26d-98e6-4b63-bb13-d72dfa5dd9fc-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zkjqh\" (UID: \"7ae3a26d-98e6-4b63-bb13-d72dfa5dd9fc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zkjqh"
Jul 24 17:13:10.238973 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:13:10.238947    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7xkc\" (UniqueName: \"kubernetes.io/projected/7ae3a26d-98e6-4b63-bb13-d72dfa5dd9fc-kube-api-access-l7xkc\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zkjqh\" (UID: \"7ae3a26d-98e6-4b63-bb13-d72dfa5dd9fc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zkjqh"
Jul 24 17:13:10.319524 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:13:10.319445    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zkjqh"
Jul 24 17:13:10.469351 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:13:10.469323    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-zkjqh"]
Jul 24 17:13:10.471799 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:13:10.471770    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7ae3a26d_98e6_4b63_bb13_d72dfa5dd9fc.slice/crio-a82662aaa232854bcc44c8285902b40043e3bae638c916c28c69251044233f30 WatchSource:0}: Error finding container a82662aaa232854bcc44c8285902b40043e3bae638c916c28c69251044233f30: Status 404 returned error can't find the container with id a82662aaa232854bcc44c8285902b40043e3bae638c916c28c69251044233f30
Jul 24 17:13:10.878455 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:13:10.878418    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zkjqh" event={"ID":"7ae3a26d-98e6-4b63-bb13-d72dfa5dd9fc","Type":"ContainerStarted","Data":"875ee92c78914de624cbbb4435e36fa56b9cbce3df592096498dc672651c814d"}
Jul 24 17:13:10.878455 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:13:10.878462    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zkjqh" event={"ID":"7ae3a26d-98e6-4b63-bb13-d72dfa5dd9fc","Type":"ContainerStarted","Data":"a82662aaa232854bcc44c8285902b40043e3bae638c916c28c69251044233f30"}
Jul 24 17:13:10.896906 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:13:10.896859    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zkjqh" podStartSLOduration=1.6639265619999999 podStartE2EDuration="1.896842797s" totalImagesPullingTime="232.916235ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:13:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:13:10.895617227 +0000 UTC m=+575.168477006" watchObservedRunningTime="2026-07-24 17:13:10.896842797 +0000 UTC m=+575.169702577"
Jul 24 17:13:20.319764 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:13:20.319729    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zkjqh"
Jul 24 17:13:20.320249 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:13:20.319787    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zkjqh"
Jul 24 17:13:20.332220 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:13:20.332196    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zkjqh"
Jul 24 17:13:20.940005 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:13:20.939979    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zkjqh"
Jul 24 17:13:36.130155 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:13:36.130128    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6h754_860ed1fc-612f-4796-8077-72bc6c5d84db/ovn-acl-logging/0.log"
Jul 24 17:13:36.132289 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:13:36.132270    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6h754_860ed1fc-612f-4796-8077-72bc6c5d84db/ovn-acl-logging/0.log"
Jul 24 17:14:29.598997 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:14:29.598947    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-694685d449-ljcvg"]
Jul 24 17:14:29.601458 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:14:29.599175    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-694685d449-ljcvg" podUID="287c7eb8-ca25-49e9-b886-0a1e1e4d8ce2" containerName="authorino" containerID="cri-o://b805e4ee8b81430544df00c8c740d8248a9f5be42983922a8a619cd7a2e79649" gracePeriod=30
Jul 24 17:14:29.856278 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:14:29.856212    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-694685d449-ljcvg"
Jul 24 17:14:29.929909 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:14:29.929885    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/287c7eb8-ca25-49e9-b886-0a1e1e4d8ce2-tls-cert\") pod \"287c7eb8-ca25-49e9-b886-0a1e1e4d8ce2\" (UID: \"287c7eb8-ca25-49e9-b886-0a1e1e4d8ce2\") "
Jul 24 17:14:29.930028 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:14:29.929961    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmbkb\" (UniqueName: \"kubernetes.io/projected/287c7eb8-ca25-49e9-b886-0a1e1e4d8ce2-kube-api-access-tmbkb\") pod \"287c7eb8-ca25-49e9-b886-0a1e1e4d8ce2\" (UID: \"287c7eb8-ca25-49e9-b886-0a1e1e4d8ce2\") "
Jul 24 17:14:29.931840 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:14:29.931809    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/287c7eb8-ca25-49e9-b886-0a1e1e4d8ce2-kube-api-access-tmbkb" (OuterVolumeSpecName: "kube-api-access-tmbkb") pod "287c7eb8-ca25-49e9-b886-0a1e1e4d8ce2" (UID: "287c7eb8-ca25-49e9-b886-0a1e1e4d8ce2"). InnerVolumeSpecName "kube-api-access-tmbkb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:14:29.939973 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:14:29.939948    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/287c7eb8-ca25-49e9-b886-0a1e1e4d8ce2-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "287c7eb8-ca25-49e9-b886-0a1e1e4d8ce2" (UID: "287c7eb8-ca25-49e9-b886-0a1e1e4d8ce2"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:14:30.030775 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:14:30.030734    2561 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/287c7eb8-ca25-49e9-b886-0a1e1e4d8ce2-tls-cert\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:14:30.030775 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:14:30.030768    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmbkb\" (UniqueName: \"kubernetes.io/projected/287c7eb8-ca25-49e9-b886-0a1e1e4d8ce2-kube-api-access-tmbkb\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:14:30.255737 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:14:30.255703    2561 generic.go:356] "Generic (PLEG): container finished" podID="287c7eb8-ca25-49e9-b886-0a1e1e4d8ce2" containerID="b805e4ee8b81430544df00c8c740d8248a9f5be42983922a8a619cd7a2e79649" exitCode=0
Jul 24 17:14:30.255890 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:14:30.255823    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-694685d449-ljcvg"
Jul 24 17:14:30.259542 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:14:30.259517    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-694685d449-ljcvg" event={"ID":"287c7eb8-ca25-49e9-b886-0a1e1e4d8ce2","Type":"ContainerDied","Data":"b805e4ee8b81430544df00c8c740d8248a9f5be42983922a8a619cd7a2e79649"}
Jul 24 17:14:30.259691 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:14:30.259550    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-694685d449-ljcvg" event={"ID":"287c7eb8-ca25-49e9-b886-0a1e1e4d8ce2","Type":"ContainerDied","Data":"824e88ed04cea1de63bf4b93e482720334bdeb9c323caf3859f2554a5a7a1087"}
Jul 24 17:14:30.259691 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:14:30.259579    2561 scope.go:117] "RemoveContainer" containerID="b805e4ee8b81430544df00c8c740d8248a9f5be42983922a8a619cd7a2e79649"
Jul 24 17:14:30.268308 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:14:30.268291    2561 scope.go:117] "RemoveContainer" containerID="b805e4ee8b81430544df00c8c740d8248a9f5be42983922a8a619cd7a2e79649"
Jul 24 17:14:30.268547 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:14:30.268527    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b805e4ee8b81430544df00c8c740d8248a9f5be42983922a8a619cd7a2e79649\": container with ID starting with b805e4ee8b81430544df00c8c740d8248a9f5be42983922a8a619cd7a2e79649 not found: ID does not exist" containerID="b805e4ee8b81430544df00c8c740d8248a9f5be42983922a8a619cd7a2e79649"
Jul 24 17:14:30.268608 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:14:30.268553    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b805e4ee8b81430544df00c8c740d8248a9f5be42983922a8a619cd7a2e79649"} err="failed to get container status \"b805e4ee8b81430544df00c8c740d8248a9f5be42983922a8a619cd7a2e79649\": rpc error: code = NotFound desc = could not find container \"b805e4ee8b81430544df00c8c740d8248a9f5be42983922a8a619cd7a2e79649\": container with ID starting with b805e4ee8b81430544df00c8c740d8248a9f5be42983922a8a619cd7a2e79649 not found: ID does not exist"
Jul 24 17:14:30.315526 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:14:30.315502    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-694685d449-ljcvg"]
Jul 24 17:14:30.327102 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:14:30.327079    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-694685d449-ljcvg"]
Jul 24 17:14:32.259366 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:14:32.259336    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="287c7eb8-ca25-49e9-b886-0a1e1e4d8ce2" path="/var/lib/kubelet/pods/287c7eb8-ca25-49e9-b886-0a1e1e4d8ce2/volumes"
Jul 24 17:15:16.081620 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:15:16.081586    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75f9bdd58d-xf4g8"]
Jul 24 17:15:16.082294 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:15:16.081775    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-75f9bdd58d-xf4g8" podUID="edade610-8f64-4e6d-b203-db81e7465b54" containerName="manager" containerID="cri-o://548c28358ea169b39b2285bfc27fa94f7703f3375c9c77aaaab8328b90610de9" gracePeriod=30
Jul 24 17:15:16.327946 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:15:16.327923    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75f9bdd58d-xf4g8"
Jul 24 17:15:16.443457 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:15:16.443418    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/edade610-8f64-4e6d-b203-db81e7465b54-webhook-cert\") pod \"edade610-8f64-4e6d-b203-db81e7465b54\" (UID: \"edade610-8f64-4e6d-b203-db81e7465b54\") "
Jul 24 17:15:16.443708 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:15:16.443581    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jnmw2\" (UniqueName: \"kubernetes.io/projected/edade610-8f64-4e6d-b203-db81e7465b54-kube-api-access-jnmw2\") pod \"edade610-8f64-4e6d-b203-db81e7465b54\" (UID: \"edade610-8f64-4e6d-b203-db81e7465b54\") "
Jul 24 17:15:16.445417 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:15:16.445386    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edade610-8f64-4e6d-b203-db81e7465b54-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "edade610-8f64-4e6d-b203-db81e7465b54" (UID: "edade610-8f64-4e6d-b203-db81e7465b54"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:15:16.445563 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:15:16.445541    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edade610-8f64-4e6d-b203-db81e7465b54-kube-api-access-jnmw2" (OuterVolumeSpecName: "kube-api-access-jnmw2") pod "edade610-8f64-4e6d-b203-db81e7465b54" (UID: "edade610-8f64-4e6d-b203-db81e7465b54"). InnerVolumeSpecName "kube-api-access-jnmw2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:15:16.467739 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:15:16.467713    2561 generic.go:356] "Generic (PLEG): container finished" podID="edade610-8f64-4e6d-b203-db81e7465b54" containerID="548c28358ea169b39b2285bfc27fa94f7703f3375c9c77aaaab8328b90610de9" exitCode=0
Jul 24 17:15:16.467858 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:15:16.467756    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75f9bdd58d-xf4g8"
Jul 24 17:15:16.467858 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:15:16.467799    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75f9bdd58d-xf4g8" event={"ID":"edade610-8f64-4e6d-b203-db81e7465b54","Type":"ContainerDied","Data":"548c28358ea169b39b2285bfc27fa94f7703f3375c9c77aaaab8328b90610de9"}
Jul 24 17:15:16.467858 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:15:16.467846    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75f9bdd58d-xf4g8" event={"ID":"edade610-8f64-4e6d-b203-db81e7465b54","Type":"ContainerDied","Data":"fd9dd850b78b1e7aa85b1c2efa8e611718d4fd9ea7b07ba6711993aa27ded54c"}
Jul 24 17:15:16.467962 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:15:16.467867    2561 scope.go:117] "RemoveContainer" containerID="548c28358ea169b39b2285bfc27fa94f7703f3375c9c77aaaab8328b90610de9"
Jul 24 17:15:16.477172 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:15:16.477153    2561 scope.go:117] "RemoveContainer" containerID="548c28358ea169b39b2285bfc27fa94f7703f3375c9c77aaaab8328b90610de9"
Jul 24 17:15:16.477456 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:15:16.477433    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"548c28358ea169b39b2285bfc27fa94f7703f3375c9c77aaaab8328b90610de9\": container with ID starting with 548c28358ea169b39b2285bfc27fa94f7703f3375c9c77aaaab8328b90610de9 not found: ID does not exist" containerID="548c28358ea169b39b2285bfc27fa94f7703f3375c9c77aaaab8328b90610de9"
Jul 24 17:15:16.477519 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:15:16.477468    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"548c28358ea169b39b2285bfc27fa94f7703f3375c9c77aaaab8328b90610de9"} err="failed to get container status \"548c28358ea169b39b2285bfc27fa94f7703f3375c9c77aaaab8328b90610de9\": rpc error: code = NotFound desc = could not find container \"548c28358ea169b39b2285bfc27fa94f7703f3375c9c77aaaab8328b90610de9\": container with ID starting with 548c28358ea169b39b2285bfc27fa94f7703f3375c9c77aaaab8328b90610de9 not found: ID does not exist"
Jul 24 17:15:16.490321 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:15:16.490299    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75f9bdd58d-xf4g8"]
Jul 24 17:15:16.494568 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:15:16.494548    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-75f9bdd58d-xf4g8"]
Jul 24 17:15:16.544405 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:15:16.544380    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnmw2\" (UniqueName: \"kubernetes.io/projected/edade610-8f64-4e6d-b203-db81e7465b54-kube-api-access-jnmw2\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:15:16.544405 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:15:16.544405    2561 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/edade610-8f64-4e6d-b203-db81e7465b54-webhook-cert\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:15:18.258617 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:15:18.258584    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edade610-8f64-4e6d-b203-db81e7465b54" path="/var/lib/kubelet/pods/edade610-8f64-4e6d-b203-db81e7465b54/volumes"
Jul 24 17:16:17.331487 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:17.331453    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-75f9bdd58d-hhczk"]
Jul 24 17:16:17.331944 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:17.331826    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edade610-8f64-4e6d-b203-db81e7465b54" containerName="manager"
Jul 24 17:16:17.331944 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:17.331837    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="edade610-8f64-4e6d-b203-db81e7465b54" containerName="manager"
Jul 24 17:16:17.331944 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:17.331852    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="287c7eb8-ca25-49e9-b886-0a1e1e4d8ce2" containerName="authorino"
Jul 24 17:16:17.331944 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:17.331858    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="287c7eb8-ca25-49e9-b886-0a1e1e4d8ce2" containerName="authorino"
Jul 24 17:16:17.331944 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:17.331915    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="edade610-8f64-4e6d-b203-db81e7465b54" containerName="manager"
Jul 24 17:16:17.331944 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:17.331925    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="287c7eb8-ca25-49e9-b886-0a1e1e4d8ce2" containerName="authorino"
Jul 24 17:16:17.334888 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:17.334873    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75f9bdd58d-hhczk"
Jul 24 17:16:17.338486 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:17.338464    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 24 17:16:17.339443 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:17.339425    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-brxpq\""
Jul 24 17:16:17.339516 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:17.339427    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 24 17:16:17.346966 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:17.346943    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75f9bdd58d-hhczk"]
Jul 24 17:16:17.496768 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:17.496727    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f29586f-e175-43bd-8788-e4d45def4660-webhook-cert\") pod \"maas-controller-75f9bdd58d-hhczk\" (UID: \"4f29586f-e175-43bd-8788-e4d45def4660\") " pod="opendatahub/maas-controller-75f9bdd58d-hhczk"
Jul 24 17:16:17.496947 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:17.496799    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzhqw\" (UniqueName: \"kubernetes.io/projected/4f29586f-e175-43bd-8788-e4d45def4660-kube-api-access-jzhqw\") pod \"maas-controller-75f9bdd58d-hhczk\" (UID: \"4f29586f-e175-43bd-8788-e4d45def4660\") " pod="opendatahub/maas-controller-75f9bdd58d-hhczk"
Jul 24 17:16:17.597904 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:17.597826    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzhqw\" (UniqueName: \"kubernetes.io/projected/4f29586f-e175-43bd-8788-e4d45def4660-kube-api-access-jzhqw\") pod \"maas-controller-75f9bdd58d-hhczk\" (UID: \"4f29586f-e175-43bd-8788-e4d45def4660\") " pod="opendatahub/maas-controller-75f9bdd58d-hhczk"
Jul 24 17:16:17.597904 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:17.597898    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f29586f-e175-43bd-8788-e4d45def4660-webhook-cert\") pod \"maas-controller-75f9bdd58d-hhczk\" (UID: \"4f29586f-e175-43bd-8788-e4d45def4660\") " pod="opendatahub/maas-controller-75f9bdd58d-hhczk"
Jul 24 17:16:17.600333 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:17.600312    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f29586f-e175-43bd-8788-e4d45def4660-webhook-cert\") pod \"maas-controller-75f9bdd58d-hhczk\" (UID: \"4f29586f-e175-43bd-8788-e4d45def4660\") " pod="opendatahub/maas-controller-75f9bdd58d-hhczk"
Jul 24 17:16:17.608018 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:17.607994    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzhqw\" (UniqueName: \"kubernetes.io/projected/4f29586f-e175-43bd-8788-e4d45def4660-kube-api-access-jzhqw\") pod \"maas-controller-75f9bdd58d-hhczk\" (UID: \"4f29586f-e175-43bd-8788-e4d45def4660\") " pod="opendatahub/maas-controller-75f9bdd58d-hhczk"
Jul 24 17:16:17.647124 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:17.647099    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75f9bdd58d-hhczk"
Jul 24 17:16:17.778579 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:17.778544    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75f9bdd58d-hhczk"]
Jul 24 17:16:17.781038 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:16:17.781010    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f29586f_e175_43bd_8788_e4d45def4660.slice/crio-656d3dd25fa2df9ece46c715af630028d5738cc0d0413ae753521a9935136957 WatchSource:0}: Error finding container 656d3dd25fa2df9ece46c715af630028d5738cc0d0413ae753521a9935136957: Status 404 returned error can't find the container with id 656d3dd25fa2df9ece46c715af630028d5738cc0d0413ae753521a9935136957
Jul 24 17:16:17.782627 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:17.782610    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 17:16:18.752976 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:18.752935    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75f9bdd58d-hhczk" event={"ID":"4f29586f-e175-43bd-8788-e4d45def4660","Type":"ContainerStarted","Data":"56eadafb32114f7e5f4a47ce795e3d71fef43d0b0dec6f73b2f1a16793736207"}
Jul 24 17:16:18.753349 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:18.753001    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-75f9bdd58d-hhczk"
Jul 24 17:16:18.753349 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:18.753020    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75f9bdd58d-hhczk" event={"ID":"4f29586f-e175-43bd-8788-e4d45def4660","Type":"ContainerStarted","Data":"656d3dd25fa2df9ece46c715af630028d5738cc0d0413ae753521a9935136957"}
Jul 24 17:16:18.774796 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:18.774751    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-75f9bdd58d-hhczk" podStartSLOduration=1.312296304 podStartE2EDuration="1.774736699s" totalImagesPullingTime="462.440395ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:16:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:16:18.773317688 +0000 UTC m=+763.046177469" watchObservedRunningTime="2026-07-24 17:16:18.774736699 +0000 UTC m=+763.047596480"
Jul 24 17:16:29.759774 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:29.759747    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-75f9bdd58d-hhczk"
Jul 24 17:16:34.478260 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:34.478227    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75f9bdd58d-hhczk"]
Jul 24 17:16:34.478639 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:34.478390    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-75f9bdd58d-hhczk" podUID="4f29586f-e175-43bd-8788-e4d45def4660" containerName="manager" containerID="cri-o://56eadafb32114f7e5f4a47ce795e3d71fef43d0b0dec6f73b2f1a16793736207" gracePeriod=30
Jul 24 17:16:34.723674 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:34.723648    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75f9bdd58d-hhczk"
Jul 24 17:16:34.741055 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:34.740989    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzhqw\" (UniqueName: \"kubernetes.io/projected/4f29586f-e175-43bd-8788-e4d45def4660-kube-api-access-jzhqw\") pod \"4f29586f-e175-43bd-8788-e4d45def4660\" (UID: \"4f29586f-e175-43bd-8788-e4d45def4660\") "
Jul 24 17:16:34.741055 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:34.741023    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f29586f-e175-43bd-8788-e4d45def4660-webhook-cert\") pod \"4f29586f-e175-43bd-8788-e4d45def4660\" (UID: \"4f29586f-e175-43bd-8788-e4d45def4660\") "
Jul 24 17:16:34.743320 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:34.743286    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f29586f-e175-43bd-8788-e4d45def4660-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "4f29586f-e175-43bd-8788-e4d45def4660" (UID: "4f29586f-e175-43bd-8788-e4d45def4660"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:16:34.743437 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:34.743390    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f29586f-e175-43bd-8788-e4d45def4660-kube-api-access-jzhqw" (OuterVolumeSpecName: "kube-api-access-jzhqw") pod "4f29586f-e175-43bd-8788-e4d45def4660" (UID: "4f29586f-e175-43bd-8788-e4d45def4660"). InnerVolumeSpecName "kube-api-access-jzhqw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:16:34.825764 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:34.825724    2561 generic.go:356] "Generic (PLEG): container finished" podID="4f29586f-e175-43bd-8788-e4d45def4660" containerID="56eadafb32114f7e5f4a47ce795e3d71fef43d0b0dec6f73b2f1a16793736207" exitCode=0
Jul 24 17:16:34.825915 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:34.825773    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75f9bdd58d-hhczk"
Jul 24 17:16:34.825915 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:34.825817    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75f9bdd58d-hhczk" event={"ID":"4f29586f-e175-43bd-8788-e4d45def4660","Type":"ContainerDied","Data":"56eadafb32114f7e5f4a47ce795e3d71fef43d0b0dec6f73b2f1a16793736207"}
Jul 24 17:16:34.825915 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:34.825902    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75f9bdd58d-hhczk" event={"ID":"4f29586f-e175-43bd-8788-e4d45def4660","Type":"ContainerDied","Data":"656d3dd25fa2df9ece46c715af630028d5738cc0d0413ae753521a9935136957"}
Jul 24 17:16:34.826018 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:34.825929    2561 scope.go:117] "RemoveContainer" containerID="56eadafb32114f7e5f4a47ce795e3d71fef43d0b0dec6f73b2f1a16793736207"
Jul 24 17:16:34.834665 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:34.834647    2561 scope.go:117] "RemoveContainer" containerID="56eadafb32114f7e5f4a47ce795e3d71fef43d0b0dec6f73b2f1a16793736207"
Jul 24 17:16:34.834904 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:16:34.834881    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56eadafb32114f7e5f4a47ce795e3d71fef43d0b0dec6f73b2f1a16793736207\": container with ID starting with 56eadafb32114f7e5f4a47ce795e3d71fef43d0b0dec6f73b2f1a16793736207 not found: ID does not exist" containerID="56eadafb32114f7e5f4a47ce795e3d71fef43d0b0dec6f73b2f1a16793736207"
Jul 24 17:16:34.835007 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:34.834915    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56eadafb32114f7e5f4a47ce795e3d71fef43d0b0dec6f73b2f1a16793736207"} err="failed to get container status \"56eadafb32114f7e5f4a47ce795e3d71fef43d0b0dec6f73b2f1a16793736207\": rpc error: code = NotFound desc = could not find container \"56eadafb32114f7e5f4a47ce795e3d71fef43d0b0dec6f73b2f1a16793736207\": container with ID starting with 56eadafb32114f7e5f4a47ce795e3d71fef43d0b0dec6f73b2f1a16793736207 not found: ID does not exist"
Jul 24 17:16:34.842412 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:34.842393    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzhqw\" (UniqueName: \"kubernetes.io/projected/4f29586f-e175-43bd-8788-e4d45def4660-kube-api-access-jzhqw\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:16:34.842488 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:34.842415    2561 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f29586f-e175-43bd-8788-e4d45def4660-webhook-cert\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:16:34.845819 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:34.845799    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75f9bdd58d-hhczk"]
Jul 24 17:16:34.849562 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:34.849540    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-75f9bdd58d-hhczk"]
Jul 24 17:16:35.646736 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:35.646707    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-75f9bdd58d-ls6r2"]
Jul 24 17:16:35.647183 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:35.647054    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f29586f-e175-43bd-8788-e4d45def4660" containerName="manager"
Jul 24 17:16:35.647183 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:35.647079    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f29586f-e175-43bd-8788-e4d45def4660" containerName="manager"
Jul 24 17:16:35.647183 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:35.647161    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f29586f-e175-43bd-8788-e4d45def4660" containerName="manager"
Jul 24 17:16:35.651419 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:35.651403    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75f9bdd58d-ls6r2"
Jul 24 17:16:35.654345 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:35.654325    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 24 17:16:35.654439 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:35.654376    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-brxpq\""
Jul 24 17:16:35.654439 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:35.654383    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 24 17:16:35.659676 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:35.659653    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75f9bdd58d-ls6r2"]
Jul 24 17:16:35.750160 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:35.750130    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0d71feeb-49cd-4e8c-a97b-fcb85b82b8b6-webhook-cert\") pod \"maas-controller-75f9bdd58d-ls6r2\" (UID: \"0d71feeb-49cd-4e8c-a97b-fcb85b82b8b6\") " pod="opendatahub/maas-controller-75f9bdd58d-ls6r2"
Jul 24 17:16:35.750160 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:35.750160    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wgxk\" (UniqueName: \"kubernetes.io/projected/0d71feeb-49cd-4e8c-a97b-fcb85b82b8b6-kube-api-access-4wgxk\") pod \"maas-controller-75f9bdd58d-ls6r2\" (UID: \"0d71feeb-49cd-4e8c-a97b-fcb85b82b8b6\") " pod="opendatahub/maas-controller-75f9bdd58d-ls6r2"
Jul 24 17:16:35.851377 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:35.851348    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0d71feeb-49cd-4e8c-a97b-fcb85b82b8b6-webhook-cert\") pod \"maas-controller-75f9bdd58d-ls6r2\" (UID: \"0d71feeb-49cd-4e8c-a97b-fcb85b82b8b6\") " pod="opendatahub/maas-controller-75f9bdd58d-ls6r2"
Jul 24 17:16:35.851377 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:35.851377    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wgxk\" (UniqueName: \"kubernetes.io/projected/0d71feeb-49cd-4e8c-a97b-fcb85b82b8b6-kube-api-access-4wgxk\") pod \"maas-controller-75f9bdd58d-ls6r2\" (UID: \"0d71feeb-49cd-4e8c-a97b-fcb85b82b8b6\") " pod="opendatahub/maas-controller-75f9bdd58d-ls6r2"
Jul 24 17:16:35.853715 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:35.853698    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0d71feeb-49cd-4e8c-a97b-fcb85b82b8b6-webhook-cert\") pod \"maas-controller-75f9bdd58d-ls6r2\" (UID: \"0d71feeb-49cd-4e8c-a97b-fcb85b82b8b6\") " pod="opendatahub/maas-controller-75f9bdd58d-ls6r2"
Jul 24 17:16:35.861688 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:35.861668    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wgxk\" (UniqueName: \"kubernetes.io/projected/0d71feeb-49cd-4e8c-a97b-fcb85b82b8b6-kube-api-access-4wgxk\") pod \"maas-controller-75f9bdd58d-ls6r2\" (UID: \"0d71feeb-49cd-4e8c-a97b-fcb85b82b8b6\") " pod="opendatahub/maas-controller-75f9bdd58d-ls6r2"
Jul 24 17:16:35.962402 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:35.962341    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75f9bdd58d-ls6r2"
Jul 24 17:16:36.094167 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:36.094141    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75f9bdd58d-ls6r2"]
Jul 24 17:16:36.096939 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:16:36.096913    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d71feeb_49cd_4e8c_a97b_fcb85b82b8b6.slice/crio-6cc0e3a0c166fbad91c72ae8e21a56a11445cca206ead4e8fa635661b775544b WatchSource:0}: Error finding container 6cc0e3a0c166fbad91c72ae8e21a56a11445cca206ead4e8fa635661b775544b: Status 404 returned error can't find the container with id 6cc0e3a0c166fbad91c72ae8e21a56a11445cca206ead4e8fa635661b775544b
Jul 24 17:16:36.258545 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:36.258491    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f29586f-e175-43bd-8788-e4d45def4660" path="/var/lib/kubelet/pods/4f29586f-e175-43bd-8788-e4d45def4660/volumes"
Jul 24 17:16:36.595231 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:36.595209    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 24 17:16:36.836922 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:36.836892    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75f9bdd58d-ls6r2" event={"ID":"0d71feeb-49cd-4e8c-a97b-fcb85b82b8b6","Type":"ContainerStarted","Data":"07c9dd2c7f3232529dcb1b944791845ecc6c383194bfae3d453039c7b71bc2c1"}
Jul 24 17:16:36.837318 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:36.836947    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75f9bdd58d-ls6r2" event={"ID":"0d71feeb-49cd-4e8c-a97b-fcb85b82b8b6","Type":"ContainerStarted","Data":"6cc0e3a0c166fbad91c72ae8e21a56a11445cca206ead4e8fa635661b775544b"}
Jul 24 17:16:36.837318 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:36.836986    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-75f9bdd58d-ls6r2"
Jul 24 17:16:36.855359 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:36.855278    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-75f9bdd58d-ls6r2" podStartSLOduration=1.360664471 podStartE2EDuration="1.855263179s" totalImagesPullingTime="494.598708ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:16:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:16:36.853227159 +0000 UTC m=+781.126086935" watchObservedRunningTime="2026-07-24 17:16:36.855263179 +0000 UTC m=+781.128122959"
Jul 24 17:16:47.843911 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:16:47.843882    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-75f9bdd58d-ls6r2"
Jul 24 17:18:36.160735 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:18:36.160666    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6h754_860ed1fc-612f-4796-8077-72bc6c5d84db/ovn-acl-logging/0.log"
Jul 24 17:18:36.161301 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:18:36.160734    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6h754_860ed1fc-612f-4796-8077-72bc6c5d84db/ovn-acl-logging/0.log"
Jul 24 17:23:36.190586 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:23:36.190559    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6h754_860ed1fc-612f-4796-8077-72bc6c5d84db/ovn-acl-logging/0.log"
Jul 24 17:23:36.191165 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:23:36.190620    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6h754_860ed1fc-612f-4796-8077-72bc6c5d84db/ovn-acl-logging/0.log"
Jul 24 17:25:10.491843 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:10.491810    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt"]
Jul 24 17:25:10.495321 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:10.495298    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt"
Jul 24 17:25:10.497530 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:10.497510    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-6ccc13da-kserve-self-signed-certs\""
Jul 24 17:25:10.509677 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:10.509653    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt"]
Jul 24 17:25:10.588701 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:10.588670    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa83dcb9-4526-4c73-80d5-02492016e94f-tls-certs\") pod \"e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt\" (UID: \"fa83dcb9-4526-4c73-80d5-02492016e94f\") " pod="llm/e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt"
Jul 24 17:25:10.588834 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:10.588704    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fa83dcb9-4526-4c73-80d5-02492016e94f-home\") pod \"e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt\" (UID: \"fa83dcb9-4526-4c73-80d5-02492016e94f\") " pod="llm/e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt"
Jul 24 17:25:10.588834 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:10.588769    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa83dcb9-4526-4c73-80d5-02492016e94f-model-cache\") pod \"e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt\" (UID: \"fa83dcb9-4526-4c73-80d5-02492016e94f\") " pod="llm/e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt"
Jul 24 17:25:10.588834 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:10.588829    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa83dcb9-4526-4c73-80d5-02492016e94f-tmp-dir\") pod \"e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt\" (UID: \"fa83dcb9-4526-4c73-80d5-02492016e94f\") " pod="llm/e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt"
Jul 24 17:25:10.588937 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:10.588867    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa83dcb9-4526-4c73-80d5-02492016e94f-dshm\") pod \"e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt\" (UID: \"fa83dcb9-4526-4c73-80d5-02492016e94f\") " pod="llm/e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt"
Jul 24 17:25:10.588937 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:10.588887    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7ptk\" (UniqueName: \"kubernetes.io/projected/fa83dcb9-4526-4c73-80d5-02492016e94f-kube-api-access-q7ptk\") pod \"e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt\" (UID: \"fa83dcb9-4526-4c73-80d5-02492016e94f\") " pod="llm/e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt"
Jul 24 17:25:10.689659 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:10.689618    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa83dcb9-4526-4c73-80d5-02492016e94f-model-cache\") pod \"e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt\" (UID: \"fa83dcb9-4526-4c73-80d5-02492016e94f\") " pod="llm/e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt"
Jul 24 17:25:10.689843 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:10.689679    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa83dcb9-4526-4c73-80d5-02492016e94f-tmp-dir\") pod \"e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt\" (UID: \"fa83dcb9-4526-4c73-80d5-02492016e94f\") " pod="llm/e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt"
Jul 24 17:25:10.689843 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:10.689724    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa83dcb9-4526-4c73-80d5-02492016e94f-dshm\") pod \"e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt\" (UID: \"fa83dcb9-4526-4c73-80d5-02492016e94f\") " pod="llm/e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt"
Jul 24 17:25:10.689843 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:10.689752    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7ptk\" (UniqueName: \"kubernetes.io/projected/fa83dcb9-4526-4c73-80d5-02492016e94f-kube-api-access-q7ptk\") pod \"e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt\" (UID: \"fa83dcb9-4526-4c73-80d5-02492016e94f\") " pod="llm/e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt"
Jul 24 17:25:10.689843 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:10.689828    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa83dcb9-4526-4c73-80d5-02492016e94f-tls-certs\") pod \"e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt\" (UID: \"fa83dcb9-4526-4c73-80d5-02492016e94f\") " pod="llm/e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt"
Jul 24 17:25:10.690044 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:10.689863    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fa83dcb9-4526-4c73-80d5-02492016e94f-home\") pod \"e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt\" (UID: \"fa83dcb9-4526-4c73-80d5-02492016e94f\") " pod="llm/e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt"
Jul 24 17:25:10.690123 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:10.690100    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa83dcb9-4526-4c73-80d5-02492016e94f-model-cache\") pod \"e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt\" (UID: \"fa83dcb9-4526-4c73-80d5-02492016e94f\") " pod="llm/e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt"
Jul 24 17:25:10.690183 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:10.690118    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa83dcb9-4526-4c73-80d5-02492016e94f-tmp-dir\") pod \"e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt\" (UID: \"fa83dcb9-4526-4c73-80d5-02492016e94f\") " pod="llm/e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt"
Jul 24 17:25:10.690302 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:10.690282    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fa83dcb9-4526-4c73-80d5-02492016e94f-home\") pod \"e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt\" (UID: \"fa83dcb9-4526-4c73-80d5-02492016e94f\") " pod="llm/e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt"
Jul 24 17:25:10.692114 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:10.692094    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa83dcb9-4526-4c73-80d5-02492016e94f-dshm\") pod \"e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt\" (UID: \"fa83dcb9-4526-4c73-80d5-02492016e94f\") " pod="llm/e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt"
Jul 24 17:25:10.692410 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:10.692389    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa83dcb9-4526-4c73-80d5-02492016e94f-tls-certs\") pod \"e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt\" (UID: \"fa83dcb9-4526-4c73-80d5-02492016e94f\") " pod="llm/e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt"
Jul 24 17:25:10.698997 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:10.698968    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7ptk\" (UniqueName: \"kubernetes.io/projected/fa83dcb9-4526-4c73-80d5-02492016e94f-kube-api-access-q7ptk\") pod \"e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt\" (UID: \"fa83dcb9-4526-4c73-80d5-02492016e94f\") " pod="llm/e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt"
Jul 24 17:25:10.803931 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:10.803851    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt"
Jul 24 17:25:10.939325 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:10.939214    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt"]
Jul 24 17:25:10.944184 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:25:10.944157    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfa83dcb9_4526_4c73_80d5_02492016e94f.slice/crio-fde4669dff5a2898a2387ea3b133de267e3d70e06d8d6c60b764c50863e5e8ee WatchSource:0}: Error finding container fde4669dff5a2898a2387ea3b133de267e3d70e06d8d6c60b764c50863e5e8ee: Status 404 returned error can't find the container with id fde4669dff5a2898a2387ea3b133de267e3d70e06d8d6c60b764c50863e5e8ee
Jul 24 17:25:11.219357 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:11.219321    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt" event={"ID":"fa83dcb9-4526-4c73-80d5-02492016e94f","Type":"ContainerStarted","Data":"518d5cf08bd961458792b4efd80b9ee472cfeca3dbfa69eb5afe4a42336532e6"}
Jul 24 17:25:11.219357 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:11.219359    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt" event={"ID":"fa83dcb9-4526-4c73-80d5-02492016e94f","Type":"ContainerStarted","Data":"fde4669dff5a2898a2387ea3b133de267e3d70e06d8d6c60b764c50863e5e8ee"}
Jul 24 17:25:11.237300 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:11.237256    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt" podStartSLOduration=1.237240533 podStartE2EDuration="1.237240533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:25:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:25:11.236781746 +0000 UTC m=+1295.509641527" watchObservedRunningTime="2026-07-24 17:25:11.237240533 +0000 UTC m=+1295.510100313"
Jul 24 17:25:20.804390 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:20.804281    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt"
Jul 24 17:25:20.804390 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:20.804348    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt"
Jul 24 17:25:20.816766 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:20.816743    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt"
Jul 24 17:25:21.281895 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:21.281868    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt"
Jul 24 17:25:28.125981 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:28.125950    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks"]
Jul 24 17:25:28.129885 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:28.129869    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks"
Jul 24 17:25:28.133148 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:28.133129    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-6ccc13da-kserve-self-signed-certs\""
Jul 24 17:25:28.143199 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:28.143177    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks"]
Jul 24 17:25:28.251268 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:28.251239    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb77b79a-a9ff-4ab6-9af0-380fed4ee118-tmp-dir\") pod \"e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks\" (UID: \"eb77b79a-a9ff-4ab6-9af0-380fed4ee118\") " pod="llm/e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks"
Jul 24 17:25:28.251420 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:28.251294    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb77b79a-a9ff-4ab6-9af0-380fed4ee118-dshm\") pod \"e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks\" (UID: \"eb77b79a-a9ff-4ab6-9af0-380fed4ee118\") " pod="llm/e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks"
Jul 24 17:25:28.251467 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:28.251420    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb77b79a-a9ff-4ab6-9af0-380fed4ee118-home\") pod \"e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks\" (UID: \"eb77b79a-a9ff-4ab6-9af0-380fed4ee118\") " pod="llm/e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks"
Jul 24 17:25:28.251467 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:28.251450    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-477kb\" (UniqueName: \"kubernetes.io/projected/eb77b79a-a9ff-4ab6-9af0-380fed4ee118-kube-api-access-477kb\") pod \"e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks\" (UID: \"eb77b79a-a9ff-4ab6-9af0-380fed4ee118\") " pod="llm/e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks"
Jul 24 17:25:28.251564 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:28.251474    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb77b79a-a9ff-4ab6-9af0-380fed4ee118-model-cache\") pod \"e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks\" (UID: \"eb77b79a-a9ff-4ab6-9af0-380fed4ee118\") " pod="llm/e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks"
Jul 24 17:25:28.251564 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:28.251495    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb77b79a-a9ff-4ab6-9af0-380fed4ee118-tls-certs\") pod \"e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks\" (UID: \"eb77b79a-a9ff-4ab6-9af0-380fed4ee118\") " pod="llm/e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks"
Jul 24 17:25:28.352317 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:28.352289    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb77b79a-a9ff-4ab6-9af0-380fed4ee118-tmp-dir\") pod \"e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks\" (UID: \"eb77b79a-a9ff-4ab6-9af0-380fed4ee118\") " pod="llm/e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks"
Jul 24 17:25:28.352474 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:28.352333    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb77b79a-a9ff-4ab6-9af0-380fed4ee118-dshm\") pod \"e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks\" (UID: \"eb77b79a-a9ff-4ab6-9af0-380fed4ee118\") " pod="llm/e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks"
Jul 24 17:25:28.352474 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:28.352393    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb77b79a-a9ff-4ab6-9af0-380fed4ee118-home\") pod \"e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks\" (UID: \"eb77b79a-a9ff-4ab6-9af0-380fed4ee118\") " pod="llm/e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks"
Jul 24 17:25:28.352474 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:28.352412    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-477kb\" (UniqueName: \"kubernetes.io/projected/eb77b79a-a9ff-4ab6-9af0-380fed4ee118-kube-api-access-477kb\") pod \"e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks\" (UID: \"eb77b79a-a9ff-4ab6-9af0-380fed4ee118\") " pod="llm/e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks"
Jul 24 17:25:28.352474 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:28.352438    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb77b79a-a9ff-4ab6-9af0-380fed4ee118-model-cache\") pod \"e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks\" (UID: \"eb77b79a-a9ff-4ab6-9af0-380fed4ee118\") " pod="llm/e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks"
Jul 24 17:25:28.352474 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:28.352465    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb77b79a-a9ff-4ab6-9af0-380fed4ee118-tls-certs\") pod \"e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks\" (UID: \"eb77b79a-a9ff-4ab6-9af0-380fed4ee118\") " pod="llm/e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks"
Jul 24 17:25:28.352769 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:28.352746    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb77b79a-a9ff-4ab6-9af0-380fed4ee118-tmp-dir\") pod \"e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks\" (UID: \"eb77b79a-a9ff-4ab6-9af0-380fed4ee118\") " pod="llm/e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks"
Jul 24 17:25:28.352861 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:28.352766    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb77b79a-a9ff-4ab6-9af0-380fed4ee118-home\") pod \"e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks\" (UID: \"eb77b79a-a9ff-4ab6-9af0-380fed4ee118\") " pod="llm/e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks"
Jul 24 17:25:28.352926 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:28.352886    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb77b79a-a9ff-4ab6-9af0-380fed4ee118-model-cache\") pod \"e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks\" (UID: \"eb77b79a-a9ff-4ab6-9af0-380fed4ee118\") " pod="llm/e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks"
Jul 24 17:25:28.354765 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:28.354743    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb77b79a-a9ff-4ab6-9af0-380fed4ee118-dshm\") pod \"e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks\" (UID: \"eb77b79a-a9ff-4ab6-9af0-380fed4ee118\") " pod="llm/e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks"
Jul 24 17:25:28.355075 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:28.355050    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb77b79a-a9ff-4ab6-9af0-380fed4ee118-tls-certs\") pod \"e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks\" (UID: \"eb77b79a-a9ff-4ab6-9af0-380fed4ee118\") " pod="llm/e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks"
Jul 24 17:25:28.361220 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:28.361197    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-477kb\" (UniqueName: \"kubernetes.io/projected/eb77b79a-a9ff-4ab6-9af0-380fed4ee118-kube-api-access-477kb\") pod \"e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks\" (UID: \"eb77b79a-a9ff-4ab6-9af0-380fed4ee118\") " pod="llm/e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks"
Jul 24 17:25:28.439735 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:28.439651    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks"
Jul 24 17:25:28.573464 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:28.573439    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks"]
Jul 24 17:25:28.575500 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:25:28.575473    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeb77b79a_a9ff_4ab6_9af0_380fed4ee118.slice/crio-6dce0a13419f1c374e0c764d490a8d6ce6341712d5e2b4c6c5d1a4f98a93281c WatchSource:0}: Error finding container 6dce0a13419f1c374e0c764d490a8d6ce6341712d5e2b4c6c5d1a4f98a93281c: Status 404 returned error can't find the container with id 6dce0a13419f1c374e0c764d490a8d6ce6341712d5e2b4c6c5d1a4f98a93281c
Jul 24 17:25:29.306972 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:29.306936    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks" event={"ID":"eb77b79a-a9ff-4ab6-9af0-380fed4ee118","Type":"ContainerStarted","Data":"259c8e5f444d902812b892a1549d9a72b162421153b5296d136e4ce431da2d97"}
Jul 24 17:25:29.306972 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:29.306974    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks" event={"ID":"eb77b79a-a9ff-4ab6-9af0-380fed4ee118","Type":"ContainerStarted","Data":"6dce0a13419f1c374e0c764d490a8d6ce6341712d5e2b4c6c5d1a4f98a93281c"}
Jul 24 17:25:29.324477 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:29.324433    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks" podStartSLOduration=1.324417638 podStartE2EDuration="1.324417638s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:25:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:25:29.323544622 +0000 UTC m=+1313.596404429" watchObservedRunningTime="2026-07-24 17:25:29.324417638 +0000 UTC m=+1313.597277418"
Jul 24 17:25:38.440858 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:38.440820    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks"
Jul 24 17:25:38.441256 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:38.440875    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks"
Jul 24 17:25:38.453210 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:38.453187    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks"
Jul 24 17:25:39.363243 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:39.363217    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks"
Jul 24 17:25:56.064113 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:56.064083    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt"]
Jul 24 17:25:57.595888 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:25:57.595857    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks"]
Jul 24 17:26:11.083004 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:11.082960    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt" podUID="fa83dcb9-4526-4c73-80d5-02492016e94f" containerName="main" containerID="cri-o://518d5cf08bd961458792b4efd80b9ee472cfeca3dbfa69eb5afe4a42336532e6" gracePeriod=45
Jul 24 17:26:11.324365 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:11.324338    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt"
Jul 24 17:26:11.450974 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:11.450926    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa83dcb9-4526-4c73-80d5-02492016e94f-dshm\") pod \"fa83dcb9-4526-4c73-80d5-02492016e94f\" (UID: \"fa83dcb9-4526-4c73-80d5-02492016e94f\") "
Jul 24 17:26:11.451161 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:11.451014    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa83dcb9-4526-4c73-80d5-02492016e94f-model-cache\") pod \"fa83dcb9-4526-4c73-80d5-02492016e94f\" (UID: \"fa83dcb9-4526-4c73-80d5-02492016e94f\") "
Jul 24 17:26:11.451161 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:11.451041    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fa83dcb9-4526-4c73-80d5-02492016e94f-home\") pod \"fa83dcb9-4526-4c73-80d5-02492016e94f\" (UID: \"fa83dcb9-4526-4c73-80d5-02492016e94f\") "
Jul 24 17:26:11.451161 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:11.451077    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa83dcb9-4526-4c73-80d5-02492016e94f-tmp-dir\") pod \"fa83dcb9-4526-4c73-80d5-02492016e94f\" (UID: \"fa83dcb9-4526-4c73-80d5-02492016e94f\") "
Jul 24 17:26:11.451161 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:11.451120    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa83dcb9-4526-4c73-80d5-02492016e94f-tls-certs\") pod \"fa83dcb9-4526-4c73-80d5-02492016e94f\" (UID: \"fa83dcb9-4526-4c73-80d5-02492016e94f\") "
Jul 24 17:26:11.451161 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:11.451136    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7ptk\" (UniqueName: \"kubernetes.io/projected/fa83dcb9-4526-4c73-80d5-02492016e94f-kube-api-access-q7ptk\") pod \"fa83dcb9-4526-4c73-80d5-02492016e94f\" (UID: \"fa83dcb9-4526-4c73-80d5-02492016e94f\") "
Jul 24 17:26:11.451396 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:11.451324    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa83dcb9-4526-4c73-80d5-02492016e94f-model-cache" (OuterVolumeSpecName: "model-cache") pod "fa83dcb9-4526-4c73-80d5-02492016e94f" (UID: "fa83dcb9-4526-4c73-80d5-02492016e94f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:26:11.451396 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:11.451314    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa83dcb9-4526-4c73-80d5-02492016e94f-home" (OuterVolumeSpecName: "home") pod "fa83dcb9-4526-4c73-80d5-02492016e94f" (UID: "fa83dcb9-4526-4c73-80d5-02492016e94f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:26:11.451396 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:11.451381    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa83dcb9-4526-4c73-80d5-02492016e94f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fa83dcb9-4526-4c73-80d5-02492016e94f" (UID: "fa83dcb9-4526-4c73-80d5-02492016e94f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:26:11.451557 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:11.451501    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa83dcb9-4526-4c73-80d5-02492016e94f-model-cache\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:26:11.451557 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:11.451517    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fa83dcb9-4526-4c73-80d5-02492016e94f-home\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:26:11.451557 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:11.451528    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa83dcb9-4526-4c73-80d5-02492016e94f-tmp-dir\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:26:11.453286 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:11.453257    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa83dcb9-4526-4c73-80d5-02492016e94f-kube-api-access-q7ptk" (OuterVolumeSpecName: "kube-api-access-q7ptk") pod "fa83dcb9-4526-4c73-80d5-02492016e94f" (UID: "fa83dcb9-4526-4c73-80d5-02492016e94f"). InnerVolumeSpecName "kube-api-access-q7ptk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:26:11.453398 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:11.453260    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa83dcb9-4526-4c73-80d5-02492016e94f-dshm" (OuterVolumeSpecName: "dshm") pod "fa83dcb9-4526-4c73-80d5-02492016e94f" (UID: "fa83dcb9-4526-4c73-80d5-02492016e94f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:26:11.453398 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:11.453285    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa83dcb9-4526-4c73-80d5-02492016e94f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fa83dcb9-4526-4c73-80d5-02492016e94f" (UID: "fa83dcb9-4526-4c73-80d5-02492016e94f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:26:11.503274 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:11.503243    2561 generic.go:356] "Generic (PLEG): container finished" podID="fa83dcb9-4526-4c73-80d5-02492016e94f" containerID="518d5cf08bd961458792b4efd80b9ee472cfeca3dbfa69eb5afe4a42336532e6" exitCode=0
Jul 24 17:26:11.503423 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:11.503288    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt"
Jul 24 17:26:11.503423 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:11.503307    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt" event={"ID":"fa83dcb9-4526-4c73-80d5-02492016e94f","Type":"ContainerDied","Data":"518d5cf08bd961458792b4efd80b9ee472cfeca3dbfa69eb5afe4a42336532e6"}
Jul 24 17:26:11.503423 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:11.503338    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt" event={"ID":"fa83dcb9-4526-4c73-80d5-02492016e94f","Type":"ContainerDied","Data":"fde4669dff5a2898a2387ea3b133de267e3d70e06d8d6c60b764c50863e5e8ee"}
Jul 24 17:26:11.503423 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:11.503354    2561 scope.go:117] "RemoveContainer" containerID="518d5cf08bd961458792b4efd80b9ee472cfeca3dbfa69eb5afe4a42336532e6"
Jul 24 17:26:11.515968 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:11.515951    2561 scope.go:117] "RemoveContainer" containerID="518d5cf08bd961458792b4efd80b9ee472cfeca3dbfa69eb5afe4a42336532e6"
Jul 24 17:26:11.516247 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:26:11.516224    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"518d5cf08bd961458792b4efd80b9ee472cfeca3dbfa69eb5afe4a42336532e6\": container with ID starting with 518d5cf08bd961458792b4efd80b9ee472cfeca3dbfa69eb5afe4a42336532e6 not found: ID does not exist" containerID="518d5cf08bd961458792b4efd80b9ee472cfeca3dbfa69eb5afe4a42336532e6"
Jul 24 17:26:11.516299 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:11.516255    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"518d5cf08bd961458792b4efd80b9ee472cfeca3dbfa69eb5afe4a42336532e6"} err="failed to get container status \"518d5cf08bd961458792b4efd80b9ee472cfeca3dbfa69eb5afe4a42336532e6\": rpc error: code = NotFound desc = could not find container \"518d5cf08bd961458792b4efd80b9ee472cfeca3dbfa69eb5afe4a42336532e6\": container with ID starting with 518d5cf08bd961458792b4efd80b9ee472cfeca3dbfa69eb5afe4a42336532e6 not found: ID does not exist"
Jul 24 17:26:11.523542 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:11.523520    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt"]
Jul 24 17:26:11.525831 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:11.525811    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt"]
Jul 24 17:26:11.552120 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:11.552087    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa83dcb9-4526-4c73-80d5-02492016e94f-tls-certs\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:26:11.552120 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:11.552117    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7ptk\" (UniqueName: \"kubernetes.io/projected/fa83dcb9-4526-4c73-80d5-02492016e94f-kube-api-access-q7ptk\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:26:11.552120 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:11.552128    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa83dcb9-4526-4c73-80d5-02492016e94f-dshm\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:26:12.259591 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:12.259562    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa83dcb9-4526-4c73-80d5-02492016e94f" path="/var/lib/kubelet/pods/fa83dcb9-4526-4c73-80d5-02492016e94f/volumes"
Jul 24 17:26:12.614713 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:12.614615    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks" podUID="eb77b79a-a9ff-4ab6-9af0-380fed4ee118" containerName="main" containerID="cri-o://259c8e5f444d902812b892a1549d9a72b162421153b5296d136e4ce431da2d97" gracePeriod=45
Jul 24 17:26:12.869561 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:12.869499    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks"
Jul 24 17:26:12.965827 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:12.965792    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb77b79a-a9ff-4ab6-9af0-380fed4ee118-model-cache\") pod \"eb77b79a-a9ff-4ab6-9af0-380fed4ee118\" (UID: \"eb77b79a-a9ff-4ab6-9af0-380fed4ee118\") "
Jul 24 17:26:12.965827 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:12.965832    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb77b79a-a9ff-4ab6-9af0-380fed4ee118-dshm\") pod \"eb77b79a-a9ff-4ab6-9af0-380fed4ee118\" (UID: \"eb77b79a-a9ff-4ab6-9af0-380fed4ee118\") "
Jul 24 17:26:12.966095 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:12.965854    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb77b79a-a9ff-4ab6-9af0-380fed4ee118-home\") pod \"eb77b79a-a9ff-4ab6-9af0-380fed4ee118\" (UID: \"eb77b79a-a9ff-4ab6-9af0-380fed4ee118\") "
Jul 24 17:26:12.966095 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:12.965918    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb77b79a-a9ff-4ab6-9af0-380fed4ee118-tls-certs\") pod \"eb77b79a-a9ff-4ab6-9af0-380fed4ee118\" (UID: \"eb77b79a-a9ff-4ab6-9af0-380fed4ee118\") "
Jul 24 17:26:12.966095 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:12.965991    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb77b79a-a9ff-4ab6-9af0-380fed4ee118-tmp-dir\") pod \"eb77b79a-a9ff-4ab6-9af0-380fed4ee118\" (UID: \"eb77b79a-a9ff-4ab6-9af0-380fed4ee118\") "
Jul 24 17:26:12.966095 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:12.966040    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-477kb\" (UniqueName: \"kubernetes.io/projected/eb77b79a-a9ff-4ab6-9af0-380fed4ee118-kube-api-access-477kb\") pod \"eb77b79a-a9ff-4ab6-9af0-380fed4ee118\" (UID: \"eb77b79a-a9ff-4ab6-9af0-380fed4ee118\") "
Jul 24 17:26:12.966298 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:12.966183    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb77b79a-a9ff-4ab6-9af0-380fed4ee118-model-cache" (OuterVolumeSpecName: "model-cache") pod "eb77b79a-a9ff-4ab6-9af0-380fed4ee118" (UID: "eb77b79a-a9ff-4ab6-9af0-380fed4ee118"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:26:12.966298 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:12.966231    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb77b79a-a9ff-4ab6-9af0-380fed4ee118-home" (OuterVolumeSpecName: "home") pod "eb77b79a-a9ff-4ab6-9af0-380fed4ee118" (UID: "eb77b79a-a9ff-4ab6-9af0-380fed4ee118"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:26:12.966408 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:12.966324    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb77b79a-a9ff-4ab6-9af0-380fed4ee118-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "eb77b79a-a9ff-4ab6-9af0-380fed4ee118" (UID: "eb77b79a-a9ff-4ab6-9af0-380fed4ee118"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:26:12.966408 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:12.966359    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb77b79a-a9ff-4ab6-9af0-380fed4ee118-model-cache\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:26:12.966408 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:12.966376    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb77b79a-a9ff-4ab6-9af0-380fed4ee118-home\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:26:12.967907 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:12.967884    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb77b79a-a9ff-4ab6-9af0-380fed4ee118-dshm" (OuterVolumeSpecName: "dshm") pod "eb77b79a-a9ff-4ab6-9af0-380fed4ee118" (UID: "eb77b79a-a9ff-4ab6-9af0-380fed4ee118"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:26:12.968117 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:12.968100    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb77b79a-a9ff-4ab6-9af0-380fed4ee118-kube-api-access-477kb" (OuterVolumeSpecName: "kube-api-access-477kb") pod "eb77b79a-a9ff-4ab6-9af0-380fed4ee118" (UID: "eb77b79a-a9ff-4ab6-9af0-380fed4ee118"). InnerVolumeSpecName "kube-api-access-477kb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:26:12.968185 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:12.968162    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb77b79a-a9ff-4ab6-9af0-380fed4ee118-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "eb77b79a-a9ff-4ab6-9af0-380fed4ee118" (UID: "eb77b79a-a9ff-4ab6-9af0-380fed4ee118"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:26:13.067508 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:13.067475    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb77b79a-a9ff-4ab6-9af0-380fed4ee118-tls-certs\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:26:13.067508 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:13.067501    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb77b79a-a9ff-4ab6-9af0-380fed4ee118-tmp-dir\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:26:13.067508 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:13.067512    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-477kb\" (UniqueName: \"kubernetes.io/projected/eb77b79a-a9ff-4ab6-9af0-380fed4ee118-kube-api-access-477kb\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:26:13.067508 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:13.067521    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb77b79a-a9ff-4ab6-9af0-380fed4ee118-dshm\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:26:13.516011 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:13.515976    2561 generic.go:356] "Generic (PLEG): container finished" podID="eb77b79a-a9ff-4ab6-9af0-380fed4ee118" containerID="259c8e5f444d902812b892a1549d9a72b162421153b5296d136e4ce431da2d97" exitCode=0
Jul 24 17:26:13.516425 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:13.516033    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks"
Jul 24 17:26:13.516425 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:13.516092    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks" event={"ID":"eb77b79a-a9ff-4ab6-9af0-380fed4ee118","Type":"ContainerDied","Data":"259c8e5f444d902812b892a1549d9a72b162421153b5296d136e4ce431da2d97"}
Jul 24 17:26:13.516425 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:13.516138    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks" event={"ID":"eb77b79a-a9ff-4ab6-9af0-380fed4ee118","Type":"ContainerDied","Data":"6dce0a13419f1c374e0c764d490a8d6ce6341712d5e2b4c6c5d1a4f98a93281c"}
Jul 24 17:26:13.516425 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:13.516156    2561 scope.go:117] "RemoveContainer" containerID="259c8e5f444d902812b892a1549d9a72b162421153b5296d136e4ce431da2d97"
Jul 24 17:26:13.525433 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:13.525414    2561 scope.go:117] "RemoveContainer" containerID="259c8e5f444d902812b892a1549d9a72b162421153b5296d136e4ce431da2d97"
Jul 24 17:26:13.525700 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:26:13.525676    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"259c8e5f444d902812b892a1549d9a72b162421153b5296d136e4ce431da2d97\": container with ID starting with 259c8e5f444d902812b892a1549d9a72b162421153b5296d136e4ce431da2d97 not found: ID does not exist" containerID="259c8e5f444d902812b892a1549d9a72b162421153b5296d136e4ce431da2d97"
Jul 24 17:26:13.525767 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:13.525713    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"259c8e5f444d902812b892a1549d9a72b162421153b5296d136e4ce431da2d97"} err="failed to get container status \"259c8e5f444d902812b892a1549d9a72b162421153b5296d136e4ce431da2d97\": rpc error: code = NotFound desc = could not find container \"259c8e5f444d902812b892a1549d9a72b162421153b5296d136e4ce431da2d97\": container with ID starting with 259c8e5f444d902812b892a1549d9a72b162421153b5296d136e4ce431da2d97 not found: ID does not exist"
Jul 24 17:26:13.540393 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:13.540355    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks"]
Jul 24 17:26:13.546246 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:13.546219    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-6ccc13da-kserve-6fd8b7df55-zthks"]
Jul 24 17:26:14.259363 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:14.259331    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb77b79a-a9ff-4ab6-9af0-380fed4ee118" path="/var/lib/kubelet/pods/eb77b79a-a9ff-4ab6-9af0-380fed4ee118/volumes"
Jul 24 17:26:16.272976 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:26:16.272920    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="llm/e2e-same-id-a-6ccc13da-kserve-755b4fc89f-wcmkt" podUID="fa83dcb9-4526-4c73-80d5-02492016e94f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.43:8000/ready\": context deadline exceeded"
Jul 24 17:28:36.219159 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:28:36.219132    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6h754_860ed1fc-612f-4796-8077-72bc6c5d84db/ovn-acl-logging/0.log"
Jul 24 17:28:36.221682 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:28:36.219412    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6h754_860ed1fc-612f-4796-8077-72bc6c5d84db/ovn-acl-logging/0.log"
Jul 24 17:29:37.332155 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:29:37.332111    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-6432af27-7f9db4765b-svqd7"]
Jul 24 17:29:37.332727 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:29:37.332675    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb77b79a-a9ff-4ab6-9af0-380fed4ee118" containerName="main"
Jul 24 17:29:37.332727 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:29:37.332695    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb77b79a-a9ff-4ab6-9af0-380fed4ee118" containerName="main"
Jul 24 17:29:37.332727 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:29:37.332723    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa83dcb9-4526-4c73-80d5-02492016e94f" containerName="main"
Jul 24 17:29:37.332893 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:29:37.332733    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa83dcb9-4526-4c73-80d5-02492016e94f" containerName="main"
Jul 24 17:29:37.332893 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:29:37.332826    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb77b79a-a9ff-4ab6-9af0-380fed4ee118" containerName="main"
Jul 24 17:29:37.332893 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:29:37.332840    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa83dcb9-4526-4c73-80d5-02492016e94f" containerName="main"
Jul 24 17:29:37.335969 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:29:37.335948    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-6432af27-7f9db4765b-svqd7"
Jul 24 17:29:37.338689 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:29:37.338668    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-6432af27-dockercfg-lkf84\""
Jul 24 17:29:37.338996 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:29:37.338982    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-6432af27\""
Jul 24 17:29:37.345221 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:29:37.345194    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-6432af27-7757647d8b-dc68t"]
Jul 24 17:29:37.349049 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:29:37.349027    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-6432af27-7f9db4765b-svqd7"]
Jul 24 17:29:37.349157 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:29:37.349140    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-6432af27-7757647d8b-dc68t"
Jul 24 17:29:37.359963 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:29:37.359940    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-6432af27-7757647d8b-dc68t"]
Jul 24 17:29:37.371382 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:29:37.371353    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwcrd\" (UniqueName: \"kubernetes.io/projected/e8efd89a-c232-4f81-8e69-cdf4c9357a96-kube-api-access-gwcrd\") pod \"payload-processing-e2e-ait-6432af27-7757647d8b-dc68t\" (UID: \"e8efd89a-c232-4f81-8e69-cdf4c9357a96\") " pod="openshift-ingress/payload-processing-e2e-ait-6432af27-7757647d8b-dc68t"
Jul 24 17:29:37.371569 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:29:37.371420    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7fcn\" (UniqueName: \"kubernetes.io/projected/4426c526-213d-4894-8315-4344430493c2-kube-api-access-z7fcn\") pod \"payload-pre-processing-e2e-ait-6432af27-7f9db4765b-svqd7\" (UID: \"4426c526-213d-4894-8315-4344430493c2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-6432af27-7f9db4765b-svqd7"
Jul 24 17:29:37.371569 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:29:37.371452    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4426c526-213d-4894-8315-4344430493c2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-6432af27-7f9db4765b-svqd7\" (UID: \"4426c526-213d-4894-8315-4344430493c2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-6432af27-7f9db4765b-svqd7"
Jul 24 17:29:37.371569 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:29:37.371534    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e8efd89a-c232-4f81-8e69-cdf4c9357a96-plugins-config-volume\") pod \"payload-processing-e2e-ait-6432af27-7757647d8b-dc68t\" (UID: \"e8efd89a-c232-4f81-8e69-cdf4c9357a96\") " pod="openshift-ingress/payload-processing-e2e-ait-6432af27-7757647d8b-dc68t"
Jul 24 17:29:37.472202 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:29:37.472156    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwcrd\" (UniqueName: \"kubernetes.io/projected/e8efd89a-c232-4f81-8e69-cdf4c9357a96-kube-api-access-gwcrd\") pod \"payload-processing-e2e-ait-6432af27-7757647d8b-dc68t\" (UID: \"e8efd89a-c232-4f81-8e69-cdf4c9357a96\") " pod="openshift-ingress/payload-processing-e2e-ait-6432af27-7757647d8b-dc68t"
Jul 24 17:29:37.472407 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:29:37.472219    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7fcn\" (UniqueName: \"kubernetes.io/projected/4426c526-213d-4894-8315-4344430493c2-kube-api-access-z7fcn\") pod \"payload-pre-processing-e2e-ait-6432af27-7f9db4765b-svqd7\" (UID: \"4426c526-213d-4894-8315-4344430493c2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-6432af27-7f9db4765b-svqd7"
Jul 24 17:29:37.472407 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:29:37.472243    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4426c526-213d-4894-8315-4344430493c2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-6432af27-7f9db4765b-svqd7\" (UID: \"4426c526-213d-4894-8315-4344430493c2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-6432af27-7f9db4765b-svqd7"
Jul 24 17:29:37.472407 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:29:37.472291    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e8efd89a-c232-4f81-8e69-cdf4c9357a96-plugins-config-volume\") pod \"payload-processing-e2e-ait-6432af27-7757647d8b-dc68t\" (UID: \"e8efd89a-c232-4f81-8e69-cdf4c9357a96\") " pod="openshift-ingress/payload-processing-e2e-ait-6432af27-7757647d8b-dc68t"
Jul 24 17:29:37.473010 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:29:37.472987    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e8efd89a-c232-4f81-8e69-cdf4c9357a96-plugins-config-volume\") pod \"payload-processing-e2e-ait-6432af27-7757647d8b-dc68t\" (UID: \"e8efd89a-c232-4f81-8e69-cdf4c9357a96\") " pod="openshift-ingress/payload-processing-e2e-ait-6432af27-7757647d8b-dc68t"
Jul 24 17:29:37.473142 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:29:37.472994    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4426c526-213d-4894-8315-4344430493c2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-6432af27-7f9db4765b-svqd7\" (UID: \"4426c526-213d-4894-8315-4344430493c2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-6432af27-7f9db4765b-svqd7"
Jul 24 17:29:37.481877 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:29:37.481850    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwcrd\" (UniqueName: \"kubernetes.io/projected/e8efd89a-c232-4f81-8e69-cdf4c9357a96-kube-api-access-gwcrd\") pod \"payload-processing-e2e-ait-6432af27-7757647d8b-dc68t\" (UID: \"e8efd89a-c232-4f81-8e69-cdf4c9357a96\") " pod="openshift-ingress/payload-processing-e2e-ait-6432af27-7757647d8b-dc68t"
Jul 24 17:29:37.481984 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:29:37.481880    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7fcn\" (UniqueName: \"kubernetes.io/projected/4426c526-213d-4894-8315-4344430493c2-kube-api-access-z7fcn\") pod \"payload-pre-processing-e2e-ait-6432af27-7f9db4765b-svqd7\" (UID: \"4426c526-213d-4894-8315-4344430493c2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-6432af27-7f9db4765b-svqd7"
Jul 24 17:29:37.646968 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:29:37.646939    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-6432af27-7f9db4765b-svqd7"
Jul 24 17:29:37.658253 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:29:37.658226    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-6432af27-7757647d8b-dc68t"
Jul 24 17:29:37.796420 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:29:37.796235    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-6432af27-7f9db4765b-svqd7"]
Jul 24 17:29:37.799007 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:29:37.798977    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4426c526_213d_4894_8315_4344430493c2.slice/crio-a4607139f58d5884c207b140b8f9124fbae154af3f82112d1a0dd2a4ed4941ad WatchSource:0}: Error finding container a4607139f58d5884c207b140b8f9124fbae154af3f82112d1a0dd2a4ed4941ad: Status 404 returned error can't find the container with id a4607139f58d5884c207b140b8f9124fbae154af3f82112d1a0dd2a4ed4941ad
Jul 24 17:29:37.816674 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:29:37.816644    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-6432af27-7757647d8b-dc68t"]
Jul 24 17:29:37.820143 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:29:37.820119    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8efd89a_c232_4f81_8e69_cdf4c9357a96.slice/crio-2d88c305c59d2198f0f10490a699952ff79fc229e783aa751ddec331233a21d3 WatchSource:0}: Error finding container 2d88c305c59d2198f0f10490a699952ff79fc229e783aa751ddec331233a21d3: Status 404 returned error can't find the container with id 2d88c305c59d2198f0f10490a699952ff79fc229e783aa751ddec331233a21d3
Jul 24 17:29:38.448881 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:29:38.448844    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-6432af27-7757647d8b-dc68t" event={"ID":"e8efd89a-c232-4f81-8e69-cdf4c9357a96","Type":"ContainerStarted","Data":"084470262f18b72e1933773076d9f042d593c04f28208383beb1c5695df02fd4"}
Jul 24 17:29:38.449302 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:29:38.448904    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-6432af27-7757647d8b-dc68t" event={"ID":"e8efd89a-c232-4f81-8e69-cdf4c9357a96","Type":"ContainerStarted","Data":"2d88c305c59d2198f0f10490a699952ff79fc229e783aa751ddec331233a21d3"}
Jul 24 17:29:38.449302 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:29:38.449021    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-6432af27-7757647d8b-dc68t"
Jul 24 17:29:38.450344 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:29:38.450322    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-6432af27-7f9db4765b-svqd7" event={"ID":"4426c526-213d-4894-8315-4344430493c2","Type":"ContainerStarted","Data":"d75a67d19c6080df255fa5581e5e7ba3ad7b7ad6621c948c1dd255d08ade1357"}
Jul 24 17:29:38.450411 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:29:38.450371    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-6432af27-7f9db4765b-svqd7"
Jul 24 17:29:38.450411 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:29:38.450390    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-6432af27-7f9db4765b-svqd7" event={"ID":"4426c526-213d-4894-8315-4344430493c2","Type":"ContainerStarted","Data":"a4607139f58d5884c207b140b8f9124fbae154af3f82112d1a0dd2a4ed4941ad"}
Jul 24 17:29:38.466741 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:29:38.466693    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-6432af27-7757647d8b-dc68t" podStartSLOduration=1.466675005 podStartE2EDuration="1.466675005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:29:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:29:38.465449109 +0000 UTC m=+1562.738308889" watchObservedRunningTime="2026-07-24 17:29:38.466675005 +0000 UTC m=+1562.739534763"
Jul 24 17:29:38.483472 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:29:38.483417    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-6432af27-7f9db4765b-svqd7" podStartSLOduration=1.483394558 podStartE2EDuration="1.483394558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:29:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:29:38.483396061 +0000 UTC m=+1562.756255863" watchObservedRunningTime="2026-07-24 17:29:38.483394558 +0000 UTC m=+1562.756254363"
Jul 24 17:29:49.456398 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:29:49.456367    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-6432af27-7f9db4765b-svqd7"
Jul 24 17:29:49.456837 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:29:49.456434    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-6432af27-7757647d8b-dc68t"
Jul 24 17:30:12.486515 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:12.486476    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-6432af27-7757647d8b-dc68t"]
Jul 24 17:30:12.487112 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:12.486727    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-6432af27-7757647d8b-dc68t" podUID="e8efd89a-c232-4f81-8e69-cdf4c9357a96" containerName="payload-processing" containerID="cri-o://084470262f18b72e1933773076d9f042d593c04f28208383beb1c5695df02fd4" gracePeriod=30
Jul 24 17:30:12.494224 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:12.494201    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-6432af27-7f9db4765b-svqd7"]
Jul 24 17:30:12.494503 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:12.494435    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-6432af27-7f9db4765b-svqd7" podUID="4426c526-213d-4894-8315-4344430493c2" containerName="payload-pre-processing" containerID="cri-o://d75a67d19c6080df255fa5581e5e7ba3ad7b7ad6621c948c1dd255d08ade1357" gracePeriod=30
Jul 24 17:30:12.619354 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:12.619323    2561 generic.go:356] "Generic (PLEG): container finished" podID="e8efd89a-c232-4f81-8e69-cdf4c9357a96" containerID="084470262f18b72e1933773076d9f042d593c04f28208383beb1c5695df02fd4" exitCode=0
Jul 24 17:30:12.619486 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:12.619428    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-6432af27-7757647d8b-dc68t" event={"ID":"e8efd89a-c232-4f81-8e69-cdf4c9357a96","Type":"ContainerDied","Data":"084470262f18b72e1933773076d9f042d593c04f28208383beb1c5695df02fd4"}
Jul 24 17:30:12.621049 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:12.621025    2561 generic.go:356] "Generic (PLEG): container finished" podID="4426c526-213d-4894-8315-4344430493c2" containerID="d75a67d19c6080df255fa5581e5e7ba3ad7b7ad6621c948c1dd255d08ade1357" exitCode=0
Jul 24 17:30:12.621176 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:12.621104    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-6432af27-7f9db4765b-svqd7" event={"ID":"4426c526-213d-4894-8315-4344430493c2","Type":"ContainerDied","Data":"d75a67d19c6080df255fa5581e5e7ba3ad7b7ad6621c948c1dd255d08ade1357"}
Jul 24 17:30:12.763680 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:12.763656    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-6432af27-7757647d8b-dc68t"
Jul 24 17:30:12.766549 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:12.766529    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-6432af27-7f9db4765b-svqd7"
Jul 24 17:30:12.899599 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:12.899565    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4426c526-213d-4894-8315-4344430493c2-plugins-config-volume\") pod \"4426c526-213d-4894-8315-4344430493c2\" (UID: \"4426c526-213d-4894-8315-4344430493c2\") "
Jul 24 17:30:12.899770 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:12.899637    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7fcn\" (UniqueName: \"kubernetes.io/projected/4426c526-213d-4894-8315-4344430493c2-kube-api-access-z7fcn\") pod \"4426c526-213d-4894-8315-4344430493c2\" (UID: \"4426c526-213d-4894-8315-4344430493c2\") "
Jul 24 17:30:12.899770 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:12.899719    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gwcrd\" (UniqueName: \"kubernetes.io/projected/e8efd89a-c232-4f81-8e69-cdf4c9357a96-kube-api-access-gwcrd\") pod \"e8efd89a-c232-4f81-8e69-cdf4c9357a96\" (UID: \"e8efd89a-c232-4f81-8e69-cdf4c9357a96\") "
Jul 24 17:30:12.899770 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:12.899748    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e8efd89a-c232-4f81-8e69-cdf4c9357a96-plugins-config-volume\") pod \"e8efd89a-c232-4f81-8e69-cdf4c9357a96\" (UID: \"e8efd89a-c232-4f81-8e69-cdf4c9357a96\") "
Jul 24 17:30:12.899974 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:12.899945    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4426c526-213d-4894-8315-4344430493c2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4426c526-213d-4894-8315-4344430493c2" (UID: "4426c526-213d-4894-8315-4344430493c2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:30:12.900168 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:12.900146    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8efd89a-c232-4f81-8e69-cdf4c9357a96-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e8efd89a-c232-4f81-8e69-cdf4c9357a96" (UID: "e8efd89a-c232-4f81-8e69-cdf4c9357a96"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:30:12.901949 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:12.901928    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8efd89a-c232-4f81-8e69-cdf4c9357a96-kube-api-access-gwcrd" (OuterVolumeSpecName: "kube-api-access-gwcrd") pod "e8efd89a-c232-4f81-8e69-cdf4c9357a96" (UID: "e8efd89a-c232-4f81-8e69-cdf4c9357a96"). InnerVolumeSpecName "kube-api-access-gwcrd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:30:12.902047 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:12.901955    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4426c526-213d-4894-8315-4344430493c2-kube-api-access-z7fcn" (OuterVolumeSpecName: "kube-api-access-z7fcn") pod "4426c526-213d-4894-8315-4344430493c2" (UID: "4426c526-213d-4894-8315-4344430493c2"). InnerVolumeSpecName "kube-api-access-z7fcn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:30:13.000594 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:13.000513    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gwcrd\" (UniqueName: \"kubernetes.io/projected/e8efd89a-c232-4f81-8e69-cdf4c9357a96-kube-api-access-gwcrd\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:30:13.000594 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:13.000538    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e8efd89a-c232-4f81-8e69-cdf4c9357a96-plugins-config-volume\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:30:13.000594 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:13.000547    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4426c526-213d-4894-8315-4344430493c2-plugins-config-volume\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:30:13.000594 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:13.000557    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7fcn\" (UniqueName: \"kubernetes.io/projected/4426c526-213d-4894-8315-4344430493c2-kube-api-access-z7fcn\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:30:13.627127 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:13.627095    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-6432af27-7757647d8b-dc68t" event={"ID":"e8efd89a-c232-4f81-8e69-cdf4c9357a96","Type":"ContainerDied","Data":"2d88c305c59d2198f0f10490a699952ff79fc229e783aa751ddec331233a21d3"}
Jul 24 17:30:13.627584 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:13.627154    2561 scope.go:117] "RemoveContainer" containerID="084470262f18b72e1933773076d9f042d593c04f28208383beb1c5695df02fd4"
Jul 24 17:30:13.627584 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:13.627100    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-6432af27-7757647d8b-dc68t"
Jul 24 17:30:13.628452 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:13.628404    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-6432af27-7f9db4765b-svqd7" event={"ID":"4426c526-213d-4894-8315-4344430493c2","Type":"ContainerDied","Data":"a4607139f58d5884c207b140b8f9124fbae154af3f82112d1a0dd2a4ed4941ad"}
Jul 24 17:30:13.628528 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:13.628451    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-6432af27-7f9db4765b-svqd7"
Jul 24 17:30:13.637180 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:13.637164    2561 scope.go:117] "RemoveContainer" containerID="d75a67d19c6080df255fa5581e5e7ba3ad7b7ad6621c948c1dd255d08ade1357"
Jul 24 17:30:13.649309 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:13.649288    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-6432af27-7757647d8b-dc68t"]
Jul 24 17:30:13.655130 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:13.655109    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-6432af27-7757647d8b-dc68t"]
Jul 24 17:30:13.665303 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:13.665273    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-6432af27-7f9db4765b-svqd7"]
Jul 24 17:30:13.669900 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:13.669881    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-6432af27-7f9db4765b-svqd7"]
Jul 24 17:30:14.258229 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:14.258194    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4426c526-213d-4894-8315-4344430493c2" path="/var/lib/kubelet/pods/4426c526-213d-4894-8315-4344430493c2/volumes"
Jul 24 17:30:14.258562 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:14.258550    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8efd89a-c232-4f81-8e69-cdf4c9357a96" path="/var/lib/kubelet/pods/e8efd89a-c232-4f81-8e69-cdf4c9357a96/volumes"
Jul 24 17:30:18.259280 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:18.259253    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh"]
Jul 24 17:30:18.259645 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:18.259571    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4426c526-213d-4894-8315-4344430493c2" containerName="payload-pre-processing"
Jul 24 17:30:18.259645 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:18.259582    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4426c526-213d-4894-8315-4344430493c2" containerName="payload-pre-processing"
Jul 24 17:30:18.259645 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:18.259595    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8efd89a-c232-4f81-8e69-cdf4c9357a96" containerName="payload-processing"
Jul 24 17:30:18.259645 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:18.259602    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8efd89a-c232-4f81-8e69-cdf4c9357a96" containerName="payload-processing"
Jul 24 17:30:18.259776 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:18.259667    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8efd89a-c232-4f81-8e69-cdf4c9357a96" containerName="payload-processing"
Jul 24 17:30:18.259776 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:18.259677    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4426c526-213d-4894-8315-4344430493c2" containerName="payload-pre-processing"
Jul 24 17:30:18.264042 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:18.264023    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh"
Jul 24 17:30:18.266435 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:18.266412    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-1f7abc01-gw-openshift-default-dockercfg-z45k4\""
Jul 24 17:30:18.266557 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:18.266540    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 24 17:30:18.272324 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:18.272302    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh"]
Jul 24 17:30:18.448624 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:18.448586    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a750dd0e-a6e4-43d9-af1e-d3545032edde-istio-envoy\") pod \"e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh\" (UID: \"a750dd0e-a6e4-43d9-af1e-d3545032edde\") " pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh"
Jul 24 17:30:18.448830 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:18.448639    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a750dd0e-a6e4-43d9-af1e-d3545032edde-istio-podinfo\") pod \"e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh\" (UID: \"a750dd0e-a6e4-43d9-af1e-d3545032edde\") " pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh"
Jul 24 17:30:18.448830 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:18.448690    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a750dd0e-a6e4-43d9-af1e-d3545032edde-workload-socket\") pod \"e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh\" (UID: \"a750dd0e-a6e4-43d9-af1e-d3545032edde\") " pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh"
Jul 24 17:30:18.448830 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:18.448740    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a750dd0e-a6e4-43d9-af1e-d3545032edde-istio-token\") pod \"e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh\" (UID: \"a750dd0e-a6e4-43d9-af1e-d3545032edde\") " pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh"
Jul 24 17:30:18.448830 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:18.448760    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a750dd0e-a6e4-43d9-af1e-d3545032edde-istio-data\") pod \"e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh\" (UID: \"a750dd0e-a6e4-43d9-af1e-d3545032edde\") " pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh"
Jul 24 17:30:18.448830 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:18.448810    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a750dd0e-a6e4-43d9-af1e-d3545032edde-credential-socket\") pod \"e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh\" (UID: \"a750dd0e-a6e4-43d9-af1e-d3545032edde\") " pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh"
Jul 24 17:30:18.449186 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:18.448838    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a750dd0e-a6e4-43d9-af1e-d3545032edde-workload-certs\") pod \"e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh\" (UID: \"a750dd0e-a6e4-43d9-af1e-d3545032edde\") " pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh"
Jul 24 17:30:18.449186 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:18.448908    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a750dd0e-a6e4-43d9-af1e-d3545032edde-istiod-ca-cert\") pod \"e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh\" (UID: \"a750dd0e-a6e4-43d9-af1e-d3545032edde\") " pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh"
Jul 24 17:30:18.449186 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:18.448936    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nw8s\" (UniqueName: \"kubernetes.io/projected/a750dd0e-a6e4-43d9-af1e-d3545032edde-kube-api-access-5nw8s\") pod \"e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh\" (UID: \"a750dd0e-a6e4-43d9-af1e-d3545032edde\") " pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh"
Jul 24 17:30:18.549792 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:18.549692    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a750dd0e-a6e4-43d9-af1e-d3545032edde-istiod-ca-cert\") pod \"e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh\" (UID: \"a750dd0e-a6e4-43d9-af1e-d3545032edde\") " pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh"
Jul 24 17:30:18.549792 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:18.549743    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nw8s\" (UniqueName: \"kubernetes.io/projected/a750dd0e-a6e4-43d9-af1e-d3545032edde-kube-api-access-5nw8s\") pod \"e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh\" (UID: \"a750dd0e-a6e4-43d9-af1e-d3545032edde\") " pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh"
Jul 24 17:30:18.550034 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:18.549811    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a750dd0e-a6e4-43d9-af1e-d3545032edde-istio-envoy\") pod \"e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh\" (UID: \"a750dd0e-a6e4-43d9-af1e-d3545032edde\") " pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh"
Jul 24 17:30:18.550034 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:18.549834    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a750dd0e-a6e4-43d9-af1e-d3545032edde-istio-podinfo\") pod \"e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh\" (UID: \"a750dd0e-a6e4-43d9-af1e-d3545032edde\") " pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh"
Jul 24 17:30:18.550034 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:18.549859    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a750dd0e-a6e4-43d9-af1e-d3545032edde-workload-socket\") pod \"e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh\" (UID: \"a750dd0e-a6e4-43d9-af1e-d3545032edde\") " pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh"
Jul 24 17:30:18.550243 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:18.550045    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a750dd0e-a6e4-43d9-af1e-d3545032edde-istio-token\") pod \"e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh\" (UID: \"a750dd0e-a6e4-43d9-af1e-d3545032edde\") " pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh"
Jul 24 17:30:18.550243 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:18.550120    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a750dd0e-a6e4-43d9-af1e-d3545032edde-istio-data\") pod \"e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh\" (UID: \"a750dd0e-a6e4-43d9-af1e-d3545032edde\") " pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh"
Jul 24 17:30:18.550243 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:18.550154    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a750dd0e-a6e4-43d9-af1e-d3545032edde-credential-socket\") pod \"e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh\" (UID: \"a750dd0e-a6e4-43d9-af1e-d3545032edde\") " pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh"
Jul 24 17:30:18.550243 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:18.550178    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a750dd0e-a6e4-43d9-af1e-d3545032edde-workload-certs\") pod \"e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh\" (UID: \"a750dd0e-a6e4-43d9-af1e-d3545032edde\") " pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh"
Jul 24 17:30:18.550466 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:18.550246    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a750dd0e-a6e4-43d9-af1e-d3545032edde-workload-socket\") pod \"e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh\" (UID: \"a750dd0e-a6e4-43d9-af1e-d3545032edde\") " pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh"
Jul 24 17:30:18.550527 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:18.550510    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a750dd0e-a6e4-43d9-af1e-d3545032edde-workload-certs\") pod \"e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh\" (UID: \"a750dd0e-a6e4-43d9-af1e-d3545032edde\") " pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh"
Jul 24 17:30:18.550588 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:18.550539    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a750dd0e-a6e4-43d9-af1e-d3545032edde-istio-data\") pod \"e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh\" (UID: \"a750dd0e-a6e4-43d9-af1e-d3545032edde\") " pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh"
Jul 24 17:30:18.550588 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:18.550570    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a750dd0e-a6e4-43d9-af1e-d3545032edde-istiod-ca-cert\") pod \"e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh\" (UID: \"a750dd0e-a6e4-43d9-af1e-d3545032edde\") " pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh"
Jul 24 17:30:18.550681 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:18.550574    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a750dd0e-a6e4-43d9-af1e-d3545032edde-credential-socket\") pod \"e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh\" (UID: \"a750dd0e-a6e4-43d9-af1e-d3545032edde\") " pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh"
Jul 24 17:30:18.552361 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:18.552338    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a750dd0e-a6e4-43d9-af1e-d3545032edde-istio-envoy\") pod \"e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh\" (UID: \"a750dd0e-a6e4-43d9-af1e-d3545032edde\") " pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh"
Jul 24 17:30:18.552737 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:18.552718    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a750dd0e-a6e4-43d9-af1e-d3545032edde-istio-podinfo\") pod \"e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh\" (UID: \"a750dd0e-a6e4-43d9-af1e-d3545032edde\") " pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh"
Jul 24 17:30:18.558461 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:18.558430    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a750dd0e-a6e4-43d9-af1e-d3545032edde-istio-token\") pod \"e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh\" (UID: \"a750dd0e-a6e4-43d9-af1e-d3545032edde\") " pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh"
Jul 24 17:30:18.558637 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:18.558617    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nw8s\" (UniqueName: \"kubernetes.io/projected/a750dd0e-a6e4-43d9-af1e-d3545032edde-kube-api-access-5nw8s\") pod \"e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh\" (UID: \"a750dd0e-a6e4-43d9-af1e-d3545032edde\") " pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh"
Jul 24 17:30:18.574486 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:18.574462    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh"
Jul 24 17:30:18.707473 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:18.707436    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh"]
Jul 24 17:30:18.710662 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:30:18.710633    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda750dd0e_a6e4_43d9_af1e_d3545032edde.slice/crio-8b367f698ff5e4131779a324311c818d9fccf414e7ff74a745eb56fdd6dbdeea WatchSource:0}: Error finding container 8b367f698ff5e4131779a324311c818d9fccf414e7ff74a745eb56fdd6dbdeea: Status 404 returned error can't find the container with id 8b367f698ff5e4131779a324311c818d9fccf414e7ff74a745eb56fdd6dbdeea
Jul 24 17:30:18.712814 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:18.712794    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 17:30:19.661189 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:19.661153    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh" event={"ID":"a750dd0e-a6e4-43d9-af1e-d3545032edde","Type":"ContainerStarted","Data":"8b367f698ff5e4131779a324311c818d9fccf414e7ff74a745eb56fdd6dbdeea"}
Jul 24 17:30:25.209686 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:25.209649    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:30:25.209959 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:25.209721    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:30:25.209959 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:25.209752    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:30:25.693024 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:25.692985    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh" event={"ID":"a750dd0e-a6e4-43d9-af1e-d3545032edde","Type":"ContainerStarted","Data":"caef335ff8678185a12bce1f6d1bffd35aa6831661c03484353086cc2cf9d7b8"}
Jul 24 17:30:25.712813 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:25.712767    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh" podStartSLOduration=1.216296728 podStartE2EDuration="7.712752833s" totalImagesPullingTime="6.496456105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:30:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:30:25.711033018 +0000 UTC m=+1609.983892835" watchObservedRunningTime="2026-07-24 17:30:25.712752833 +0000 UTC m=+1609.985612612"
Jul 24 17:30:26.575631 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:26.575602    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh"
Jul 24 17:30:26.580435 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:26.580413    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh"
Jul 24 17:30:26.697557 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:26.697527    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh"
Jul 24 17:30:26.698564 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:26.698547    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh"
Jul 24 17:30:28.021678 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:28.021600    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-1f7abc01-66bc4644b8-d5nbf"]
Jul 24 17:30:28.024977 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:28.024957    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-1f7abc01-66bc4644b8-d5nbf"
Jul 24 17:30:28.027420 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:28.027403    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-1f7abc01\""
Jul 24 17:30:28.028039 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:28.028024    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-1f7abc01-dockercfg-922zn\""
Jul 24 17:30:28.035800 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:28.035778    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-1f7abc01-66bc4644b8-d5nbf"]
Jul 24 17:30:28.055438 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:28.055412    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-1f7abc01-574db59fb9-86h4c"]
Jul 24 17:30:28.058789 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:28.058775    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-1f7abc01-574db59fb9-86h4c"
Jul 24 17:30:28.067200 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:28.067180    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-1f7abc01-574db59fb9-86h4c"]
Jul 24 17:30:28.136756 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:28.136723    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlszq\" (UniqueName: \"kubernetes.io/projected/8db86e81-fc66-4831-a8ba-d36414a42d05-kube-api-access-dlszq\") pod \"payload-pre-processing-e2e-migrate-1f7abc01-66bc4644b8-d5nbf\" (UID: \"8db86e81-fc66-4831-a8ba-d36414a42d05\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-1f7abc01-66bc4644b8-d5nbf"
Jul 24 17:30:28.136926 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:28.136815    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9622083-cbd7-48f1-b316-499238dbda7d-plugins-config-volume\") pod \"payload-processing-e2e-migrate-1f7abc01-574db59fb9-86h4c\" (UID: \"f9622083-cbd7-48f1-b316-499238dbda7d\") " pod="openshift-ingress/payload-processing-e2e-migrate-1f7abc01-574db59fb9-86h4c"
Jul 24 17:30:28.136926 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:28.136876    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8db86e81-fc66-4831-a8ba-d36414a42d05-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-1f7abc01-66bc4644b8-d5nbf\" (UID: \"8db86e81-fc66-4831-a8ba-d36414a42d05\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-1f7abc01-66bc4644b8-d5nbf"
Jul 24 17:30:28.136926 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:28.136910    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdm2p\" (UniqueName: \"kubernetes.io/projected/f9622083-cbd7-48f1-b316-499238dbda7d-kube-api-access-hdm2p\") pod \"payload-processing-e2e-migrate-1f7abc01-574db59fb9-86h4c\" (UID: \"f9622083-cbd7-48f1-b316-499238dbda7d\") " pod="openshift-ingress/payload-processing-e2e-migrate-1f7abc01-574db59fb9-86h4c"
Jul 24 17:30:28.237523 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:28.237489    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlszq\" (UniqueName: \"kubernetes.io/projected/8db86e81-fc66-4831-a8ba-d36414a42d05-kube-api-access-dlszq\") pod \"payload-pre-processing-e2e-migrate-1f7abc01-66bc4644b8-d5nbf\" (UID: \"8db86e81-fc66-4831-a8ba-d36414a42d05\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-1f7abc01-66bc4644b8-d5nbf"
Jul 24 17:30:28.237685 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:28.237580    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9622083-cbd7-48f1-b316-499238dbda7d-plugins-config-volume\") pod \"payload-processing-e2e-migrate-1f7abc01-574db59fb9-86h4c\" (UID: \"f9622083-cbd7-48f1-b316-499238dbda7d\") " pod="openshift-ingress/payload-processing-e2e-migrate-1f7abc01-574db59fb9-86h4c"
Jul 24 17:30:28.237685 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:28.237630    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8db86e81-fc66-4831-a8ba-d36414a42d05-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-1f7abc01-66bc4644b8-d5nbf\" (UID: \"8db86e81-fc66-4831-a8ba-d36414a42d05\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-1f7abc01-66bc4644b8-d5nbf"
Jul 24 17:30:28.237796 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:28.237751    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdm2p\" (UniqueName: \"kubernetes.io/projected/f9622083-cbd7-48f1-b316-499238dbda7d-kube-api-access-hdm2p\") pod \"payload-processing-e2e-migrate-1f7abc01-574db59fb9-86h4c\" (UID: \"f9622083-cbd7-48f1-b316-499238dbda7d\") " pod="openshift-ingress/payload-processing-e2e-migrate-1f7abc01-574db59fb9-86h4c"
Jul 24 17:30:28.238433 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:28.238414    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8db86e81-fc66-4831-a8ba-d36414a42d05-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-1f7abc01-66bc4644b8-d5nbf\" (UID: \"8db86e81-fc66-4831-a8ba-d36414a42d05\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-1f7abc01-66bc4644b8-d5nbf"
Jul 24 17:30:28.238525 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:28.238423    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9622083-cbd7-48f1-b316-499238dbda7d-plugins-config-volume\") pod \"payload-processing-e2e-migrate-1f7abc01-574db59fb9-86h4c\" (UID: \"f9622083-cbd7-48f1-b316-499238dbda7d\") " pod="openshift-ingress/payload-processing-e2e-migrate-1f7abc01-574db59fb9-86h4c"
Jul 24 17:30:28.245502 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:28.245475    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdm2p\" (UniqueName: \"kubernetes.io/projected/f9622083-cbd7-48f1-b316-499238dbda7d-kube-api-access-hdm2p\") pod \"payload-processing-e2e-migrate-1f7abc01-574db59fb9-86h4c\" (UID: \"f9622083-cbd7-48f1-b316-499238dbda7d\") " pod="openshift-ingress/payload-processing-e2e-migrate-1f7abc01-574db59fb9-86h4c"
Jul 24 17:30:28.245588 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:28.245520    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlszq\" (UniqueName: \"kubernetes.io/projected/8db86e81-fc66-4831-a8ba-d36414a42d05-kube-api-access-dlszq\") pod \"payload-pre-processing-e2e-migrate-1f7abc01-66bc4644b8-d5nbf\" (UID: \"8db86e81-fc66-4831-a8ba-d36414a42d05\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-1f7abc01-66bc4644b8-d5nbf"
Jul 24 17:30:28.336277 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:28.336208    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-1f7abc01-66bc4644b8-d5nbf"
Jul 24 17:30:28.369859 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:28.369831    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-1f7abc01-574db59fb9-86h4c"
Jul 24 17:30:28.493220 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:28.493191    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-1f7abc01-66bc4644b8-d5nbf"]
Jul 24 17:30:28.494708 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:30:28.494681    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8db86e81_fc66_4831_a8ba_d36414a42d05.slice/crio-3bca384d955e0c6f08a852de96865546fe4a6015fe25938e42374f1f6d403284 WatchSource:0}: Error finding container 3bca384d955e0c6f08a852de96865546fe4a6015fe25938e42374f1f6d403284: Status 404 returned error can't find the container with id 3bca384d955e0c6f08a852de96865546fe4a6015fe25938e42374f1f6d403284
Jul 24 17:30:28.519767 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:28.519742    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-1f7abc01-574db59fb9-86h4c"]
Jul 24 17:30:28.524157 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:30:28.524132    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9622083_cbd7_48f1_b316_499238dbda7d.slice/crio-fef7baa8336ce0f09ab7481b093e150ad9b3749788581e40dac648b3910c0f8c WatchSource:0}: Error finding container fef7baa8336ce0f09ab7481b093e150ad9b3749788581e40dac648b3910c0f8c: Status 404 returned error can't find the container with id fef7baa8336ce0f09ab7481b093e150ad9b3749788581e40dac648b3910c0f8c
Jul 24 17:30:28.709710 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:28.709673    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-1f7abc01-66bc4644b8-d5nbf" event={"ID":"8db86e81-fc66-4831-a8ba-d36414a42d05","Type":"ContainerStarted","Data":"2fd75cbf33eb6b101db23530c5c65f812f8a64bfb24ba0ceb0743a79b2b3ded2"}
Jul 24 17:30:28.709901 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:28.709738    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-1f7abc01-66bc4644b8-d5nbf" event={"ID":"8db86e81-fc66-4831-a8ba-d36414a42d05","Type":"ContainerStarted","Data":"3bca384d955e0c6f08a852de96865546fe4a6015fe25938e42374f1f6d403284"}
Jul 24 17:30:28.709901 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:28.709769    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-1f7abc01-66bc4644b8-d5nbf"
Jul 24 17:30:28.711144 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:28.711113    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-1f7abc01-574db59fb9-86h4c" event={"ID":"f9622083-cbd7-48f1-b316-499238dbda7d","Type":"ContainerStarted","Data":"7c4918c5ce58d88667dcb04c03078f8b3c15d19283bf1387faa2340d9ef1db34"}
Jul 24 17:30:28.711264 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:28.711167    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-1f7abc01-574db59fb9-86h4c" event={"ID":"f9622083-cbd7-48f1-b316-499238dbda7d","Type":"ContainerStarted","Data":"fef7baa8336ce0f09ab7481b093e150ad9b3749788581e40dac648b3910c0f8c"}
Jul 24 17:30:28.711335 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:28.711320    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-1f7abc01-574db59fb9-86h4c"
Jul 24 17:30:28.725993 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:28.725893    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-1f7abc01-66bc4644b8-d5nbf" podStartSLOduration=1.725877658 podStartE2EDuration="1.725877658s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:30:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:30:28.725114644 +0000 UTC m=+1612.997974445" watchObservedRunningTime="2026-07-24 17:30:28.725877658 +0000 UTC m=+1612.998737443"
Jul 24 17:30:28.741837 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:28.741798    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-1f7abc01-574db59fb9-86h4c" podStartSLOduration=0.74178522 podStartE2EDuration="741.78522ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:30:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:30:28.740228107 +0000 UTC m=+1613.013087911" watchObservedRunningTime="2026-07-24 17:30:28.74178522 +0000 UTC m=+1613.014644999"
Jul 24 17:30:39.717490 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:39.717460    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-1f7abc01-574db59fb9-86h4c"
Jul 24 17:30:39.717931 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:39.717701    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-1f7abc01-66bc4644b8-d5nbf"
Jul 24 17:30:39.767241 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:39.767175    2561 generic.go:356] "Generic (PLEG): container finished" podID="a750dd0e-a6e4-43d9-af1e-d3545032edde" containerID="caef335ff8678185a12bce1f6d1bffd35aa6831661c03484353086cc2cf9d7b8" exitCode=0
Jul 24 17:30:39.767381 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:39.767250    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh" event={"ID":"a750dd0e-a6e4-43d9-af1e-d3545032edde","Type":"ContainerDied","Data":"caef335ff8678185a12bce1f6d1bffd35aa6831661c03484353086cc2cf9d7b8"}
Jul 24 17:30:39.767644 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:39.767627    2561 scope.go:117] "RemoveContainer" containerID="caef335ff8678185a12bce1f6d1bffd35aa6831661c03484353086cc2cf9d7b8"
Jul 24 17:30:39.769862 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:39.769823    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:30:39.769991 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:39.769892    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:30:39.769991 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:39.769924    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:30:40.777246 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:40.777195    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh" event={"ID":"a750dd0e-a6e4-43d9-af1e-d3545032edde","Type":"ContainerStarted","Data":"60d506db0fe44676e72900d45955d4290343262fd1915bcc98b58c8ae6c5e1d5"}
Jul 24 17:30:41.576435 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:41.576402    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh"
Jul 24 17:30:41.576836 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:41.576811    2561 patch_prober.go:28] interesting pod/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 24 17:30:41.577033 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:41.577007    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh" podUID="a750dd0e-a6e4-43d9-af1e-d3545032edde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 24 17:30:41.697941 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:41.697911    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh"
Jul 24 17:30:42.575393 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:42.575351    2561 patch_prober.go:28] interesting pod/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 24 17:30:42.576594 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:42.576558    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh" podUID="a750dd0e-a6e4-43d9-af1e-d3545032edde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 24 17:30:43.575807 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:43.575764    2561 patch_prober.go:28] interesting pod/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 24 17:30:43.576433 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:43.575843    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh" podUID="a750dd0e-a6e4-43d9-af1e-d3545032edde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 24 17:30:44.578691 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:44.578658    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh"
Jul 24 17:30:44.579820 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:30:44.579804    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh"
Jul 24 17:31:02.701679 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:02.701644    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-1f7abc01-574db59fb9-86h4c"]
Jul 24 17:31:02.702175 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:02.701907    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-1f7abc01-574db59fb9-86h4c" podUID="f9622083-cbd7-48f1-b316-499238dbda7d" containerName="payload-processing" containerID="cri-o://7c4918c5ce58d88667dcb04c03078f8b3c15d19283bf1387faa2340d9ef1db34" gracePeriod=30
Jul 24 17:31:02.707688 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:02.707651    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-1f7abc01-66bc4644b8-d5nbf"]
Jul 24 17:31:02.707914 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:02.707858    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-1f7abc01-66bc4644b8-d5nbf" podUID="8db86e81-fc66-4831-a8ba-d36414a42d05" containerName="payload-pre-processing" containerID="cri-o://2fd75cbf33eb6b101db23530c5c65f812f8a64bfb24ba0ceb0743a79b2b3ded2" gracePeriod=30
Jul 24 17:31:02.883161 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:02.883120    2561 generic.go:356] "Generic (PLEG): container finished" podID="8db86e81-fc66-4831-a8ba-d36414a42d05" containerID="2fd75cbf33eb6b101db23530c5c65f812f8a64bfb24ba0ceb0743a79b2b3ded2" exitCode=0
Jul 24 17:31:02.883326 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:02.883187    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-1f7abc01-66bc4644b8-d5nbf" event={"ID":"8db86e81-fc66-4831-a8ba-d36414a42d05","Type":"ContainerDied","Data":"2fd75cbf33eb6b101db23530c5c65f812f8a64bfb24ba0ceb0743a79b2b3ded2"}
Jul 24 17:31:02.884801 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:02.884778    2561 generic.go:356] "Generic (PLEG): container finished" podID="f9622083-cbd7-48f1-b316-499238dbda7d" containerID="7c4918c5ce58d88667dcb04c03078f8b3c15d19283bf1387faa2340d9ef1db34" exitCode=0
Jul 24 17:31:02.884900 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:02.884841    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-1f7abc01-574db59fb9-86h4c" event={"ID":"f9622083-cbd7-48f1-b316-499238dbda7d","Type":"ContainerDied","Data":"7c4918c5ce58d88667dcb04c03078f8b3c15d19283bf1387faa2340d9ef1db34"}
Jul 24 17:31:02.979863 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:02.979841    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-1f7abc01-574db59fb9-86h4c"
Jul 24 17:31:02.983150 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:02.983131    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-1f7abc01-66bc4644b8-d5nbf"
Jul 24 17:31:03.070805 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:03.070766    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8db86e81-fc66-4831-a8ba-d36414a42d05-plugins-config-volume\") pod \"8db86e81-fc66-4831-a8ba-d36414a42d05\" (UID: \"8db86e81-fc66-4831-a8ba-d36414a42d05\") "
Jul 24 17:31:03.070980 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:03.070840    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9622083-cbd7-48f1-b316-499238dbda7d-plugins-config-volume\") pod \"f9622083-cbd7-48f1-b316-499238dbda7d\" (UID: \"f9622083-cbd7-48f1-b316-499238dbda7d\") "
Jul 24 17:31:03.070980 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:03.070858    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hdm2p\" (UniqueName: \"kubernetes.io/projected/f9622083-cbd7-48f1-b316-499238dbda7d-kube-api-access-hdm2p\") pod \"f9622083-cbd7-48f1-b316-499238dbda7d\" (UID: \"f9622083-cbd7-48f1-b316-499238dbda7d\") "
Jul 24 17:31:03.070980 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:03.070883    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dlszq\" (UniqueName: \"kubernetes.io/projected/8db86e81-fc66-4831-a8ba-d36414a42d05-kube-api-access-dlszq\") pod \"8db86e81-fc66-4831-a8ba-d36414a42d05\" (UID: \"8db86e81-fc66-4831-a8ba-d36414a42d05\") "
Jul 24 17:31:03.071193 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:03.071170    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8db86e81-fc66-4831-a8ba-d36414a42d05-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8db86e81-fc66-4831-a8ba-d36414a42d05" (UID: "8db86e81-fc66-4831-a8ba-d36414a42d05"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:31:03.071309 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:03.071285    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9622083-cbd7-48f1-b316-499238dbda7d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f9622083-cbd7-48f1-b316-499238dbda7d" (UID: "f9622083-cbd7-48f1-b316-499238dbda7d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:31:03.072965 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:03.072943    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9622083-cbd7-48f1-b316-499238dbda7d-kube-api-access-hdm2p" (OuterVolumeSpecName: "kube-api-access-hdm2p") pod "f9622083-cbd7-48f1-b316-499238dbda7d" (UID: "f9622083-cbd7-48f1-b316-499238dbda7d"). InnerVolumeSpecName "kube-api-access-hdm2p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:31:03.073037 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:03.072977    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8db86e81-fc66-4831-a8ba-d36414a42d05-kube-api-access-dlszq" (OuterVolumeSpecName: "kube-api-access-dlszq") pod "8db86e81-fc66-4831-a8ba-d36414a42d05" (UID: "8db86e81-fc66-4831-a8ba-d36414a42d05"). InnerVolumeSpecName "kube-api-access-dlszq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:31:03.172126 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:03.172087    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlszq\" (UniqueName: \"kubernetes.io/projected/8db86e81-fc66-4831-a8ba-d36414a42d05-kube-api-access-dlszq\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:31:03.172126 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:03.172122    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8db86e81-fc66-4831-a8ba-d36414a42d05-plugins-config-volume\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:31:03.172126 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:03.172133    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9622083-cbd7-48f1-b316-499238dbda7d-plugins-config-volume\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:31:03.172126 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:03.172142    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hdm2p\" (UniqueName: \"kubernetes.io/projected/f9622083-cbd7-48f1-b316-499238dbda7d-kube-api-access-hdm2p\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:31:03.890560 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:03.890532    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-1f7abc01-66bc4644b8-d5nbf"
Jul 24 17:31:03.890980 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:03.890566    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-1f7abc01-66bc4644b8-d5nbf" event={"ID":"8db86e81-fc66-4831-a8ba-d36414a42d05","Type":"ContainerDied","Data":"3bca384d955e0c6f08a852de96865546fe4a6015fe25938e42374f1f6d403284"}
Jul 24 17:31:03.890980 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:03.890628    2561 scope.go:117] "RemoveContainer" containerID="2fd75cbf33eb6b101db23530c5c65f812f8a64bfb24ba0ceb0743a79b2b3ded2"
Jul 24 17:31:03.892008 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:03.891946    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-1f7abc01-574db59fb9-86h4c" event={"ID":"f9622083-cbd7-48f1-b316-499238dbda7d","Type":"ContainerDied","Data":"fef7baa8336ce0f09ab7481b093e150ad9b3749788581e40dac648b3910c0f8c"}
Jul 24 17:31:03.892008 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:03.891988    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-1f7abc01-574db59fb9-86h4c"
Jul 24 17:31:03.900115 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:03.900053    2561 scope.go:117] "RemoveContainer" containerID="7c4918c5ce58d88667dcb04c03078f8b3c15d19283bf1387faa2340d9ef1db34"
Jul 24 17:31:03.915421 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:03.915400    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-1f7abc01-574db59fb9-86h4c"]
Jul 24 17:31:03.919659 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:03.919639    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-1f7abc01-574db59fb9-86h4c"]
Jul 24 17:31:03.929653 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:03.929630    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-1f7abc01-66bc4644b8-d5nbf"]
Jul 24 17:31:03.933279 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:03.933257    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-1f7abc01-66bc4644b8-d5nbf"]
Jul 24 17:31:04.261147 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:04.261113    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8db86e81-fc66-4831-a8ba-d36414a42d05" path="/var/lib/kubelet/pods/8db86e81-fc66-4831-a8ba-d36414a42d05/volumes"
Jul 24 17:31:04.261543 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:04.261528    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9622083-cbd7-48f1-b316-499238dbda7d" path="/var/lib/kubelet/pods/f9622083-cbd7-48f1-b316-499238dbda7d/volumes"
Jul 24 17:31:07.405868 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:07.405837    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh"]
Jul 24 17:31:07.406342 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:07.406155    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh" podUID="a750dd0e-a6e4-43d9-af1e-d3545032edde" containerName="istio-proxy" containerID="cri-o://60d506db0fe44676e72900d45955d4290343262fd1915bcc98b58c8ae6c5e1d5" gracePeriod=30
Jul 24 17:31:08.219579 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:08.219546    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx"]
Jul 24 17:31:08.219983 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:08.219965    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9622083-cbd7-48f1-b316-499238dbda7d" containerName="payload-processing"
Jul 24 17:31:08.220103 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:08.219985    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9622083-cbd7-48f1-b316-499238dbda7d" containerName="payload-processing"
Jul 24 17:31:08.220103 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:08.220025    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8db86e81-fc66-4831-a8ba-d36414a42d05" containerName="payload-pre-processing"
Jul 24 17:31:08.220103 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:08.220036    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8db86e81-fc66-4831-a8ba-d36414a42d05" containerName="payload-pre-processing"
Jul 24 17:31:08.220278 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:08.220152    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9622083-cbd7-48f1-b316-499238dbda7d" containerName="payload-processing"
Jul 24 17:31:08.220278 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:08.220166    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="8db86e81-fc66-4831-a8ba-d36414a42d05" containerName="payload-pre-processing"
Jul 24 17:31:08.223015 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:08.222995    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx"
Jul 24 17:31:08.225377 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:08.225356    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-1f216bac-openshift-default-dockercfg-dxd98\""
Jul 24 17:31:08.237053 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:08.237032    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx"]
Jul 24 17:31:08.317712 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:08.317681    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7989d9a1-f600-4fc7-b317-e131daa51c3b-istio-podinfo\") pod \"e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx\" (UID: \"7989d9a1-f600-4fc7-b317-e131daa51c3b\") " pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx"
Jul 24 17:31:08.317905 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:08.317733    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7989d9a1-f600-4fc7-b317-e131daa51c3b-istio-data\") pod \"e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx\" (UID: \"7989d9a1-f600-4fc7-b317-e131daa51c3b\") " pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx"
Jul 24 17:31:08.317905 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:08.317785    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7989d9a1-f600-4fc7-b317-e131daa51c3b-istio-envoy\") pod \"e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx\" (UID: \"7989d9a1-f600-4fc7-b317-e131daa51c3b\") " pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx"
Jul 24 17:31:08.317905 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:08.317841    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7989d9a1-f600-4fc7-b317-e131daa51c3b-workload-socket\") pod \"e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx\" (UID: \"7989d9a1-f600-4fc7-b317-e131daa51c3b\") " pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx"
Jul 24 17:31:08.317905 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:08.317895    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7989d9a1-f600-4fc7-b317-e131daa51c3b-istiod-ca-cert\") pod \"e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx\" (UID: \"7989d9a1-f600-4fc7-b317-e131daa51c3b\") " pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx"
Jul 24 17:31:08.318163 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:08.318019    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7989d9a1-f600-4fc7-b317-e131daa51c3b-credential-socket\") pod \"e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx\" (UID: \"7989d9a1-f600-4fc7-b317-e131daa51c3b\") " pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx"
Jul 24 17:31:08.318163 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:08.318106    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dwhd\" (UniqueName: \"kubernetes.io/projected/7989d9a1-f600-4fc7-b317-e131daa51c3b-kube-api-access-9dwhd\") pod \"e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx\" (UID: \"7989d9a1-f600-4fc7-b317-e131daa51c3b\") " pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx"
Jul 24 17:31:08.318163 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:08.318137    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7989d9a1-f600-4fc7-b317-e131daa51c3b-istio-token\") pod \"e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx\" (UID: \"7989d9a1-f600-4fc7-b317-e131daa51c3b\") " pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx"
Jul 24 17:31:08.318276 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:08.318221    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7989d9a1-f600-4fc7-b317-e131daa51c3b-workload-certs\") pod \"e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx\" (UID: \"7989d9a1-f600-4fc7-b317-e131daa51c3b\") " pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx"
Jul 24 17:31:08.419014 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:08.418980    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7989d9a1-f600-4fc7-b317-e131daa51c3b-istio-podinfo\") pod \"e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx\" (UID: \"7989d9a1-f600-4fc7-b317-e131daa51c3b\") " pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx"
Jul 24 17:31:08.419404 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:08.419026    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7989d9a1-f600-4fc7-b317-e131daa51c3b-istio-data\") pod \"e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx\" (UID: \"7989d9a1-f600-4fc7-b317-e131daa51c3b\") " pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx"
Jul 24 17:31:08.419404 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:08.419074    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7989d9a1-f600-4fc7-b317-e131daa51c3b-istio-envoy\") pod \"e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx\" (UID: \"7989d9a1-f600-4fc7-b317-e131daa51c3b\") " pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx"
Jul 24 17:31:08.419404 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:08.419111    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7989d9a1-f600-4fc7-b317-e131daa51c3b-workload-socket\") pod \"e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx\" (UID: \"7989d9a1-f600-4fc7-b317-e131daa51c3b\") " pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx"
Jul 24 17:31:08.419404 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:08.419167    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7989d9a1-f600-4fc7-b317-e131daa51c3b-istiod-ca-cert\") pod \"e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx\" (UID: \"7989d9a1-f600-4fc7-b317-e131daa51c3b\") " pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx"
Jul 24 17:31:08.419404 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:08.419233    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7989d9a1-f600-4fc7-b317-e131daa51c3b-credential-socket\") pod \"e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx\" (UID: \"7989d9a1-f600-4fc7-b317-e131daa51c3b\") " pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx"
Jul 24 17:31:08.419404 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:08.419265    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dwhd\" (UniqueName: \"kubernetes.io/projected/7989d9a1-f600-4fc7-b317-e131daa51c3b-kube-api-access-9dwhd\") pod \"e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx\" (UID: \"7989d9a1-f600-4fc7-b317-e131daa51c3b\") " pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx"
Jul 24 17:31:08.419746 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:08.419446    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7989d9a1-f600-4fc7-b317-e131daa51c3b-istio-token\") pod \"e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx\" (UID: \"7989d9a1-f600-4fc7-b317-e131daa51c3b\") " pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx"
Jul 24 17:31:08.419814 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:08.419754    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7989d9a1-f600-4fc7-b317-e131daa51c3b-workload-certs\") pod \"e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx\" (UID: \"7989d9a1-f600-4fc7-b317-e131daa51c3b\") " pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx"
Jul 24 17:31:08.419814 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:08.419517    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7989d9a1-f600-4fc7-b317-e131daa51c3b-istio-data\") pod \"e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx\" (UID: \"7989d9a1-f600-4fc7-b317-e131daa51c3b\") " pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx"
Jul 24 17:31:08.419814 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:08.419679    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7989d9a1-f600-4fc7-b317-e131daa51c3b-credential-socket\") pod \"e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx\" (UID: \"7989d9a1-f600-4fc7-b317-e131daa51c3b\") " pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx"
Jul 24 17:31:08.419814 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:08.419562    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7989d9a1-f600-4fc7-b317-e131daa51c3b-workload-socket\") pod \"e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx\" (UID: \"7989d9a1-f600-4fc7-b317-e131daa51c3b\") " pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx"
Jul 24 17:31:08.420024 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:08.419995    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7989d9a1-f600-4fc7-b317-e131daa51c3b-istiod-ca-cert\") pod \"e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx\" (UID: \"7989d9a1-f600-4fc7-b317-e131daa51c3b\") " pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx"
Jul 24 17:31:08.420115 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:08.420093    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7989d9a1-f600-4fc7-b317-e131daa51c3b-workload-certs\") pod \"e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx\" (UID: \"7989d9a1-f600-4fc7-b317-e131daa51c3b\") " pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx"
Jul 24 17:31:08.421257 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:08.421226    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7989d9a1-f600-4fc7-b317-e131daa51c3b-istio-envoy\") pod \"e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx\" (UID: \"7989d9a1-f600-4fc7-b317-e131daa51c3b\") " pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx"
Jul 24 17:31:08.421488 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:08.421469    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7989d9a1-f600-4fc7-b317-e131daa51c3b-istio-podinfo\") pod \"e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx\" (UID: \"7989d9a1-f600-4fc7-b317-e131daa51c3b\") " pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx"
Jul 24 17:31:08.427443 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:08.427418    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7989d9a1-f600-4fc7-b317-e131daa51c3b-istio-token\") pod \"e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx\" (UID: \"7989d9a1-f600-4fc7-b317-e131daa51c3b\") " pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx"
Jul 24 17:31:08.427728 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:08.427710    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dwhd\" (UniqueName: \"kubernetes.io/projected/7989d9a1-f600-4fc7-b317-e131daa51c3b-kube-api-access-9dwhd\") pod \"e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx\" (UID: \"7989d9a1-f600-4fc7-b317-e131daa51c3b\") " pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx"
Jul 24 17:31:08.532356 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:08.532270    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx"
Jul 24 17:31:08.663136 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:08.663113    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx"]
Jul 24 17:31:08.665103 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:31:08.665077    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7989d9a1_f600_4fc7_b317_e131daa51c3b.slice/crio-5efb4e96e23607c672082414f95c93447de7e1e9b1b3bf69082e92f560d90645 WatchSource:0}: Error finding container 5efb4e96e23607c672082414f95c93447de7e1e9b1b3bf69082e92f560d90645: Status 404 returned error can't find the container with id 5efb4e96e23607c672082414f95c93447de7e1e9b1b3bf69082e92f560d90645
Jul 24 17:31:08.667433 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:08.667404    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:31:08.667528 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:08.667476    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:31:08.667528 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:08.667510    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:31:08.920038 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:08.920004    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx" event={"ID":"7989d9a1-f600-4fc7-b317-e131daa51c3b","Type":"ContainerStarted","Data":"68848c519c1aed019b164db6cd758300881a625e679bf6c153eeca95ba70f049"}
Jul 24 17:31:08.920228 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:08.920085    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx" event={"ID":"7989d9a1-f600-4fc7-b317-e131daa51c3b","Type":"ContainerStarted","Data":"5efb4e96e23607c672082414f95c93447de7e1e9b1b3bf69082e92f560d90645"}
Jul 24 17:31:08.985639 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:08.985588    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx" podStartSLOduration=0.985574137 podStartE2EDuration="985.574137ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:31:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:31:08.983511428 +0000 UTC m=+1653.256371228" watchObservedRunningTime="2026-07-24 17:31:08.985574137 +0000 UTC m=+1653.258433917"
Jul 24 17:31:09.533439 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:09.533406    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx"
Jul 24 17:31:09.538186 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:09.538164    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx"
Jul 24 17:31:09.925360 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:09.925323    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx"
Jul 24 17:31:09.926330 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:09.926306    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx"
Jul 24 17:31:11.149437 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:11.149406    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1f216bac-6bcdf9f5f6-mxrkz"]
Jul 24 17:31:11.152883 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:11.152866    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-1f216bac-6bcdf9f5f6-mxrkz"
Jul 24 17:31:11.155507 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:11.155488    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-1f216bac-dockercfg-bq82x\""
Jul 24 17:31:11.155507 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:11.155501    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-1f216bac\""
Jul 24 17:31:11.165225 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:11.165203    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1f216bac-6bcdf9f5f6-mxrkz"]
Jul 24 17:31:11.247571 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:11.247539    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d275119f-9418-44f7-b83a-3bb2aff4e1fd-plugins-config-volume\") pod \"payload-processing-e2e-ait-1f216bac-6bcdf9f5f6-mxrkz\" (UID: \"d275119f-9418-44f7-b83a-3bb2aff4e1fd\") " pod="openshift-ingress/payload-processing-e2e-ait-1f216bac-6bcdf9f5f6-mxrkz"
Jul 24 17:31:11.247747 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:11.247648    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnh7k\" (UniqueName: \"kubernetes.io/projected/d275119f-9418-44f7-b83a-3bb2aff4e1fd-kube-api-access-bnh7k\") pod \"payload-processing-e2e-ait-1f216bac-6bcdf9f5f6-mxrkz\" (UID: \"d275119f-9418-44f7-b83a-3bb2aff4e1fd\") " pod="openshift-ingress/payload-processing-e2e-ait-1f216bac-6bcdf9f5f6-mxrkz"
Jul 24 17:31:11.348839 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:11.348801    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d275119f-9418-44f7-b83a-3bb2aff4e1fd-plugins-config-volume\") pod \"payload-processing-e2e-ait-1f216bac-6bcdf9f5f6-mxrkz\" (UID: \"d275119f-9418-44f7-b83a-3bb2aff4e1fd\") " pod="openshift-ingress/payload-processing-e2e-ait-1f216bac-6bcdf9f5f6-mxrkz"
Jul 24 17:31:11.349104 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:11.348853    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnh7k\" (UniqueName: \"kubernetes.io/projected/d275119f-9418-44f7-b83a-3bb2aff4e1fd-kube-api-access-bnh7k\") pod \"payload-processing-e2e-ait-1f216bac-6bcdf9f5f6-mxrkz\" (UID: \"d275119f-9418-44f7-b83a-3bb2aff4e1fd\") " pod="openshift-ingress/payload-processing-e2e-ait-1f216bac-6bcdf9f5f6-mxrkz"
Jul 24 17:31:11.349656 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:11.349629    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d275119f-9418-44f7-b83a-3bb2aff4e1fd-plugins-config-volume\") pod \"payload-processing-e2e-ait-1f216bac-6bcdf9f5f6-mxrkz\" (UID: \"d275119f-9418-44f7-b83a-3bb2aff4e1fd\") " pod="openshift-ingress/payload-processing-e2e-ait-1f216bac-6bcdf9f5f6-mxrkz"
Jul 24 17:31:11.357516 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:11.357494    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnh7k\" (UniqueName: \"kubernetes.io/projected/d275119f-9418-44f7-b83a-3bb2aff4e1fd-kube-api-access-bnh7k\") pod \"payload-processing-e2e-ait-1f216bac-6bcdf9f5f6-mxrkz\" (UID: \"d275119f-9418-44f7-b83a-3bb2aff4e1fd\") " pod="openshift-ingress/payload-processing-e2e-ait-1f216bac-6bcdf9f5f6-mxrkz"
Jul 24 17:31:11.464964 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:11.464886    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-1f216bac-6bcdf9f5f6-mxrkz"
Jul 24 17:31:11.594493 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:11.594472    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1f216bac-6bcdf9f5f6-mxrkz"]
Jul 24 17:31:11.596943 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:31:11.596912    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd275119f_9418_44f7_b83a_3bb2aff4e1fd.slice/crio-187acfad8274f3582ca0112d44ce02a7a325b282e0ab82047a9db29c9c6cae2e WatchSource:0}: Error finding container 187acfad8274f3582ca0112d44ce02a7a325b282e0ab82047a9db29c9c6cae2e: Status 404 returned error can't find the container with id 187acfad8274f3582ca0112d44ce02a7a325b282e0ab82047a9db29c9c6cae2e
Jul 24 17:31:11.936519 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:11.936486    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-1f216bac-6bcdf9f5f6-mxrkz" event={"ID":"d275119f-9418-44f7-b83a-3bb2aff4e1fd","Type":"ContainerStarted","Data":"2a74275285f21c56e97b7e5e3cc6261dd3e7c7ccf7ce343f5f18e6f2e2caed74"}
Jul 24 17:31:11.936720 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:11.936539    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-1f216bac-6bcdf9f5f6-mxrkz" event={"ID":"d275119f-9418-44f7-b83a-3bb2aff4e1fd","Type":"ContainerStarted","Data":"187acfad8274f3582ca0112d44ce02a7a325b282e0ab82047a9db29c9c6cae2e"}
Jul 24 17:31:11.936720 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:11.936575    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-1f216bac-6bcdf9f5f6-mxrkz"
Jul 24 17:31:11.958162 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:11.958117    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-1f216bac-6bcdf9f5f6-mxrkz" podStartSLOduration=0.958093634 podStartE2EDuration="958.093634ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:31:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:31:11.956195802 +0000 UTC m=+1656.229055608" watchObservedRunningTime="2026-07-24 17:31:11.958093634 +0000 UTC m=+1656.230953413"
Jul 24 17:31:12.651845 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:12.651822    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh"
Jul 24 17:31:12.760819 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:12.760733    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5nw8s\" (UniqueName: \"kubernetes.io/projected/a750dd0e-a6e4-43d9-af1e-d3545032edde-kube-api-access-5nw8s\") pod \"a750dd0e-a6e4-43d9-af1e-d3545032edde\" (UID: \"a750dd0e-a6e4-43d9-af1e-d3545032edde\") "
Jul 24 17:31:12.760819 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:12.760769    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a750dd0e-a6e4-43d9-af1e-d3545032edde-workload-certs\") pod \"a750dd0e-a6e4-43d9-af1e-d3545032edde\" (UID: \"a750dd0e-a6e4-43d9-af1e-d3545032edde\") "
Jul 24 17:31:12.760819 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:12.760804    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a750dd0e-a6e4-43d9-af1e-d3545032edde-istiod-ca-cert\") pod \"a750dd0e-a6e4-43d9-af1e-d3545032edde\" (UID: \"a750dd0e-a6e4-43d9-af1e-d3545032edde\") "
Jul 24 17:31:12.761212 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:12.760843    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a750dd0e-a6e4-43d9-af1e-d3545032edde-istio-envoy\") pod \"a750dd0e-a6e4-43d9-af1e-d3545032edde\" (UID: \"a750dd0e-a6e4-43d9-af1e-d3545032edde\") "
Jul 24 17:31:12.761212 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:12.760879    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a750dd0e-a6e4-43d9-af1e-d3545032edde-istio-token\") pod \"a750dd0e-a6e4-43d9-af1e-d3545032edde\" (UID: \"a750dd0e-a6e4-43d9-af1e-d3545032edde\") "
Jul 24 17:31:12.761212 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:12.760912    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a750dd0e-a6e4-43d9-af1e-d3545032edde-istio-data\") pod \"a750dd0e-a6e4-43d9-af1e-d3545032edde\" (UID: \"a750dd0e-a6e4-43d9-af1e-d3545032edde\") "
Jul 24 17:31:12.761212 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:12.760965    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a750dd0e-a6e4-43d9-af1e-d3545032edde-workload-socket\") pod \"a750dd0e-a6e4-43d9-af1e-d3545032edde\" (UID: \"a750dd0e-a6e4-43d9-af1e-d3545032edde\") "
Jul 24 17:31:12.761212 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:12.761008    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a750dd0e-a6e4-43d9-af1e-d3545032edde-istio-podinfo\") pod \"a750dd0e-a6e4-43d9-af1e-d3545032edde\" (UID: \"a750dd0e-a6e4-43d9-af1e-d3545032edde\") "
Jul 24 17:31:12.761212 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:12.761092    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a750dd0e-a6e4-43d9-af1e-d3545032edde-credential-socket\") pod \"a750dd0e-a6e4-43d9-af1e-d3545032edde\" (UID: \"a750dd0e-a6e4-43d9-af1e-d3545032edde\") "
Jul 24 17:31:12.761212 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:12.761097    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a750dd0e-a6e4-43d9-af1e-d3545032edde-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a750dd0e-a6e4-43d9-af1e-d3545032edde" (UID: "a750dd0e-a6e4-43d9-af1e-d3545032edde"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:31:12.762731 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:12.761340    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a750dd0e-a6e4-43d9-af1e-d3545032edde-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a750dd0e-a6e4-43d9-af1e-d3545032edde" (UID: "a750dd0e-a6e4-43d9-af1e-d3545032edde"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:31:12.762731 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:12.761384    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a750dd0e-a6e4-43d9-af1e-d3545032edde-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a750dd0e-a6e4-43d9-af1e-d3545032edde" (UID: "a750dd0e-a6e4-43d9-af1e-d3545032edde"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:31:12.762731 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:12.761473    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a750dd0e-a6e4-43d9-af1e-d3545032edde-workload-socket\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:31:12.762731 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:12.761491    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a750dd0e-a6e4-43d9-af1e-d3545032edde-workload-certs\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:31:12.762731 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:12.761513    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a750dd0e-a6e4-43d9-af1e-d3545032edde-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a750dd0e-a6e4-43d9-af1e-d3545032edde" (UID: "a750dd0e-a6e4-43d9-af1e-d3545032edde"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:31:12.762731 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:12.762316    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a750dd0e-a6e4-43d9-af1e-d3545032edde-istio-data" (OuterVolumeSpecName: "istio-data") pod "a750dd0e-a6e4-43d9-af1e-d3545032edde" (UID: "a750dd0e-a6e4-43d9-af1e-d3545032edde"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:31:12.763309 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:12.763205    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a750dd0e-a6e4-43d9-af1e-d3545032edde-kube-api-access-5nw8s" (OuterVolumeSpecName: "kube-api-access-5nw8s") pod "a750dd0e-a6e4-43d9-af1e-d3545032edde" (UID: "a750dd0e-a6e4-43d9-af1e-d3545032edde"). InnerVolumeSpecName "kube-api-access-5nw8s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:31:12.763559 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:12.763514    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a750dd0e-a6e4-43d9-af1e-d3545032edde-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a750dd0e-a6e4-43d9-af1e-d3545032edde" (UID: "a750dd0e-a6e4-43d9-af1e-d3545032edde"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 17:31:12.763822 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:12.763803    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a750dd0e-a6e4-43d9-af1e-d3545032edde-istio-token" (OuterVolumeSpecName: "istio-token") pod "a750dd0e-a6e4-43d9-af1e-d3545032edde" (UID: "a750dd0e-a6e4-43d9-af1e-d3545032edde"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:31:12.764002 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:12.763978    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a750dd0e-a6e4-43d9-af1e-d3545032edde-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a750dd0e-a6e4-43d9-af1e-d3545032edde" (UID: "a750dd0e-a6e4-43d9-af1e-d3545032edde"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:31:12.862976 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:12.862941    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a750dd0e-a6e4-43d9-af1e-d3545032edde-istio-podinfo\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:31:12.862976 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:12.862969    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a750dd0e-a6e4-43d9-af1e-d3545032edde-credential-socket\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:31:12.862976 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:12.862979    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5nw8s\" (UniqueName: \"kubernetes.io/projected/a750dd0e-a6e4-43d9-af1e-d3545032edde-kube-api-access-5nw8s\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:31:12.863221 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:12.862992    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a750dd0e-a6e4-43d9-af1e-d3545032edde-istiod-ca-cert\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:31:12.863221 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:12.863001    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a750dd0e-a6e4-43d9-af1e-d3545032edde-istio-envoy\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:31:12.863221 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:12.863010    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a750dd0e-a6e4-43d9-af1e-d3545032edde-istio-token\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:31:12.863221 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:12.863017    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a750dd0e-a6e4-43d9-af1e-d3545032edde-istio-data\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:31:12.942879 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:12.942850    2561 generic.go:356] "Generic (PLEG): container finished" podID="a750dd0e-a6e4-43d9-af1e-d3545032edde" containerID="60d506db0fe44676e72900d45955d4290343262fd1915bcc98b58c8ae6c5e1d5" exitCode=0
Jul 24 17:31:12.943102 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:12.942899    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh"
Jul 24 17:31:12.943102 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:12.942932    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh" event={"ID":"a750dd0e-a6e4-43d9-af1e-d3545032edde","Type":"ContainerDied","Data":"60d506db0fe44676e72900d45955d4290343262fd1915bcc98b58c8ae6c5e1d5"}
Jul 24 17:31:12.943102 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:12.942994    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh" event={"ID":"a750dd0e-a6e4-43d9-af1e-d3545032edde","Type":"ContainerDied","Data":"8b367f698ff5e4131779a324311c818d9fccf414e7ff74a745eb56fdd6dbdeea"}
Jul 24 17:31:12.943102 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:12.943017    2561 scope.go:117] "RemoveContainer" containerID="60d506db0fe44676e72900d45955d4290343262fd1915bcc98b58c8ae6c5e1d5"
Jul 24 17:31:12.953711 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:12.953641    2561 scope.go:117] "RemoveContainer" containerID="caef335ff8678185a12bce1f6d1bffd35aa6831661c03484353086cc2cf9d7b8"
Jul 24 17:31:12.963505 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:12.963478    2561 scope.go:117] "RemoveContainer" containerID="60d506db0fe44676e72900d45955d4290343262fd1915bcc98b58c8ae6c5e1d5"
Jul 24 17:31:12.963865 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:31:12.963829    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60d506db0fe44676e72900d45955d4290343262fd1915bcc98b58c8ae6c5e1d5\": container with ID starting with 60d506db0fe44676e72900d45955d4290343262fd1915bcc98b58c8ae6c5e1d5 not found: ID does not exist" containerID="60d506db0fe44676e72900d45955d4290343262fd1915bcc98b58c8ae6c5e1d5"
Jul 24 17:31:12.963990 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:12.963934    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60d506db0fe44676e72900d45955d4290343262fd1915bcc98b58c8ae6c5e1d5"} err="failed to get container status \"60d506db0fe44676e72900d45955d4290343262fd1915bcc98b58c8ae6c5e1d5\": rpc error: code = NotFound desc = could not find container \"60d506db0fe44676e72900d45955d4290343262fd1915bcc98b58c8ae6c5e1d5\": container with ID starting with 60d506db0fe44676e72900d45955d4290343262fd1915bcc98b58c8ae6c5e1d5 not found: ID does not exist"
Jul 24 17:31:12.963990 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:12.963983    2561 scope.go:117] "RemoveContainer" containerID="caef335ff8678185a12bce1f6d1bffd35aa6831661c03484353086cc2cf9d7b8"
Jul 24 17:31:12.964582 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:31:12.964332    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"caef335ff8678185a12bce1f6d1bffd35aa6831661c03484353086cc2cf9d7b8\": container with ID starting with caef335ff8678185a12bce1f6d1bffd35aa6831661c03484353086cc2cf9d7b8 not found: ID does not exist" containerID="caef335ff8678185a12bce1f6d1bffd35aa6831661c03484353086cc2cf9d7b8"
Jul 24 17:31:12.964582 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:12.964364    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"caef335ff8678185a12bce1f6d1bffd35aa6831661c03484353086cc2cf9d7b8"} err="failed to get container status \"caef335ff8678185a12bce1f6d1bffd35aa6831661c03484353086cc2cf9d7b8\": rpc error: code = NotFound desc = could not find container \"caef335ff8678185a12bce1f6d1bffd35aa6831661c03484353086cc2cf9d7b8\": container with ID starting with caef335ff8678185a12bce1f6d1bffd35aa6831661c03484353086cc2cf9d7b8 not found: ID does not exist"
Jul 24 17:31:12.966381 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:12.966362    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh"]
Jul 24 17:31:12.971227 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:12.971200    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-1f7abc01-gw-openshift-default-56c65cfddd-z24jh"]
Jul 24 17:31:14.258655 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:14.258622    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a750dd0e-a6e4-43d9-af1e-d3545032edde" path="/var/lib/kubelet/pods/a750dd0e-a6e4-43d9-af1e-d3545032edde/volumes"
Jul 24 17:31:22.946036 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:22.946011    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-1f216bac-6bcdf9f5f6-mxrkz"
Jul 24 17:31:25.110654 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:25.110627    2561 patch_prober.go:28] interesting pod/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": read tcp 10.134.0.2:32936->10.134.0.50:15021: read: connection reset by peer" start-of-body=
Jul 24 17:31:25.111002 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:25.110686    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx" podUID="7989d9a1-f600-4fc7-b317-e131daa51c3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": read tcp 10.134.0.2:32936->10.134.0.50:15021: read: connection reset by peer"
Jul 24 17:31:26.013918 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:26.013886    2561 generic.go:356] "Generic (PLEG): container finished" podID="7989d9a1-f600-4fc7-b317-e131daa51c3b" containerID="68848c519c1aed019b164db6cd758300881a625e679bf6c153eeca95ba70f049" exitCode=0
Jul 24 17:31:26.014109 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:26.013969    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx" event={"ID":"7989d9a1-f600-4fc7-b317-e131daa51c3b","Type":"ContainerDied","Data":"68848c519c1aed019b164db6cd758300881a625e679bf6c153eeca95ba70f049"}
Jul 24 17:31:26.014377 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:26.014362    2561 scope.go:117] "RemoveContainer" containerID="68848c519c1aed019b164db6cd758300881a625e679bf6c153eeca95ba70f049"
Jul 24 17:31:26.015346 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:26.015320    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:31:26.015403 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:26.015384    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:31:26.015438 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:26.015419    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:31:27.020469 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:27.020439    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx" event={"ID":"7989d9a1-f600-4fc7-b317-e131daa51c3b","Type":"ContainerStarted","Data":"e3a9620f15f490163f4662dbca39e8fa014eb0b13ccff59277fe01fdce5ec872"}
Jul 24 17:31:27.533512 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:27.533476    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx"
Jul 24 17:31:27.533745 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:27.533723    2561 patch_prober.go:28] interesting pod/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 24 17:31:27.533799 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:27.533771    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx" podUID="7989d9a1-f600-4fc7-b317-e131daa51c3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 24 17:31:28.533033 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:28.532994    2561 patch_prober.go:28] interesting pod/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 24 17:31:28.533470 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:28.533103    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx" podUID="7989d9a1-f600-4fc7-b317-e131daa51c3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 24 17:31:29.533627 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:29.533588    2561 patch_prober.go:28] interesting pod/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 24 17:31:29.534010 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:29.533659    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx" podUID="7989d9a1-f600-4fc7-b317-e131daa51c3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 24 17:31:30.533532 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:30.533497    2561 patch_prober.go:28] interesting pod/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 24 17:31:30.533707 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:30.533555    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx" podUID="7989d9a1-f600-4fc7-b317-e131daa51c3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 24 17:31:31.536889 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:31.536857    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx"
Jul 24 17:31:31.537314 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:31.537116    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx"
Jul 24 17:31:31.537783 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:31.537767    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx"
Jul 24 17:31:46.924222 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:46.924179    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1f216bac-6bcdf9f5f6-mxrkz"]
Jul 24 17:31:46.924768 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:46.924492    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-1f216bac-6bcdf9f5f6-mxrkz" podUID="d275119f-9418-44f7-b83a-3bb2aff4e1fd" containerName="payload-processing" containerID="cri-o://2a74275285f21c56e97b7e5e3cc6261dd3e7c7ccf7ce343f5f18e6f2e2caed74" gracePeriod=30
Jul 24 17:31:47.124613 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:47.124522    2561 generic.go:356] "Generic (PLEG): container finished" podID="d275119f-9418-44f7-b83a-3bb2aff4e1fd" containerID="2a74275285f21c56e97b7e5e3cc6261dd3e7c7ccf7ce343f5f18e6f2e2caed74" exitCode=0
Jul 24 17:31:47.125142 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:47.124876    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-1f216bac-6bcdf9f5f6-mxrkz" event={"ID":"d275119f-9418-44f7-b83a-3bb2aff4e1fd","Type":"ContainerDied","Data":"2a74275285f21c56e97b7e5e3cc6261dd3e7c7ccf7ce343f5f18e6f2e2caed74"}
Jul 24 17:31:47.182344 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:47.182283    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-1f216bac-6bcdf9f5f6-mxrkz"
Jul 24 17:31:47.278879 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:47.278847    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bnh7k\" (UniqueName: \"kubernetes.io/projected/d275119f-9418-44f7-b83a-3bb2aff4e1fd-kube-api-access-bnh7k\") pod \"d275119f-9418-44f7-b83a-3bb2aff4e1fd\" (UID: \"d275119f-9418-44f7-b83a-3bb2aff4e1fd\") "
Jul 24 17:31:47.279096 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:47.278940    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d275119f-9418-44f7-b83a-3bb2aff4e1fd-plugins-config-volume\") pod \"d275119f-9418-44f7-b83a-3bb2aff4e1fd\" (UID: \"d275119f-9418-44f7-b83a-3bb2aff4e1fd\") "
Jul 24 17:31:47.279326 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:47.279301    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d275119f-9418-44f7-b83a-3bb2aff4e1fd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d275119f-9418-44f7-b83a-3bb2aff4e1fd" (UID: "d275119f-9418-44f7-b83a-3bb2aff4e1fd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:31:47.280986 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:47.280964    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d275119f-9418-44f7-b83a-3bb2aff4e1fd-kube-api-access-bnh7k" (OuterVolumeSpecName: "kube-api-access-bnh7k") pod "d275119f-9418-44f7-b83a-3bb2aff4e1fd" (UID: "d275119f-9418-44f7-b83a-3bb2aff4e1fd"). InnerVolumeSpecName "kube-api-access-bnh7k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:31:47.380416 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:47.380382    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d275119f-9418-44f7-b83a-3bb2aff4e1fd-plugins-config-volume\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:31:47.380416 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:47.380403    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bnh7k\" (UniqueName: \"kubernetes.io/projected/d275119f-9418-44f7-b83a-3bb2aff4e1fd-kube-api-access-bnh7k\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:31:48.131131 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:48.131102    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-1f216bac-6bcdf9f5f6-mxrkz"
Jul 24 17:31:48.131131 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:48.131119    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-1f216bac-6bcdf9f5f6-mxrkz" event={"ID":"d275119f-9418-44f7-b83a-3bb2aff4e1fd","Type":"ContainerDied","Data":"187acfad8274f3582ca0112d44ce02a7a325b282e0ab82047a9db29c9c6cae2e"}
Jul 24 17:31:48.131583 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:48.131178    2561 scope.go:117] "RemoveContainer" containerID="2a74275285f21c56e97b7e5e3cc6261dd3e7c7ccf7ce343f5f18e6f2e2caed74"
Jul 24 17:31:48.152380 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:48.152359    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1f216bac-6bcdf9f5f6-mxrkz"]
Jul 24 17:31:48.156473 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:48.156453    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1f216bac-6bcdf9f5f6-mxrkz"]
Jul 24 17:31:48.258777 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:48.258741    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d275119f-9418-44f7-b83a-3bb2aff4e1fd" path="/var/lib/kubelet/pods/d275119f-9418-44f7-b83a-3bb2aff4e1fd/volumes"
Jul 24 17:31:52.548940 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:52.548911    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx"]
Jul 24 17:31:52.549369 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:52.549119    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx" podUID="7989d9a1-f600-4fc7-b317-e131daa51c3b" containerName="istio-proxy" containerID="cri-o://e3a9620f15f490163f4662dbca39e8fa014eb0b13ccff59277fe01fdce5ec872" gracePeriod=30
Jul 24 17:31:53.311162 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:53.311129    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx"]
Jul 24 17:31:53.311575 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:53.311558    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d275119f-9418-44f7-b83a-3bb2aff4e1fd" containerName="payload-processing"
Jul 24 17:31:53.311677 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:53.311578    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d275119f-9418-44f7-b83a-3bb2aff4e1fd" containerName="payload-processing"
Jul 24 17:31:53.311677 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:53.311597    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a750dd0e-a6e4-43d9-af1e-d3545032edde" containerName="istio-proxy"
Jul 24 17:31:53.311677 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:53.311605    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a750dd0e-a6e4-43d9-af1e-d3545032edde" containerName="istio-proxy"
Jul 24 17:31:53.311677 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:53.311649    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a750dd0e-a6e4-43d9-af1e-d3545032edde" containerName="istio-proxy"
Jul 24 17:31:53.311677 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:53.311658    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a750dd0e-a6e4-43d9-af1e-d3545032edde" containerName="istio-proxy"
Jul 24 17:31:53.311926 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:53.311740    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d275119f-9418-44f7-b83a-3bb2aff4e1fd" containerName="payload-processing"
Jul 24 17:31:53.311926 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:53.311757    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a750dd0e-a6e4-43d9-af1e-d3545032edde" containerName="istio-proxy"
Jul 24 17:31:53.315789 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:53.315768    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx"
Jul 24 17:31:53.318402 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:53.318383    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-deb90cc5-openshift-default-dockercfg-dqm74\""
Jul 24 17:31:53.326259 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:53.326236    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx"]
Jul 24 17:31:53.337420 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:53.337392    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e17b84ae-228d-4357-9f33-184103b8ca6d-istiod-ca-cert\") pod \"e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx\" (UID: \"e17b84ae-228d-4357-9f33-184103b8ca6d\") " pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx"
Jul 24 17:31:53.337508 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:53.337447    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e17b84ae-228d-4357-9f33-184103b8ca6d-workload-certs\") pod \"e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx\" (UID: \"e17b84ae-228d-4357-9f33-184103b8ca6d\") " pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx"
Jul 24 17:31:53.337508 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:53.337488    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e17b84ae-228d-4357-9f33-184103b8ca6d-istio-data\") pod \"e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx\" (UID: \"e17b84ae-228d-4357-9f33-184103b8ca6d\") " pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx"
Jul 24 17:31:53.337579 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:53.337556    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e17b84ae-228d-4357-9f33-184103b8ca6d-istio-podinfo\") pod \"e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx\" (UID: \"e17b84ae-228d-4357-9f33-184103b8ca6d\") " pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx"
Jul 24 17:31:53.337640 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:53.337626    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e17b84ae-228d-4357-9f33-184103b8ca6d-credential-socket\") pod \"e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx\" (UID: \"e17b84ae-228d-4357-9f33-184103b8ca6d\") " pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx"
Jul 24 17:31:53.337683 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:53.337662    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e17b84ae-228d-4357-9f33-184103b8ca6d-workload-socket\") pod \"e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx\" (UID: \"e17b84ae-228d-4357-9f33-184103b8ca6d\") " pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx"
Jul 24 17:31:53.337731 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:53.337687    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e17b84ae-228d-4357-9f33-184103b8ca6d-istio-token\") pod \"e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx\" (UID: \"e17b84ae-228d-4357-9f33-184103b8ca6d\") " pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx"
Jul 24 17:31:53.337818 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:53.337798    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e17b84ae-228d-4357-9f33-184103b8ca6d-istio-envoy\") pod \"e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx\" (UID: \"e17b84ae-228d-4357-9f33-184103b8ca6d\") " pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx"
Jul 24 17:31:53.337876 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:53.337857    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kblbf\" (UniqueName: \"kubernetes.io/projected/e17b84ae-228d-4357-9f33-184103b8ca6d-kube-api-access-kblbf\") pod \"e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx\" (UID: \"e17b84ae-228d-4357-9f33-184103b8ca6d\") " pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx"
Jul 24 17:31:53.438308 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:53.438281    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e17b84ae-228d-4357-9f33-184103b8ca6d-istio-envoy\") pod \"e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx\" (UID: \"e17b84ae-228d-4357-9f33-184103b8ca6d\") " pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx"
Jul 24 17:31:53.438508 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:53.438324    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kblbf\" (UniqueName: \"kubernetes.io/projected/e17b84ae-228d-4357-9f33-184103b8ca6d-kube-api-access-kblbf\") pod \"e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx\" (UID: \"e17b84ae-228d-4357-9f33-184103b8ca6d\") " pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx"
Jul 24 17:31:53.438508 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:53.438350    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e17b84ae-228d-4357-9f33-184103b8ca6d-istiod-ca-cert\") pod \"e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx\" (UID: \"e17b84ae-228d-4357-9f33-184103b8ca6d\") " pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx"
Jul 24 17:31:53.438508 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:53.438374    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e17b84ae-228d-4357-9f33-184103b8ca6d-workload-certs\") pod \"e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx\" (UID: \"e17b84ae-228d-4357-9f33-184103b8ca6d\") " pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx"
Jul 24 17:31:53.438508 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:53.438410    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e17b84ae-228d-4357-9f33-184103b8ca6d-istio-data\") pod \"e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx\" (UID: \"e17b84ae-228d-4357-9f33-184103b8ca6d\") " pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx"
Jul 24 17:31:53.438508 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:53.438447    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e17b84ae-228d-4357-9f33-184103b8ca6d-istio-podinfo\") pod \"e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx\" (UID: \"e17b84ae-228d-4357-9f33-184103b8ca6d\") " pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx"
Jul 24 17:31:53.438508 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:53.438477    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e17b84ae-228d-4357-9f33-184103b8ca6d-credential-socket\") pod \"e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx\" (UID: \"e17b84ae-228d-4357-9f33-184103b8ca6d\") " pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx"
Jul 24 17:31:53.438508 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:53.438509    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e17b84ae-228d-4357-9f33-184103b8ca6d-workload-socket\") pod \"e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx\" (UID: \"e17b84ae-228d-4357-9f33-184103b8ca6d\") " pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx"
Jul 24 17:31:53.438894 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:53.438698    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e17b84ae-228d-4357-9f33-184103b8ca6d-istio-token\") pod \"e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx\" (UID: \"e17b84ae-228d-4357-9f33-184103b8ca6d\") " pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx"
Jul 24 17:31:53.438894 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:53.438792    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e17b84ae-228d-4357-9f33-184103b8ca6d-workload-certs\") pod \"e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx\" (UID: \"e17b84ae-228d-4357-9f33-184103b8ca6d\") " pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx"
Jul 24 17:31:53.438894 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:53.438879    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e17b84ae-228d-4357-9f33-184103b8ca6d-istio-data\") pod \"e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx\" (UID: \"e17b84ae-228d-4357-9f33-184103b8ca6d\") " pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx"
Jul 24 17:31:53.439096 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:53.438937    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e17b84ae-228d-4357-9f33-184103b8ca6d-credential-socket\") pod \"e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx\" (UID: \"e17b84ae-228d-4357-9f33-184103b8ca6d\") " pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx"
Jul 24 17:31:53.439096 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:53.439084    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e17b84ae-228d-4357-9f33-184103b8ca6d-workload-socket\") pod \"e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx\" (UID: \"e17b84ae-228d-4357-9f33-184103b8ca6d\") " pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx"
Jul 24 17:31:53.439209 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:53.439189    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e17b84ae-228d-4357-9f33-184103b8ca6d-istiod-ca-cert\") pod \"e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx\" (UID: \"e17b84ae-228d-4357-9f33-184103b8ca6d\") " pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx"
Jul 24 17:31:53.440591 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:53.440573    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e17b84ae-228d-4357-9f33-184103b8ca6d-istio-envoy\") pod \"e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx\" (UID: \"e17b84ae-228d-4357-9f33-184103b8ca6d\") " pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx"
Jul 24 17:31:53.440852 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:53.440832    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e17b84ae-228d-4357-9f33-184103b8ca6d-istio-podinfo\") pod \"e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx\" (UID: \"e17b84ae-228d-4357-9f33-184103b8ca6d\") " pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx"
Jul 24 17:31:53.445808 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:53.445785    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e17b84ae-228d-4357-9f33-184103b8ca6d-istio-token\") pod \"e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx\" (UID: \"e17b84ae-228d-4357-9f33-184103b8ca6d\") " pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx"
Jul 24 17:31:53.446055 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:53.446038    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kblbf\" (UniqueName: \"kubernetes.io/projected/e17b84ae-228d-4357-9f33-184103b8ca6d-kube-api-access-kblbf\") pod \"e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx\" (UID: \"e17b84ae-228d-4357-9f33-184103b8ca6d\") " pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx"
Jul 24 17:31:53.627207 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:53.627177    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx"
Jul 24 17:31:53.767151 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:53.767127    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx"]
Jul 24 17:31:53.769274 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:31:53.769244    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode17b84ae_228d_4357_9f33_184103b8ca6d.slice/crio-2477d19eccbaaad9e0faa0669fb7d83854fe43f787ed03a3c3bc13cf45b47405 WatchSource:0}: Error finding container 2477d19eccbaaad9e0faa0669fb7d83854fe43f787ed03a3c3bc13cf45b47405: Status 404 returned error can't find the container with id 2477d19eccbaaad9e0faa0669fb7d83854fe43f787ed03a3c3bc13cf45b47405
Jul 24 17:31:53.771279 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:53.771251    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:31:53.771363 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:53.771314    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:31:53.771363 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:53.771342    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:31:54.162224 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:54.162182    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx" event={"ID":"e17b84ae-228d-4357-9f33-184103b8ca6d","Type":"ContainerStarted","Data":"99295045695cef287bea132412a52e82a654932da230c2a9dfcf074560564f92"}
Jul 24 17:31:54.162451 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:54.162243    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx" event={"ID":"e17b84ae-228d-4357-9f33-184103b8ca6d","Type":"ContainerStarted","Data":"2477d19eccbaaad9e0faa0669fb7d83854fe43f787ed03a3c3bc13cf45b47405"}
Jul 24 17:31:54.182344 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:54.182298    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx" podStartSLOduration=1.182282407 podStartE2EDuration="1.182282407s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:31:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:31:54.179994383 +0000 UTC m=+1698.452854165" watchObservedRunningTime="2026-07-24 17:31:54.182282407 +0000 UTC m=+1698.455142262"
Jul 24 17:31:54.627657 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:54.627630    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx"
Jul 24 17:31:54.632339 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:54.632316    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx"
Jul 24 17:31:55.166976 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:55.166940    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx"
Jul 24 17:31:55.167809 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:55.167792    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx"
Jul 24 17:31:57.797235 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:57.797209    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx"
Jul 24 17:31:57.877867 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:57.877835    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7989d9a1-f600-4fc7-b317-e131daa51c3b-istio-data\") pod \"7989d9a1-f600-4fc7-b317-e131daa51c3b\" (UID: \"7989d9a1-f600-4fc7-b317-e131daa51c3b\") "
Jul 24 17:31:57.878055 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:57.877899    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7989d9a1-f600-4fc7-b317-e131daa51c3b-istio-envoy\") pod \"7989d9a1-f600-4fc7-b317-e131daa51c3b\" (UID: \"7989d9a1-f600-4fc7-b317-e131daa51c3b\") "
Jul 24 17:31:57.878055 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:57.877942    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7989d9a1-f600-4fc7-b317-e131daa51c3b-istio-podinfo\") pod \"7989d9a1-f600-4fc7-b317-e131daa51c3b\" (UID: \"7989d9a1-f600-4fc7-b317-e131daa51c3b\") "
Jul 24 17:31:57.878055 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:57.877961    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7989d9a1-f600-4fc7-b317-e131daa51c3b-istiod-ca-cert\") pod \"7989d9a1-f600-4fc7-b317-e131daa51c3b\" (UID: \"7989d9a1-f600-4fc7-b317-e131daa51c3b\") "
Jul 24 17:31:57.878055 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:57.877981    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7989d9a1-f600-4fc7-b317-e131daa51c3b-credential-socket\") pod \"7989d9a1-f600-4fc7-b317-e131daa51c3b\" (UID: \"7989d9a1-f600-4fc7-b317-e131daa51c3b\") "
Jul 24 17:31:57.878055 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:57.878024    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7989d9a1-f600-4fc7-b317-e131daa51c3b-istio-token\") pod \"7989d9a1-f600-4fc7-b317-e131daa51c3b\" (UID: \"7989d9a1-f600-4fc7-b317-e131daa51c3b\") "
Jul 24 17:31:57.878362 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:57.878093    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9dwhd\" (UniqueName: \"kubernetes.io/projected/7989d9a1-f600-4fc7-b317-e131daa51c3b-kube-api-access-9dwhd\") pod \"7989d9a1-f600-4fc7-b317-e131daa51c3b\" (UID: \"7989d9a1-f600-4fc7-b317-e131daa51c3b\") "
Jul 24 17:31:57.878362 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:57.878125    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7989d9a1-f600-4fc7-b317-e131daa51c3b-workload-certs\") pod \"7989d9a1-f600-4fc7-b317-e131daa51c3b\" (UID: \"7989d9a1-f600-4fc7-b317-e131daa51c3b\") "
Jul 24 17:31:57.878362 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:57.878154    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7989d9a1-f600-4fc7-b317-e131daa51c3b-workload-socket\") pod \"7989d9a1-f600-4fc7-b317-e131daa51c3b\" (UID: \"7989d9a1-f600-4fc7-b317-e131daa51c3b\") "
Jul 24 17:31:57.878508 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:57.878390    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7989d9a1-f600-4fc7-b317-e131daa51c3b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7989d9a1-f600-4fc7-b317-e131daa51c3b" (UID: "7989d9a1-f600-4fc7-b317-e131daa51c3b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:31:57.878562 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:57.878526    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7989d9a1-f600-4fc7-b317-e131daa51c3b-istiod-ca-cert\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:31:57.878702 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:57.878639    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7989d9a1-f600-4fc7-b317-e131daa51c3b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7989d9a1-f600-4fc7-b317-e131daa51c3b" (UID: "7989d9a1-f600-4fc7-b317-e131daa51c3b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:31:57.878702 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:57.878650    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7989d9a1-f600-4fc7-b317-e131daa51c3b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7989d9a1-f600-4fc7-b317-e131daa51c3b" (UID: "7989d9a1-f600-4fc7-b317-e131daa51c3b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:31:57.878830 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:57.878804    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7989d9a1-f600-4fc7-b317-e131daa51c3b-istio-data" (OuterVolumeSpecName: "istio-data") pod "7989d9a1-f600-4fc7-b317-e131daa51c3b" (UID: "7989d9a1-f600-4fc7-b317-e131daa51c3b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:31:57.878830 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:57.878819    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7989d9a1-f600-4fc7-b317-e131daa51c3b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7989d9a1-f600-4fc7-b317-e131daa51c3b" (UID: "7989d9a1-f600-4fc7-b317-e131daa51c3b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:31:57.880307 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:57.880284    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7989d9a1-f600-4fc7-b317-e131daa51c3b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7989d9a1-f600-4fc7-b317-e131daa51c3b" (UID: "7989d9a1-f600-4fc7-b317-e131daa51c3b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:31:57.880394 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:57.880344    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7989d9a1-f600-4fc7-b317-e131daa51c3b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7989d9a1-f600-4fc7-b317-e131daa51c3b" (UID: "7989d9a1-f600-4fc7-b317-e131daa51c3b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 17:31:57.880638 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:57.880615    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7989d9a1-f600-4fc7-b317-e131daa51c3b-istio-token" (OuterVolumeSpecName: "istio-token") pod "7989d9a1-f600-4fc7-b317-e131daa51c3b" (UID: "7989d9a1-f600-4fc7-b317-e131daa51c3b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:31:57.880684 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:57.880615    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7989d9a1-f600-4fc7-b317-e131daa51c3b-kube-api-access-9dwhd" (OuterVolumeSpecName: "kube-api-access-9dwhd") pod "7989d9a1-f600-4fc7-b317-e131daa51c3b" (UID: "7989d9a1-f600-4fc7-b317-e131daa51c3b"). InnerVolumeSpecName "kube-api-access-9dwhd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:31:57.979136 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:57.979110    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7989d9a1-f600-4fc7-b317-e131daa51c3b-istio-podinfo\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:31:57.979136 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:57.979132    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7989d9a1-f600-4fc7-b317-e131daa51c3b-credential-socket\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:31:57.979136 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:57.979142    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7989d9a1-f600-4fc7-b317-e131daa51c3b-istio-token\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:31:57.979334 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:57.979152    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dwhd\" (UniqueName: \"kubernetes.io/projected/7989d9a1-f600-4fc7-b317-e131daa51c3b-kube-api-access-9dwhd\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:31:57.979334 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:57.979160    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7989d9a1-f600-4fc7-b317-e131daa51c3b-workload-certs\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:31:57.979334 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:57.979168    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7989d9a1-f600-4fc7-b317-e131daa51c3b-workload-socket\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:31:57.979334 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:57.979176    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7989d9a1-f600-4fc7-b317-e131daa51c3b-istio-data\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:31:57.979334 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:57.979184    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7989d9a1-f600-4fc7-b317-e131daa51c3b-istio-envoy\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:31:58.183536 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:58.183455    2561 generic.go:356] "Generic (PLEG): container finished" podID="7989d9a1-f600-4fc7-b317-e131daa51c3b" containerID="e3a9620f15f490163f4662dbca39e8fa014eb0b13ccff59277fe01fdce5ec872" exitCode=0
Jul 24 17:31:58.183536 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:58.183504    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx"
Jul 24 17:31:58.183536 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:58.183506    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx" event={"ID":"7989d9a1-f600-4fc7-b317-e131daa51c3b","Type":"ContainerDied","Data":"e3a9620f15f490163f4662dbca39e8fa014eb0b13ccff59277fe01fdce5ec872"}
Jul 24 17:31:58.183754 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:58.183557    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx" event={"ID":"7989d9a1-f600-4fc7-b317-e131daa51c3b","Type":"ContainerDied","Data":"5efb4e96e23607c672082414f95c93447de7e1e9b1b3bf69082e92f560d90645"}
Jul 24 17:31:58.183754 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:58.183582    2561 scope.go:117] "RemoveContainer" containerID="e3a9620f15f490163f4662dbca39e8fa014eb0b13ccff59277fe01fdce5ec872"
Jul 24 17:31:58.193404 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:58.193388    2561 scope.go:117] "RemoveContainer" containerID="68848c519c1aed019b164db6cd758300881a625e679bf6c153eeca95ba70f049"
Jul 24 17:31:58.201312 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:58.201295    2561 scope.go:117] "RemoveContainer" containerID="e3a9620f15f490163f4662dbca39e8fa014eb0b13ccff59277fe01fdce5ec872"
Jul 24 17:31:58.201551 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:31:58.201532    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3a9620f15f490163f4662dbca39e8fa014eb0b13ccff59277fe01fdce5ec872\": container with ID starting with e3a9620f15f490163f4662dbca39e8fa014eb0b13ccff59277fe01fdce5ec872 not found: ID does not exist" containerID="e3a9620f15f490163f4662dbca39e8fa014eb0b13ccff59277fe01fdce5ec872"
Jul 24 17:31:58.201601 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:58.201558    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3a9620f15f490163f4662dbca39e8fa014eb0b13ccff59277fe01fdce5ec872"} err="failed to get container status \"e3a9620f15f490163f4662dbca39e8fa014eb0b13ccff59277fe01fdce5ec872\": rpc error: code = NotFound desc = could not find container \"e3a9620f15f490163f4662dbca39e8fa014eb0b13ccff59277fe01fdce5ec872\": container with ID starting with e3a9620f15f490163f4662dbca39e8fa014eb0b13ccff59277fe01fdce5ec872 not found: ID does not exist"
Jul 24 17:31:58.201601 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:58.201578    2561 scope.go:117] "RemoveContainer" containerID="68848c519c1aed019b164db6cd758300881a625e679bf6c153eeca95ba70f049"
Jul 24 17:31:58.201782 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:31:58.201763    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68848c519c1aed019b164db6cd758300881a625e679bf6c153eeca95ba70f049\": container with ID starting with 68848c519c1aed019b164db6cd758300881a625e679bf6c153eeca95ba70f049 not found: ID does not exist" containerID="68848c519c1aed019b164db6cd758300881a625e679bf6c153eeca95ba70f049"
Jul 24 17:31:58.201822 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:58.201788    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68848c519c1aed019b164db6cd758300881a625e679bf6c153eeca95ba70f049"} err="failed to get container status \"68848c519c1aed019b164db6cd758300881a625e679bf6c153eeca95ba70f049\": rpc error: code = NotFound desc = could not find container \"68848c519c1aed019b164db6cd758300881a625e679bf6c153eeca95ba70f049\": container with ID starting with 68848c519c1aed019b164db6cd758300881a625e679bf6c153eeca95ba70f049 not found: ID does not exist"
Jul 24 17:31:58.204320 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:58.204299    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx"]
Jul 24 17:31:58.210879 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:58.210860    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-1f216bac-openshift-default-6465cf6b7b-sfqcx"]
Jul 24 17:31:58.259165 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:31:58.259140    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7989d9a1-f600-4fc7-b317-e131daa51c3b" path="/var/lib/kubelet/pods/7989d9a1-f600-4fc7-b317-e131daa51c3b/volumes"
Jul 24 17:32:10.168395 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:10.168357    2561 patch_prober.go:28] interesting pod/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 24 17:32:10.168809 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:10.168423    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx" podUID="e17b84ae-228d-4357-9f33-184103b8ca6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 24 17:32:10.244938 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:10.244904    2561 generic.go:356] "Generic (PLEG): container finished" podID="e17b84ae-228d-4357-9f33-184103b8ca6d" containerID="99295045695cef287bea132412a52e82a654932da230c2a9dfcf074560564f92" exitCode=0
Jul 24 17:32:10.245094 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:10.244975    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx" event={"ID":"e17b84ae-228d-4357-9f33-184103b8ca6d","Type":"ContainerDied","Data":"99295045695cef287bea132412a52e82a654932da230c2a9dfcf074560564f92"}
Jul 24 17:32:10.245391 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:10.245377    2561 scope.go:117] "RemoveContainer" containerID="99295045695cef287bea132412a52e82a654932da230c2a9dfcf074560564f92"
Jul 24 17:32:10.246431 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:10.246406    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:32:10.246491 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:10.246469    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:32:10.246531 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:10.246501    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:32:11.252233 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:11.252201    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx" event={"ID":"e17b84ae-228d-4357-9f33-184103b8ca6d","Type":"ContainerStarted","Data":"1888b2d76b0e81a6db81630585ea4709ae7aee83de9f25a8bce8b78bff7fbb1e"}
Jul 24 17:32:11.627493 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:11.627457    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx"
Jul 24 17:32:11.627722 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:11.627697    2561 patch_prober.go:28] interesting pod/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 24 17:32:11.627773 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:11.627749    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx" podUID="e17b84ae-228d-4357-9f33-184103b8ca6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 24 17:32:12.627864 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:12.627825    2561 patch_prober.go:28] interesting pod/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 24 17:32:12.628295 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:12.627893    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx" podUID="e17b84ae-228d-4357-9f33-184103b8ca6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 24 17:32:13.627815 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:13.627777    2561 patch_prober.go:28] interesting pod/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 24 17:32:13.627991 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:13.627830    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx" podUID="e17b84ae-228d-4357-9f33-184103b8ca6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 24 17:32:14.628081 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:14.628021    2561 patch_prober.go:28] interesting pod/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 24 17:32:14.628486 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:14.628100    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx" podUID="e17b84ae-228d-4357-9f33-184103b8ca6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 24 17:32:15.631915 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:15.631885    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx"
Jul 24 17:32:15.632300 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:15.632180    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx"
Jul 24 17:32:15.632764 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:15.632744    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx"
Jul 24 17:32:35.680527 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:35.680493    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx"]
Jul 24 17:32:35.681019 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:35.680730    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx" podUID="e17b84ae-228d-4357-9f33-184103b8ca6d" containerName="istio-proxy" containerID="cri-o://1888b2d76b0e81a6db81630585ea4709ae7aee83de9f25a8bce8b78bff7fbb1e" gracePeriod=30
Jul 24 17:32:40.930561 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:40.930536    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx"
Jul 24 17:32:40.966789 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:40.966714    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e17b84ae-228d-4357-9f33-184103b8ca6d-istio-token\") pod \"e17b84ae-228d-4357-9f33-184103b8ca6d\" (UID: \"e17b84ae-228d-4357-9f33-184103b8ca6d\") "
Jul 24 17:32:40.966789 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:40.966749    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e17b84ae-228d-4357-9f33-184103b8ca6d-istiod-ca-cert\") pod \"e17b84ae-228d-4357-9f33-184103b8ca6d\" (UID: \"e17b84ae-228d-4357-9f33-184103b8ca6d\") "
Jul 24 17:32:40.966789 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:40.966771    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e17b84ae-228d-4357-9f33-184103b8ca6d-workload-socket\") pod \"e17b84ae-228d-4357-9f33-184103b8ca6d\" (UID: \"e17b84ae-228d-4357-9f33-184103b8ca6d\") "
Jul 24 17:32:40.967103 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:40.966835    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e17b84ae-228d-4357-9f33-184103b8ca6d-istio-data\") pod \"e17b84ae-228d-4357-9f33-184103b8ca6d\" (UID: \"e17b84ae-228d-4357-9f33-184103b8ca6d\") "
Jul 24 17:32:40.967103 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:40.966893    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e17b84ae-228d-4357-9f33-184103b8ca6d-istio-podinfo\") pod \"e17b84ae-228d-4357-9f33-184103b8ca6d\" (UID: \"e17b84ae-228d-4357-9f33-184103b8ca6d\") "
Jul 24 17:32:40.967103 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:40.966919    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e17b84ae-228d-4357-9f33-184103b8ca6d-workload-certs\") pod \"e17b84ae-228d-4357-9f33-184103b8ca6d\" (UID: \"e17b84ae-228d-4357-9f33-184103b8ca6d\") "
Jul 24 17:32:40.967103 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:40.966960    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kblbf\" (UniqueName: \"kubernetes.io/projected/e17b84ae-228d-4357-9f33-184103b8ca6d-kube-api-access-kblbf\") pod \"e17b84ae-228d-4357-9f33-184103b8ca6d\" (UID: \"e17b84ae-228d-4357-9f33-184103b8ca6d\") "
Jul 24 17:32:40.967103 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:40.966996    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e17b84ae-228d-4357-9f33-184103b8ca6d-istio-envoy\") pod \"e17b84ae-228d-4357-9f33-184103b8ca6d\" (UID: \"e17b84ae-228d-4357-9f33-184103b8ca6d\") "
Jul 24 17:32:40.967103 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:40.967051    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e17b84ae-228d-4357-9f33-184103b8ca6d-credential-socket\") pod \"e17b84ae-228d-4357-9f33-184103b8ca6d\" (UID: \"e17b84ae-228d-4357-9f33-184103b8ca6d\") "
Jul 24 17:32:40.967434 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:40.967139    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e17b84ae-228d-4357-9f33-184103b8ca6d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e17b84ae-228d-4357-9f33-184103b8ca6d" (UID: "e17b84ae-228d-4357-9f33-184103b8ca6d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:32:40.967434 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:40.967248    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e17b84ae-228d-4357-9f33-184103b8ca6d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e17b84ae-228d-4357-9f33-184103b8ca6d" (UID: "e17b84ae-228d-4357-9f33-184103b8ca6d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:32:40.967548 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:40.967462    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e17b84ae-228d-4357-9f33-184103b8ca6d-istiod-ca-cert\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:32:40.967548 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:40.967464    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e17b84ae-228d-4357-9f33-184103b8ca6d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e17b84ae-228d-4357-9f33-184103b8ca6d" (UID: "e17b84ae-228d-4357-9f33-184103b8ca6d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:32:40.967548 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:40.967481    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e17b84ae-228d-4357-9f33-184103b8ca6d-workload-socket\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:32:40.967708 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:40.967548    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e17b84ae-228d-4357-9f33-184103b8ca6d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e17b84ae-228d-4357-9f33-184103b8ca6d" (UID: "e17b84ae-228d-4357-9f33-184103b8ca6d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:32:40.967943 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:40.967922    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e17b84ae-228d-4357-9f33-184103b8ca6d-istio-data" (OuterVolumeSpecName: "istio-data") pod "e17b84ae-228d-4357-9f33-184103b8ca6d" (UID: "e17b84ae-228d-4357-9f33-184103b8ca6d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:32:40.969402 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:40.969377    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e17b84ae-228d-4357-9f33-184103b8ca6d-istio-token" (OuterVolumeSpecName: "istio-token") pod "e17b84ae-228d-4357-9f33-184103b8ca6d" (UID: "e17b84ae-228d-4357-9f33-184103b8ca6d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:32:40.969509 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:40.969465    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e17b84ae-228d-4357-9f33-184103b8ca6d-kube-api-access-kblbf" (OuterVolumeSpecName: "kube-api-access-kblbf") pod "e17b84ae-228d-4357-9f33-184103b8ca6d" (UID: "e17b84ae-228d-4357-9f33-184103b8ca6d"). InnerVolumeSpecName "kube-api-access-kblbf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:32:40.969614 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:40.969588    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e17b84ae-228d-4357-9f33-184103b8ca6d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e17b84ae-228d-4357-9f33-184103b8ca6d" (UID: "e17b84ae-228d-4357-9f33-184103b8ca6d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:32:40.969696 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:40.969675    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e17b84ae-228d-4357-9f33-184103b8ca6d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e17b84ae-228d-4357-9f33-184103b8ca6d" (UID: "e17b84ae-228d-4357-9f33-184103b8ca6d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 17:32:41.068298 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:41.068265    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e17b84ae-228d-4357-9f33-184103b8ca6d-istio-data\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:32:41.068298 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:41.068293    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e17b84ae-228d-4357-9f33-184103b8ca6d-istio-podinfo\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:32:41.068298 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:41.068302    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e17b84ae-228d-4357-9f33-184103b8ca6d-workload-certs\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:32:41.068515 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:41.068312    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kblbf\" (UniqueName: \"kubernetes.io/projected/e17b84ae-228d-4357-9f33-184103b8ca6d-kube-api-access-kblbf\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:32:41.068515 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:41.068322    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e17b84ae-228d-4357-9f33-184103b8ca6d-istio-envoy\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:32:41.068515 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:41.068330    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e17b84ae-228d-4357-9f33-184103b8ca6d-credential-socket\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:32:41.068515 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:41.068338    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e17b84ae-228d-4357-9f33-184103b8ca6d-istio-token\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:32:41.397969 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:41.397940    2561 generic.go:356] "Generic (PLEG): container finished" podID="e17b84ae-228d-4357-9f33-184103b8ca6d" containerID="1888b2d76b0e81a6db81630585ea4709ae7aee83de9f25a8bce8b78bff7fbb1e" exitCode=0
Jul 24 17:32:41.398245 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:41.397991    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx"
Jul 24 17:32:41.398245 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:41.398035    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx" event={"ID":"e17b84ae-228d-4357-9f33-184103b8ca6d","Type":"ContainerDied","Data":"1888b2d76b0e81a6db81630585ea4709ae7aee83de9f25a8bce8b78bff7fbb1e"}
Jul 24 17:32:41.398245 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:41.398106    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx" event={"ID":"e17b84ae-228d-4357-9f33-184103b8ca6d","Type":"ContainerDied","Data":"2477d19eccbaaad9e0faa0669fb7d83854fe43f787ed03a3c3bc13cf45b47405"}
Jul 24 17:32:41.398245 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:41.398135    2561 scope.go:117] "RemoveContainer" containerID="1888b2d76b0e81a6db81630585ea4709ae7aee83de9f25a8bce8b78bff7fbb1e"
Jul 24 17:32:41.407678 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:41.407660    2561 scope.go:117] "RemoveContainer" containerID="99295045695cef287bea132412a52e82a654932da230c2a9dfcf074560564f92"
Jul 24 17:32:41.415586 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:41.415564    2561 scope.go:117] "RemoveContainer" containerID="1888b2d76b0e81a6db81630585ea4709ae7aee83de9f25a8bce8b78bff7fbb1e"
Jul 24 17:32:41.415847 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:32:41.415828    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1888b2d76b0e81a6db81630585ea4709ae7aee83de9f25a8bce8b78bff7fbb1e\": container with ID starting with 1888b2d76b0e81a6db81630585ea4709ae7aee83de9f25a8bce8b78bff7fbb1e not found: ID does not exist" containerID="1888b2d76b0e81a6db81630585ea4709ae7aee83de9f25a8bce8b78bff7fbb1e"
Jul 24 17:32:41.415921 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:41.415862    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1888b2d76b0e81a6db81630585ea4709ae7aee83de9f25a8bce8b78bff7fbb1e"} err="failed to get container status \"1888b2d76b0e81a6db81630585ea4709ae7aee83de9f25a8bce8b78bff7fbb1e\": rpc error: code = NotFound desc = could not find container \"1888b2d76b0e81a6db81630585ea4709ae7aee83de9f25a8bce8b78bff7fbb1e\": container with ID starting with 1888b2d76b0e81a6db81630585ea4709ae7aee83de9f25a8bce8b78bff7fbb1e not found: ID does not exist"
Jul 24 17:32:41.415921 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:41.415886    2561 scope.go:117] "RemoveContainer" containerID="99295045695cef287bea132412a52e82a654932da230c2a9dfcf074560564f92"
Jul 24 17:32:41.416182 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:32:41.416164    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99295045695cef287bea132412a52e82a654932da230c2a9dfcf074560564f92\": container with ID starting with 99295045695cef287bea132412a52e82a654932da230c2a9dfcf074560564f92 not found: ID does not exist" containerID="99295045695cef287bea132412a52e82a654932da230c2a9dfcf074560564f92"
Jul 24 17:32:41.416227 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:41.416188    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99295045695cef287bea132412a52e82a654932da230c2a9dfcf074560564f92"} err="failed to get container status \"99295045695cef287bea132412a52e82a654932da230c2a9dfcf074560564f92\": rpc error: code = NotFound desc = could not find container \"99295045695cef287bea132412a52e82a654932da230c2a9dfcf074560564f92\": container with ID starting with 99295045695cef287bea132412a52e82a654932da230c2a9dfcf074560564f92 not found: ID does not exist"
Jul 24 17:32:41.419673 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:41.419649    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx"]
Jul 24 17:32:41.423753 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:41.423725    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-deb90cc5-openshift-default-7c75d86b48-gq6nx"]
Jul 24 17:32:42.258778 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:32:42.258743    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e17b84ae-228d-4357-9f33-184103b8ca6d" path="/var/lib/kubelet/pods/e17b84ae-228d-4357-9f33-184103b8ca6d/volumes"
Jul 24 17:33:36.247144 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:33:36.247113    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6h754_860ed1fc-612f-4796-8077-72bc6c5d84db/ovn-acl-logging/0.log"
Jul 24 17:33:36.248491 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:33:36.248471    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6h754_860ed1fc-612f-4796-8077-72bc6c5d84db/ovn-acl-logging/0.log"
Jul 24 17:34:19.561810 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:19.561780    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s"]
Jul 24 17:34:19.562300 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:19.562158    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e17b84ae-228d-4357-9f33-184103b8ca6d" containerName="istio-proxy"
Jul 24 17:34:19.562300 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:19.562169    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e17b84ae-228d-4357-9f33-184103b8ca6d" containerName="istio-proxy"
Jul 24 17:34:19.562300 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:19.562182    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7989d9a1-f600-4fc7-b317-e131daa51c3b" containerName="istio-proxy"
Jul 24 17:34:19.562300 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:19.562188    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7989d9a1-f600-4fc7-b317-e131daa51c3b" containerName="istio-proxy"
Jul 24 17:34:19.562300 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:19.562209    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7989d9a1-f600-4fc7-b317-e131daa51c3b" containerName="istio-proxy"
Jul 24 17:34:19.562300 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:19.562215    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7989d9a1-f600-4fc7-b317-e131daa51c3b" containerName="istio-proxy"
Jul 24 17:34:19.562300 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:19.562269    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7989d9a1-f600-4fc7-b317-e131daa51c3b" containerName="istio-proxy"
Jul 24 17:34:19.562300 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:19.562277    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e17b84ae-228d-4357-9f33-184103b8ca6d" containerName="istio-proxy"
Jul 24 17:34:19.562300 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:19.562284    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a750dd0e-a6e4-43d9-af1e-d3545032edde" containerName="istio-proxy"
Jul 24 17:34:19.562300 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:19.562291    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e17b84ae-228d-4357-9f33-184103b8ca6d" containerName="istio-proxy"
Jul 24 17:34:19.564885 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:19.564871    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s"
Jul 24 17:34:19.567274 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:19.567251    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 24 17:34:19.567408 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:19.567255    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-0bdb575b-openshift-default-dockercfg-qxmtf\""
Jul 24 17:34:19.587650 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:19.587625    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s"]
Jul 24 17:34:19.658710 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:19.658676    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-workload-socket\") pod \"e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s\" (UID: \"b272a2b1-9ccd-4e7b-aab7-3a565568e52b\") " pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s"
Jul 24 17:34:19.658906 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:19.658736    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-istio-token\") pod \"e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s\" (UID: \"b272a2b1-9ccd-4e7b-aab7-3a565568e52b\") " pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s"
Jul 24 17:34:19.658906 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:19.658762    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-istio-data\") pod \"e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s\" (UID: \"b272a2b1-9ccd-4e7b-aab7-3a565568e52b\") " pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s"
Jul 24 17:34:19.658906 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:19.658783    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-credential-socket\") pod \"e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s\" (UID: \"b272a2b1-9ccd-4e7b-aab7-3a565568e52b\") " pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s"
Jul 24 17:34:19.658906 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:19.658800    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-istio-podinfo\") pod \"e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s\" (UID: \"b272a2b1-9ccd-4e7b-aab7-3a565568e52b\") " pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s"
Jul 24 17:34:19.658906 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:19.658860    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-workload-certs\") pod \"e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s\" (UID: \"b272a2b1-9ccd-4e7b-aab7-3a565568e52b\") " pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s"
Jul 24 17:34:19.659217 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:19.658920    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkqx9\" (UniqueName: \"kubernetes.io/projected/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-kube-api-access-fkqx9\") pod \"e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s\" (UID: \"b272a2b1-9ccd-4e7b-aab7-3a565568e52b\") " pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s"
Jul 24 17:34:19.659217 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:19.658948    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-istio-envoy\") pod \"e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s\" (UID: \"b272a2b1-9ccd-4e7b-aab7-3a565568e52b\") " pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s"
Jul 24 17:34:19.659217 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:19.659018    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-istiod-ca-cert\") pod \"e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s\" (UID: \"b272a2b1-9ccd-4e7b-aab7-3a565568e52b\") " pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s"
Jul 24 17:34:19.760001 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:19.759979    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-istio-token\") pod \"e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s\" (UID: \"b272a2b1-9ccd-4e7b-aab7-3a565568e52b\") " pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s"
Jul 24 17:34:19.760180 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:19.760006    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-istio-data\") pod \"e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s\" (UID: \"b272a2b1-9ccd-4e7b-aab7-3a565568e52b\") " pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s"
Jul 24 17:34:19.760180 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:19.760029    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-credential-socket\") pod \"e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s\" (UID: \"b272a2b1-9ccd-4e7b-aab7-3a565568e52b\") " pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s"
Jul 24 17:34:19.760180 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:19.760045    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-istio-podinfo\") pod \"e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s\" (UID: \"b272a2b1-9ccd-4e7b-aab7-3a565568e52b\") " pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s"
Jul 24 17:34:19.760180 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:19.760079    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-workload-certs\") pod \"e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s\" (UID: \"b272a2b1-9ccd-4e7b-aab7-3a565568e52b\") " pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s"
Jul 24 17:34:19.760180 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:19.760143    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkqx9\" (UniqueName: \"kubernetes.io/projected/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-kube-api-access-fkqx9\") pod \"e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s\" (UID: \"b272a2b1-9ccd-4e7b-aab7-3a565568e52b\") " pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s"
Jul 24 17:34:19.760433 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:19.760182    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-istio-envoy\") pod \"e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s\" (UID: \"b272a2b1-9ccd-4e7b-aab7-3a565568e52b\") " pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s"
Jul 24 17:34:19.760433 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:19.760389    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-istiod-ca-cert\") pod \"e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s\" (UID: \"b272a2b1-9ccd-4e7b-aab7-3a565568e52b\") " pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s"
Jul 24 17:34:19.760526 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:19.760470    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-istio-data\") pod \"e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s\" (UID: \"b272a2b1-9ccd-4e7b-aab7-3a565568e52b\") " pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s"
Jul 24 17:34:19.760526 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:19.760490    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-workload-socket\") pod \"e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s\" (UID: \"b272a2b1-9ccd-4e7b-aab7-3a565568e52b\") " pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s"
Jul 24 17:34:19.760526 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:19.760499    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-workload-certs\") pod \"e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s\" (UID: \"b272a2b1-9ccd-4e7b-aab7-3a565568e52b\") " pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s"
Jul 24 17:34:19.760526 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:19.760515    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-credential-socket\") pod \"e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s\" (UID: \"b272a2b1-9ccd-4e7b-aab7-3a565568e52b\") " pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s"
Jul 24 17:34:19.760834 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:19.760814    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-workload-socket\") pod \"e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s\" (UID: \"b272a2b1-9ccd-4e7b-aab7-3a565568e52b\") " pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s"
Jul 24 17:34:19.761043 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:19.761028    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-istiod-ca-cert\") pod \"e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s\" (UID: \"b272a2b1-9ccd-4e7b-aab7-3a565568e52b\") " pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s"
Jul 24 17:34:19.762649 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:19.762629    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-istio-podinfo\") pod \"e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s\" (UID: \"b272a2b1-9ccd-4e7b-aab7-3a565568e52b\") " pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s"
Jul 24 17:34:19.762752 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:19.762712    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-istio-envoy\") pod \"e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s\" (UID: \"b272a2b1-9ccd-4e7b-aab7-3a565568e52b\") " pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s"
Jul 24 17:34:19.768900 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:19.768881    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-istio-token\") pod \"e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s\" (UID: \"b272a2b1-9ccd-4e7b-aab7-3a565568e52b\") " pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s"
Jul 24 17:34:19.769043 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:19.769024    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkqx9\" (UniqueName: \"kubernetes.io/projected/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-kube-api-access-fkqx9\") pod \"e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s\" (UID: \"b272a2b1-9ccd-4e7b-aab7-3a565568e52b\") " pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s"
Jul 24 17:34:19.874993 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:19.874972    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s"
Jul 24 17:34:20.014640 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:20.014611    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s"]
Jul 24 17:34:20.017163 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:34:20.017134    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb272a2b1_9ccd_4e7b_aab7_3a565568e52b.slice/crio-b9e58039fcaa21089b68816aedd4c48d2076d162410db6739edc75355d98191d WatchSource:0}: Error finding container b9e58039fcaa21089b68816aedd4c48d2076d162410db6739edc75355d98191d: Status 404 returned error can't find the container with id b9e58039fcaa21089b68816aedd4c48d2076d162410db6739edc75355d98191d
Jul 24 17:34:20.019504 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:20.019476    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:34:20.019575 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:20.019550    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:34:20.019615 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:20.019582    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:34:20.852439 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:20.852406    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s" event={"ID":"b272a2b1-9ccd-4e7b-aab7-3a565568e52b","Type":"ContainerStarted","Data":"26d95c3390d2ce0640f10d72fae96a277dd431a672be91c34aae5cad2cd1aeba"}
Jul 24 17:34:20.852823 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:20.852459    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s" event={"ID":"b272a2b1-9ccd-4e7b-aab7-3a565568e52b","Type":"ContainerStarted","Data":"b9e58039fcaa21089b68816aedd4c48d2076d162410db6739edc75355d98191d"}
Jul 24 17:34:20.875316 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:20.875270    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s" podStartSLOduration=1.875255155 podStartE2EDuration="1.875255155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:34:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:34:20.873786859 +0000 UTC m=+1845.146646660" watchObservedRunningTime="2026-07-24 17:34:20.875255155 +0000 UTC m=+1845.148114935"
Jul 24 17:34:20.875794 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:20.875778    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s"
Jul 24 17:34:21.880390 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:21.880358    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s"
Jul 24 17:34:22.863641 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:22.863613    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s"
Jul 24 17:34:22.864640 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:22.864616    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s"
Jul 24 17:34:34.923434 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:34.923403    2561 generic.go:356] "Generic (PLEG): container finished" podID="b272a2b1-9ccd-4e7b-aab7-3a565568e52b" containerID="26d95c3390d2ce0640f10d72fae96a277dd431a672be91c34aae5cad2cd1aeba" exitCode=0
Jul 24 17:34:34.923924 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:34.923482    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s" event={"ID":"b272a2b1-9ccd-4e7b-aab7-3a565568e52b","Type":"ContainerDied","Data":"26d95c3390d2ce0640f10d72fae96a277dd431a672be91c34aae5cad2cd1aeba"}
Jul 24 17:34:34.923924 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:34.923881    2561 scope.go:117] "RemoveContainer" containerID="26d95c3390d2ce0640f10d72fae96a277dd431a672be91c34aae5cad2cd1aeba"
Jul 24 17:34:34.924892 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:34.924866    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:34:34.924974 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:34.924935    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:34:34.924974 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:34.924971    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:34:35.934502 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:35.934465    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s" event={"ID":"b272a2b1-9ccd-4e7b-aab7-3a565568e52b","Type":"ContainerStarted","Data":"c69d6d272461977df55ae7b551a5ef42659fd770839c8f8b52f18cd810c510bb"}
Jul 24 17:34:36.876895 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:36.876854    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s"
Jul 24 17:34:36.877105 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:36.876910    2561 patch_prober.go:28] interesting pod/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 24 17:34:36.877105 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:36.876972    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s" podUID="b272a2b1-9ccd-4e7b-aab7-3a565568e52b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 24 17:34:37.863618 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:37.863583    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s"
Jul 24 17:34:37.876099 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:37.876047    2561 patch_prober.go:28] interesting pod/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 24 17:34:37.876350 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:37.876324    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s" podUID="b272a2b1-9ccd-4e7b-aab7-3a565568e52b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 24 17:34:38.875472 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:38.875425    2561 patch_prober.go:28] interesting pod/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 24 17:34:38.875983 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:38.875500    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s" podUID="b272a2b1-9ccd-4e7b-aab7-3a565568e52b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 24 17:34:39.875990 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:39.875954    2561 patch_prober.go:28] interesting pod/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 24 17:34:39.876648 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:39.876604    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s" podUID="b272a2b1-9ccd-4e7b-aab7-3a565568e52b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 24 17:34:40.879075 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:40.879027    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s"
Jul 24 17:34:40.880049 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:40.880029    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s"
Jul 24 17:34:56.326921 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:56.326882    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s"]
Jul 24 17:34:56.327552 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:34:56.327125    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s" podUID="b272a2b1-9ccd-4e7b-aab7-3a565568e52b" containerName="istio-proxy" containerID="cri-o://c69d6d272461977df55ae7b551a5ef42659fd770839c8f8b52f18cd810c510bb" gracePeriod=30
Jul 24 17:35:01.583733 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:01.583709    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s"
Jul 24 17:35:01.649198 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:01.649169    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-istio-envoy\") pod \"b272a2b1-9ccd-4e7b-aab7-3a565568e52b\" (UID: \"b272a2b1-9ccd-4e7b-aab7-3a565568e52b\") "
Jul 24 17:35:01.649399 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:01.649204    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-istiod-ca-cert\") pod \"b272a2b1-9ccd-4e7b-aab7-3a565568e52b\" (UID: \"b272a2b1-9ccd-4e7b-aab7-3a565568e52b\") "
Jul 24 17:35:01.649399 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:01.649235    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-istio-data\") pod \"b272a2b1-9ccd-4e7b-aab7-3a565568e52b\" (UID: \"b272a2b1-9ccd-4e7b-aab7-3a565568e52b\") "
Jul 24 17:35:01.649399 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:01.649265    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-istio-podinfo\") pod \"b272a2b1-9ccd-4e7b-aab7-3a565568e52b\" (UID: \"b272a2b1-9ccd-4e7b-aab7-3a565568e52b\") "
Jul 24 17:35:01.649399 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:01.649317    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-workload-certs\") pod \"b272a2b1-9ccd-4e7b-aab7-3a565568e52b\" (UID: \"b272a2b1-9ccd-4e7b-aab7-3a565568e52b\") "
Jul 24 17:35:01.649399 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:01.649349    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-workload-socket\") pod \"b272a2b1-9ccd-4e7b-aab7-3a565568e52b\" (UID: \"b272a2b1-9ccd-4e7b-aab7-3a565568e52b\") "
Jul 24 17:35:01.649703 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:01.649407    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-credential-socket\") pod \"b272a2b1-9ccd-4e7b-aab7-3a565568e52b\" (UID: \"b272a2b1-9ccd-4e7b-aab7-3a565568e52b\") "
Jul 24 17:35:01.649703 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:01.649454    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-istio-token\") pod \"b272a2b1-9ccd-4e7b-aab7-3a565568e52b\" (UID: \"b272a2b1-9ccd-4e7b-aab7-3a565568e52b\") "
Jul 24 17:35:01.649703 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:01.649476    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fkqx9\" (UniqueName: \"kubernetes.io/projected/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-kube-api-access-fkqx9\") pod \"b272a2b1-9ccd-4e7b-aab7-3a565568e52b\" (UID: \"b272a2b1-9ccd-4e7b-aab7-3a565568e52b\") "
Jul 24 17:35:01.649703 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:01.649671    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b272a2b1-9ccd-4e7b-aab7-3a565568e52b" (UID: "b272a2b1-9ccd-4e7b-aab7-3a565568e52b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:35:01.649896 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:01.649784    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b272a2b1-9ccd-4e7b-aab7-3a565568e52b" (UID: "b272a2b1-9ccd-4e7b-aab7-3a565568e52b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:35:01.649896 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:01.649677    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b272a2b1-9ccd-4e7b-aab7-3a565568e52b" (UID: "b272a2b1-9ccd-4e7b-aab7-3a565568e52b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:35:01.649896 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:01.649830    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-credential-socket\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:35:01.649896 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:01.649854    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b272a2b1-9ccd-4e7b-aab7-3a565568e52b" (UID: "b272a2b1-9ccd-4e7b-aab7-3a565568e52b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:35:01.650151 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:01.650131    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-istio-data" (OuterVolumeSpecName: "istio-data") pod "b272a2b1-9ccd-4e7b-aab7-3a565568e52b" (UID: "b272a2b1-9ccd-4e7b-aab7-3a565568e52b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:35:01.651482 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:01.651464    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b272a2b1-9ccd-4e7b-aab7-3a565568e52b" (UID: "b272a2b1-9ccd-4e7b-aab7-3a565568e52b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:35:01.651580 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:01.651543    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b272a2b1-9ccd-4e7b-aab7-3a565568e52b" (UID: "b272a2b1-9ccd-4e7b-aab7-3a565568e52b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 17:35:01.652047 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:01.652025    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-istio-token" (OuterVolumeSpecName: "istio-token") pod "b272a2b1-9ccd-4e7b-aab7-3a565568e52b" (UID: "b272a2b1-9ccd-4e7b-aab7-3a565568e52b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:35:01.652130 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:01.652046    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-kube-api-access-fkqx9" (OuterVolumeSpecName: "kube-api-access-fkqx9") pod "b272a2b1-9ccd-4e7b-aab7-3a565568e52b" (UID: "b272a2b1-9ccd-4e7b-aab7-3a565568e52b"). InnerVolumeSpecName "kube-api-access-fkqx9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:35:01.750627 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:01.750580    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-istio-data\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:35:01.750627 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:01.750621    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-istio-podinfo\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:35:01.750627 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:01.750631    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-workload-certs\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:35:01.750878 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:01.750640    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-workload-socket\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:35:01.750878 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:01.750659    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-istio-token\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:35:01.750878 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:01.750668    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fkqx9\" (UniqueName: \"kubernetes.io/projected/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-kube-api-access-fkqx9\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:35:01.750878 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:01.750676    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-istio-envoy\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:35:01.750878 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:01.750684    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b272a2b1-9ccd-4e7b-aab7-3a565568e52b-istiod-ca-cert\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:35:02.054542 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:02.054460    2561 generic.go:356] "Generic (PLEG): container finished" podID="b272a2b1-9ccd-4e7b-aab7-3a565568e52b" containerID="c69d6d272461977df55ae7b551a5ef42659fd770839c8f8b52f18cd810c510bb" exitCode=0
Jul 24 17:35:02.054542 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:02.054502    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s"
Jul 24 17:35:02.054542 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:02.054529    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s" event={"ID":"b272a2b1-9ccd-4e7b-aab7-3a565568e52b","Type":"ContainerDied","Data":"c69d6d272461977df55ae7b551a5ef42659fd770839c8f8b52f18cd810c510bb"}
Jul 24 17:35:02.054831 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:02.054571    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s" event={"ID":"b272a2b1-9ccd-4e7b-aab7-3a565568e52b","Type":"ContainerDied","Data":"b9e58039fcaa21089b68816aedd4c48d2076d162410db6739edc75355d98191d"}
Jul 24 17:35:02.054831 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:02.054592    2561 scope.go:117] "RemoveContainer" containerID="c69d6d272461977df55ae7b551a5ef42659fd770839c8f8b52f18cd810c510bb"
Jul 24 17:35:02.063525 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:02.063505    2561 scope.go:117] "RemoveContainer" containerID="26d95c3390d2ce0640f10d72fae96a277dd431a672be91c34aae5cad2cd1aeba"
Jul 24 17:35:02.071320 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:02.071301    2561 scope.go:117] "RemoveContainer" containerID="c69d6d272461977df55ae7b551a5ef42659fd770839c8f8b52f18cd810c510bb"
Jul 24 17:35:02.071574 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:35:02.071554    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c69d6d272461977df55ae7b551a5ef42659fd770839c8f8b52f18cd810c510bb\": container with ID starting with c69d6d272461977df55ae7b551a5ef42659fd770839c8f8b52f18cd810c510bb not found: ID does not exist" containerID="c69d6d272461977df55ae7b551a5ef42659fd770839c8f8b52f18cd810c510bb"
Jul 24 17:35:02.071652 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:02.071586    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c69d6d272461977df55ae7b551a5ef42659fd770839c8f8b52f18cd810c510bb"} err="failed to get container status \"c69d6d272461977df55ae7b551a5ef42659fd770839c8f8b52f18cd810c510bb\": rpc error: code = NotFound desc = could not find container \"c69d6d272461977df55ae7b551a5ef42659fd770839c8f8b52f18cd810c510bb\": container with ID starting with c69d6d272461977df55ae7b551a5ef42659fd770839c8f8b52f18cd810c510bb not found: ID does not exist"
Jul 24 17:35:02.071652 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:02.071608    2561 scope.go:117] "RemoveContainer" containerID="26d95c3390d2ce0640f10d72fae96a277dd431a672be91c34aae5cad2cd1aeba"
Jul 24 17:35:02.071875 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:35:02.071855    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26d95c3390d2ce0640f10d72fae96a277dd431a672be91c34aae5cad2cd1aeba\": container with ID starting with 26d95c3390d2ce0640f10d72fae96a277dd431a672be91c34aae5cad2cd1aeba not found: ID does not exist" containerID="26d95c3390d2ce0640f10d72fae96a277dd431a672be91c34aae5cad2cd1aeba"
Jul 24 17:35:02.071915 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:02.071881    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26d95c3390d2ce0640f10d72fae96a277dd431a672be91c34aae5cad2cd1aeba"} err="failed to get container status \"26d95c3390d2ce0640f10d72fae96a277dd431a672be91c34aae5cad2cd1aeba\": rpc error: code = NotFound desc = could not find container \"26d95c3390d2ce0640f10d72fae96a277dd431a672be91c34aae5cad2cd1aeba\": container with ID starting with 26d95c3390d2ce0640f10d72fae96a277dd431a672be91c34aae5cad2cd1aeba not found: ID does not exist"
Jul 24 17:35:02.076405 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:02.076383    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s"]
Jul 24 17:35:02.080976 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:02.080955    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-0bdb575b-openshift-default-5f8cc89dcb-qrk2s"]
Jul 24 17:35:02.258489 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:02.258458    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b272a2b1-9ccd-4e7b-aab7-3a565568e52b" path="/var/lib/kubelet/pods/b272a2b1-9ccd-4e7b-aab7-3a565568e52b/volumes"
Jul 24 17:35:16.617779 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:16.617742    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx"]
Jul 24 17:35:16.618342 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:16.618304    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b272a2b1-9ccd-4e7b-aab7-3a565568e52b" containerName="istio-proxy"
Jul 24 17:35:16.618342 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:16.618324    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b272a2b1-9ccd-4e7b-aab7-3a565568e52b" containerName="istio-proxy"
Jul 24 17:35:16.618342 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:16.618340    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b272a2b1-9ccd-4e7b-aab7-3a565568e52b" containerName="istio-proxy"
Jul 24 17:35:16.618517 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:16.618348    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b272a2b1-9ccd-4e7b-aab7-3a565568e52b" containerName="istio-proxy"
Jul 24 17:35:16.618517 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:16.618372    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e17b84ae-228d-4357-9f33-184103b8ca6d" containerName="istio-proxy"
Jul 24 17:35:16.618517 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:16.618382    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e17b84ae-228d-4357-9f33-184103b8ca6d" containerName="istio-proxy"
Jul 24 17:35:16.618517 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:16.618482    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7989d9a1-f600-4fc7-b317-e131daa51c3b" containerName="istio-proxy"
Jul 24 17:35:16.618517 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:16.618496    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b272a2b1-9ccd-4e7b-aab7-3a565568e52b" containerName="istio-proxy"
Jul 24 17:35:16.618517 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:16.618508    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b272a2b1-9ccd-4e7b-aab7-3a565568e52b" containerName="istio-proxy"
Jul 24 17:35:16.621547 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:16.621518    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx"
Jul 24 17:35:16.623983 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:16.623956    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 24 17:35:16.624100 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:16.624020    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-4fe99dd6-openshift-default-dockercfg-lclxm\""
Jul 24 17:35:16.635363 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:16.635342    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx"]
Jul 24 17:35:16.688092 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:16.688034    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee14020f-be6f-4053-9eee-5628c14e1526-workload-certs\") pod \"e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx\" (UID: \"ee14020f-be6f-4053-9eee-5628c14e1526\") " pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx"
Jul 24 17:35:16.688260 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:16.688124    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5mzg\" (UniqueName: \"kubernetes.io/projected/ee14020f-be6f-4053-9eee-5628c14e1526-kube-api-access-k5mzg\") pod \"e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx\" (UID: \"ee14020f-be6f-4053-9eee-5628c14e1526\") " pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx"
Jul 24 17:35:16.688260 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:16.688170    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee14020f-be6f-4053-9eee-5628c14e1526-workload-socket\") pod \"e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx\" (UID: \"ee14020f-be6f-4053-9eee-5628c14e1526\") " pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx"
Jul 24 17:35:16.688260 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:16.688229    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee14020f-be6f-4053-9eee-5628c14e1526-istio-data\") pod \"e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx\" (UID: \"ee14020f-be6f-4053-9eee-5628c14e1526\") " pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx"
Jul 24 17:35:16.688370 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:16.688270    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee14020f-be6f-4053-9eee-5628c14e1526-istio-envoy\") pod \"e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx\" (UID: \"ee14020f-be6f-4053-9eee-5628c14e1526\") " pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx"
Jul 24 17:35:16.688370 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:16.688292    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee14020f-be6f-4053-9eee-5628c14e1526-istio-token\") pod \"e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx\" (UID: \"ee14020f-be6f-4053-9eee-5628c14e1526\") " pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx"
Jul 24 17:35:16.688370 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:16.688359    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee14020f-be6f-4053-9eee-5628c14e1526-istiod-ca-cert\") pod \"e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx\" (UID: \"ee14020f-be6f-4053-9eee-5628c14e1526\") " pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx"
Jul 24 17:35:16.688468 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:16.688404    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee14020f-be6f-4053-9eee-5628c14e1526-credential-socket\") pod \"e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx\" (UID: \"ee14020f-be6f-4053-9eee-5628c14e1526\") " pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx"
Jul 24 17:35:16.688468 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:16.688425    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee14020f-be6f-4053-9eee-5628c14e1526-istio-podinfo\") pod \"e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx\" (UID: \"ee14020f-be6f-4053-9eee-5628c14e1526\") " pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx"
Jul 24 17:35:16.789903 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:16.789866    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5mzg\" (UniqueName: \"kubernetes.io/projected/ee14020f-be6f-4053-9eee-5628c14e1526-kube-api-access-k5mzg\") pod \"e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx\" (UID: \"ee14020f-be6f-4053-9eee-5628c14e1526\") " pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx"
Jul 24 17:35:16.789903 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:16.789903    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee14020f-be6f-4053-9eee-5628c14e1526-workload-socket\") pod \"e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx\" (UID: \"ee14020f-be6f-4053-9eee-5628c14e1526\") " pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx"
Jul 24 17:35:16.790196 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:16.789924    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee14020f-be6f-4053-9eee-5628c14e1526-istio-data\") pod \"e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx\" (UID: \"ee14020f-be6f-4053-9eee-5628c14e1526\") " pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx"
Jul 24 17:35:16.790196 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:16.789949    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee14020f-be6f-4053-9eee-5628c14e1526-istio-envoy\") pod \"e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx\" (UID: \"ee14020f-be6f-4053-9eee-5628c14e1526\") " pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx"
Jul 24 17:35:16.790196 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:16.789978    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee14020f-be6f-4053-9eee-5628c14e1526-istio-token\") pod \"e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx\" (UID: \"ee14020f-be6f-4053-9eee-5628c14e1526\") " pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx"
Jul 24 17:35:16.790196 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:16.790023    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee14020f-be6f-4053-9eee-5628c14e1526-istiod-ca-cert\") pod \"e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx\" (UID: \"ee14020f-be6f-4053-9eee-5628c14e1526\") " pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx"
Jul 24 17:35:16.790196 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:16.790099    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee14020f-be6f-4053-9eee-5628c14e1526-credential-socket\") pod \"e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx\" (UID: \"ee14020f-be6f-4053-9eee-5628c14e1526\") " pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx"
Jul 24 17:35:16.790196 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:16.790128    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee14020f-be6f-4053-9eee-5628c14e1526-istio-podinfo\") pod \"e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx\" (UID: \"ee14020f-be6f-4053-9eee-5628c14e1526\") " pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx"
Jul 24 17:35:16.790196 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:16.790156    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee14020f-be6f-4053-9eee-5628c14e1526-workload-certs\") pod \"e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx\" (UID: \"ee14020f-be6f-4053-9eee-5628c14e1526\") " pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx"
Jul 24 17:35:16.790561 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:16.790452    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee14020f-be6f-4053-9eee-5628c14e1526-workload-socket\") pod \"e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx\" (UID: \"ee14020f-be6f-4053-9eee-5628c14e1526\") " pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx"
Jul 24 17:35:16.790561 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:16.790516    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee14020f-be6f-4053-9eee-5628c14e1526-istio-data\") pod \"e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx\" (UID: \"ee14020f-be6f-4053-9eee-5628c14e1526\") " pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx"
Jul 24 17:35:16.790677 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:16.790554    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee14020f-be6f-4053-9eee-5628c14e1526-credential-socket\") pod \"e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx\" (UID: \"ee14020f-be6f-4053-9eee-5628c14e1526\") " pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx"
Jul 24 17:35:16.790733 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:16.790672    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee14020f-be6f-4053-9eee-5628c14e1526-workload-certs\") pod \"e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx\" (UID: \"ee14020f-be6f-4053-9eee-5628c14e1526\") " pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx"
Jul 24 17:35:16.790817 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:16.790798    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee14020f-be6f-4053-9eee-5628c14e1526-istiod-ca-cert\") pod \"e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx\" (UID: \"ee14020f-be6f-4053-9eee-5628c14e1526\") " pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx"
Jul 24 17:35:16.792474 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:16.792453    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee14020f-be6f-4053-9eee-5628c14e1526-istio-envoy\") pod \"e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx\" (UID: \"ee14020f-be6f-4053-9eee-5628c14e1526\") " pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx"
Jul 24 17:35:16.792568 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:16.792552    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee14020f-be6f-4053-9eee-5628c14e1526-istio-podinfo\") pod \"e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx\" (UID: \"ee14020f-be6f-4053-9eee-5628c14e1526\") " pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx"
Jul 24 17:35:16.797920 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:16.797897    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5mzg\" (UniqueName: \"kubernetes.io/projected/ee14020f-be6f-4053-9eee-5628c14e1526-kube-api-access-k5mzg\") pod \"e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx\" (UID: \"ee14020f-be6f-4053-9eee-5628c14e1526\") " pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx"
Jul 24 17:35:16.798016 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:16.797996    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee14020f-be6f-4053-9eee-5628c14e1526-istio-token\") pod \"e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx\" (UID: \"ee14020f-be6f-4053-9eee-5628c14e1526\") " pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx"
Jul 24 17:35:16.931519 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:16.931481    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx"
Jul 24 17:35:17.071461 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:17.071425    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx"]
Jul 24 17:35:17.075008 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:35:17.074973    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee14020f_be6f_4053_9eee_5628c14e1526.slice/crio-01e3a72d41c961bc8e66f37ff07a3781256bc8dde86fa14308df465d27411a72 WatchSource:0}: Error finding container 01e3a72d41c961bc8e66f37ff07a3781256bc8dde86fa14308df465d27411a72: Status 404 returned error can't find the container with id 01e3a72d41c961bc8e66f37ff07a3781256bc8dde86fa14308df465d27411a72
Jul 24 17:35:17.077347 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:17.077311    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:35:17.077418 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:17.077395    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:35:17.077458 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:17.077438    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:35:17.127289 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:17.127266    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx" event={"ID":"ee14020f-be6f-4053-9eee-5628c14e1526","Type":"ContainerStarted","Data":"01e3a72d41c961bc8e66f37ff07a3781256bc8dde86fa14308df465d27411a72"}
Jul 24 17:35:18.132896 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:18.132862    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx" event={"ID":"ee14020f-be6f-4053-9eee-5628c14e1526","Type":"ContainerStarted","Data":"17eae129a8f49f9a64b851a62b8066a9db04727d715b0983119ca7db6ca3ccd5"}
Jul 24 17:35:18.156606 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:18.156548    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx" podStartSLOduration=2.156533794 podStartE2EDuration="2.156533794s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:35:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:35:18.15448997 +0000 UTC m=+1902.427349770" watchObservedRunningTime="2026-07-24 17:35:18.156533794 +0000 UTC m=+1902.429393573"
Jul 24 17:35:18.932137 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:18.932095    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx"
Jul 24 17:35:18.936701 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:18.936680    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx"
Jul 24 17:35:19.139166 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:19.139134    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx"
Jul 24 17:35:19.140247 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:19.140229    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx"
Jul 24 17:35:34.140474 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:34.140439    2561 patch_prober.go:28] interesting pod/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 24 17:35:34.140884 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:34.140505    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx" podUID="ee14020f-be6f-4053-9eee-5628c14e1526" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 24 17:35:34.218778 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:34.218747    2561 generic.go:356] "Generic (PLEG): container finished" podID="ee14020f-be6f-4053-9eee-5628c14e1526" containerID="17eae129a8f49f9a64b851a62b8066a9db04727d715b0983119ca7db6ca3ccd5" exitCode=0
Jul 24 17:35:34.218929 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:34.218822    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx" event={"ID":"ee14020f-be6f-4053-9eee-5628c14e1526","Type":"ContainerDied","Data":"17eae129a8f49f9a64b851a62b8066a9db04727d715b0983119ca7db6ca3ccd5"}
Jul 24 17:35:34.219265 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:34.219247    2561 scope.go:117] "RemoveContainer" containerID="17eae129a8f49f9a64b851a62b8066a9db04727d715b0983119ca7db6ca3ccd5"
Jul 24 17:35:34.220293 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:34.220265    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:35:34.220366 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:34.220349    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:35:34.220409 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:34.220385    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:35:35.224989 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:35.224952    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx" event={"ID":"ee14020f-be6f-4053-9eee-5628c14e1526","Type":"ContainerStarted","Data":"22dacc0c5e2ab9294cb84f184f01d7c871b5cb6ddbdd81452c9631d60b3a9661"}
Jul 24 17:35:35.932050 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:35.932012    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx"
Jul 24 17:35:35.932286 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:35.932258    2561 patch_prober.go:28] interesting pod/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 24 17:35:35.932373 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:35.932320    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx" podUID="ee14020f-be6f-4053-9eee-5628c14e1526" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 24 17:35:36.932477 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:36.932441    2561 patch_prober.go:28] interesting pod/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 24 17:35:36.932868 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:36.932501    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx" podUID="ee14020f-be6f-4053-9eee-5628c14e1526" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 24 17:35:37.932604 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:37.932575    2561 patch_prober.go:28] interesting pod/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 24 17:35:37.932966 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:37.932625    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx" podUID="ee14020f-be6f-4053-9eee-5628c14e1526" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 24 17:35:38.932257 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:38.932223    2561 patch_prober.go:28] interesting pod/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 24 17:35:38.932429 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:38.932273    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx" podUID="ee14020f-be6f-4053-9eee-5628c14e1526" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 24 17:35:39.936202 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:39.936173    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx"
Jul 24 17:35:39.936660 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:39.936436    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx"
Jul 24 17:35:39.937157 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:39.937142    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx"
Jul 24 17:35:48.774471 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:48.774438    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-4fe99dd6/e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8"]
Jul 24 17:35:48.776838 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:48.776822    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-4fe99dd6/e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8"
Jul 24 17:35:48.780052 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:48.779995    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-4fe99dd6\"/\"openshift-service-ca.crt\""
Jul 24 17:35:48.780052 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:48.780045    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-4fe99dd6\"/\"kube-root-ca.crt\""
Jul 24 17:35:48.780265 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:48.780045    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-4fe99dd6\"/\"e2e-lifecycle-model-4fe99dd6-kserve-self-signed-certs\""
Jul 24 17:35:48.780265 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:48.780101    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-4fe99dd6\"/\"default-dockercfg-gb26j\""
Jul 24 17:35:48.785710 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:48.785680    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-4fe99dd6/e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8"]
Jul 24 17:35:48.912366 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:48.912337    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec59036e-8d96-4c19-b03b-fe72426ba1fd-dshm\") pod \"e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8\" (UID: \"ec59036e-8d96-4c19-b03b-fe72426ba1fd\") " pod="ai-tenant-e2e-mt-4fe99dd6/e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8"
Jul 24 17:35:48.912518 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:48.912390    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec59036e-8d96-4c19-b03b-fe72426ba1fd-tmp-dir\") pod \"e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8\" (UID: \"ec59036e-8d96-4c19-b03b-fe72426ba1fd\") " pod="ai-tenant-e2e-mt-4fe99dd6/e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8"
Jul 24 17:35:48.912518 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:48.912432    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec59036e-8d96-4c19-b03b-fe72426ba1fd-home\") pod \"e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8\" (UID: \"ec59036e-8d96-4c19-b03b-fe72426ba1fd\") " pod="ai-tenant-e2e-mt-4fe99dd6/e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8"
Jul 24 17:35:48.912518 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:48.912455    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec59036e-8d96-4c19-b03b-fe72426ba1fd-tls-certs\") pod \"e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8\" (UID: \"ec59036e-8d96-4c19-b03b-fe72426ba1fd\") " pod="ai-tenant-e2e-mt-4fe99dd6/e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8"
Jul 24 17:35:48.912518 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:48.912507    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec59036e-8d96-4c19-b03b-fe72426ba1fd-model-cache\") pod \"e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8\" (UID: \"ec59036e-8d96-4c19-b03b-fe72426ba1fd\") " pod="ai-tenant-e2e-mt-4fe99dd6/e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8"
Jul 24 17:35:48.912660 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:48.912544    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfm5f\" (UniqueName: \"kubernetes.io/projected/ec59036e-8d96-4c19-b03b-fe72426ba1fd-kube-api-access-tfm5f\") pod \"e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8\" (UID: \"ec59036e-8d96-4c19-b03b-fe72426ba1fd\") " pod="ai-tenant-e2e-mt-4fe99dd6/e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8"
Jul 24 17:35:49.013510 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:49.013477    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec59036e-8d96-4c19-b03b-fe72426ba1fd-tls-certs\") pod \"e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8\" (UID: \"ec59036e-8d96-4c19-b03b-fe72426ba1fd\") " pod="ai-tenant-e2e-mt-4fe99dd6/e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8"
Jul 24 17:35:49.013656 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:49.013533    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec59036e-8d96-4c19-b03b-fe72426ba1fd-model-cache\") pod \"e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8\" (UID: \"ec59036e-8d96-4c19-b03b-fe72426ba1fd\") " pod="ai-tenant-e2e-mt-4fe99dd6/e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8"
Jul 24 17:35:49.013656 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:49.013581    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfm5f\" (UniqueName: \"kubernetes.io/projected/ec59036e-8d96-4c19-b03b-fe72426ba1fd-kube-api-access-tfm5f\") pod \"e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8\" (UID: \"ec59036e-8d96-4c19-b03b-fe72426ba1fd\") " pod="ai-tenant-e2e-mt-4fe99dd6/e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8"
Jul 24 17:35:49.013656 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:49.013636    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec59036e-8d96-4c19-b03b-fe72426ba1fd-dshm\") pod \"e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8\" (UID: \"ec59036e-8d96-4c19-b03b-fe72426ba1fd\") " pod="ai-tenant-e2e-mt-4fe99dd6/e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8"
Jul 24 17:35:49.013777 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:49.013687    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec59036e-8d96-4c19-b03b-fe72426ba1fd-tmp-dir\") pod \"e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8\" (UID: \"ec59036e-8d96-4c19-b03b-fe72426ba1fd\") " pod="ai-tenant-e2e-mt-4fe99dd6/e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8"
Jul 24 17:35:49.013777 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:49.013721    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec59036e-8d96-4c19-b03b-fe72426ba1fd-home\") pod \"e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8\" (UID: \"ec59036e-8d96-4c19-b03b-fe72426ba1fd\") " pod="ai-tenant-e2e-mt-4fe99dd6/e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8"
Jul 24 17:35:49.014144 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:49.014116    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec59036e-8d96-4c19-b03b-fe72426ba1fd-model-cache\") pod \"e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8\" (UID: \"ec59036e-8d96-4c19-b03b-fe72426ba1fd\") " pod="ai-tenant-e2e-mt-4fe99dd6/e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8"
Jul 24 17:35:49.014144 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:49.014135    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec59036e-8d96-4c19-b03b-fe72426ba1fd-tmp-dir\") pod \"e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8\" (UID: \"ec59036e-8d96-4c19-b03b-fe72426ba1fd\") " pod="ai-tenant-e2e-mt-4fe99dd6/e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8"
Jul 24 17:35:49.014294 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:49.014219    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec59036e-8d96-4c19-b03b-fe72426ba1fd-home\") pod \"e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8\" (UID: \"ec59036e-8d96-4c19-b03b-fe72426ba1fd\") " pod="ai-tenant-e2e-mt-4fe99dd6/e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8"
Jul 24 17:35:49.015802 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:49.015780    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec59036e-8d96-4c19-b03b-fe72426ba1fd-dshm\") pod \"e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8\" (UID: \"ec59036e-8d96-4c19-b03b-fe72426ba1fd\") " pod="ai-tenant-e2e-mt-4fe99dd6/e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8"
Jul 24 17:35:49.015970 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:49.015951    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec59036e-8d96-4c19-b03b-fe72426ba1fd-tls-certs\") pod \"e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8\" (UID: \"ec59036e-8d96-4c19-b03b-fe72426ba1fd\") " pod="ai-tenant-e2e-mt-4fe99dd6/e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8"
Jul 24 17:35:49.022757 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:49.022738    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfm5f\" (UniqueName: \"kubernetes.io/projected/ec59036e-8d96-4c19-b03b-fe72426ba1fd-kube-api-access-tfm5f\") pod \"e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8\" (UID: \"ec59036e-8d96-4c19-b03b-fe72426ba1fd\") " pod="ai-tenant-e2e-mt-4fe99dd6/e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8"
Jul 24 17:35:49.087734 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:49.087669    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-4fe99dd6/e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8"
Jul 24 17:35:49.215860 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:49.215826    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-4fe99dd6/e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8"]
Jul 24 17:35:49.219037 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:35:49.219011    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podec59036e_8d96_4c19_b03b_fe72426ba1fd.slice/crio-48747e89f6b761126aa8535b43070abdfa33cf3f79b1cc9e2a8bba63261c5fdb WatchSource:0}: Error finding container 48747e89f6b761126aa8535b43070abdfa33cf3f79b1cc9e2a8bba63261c5fdb: Status 404 returned error can't find the container with id 48747e89f6b761126aa8535b43070abdfa33cf3f79b1cc9e2a8bba63261c5fdb
Jul 24 17:35:49.291796 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:49.291773    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-4fe99dd6/e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8" event={"ID":"ec59036e-8d96-4c19-b03b-fe72426ba1fd","Type":"ContainerStarted","Data":"8759b8f60fac809f1b396a2a8f0d54fa05e2bb278cddfecc0db9695dfe2f5c36"}
Jul 24 17:35:49.291902 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:49.291810    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-4fe99dd6/e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8" event={"ID":"ec59036e-8d96-4c19-b03b-fe72426ba1fd","Type":"ContainerStarted","Data":"48747e89f6b761126aa8535b43070abdfa33cf3f79b1cc9e2a8bba63261c5fdb"}
Jul 24 17:35:49.310822 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:49.310776    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-4fe99dd6/e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8" podStartSLOduration=1.310761397 podStartE2EDuration="1.310761397s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:35:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:35:49.309197833 +0000 UTC m=+1933.582057643" watchObservedRunningTime="2026-07-24 17:35:49.310761397 +0000 UTC m=+1933.583621177"
Jul 24 17:35:59.088232 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:59.088193    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-4fe99dd6/e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8"
Jul 24 17:35:59.088749 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:59.088252    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-4fe99dd6/e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8"
Jul 24 17:35:59.101122 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:59.101099    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-4fe99dd6/e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8"
Jul 24 17:35:59.348056 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:35:59.347975    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-4fe99dd6/e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8"
Jul 24 17:36:42.960436 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:36:42.960399    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-4fe99dd6/e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8"]
Jul 24 17:36:57.978473 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:36:57.978420    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-4fe99dd6/e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8" podUID="ec59036e-8d96-4c19-b03b-fe72426ba1fd" containerName="main" containerID="cri-o://8759b8f60fac809f1b396a2a8f0d54fa05e2bb278cddfecc0db9695dfe2f5c36" gracePeriod=45
Jul 24 17:36:58.225541 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:36:58.225517    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-4fe99dd6/e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8"
Jul 24 17:36:58.324105 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:36:58.324019    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec59036e-8d96-4c19-b03b-fe72426ba1fd-dshm\") pod \"ec59036e-8d96-4c19-b03b-fe72426ba1fd\" (UID: \"ec59036e-8d96-4c19-b03b-fe72426ba1fd\") "
Jul 24 17:36:58.324105 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:36:58.324085    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec59036e-8d96-4c19-b03b-fe72426ba1fd-home\") pod \"ec59036e-8d96-4c19-b03b-fe72426ba1fd\" (UID: \"ec59036e-8d96-4c19-b03b-fe72426ba1fd\") "
Jul 24 17:36:58.324328 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:36:58.324126    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec59036e-8d96-4c19-b03b-fe72426ba1fd-tls-certs\") pod \"ec59036e-8d96-4c19-b03b-fe72426ba1fd\" (UID: \"ec59036e-8d96-4c19-b03b-fe72426ba1fd\") "
Jul 24 17:36:58.324328 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:36:58.324162    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec59036e-8d96-4c19-b03b-fe72426ba1fd-model-cache\") pod \"ec59036e-8d96-4c19-b03b-fe72426ba1fd\" (UID: \"ec59036e-8d96-4c19-b03b-fe72426ba1fd\") "
Jul 24 17:36:58.324328 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:36:58.324239    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tfm5f\" (UniqueName: \"kubernetes.io/projected/ec59036e-8d96-4c19-b03b-fe72426ba1fd-kube-api-access-tfm5f\") pod \"ec59036e-8d96-4c19-b03b-fe72426ba1fd\" (UID: \"ec59036e-8d96-4c19-b03b-fe72426ba1fd\") "
Jul 24 17:36:58.324328 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:36:58.324298    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec59036e-8d96-4c19-b03b-fe72426ba1fd-tmp-dir\") pod \"ec59036e-8d96-4c19-b03b-fe72426ba1fd\" (UID: \"ec59036e-8d96-4c19-b03b-fe72426ba1fd\") "
Jul 24 17:36:58.324560 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:36:58.324417    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec59036e-8d96-4c19-b03b-fe72426ba1fd-home" (OuterVolumeSpecName: "home") pod "ec59036e-8d96-4c19-b03b-fe72426ba1fd" (UID: "ec59036e-8d96-4c19-b03b-fe72426ba1fd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:36:58.324560 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:36:58.324453    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec59036e-8d96-4c19-b03b-fe72426ba1fd-model-cache" (OuterVolumeSpecName: "model-cache") pod "ec59036e-8d96-4c19-b03b-fe72426ba1fd" (UID: "ec59036e-8d96-4c19-b03b-fe72426ba1fd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:36:58.324666 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:36:58.324627    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec59036e-8d96-4c19-b03b-fe72426ba1fd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ec59036e-8d96-4c19-b03b-fe72426ba1fd" (UID: "ec59036e-8d96-4c19-b03b-fe72426ba1fd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:36:58.324754 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:36:58.324733    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec59036e-8d96-4c19-b03b-fe72426ba1fd-tmp-dir\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:36:58.324811 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:36:58.324758    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec59036e-8d96-4c19-b03b-fe72426ba1fd-home\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:36:58.324811 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:36:58.324773    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec59036e-8d96-4c19-b03b-fe72426ba1fd-model-cache\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:36:58.326320 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:36:58.326298    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec59036e-8d96-4c19-b03b-fe72426ba1fd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ec59036e-8d96-4c19-b03b-fe72426ba1fd" (UID: "ec59036e-8d96-4c19-b03b-fe72426ba1fd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:36:58.326440 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:36:58.326430    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec59036e-8d96-4c19-b03b-fe72426ba1fd-dshm" (OuterVolumeSpecName: "dshm") pod "ec59036e-8d96-4c19-b03b-fe72426ba1fd" (UID: "ec59036e-8d96-4c19-b03b-fe72426ba1fd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:36:58.326500 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:36:58.326456    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec59036e-8d96-4c19-b03b-fe72426ba1fd-kube-api-access-tfm5f" (OuterVolumeSpecName: "kube-api-access-tfm5f") pod "ec59036e-8d96-4c19-b03b-fe72426ba1fd" (UID: "ec59036e-8d96-4c19-b03b-fe72426ba1fd"). InnerVolumeSpecName "kube-api-access-tfm5f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:36:58.425353 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:36:58.425321    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec59036e-8d96-4c19-b03b-fe72426ba1fd-dshm\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:36:58.425353 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:36:58.425347    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec59036e-8d96-4c19-b03b-fe72426ba1fd-tls-certs\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:36:58.425520 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:36:58.425361    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tfm5f\" (UniqueName: \"kubernetes.io/projected/ec59036e-8d96-4c19-b03b-fe72426ba1fd-kube-api-access-tfm5f\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:36:58.618994 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:36:58.618905    2561 generic.go:356] "Generic (PLEG): container finished" podID="ec59036e-8d96-4c19-b03b-fe72426ba1fd" containerID="8759b8f60fac809f1b396a2a8f0d54fa05e2bb278cddfecc0db9695dfe2f5c36" exitCode=0
Jul 24 17:36:58.618994 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:36:58.618960    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-4fe99dd6/e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8"
Jul 24 17:36:58.618994 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:36:58.618984    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-4fe99dd6/e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8" event={"ID":"ec59036e-8d96-4c19-b03b-fe72426ba1fd","Type":"ContainerDied","Data":"8759b8f60fac809f1b396a2a8f0d54fa05e2bb278cddfecc0db9695dfe2f5c36"}
Jul 24 17:36:58.619276 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:36:58.619023    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-4fe99dd6/e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8" event={"ID":"ec59036e-8d96-4c19-b03b-fe72426ba1fd","Type":"ContainerDied","Data":"48747e89f6b761126aa8535b43070abdfa33cf3f79b1cc9e2a8bba63261c5fdb"}
Jul 24 17:36:58.619276 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:36:58.619040    2561 scope.go:117] "RemoveContainer" containerID="8759b8f60fac809f1b396a2a8f0d54fa05e2bb278cddfecc0db9695dfe2f5c36"
Jul 24 17:36:58.627701 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:36:58.627686    2561 scope.go:117] "RemoveContainer" containerID="8759b8f60fac809f1b396a2a8f0d54fa05e2bb278cddfecc0db9695dfe2f5c36"
Jul 24 17:36:58.627967 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:36:58.627949    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8759b8f60fac809f1b396a2a8f0d54fa05e2bb278cddfecc0db9695dfe2f5c36\": container with ID starting with 8759b8f60fac809f1b396a2a8f0d54fa05e2bb278cddfecc0db9695dfe2f5c36 not found: ID does not exist" containerID="8759b8f60fac809f1b396a2a8f0d54fa05e2bb278cddfecc0db9695dfe2f5c36"
Jul 24 17:36:58.628022 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:36:58.627975    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8759b8f60fac809f1b396a2a8f0d54fa05e2bb278cddfecc0db9695dfe2f5c36"} err="failed to get container status \"8759b8f60fac809f1b396a2a8f0d54fa05e2bb278cddfecc0db9695dfe2f5c36\": rpc error: code = NotFound desc = could not find container \"8759b8f60fac809f1b396a2a8f0d54fa05e2bb278cddfecc0db9695dfe2f5c36\": container with ID starting with 8759b8f60fac809f1b396a2a8f0d54fa05e2bb278cddfecc0db9695dfe2f5c36 not found: ID does not exist"
Jul 24 17:36:58.646803 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:36:58.646779    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-4fe99dd6/e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8"]
Jul 24 17:36:58.648746 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:36:58.648728    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-4fe99dd6/e2e-lifecycle-model-4fe99dd6-kserve-5d59696c67-bb6t8"]
Jul 24 17:37:00.258496 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:37:00.258461    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec59036e-8d96-4c19-b03b-fe72426ba1fd" path="/var/lib/kubelet/pods/ec59036e-8d96-4c19-b03b-fe72426ba1fd/volumes"
Jul 24 17:37:26.083716 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:37:26.083676    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx"]
Jul 24 17:37:26.084271 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:37:26.083936    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx" podUID="ee14020f-be6f-4053-9eee-5628c14e1526" containerName="istio-proxy" containerID="cri-o://22dacc0c5e2ab9294cb84f184f01d7c871b5cb6ddbdd81452c9631d60b3a9661" gracePeriod=30
Jul 24 17:37:31.342587 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:37:31.342524    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx"
Jul 24 17:37:31.429034 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:37:31.428999    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee14020f-be6f-4053-9eee-5628c14e1526-workload-socket\") pod \"ee14020f-be6f-4053-9eee-5628c14e1526\" (UID: \"ee14020f-be6f-4053-9eee-5628c14e1526\") "
Jul 24 17:37:31.429253 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:37:31.429042    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee14020f-be6f-4053-9eee-5628c14e1526-istio-podinfo\") pod \"ee14020f-be6f-4053-9eee-5628c14e1526\" (UID: \"ee14020f-be6f-4053-9eee-5628c14e1526\") "
Jul 24 17:37:31.429253 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:37:31.429116    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee14020f-be6f-4053-9eee-5628c14e1526-istio-envoy\") pod \"ee14020f-be6f-4053-9eee-5628c14e1526\" (UID: \"ee14020f-be6f-4053-9eee-5628c14e1526\") "
Jul 24 17:37:31.429253 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:37:31.429152    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee14020f-be6f-4053-9eee-5628c14e1526-istio-token\") pod \"ee14020f-be6f-4053-9eee-5628c14e1526\" (UID: \"ee14020f-be6f-4053-9eee-5628c14e1526\") "
Jul 24 17:37:31.429253 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:37:31.429229    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k5mzg\" (UniqueName: \"kubernetes.io/projected/ee14020f-be6f-4053-9eee-5628c14e1526-kube-api-access-k5mzg\") pod \"ee14020f-be6f-4053-9eee-5628c14e1526\" (UID: \"ee14020f-be6f-4053-9eee-5628c14e1526\") "
Jul 24 17:37:31.429478 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:37:31.429260    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee14020f-be6f-4053-9eee-5628c14e1526-workload-certs\") pod \"ee14020f-be6f-4053-9eee-5628c14e1526\" (UID: \"ee14020f-be6f-4053-9eee-5628c14e1526\") "
Jul 24 17:37:31.429478 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:37:31.429304    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee14020f-be6f-4053-9eee-5628c14e1526-credential-socket\") pod \"ee14020f-be6f-4053-9eee-5628c14e1526\" (UID: \"ee14020f-be6f-4053-9eee-5628c14e1526\") "
Jul 24 17:37:31.429478 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:37:31.429332    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee14020f-be6f-4053-9eee-5628c14e1526-istio-data\") pod \"ee14020f-be6f-4053-9eee-5628c14e1526\" (UID: \"ee14020f-be6f-4053-9eee-5628c14e1526\") "
Jul 24 17:37:31.429639 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:37:31.429359    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee14020f-be6f-4053-9eee-5628c14e1526-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ee14020f-be6f-4053-9eee-5628c14e1526" (UID: "ee14020f-be6f-4053-9eee-5628c14e1526"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:37:31.429705 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:37:31.429599    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee14020f-be6f-4053-9eee-5628c14e1526-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ee14020f-be6f-4053-9eee-5628c14e1526" (UID: "ee14020f-be6f-4053-9eee-5628c14e1526"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:37:31.429705 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:37:31.429613    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee14020f-be6f-4053-9eee-5628c14e1526-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ee14020f-be6f-4053-9eee-5628c14e1526" (UID: "ee14020f-be6f-4053-9eee-5628c14e1526"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:37:31.429705 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:37:31.429379    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee14020f-be6f-4053-9eee-5628c14e1526-istiod-ca-cert\") pod \"ee14020f-be6f-4053-9eee-5628c14e1526\" (UID: \"ee14020f-be6f-4053-9eee-5628c14e1526\") "
Jul 24 17:37:31.429849 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:37:31.429700    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee14020f-be6f-4053-9eee-5628c14e1526-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ee14020f-be6f-4053-9eee-5628c14e1526" (UID: "ee14020f-be6f-4053-9eee-5628c14e1526"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:37:31.430096 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:37:31.430076    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee14020f-be6f-4053-9eee-5628c14e1526-workload-certs\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:37:31.430149 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:37:31.430103    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee14020f-be6f-4053-9eee-5628c14e1526-credential-socket\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:37:31.430149 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:37:31.430119    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee14020f-be6f-4053-9eee-5628c14e1526-istiod-ca-cert\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:37:31.430149 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:37:31.430133    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee14020f-be6f-4053-9eee-5628c14e1526-workload-socket\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:37:31.430437 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:37:31.430415    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee14020f-be6f-4053-9eee-5628c14e1526-istio-data" (OuterVolumeSpecName: "istio-data") pod "ee14020f-be6f-4053-9eee-5628c14e1526" (UID: "ee14020f-be6f-4053-9eee-5628c14e1526"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:37:31.431463 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:37:31.431438    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ee14020f-be6f-4053-9eee-5628c14e1526-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ee14020f-be6f-4053-9eee-5628c14e1526" (UID: "ee14020f-be6f-4053-9eee-5628c14e1526"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 17:37:31.431463 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:37:31.431442    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee14020f-be6f-4053-9eee-5628c14e1526-istio-token" (OuterVolumeSpecName: "istio-token") pod "ee14020f-be6f-4053-9eee-5628c14e1526" (UID: "ee14020f-be6f-4053-9eee-5628c14e1526"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:37:31.431688 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:37:31.431670    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee14020f-be6f-4053-9eee-5628c14e1526-kube-api-access-k5mzg" (OuterVolumeSpecName: "kube-api-access-k5mzg") pod "ee14020f-be6f-4053-9eee-5628c14e1526" (UID: "ee14020f-be6f-4053-9eee-5628c14e1526"). InnerVolumeSpecName "kube-api-access-k5mzg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:37:31.431734 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:37:31.431705    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee14020f-be6f-4053-9eee-5628c14e1526-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ee14020f-be6f-4053-9eee-5628c14e1526" (UID: "ee14020f-be6f-4053-9eee-5628c14e1526"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:37:31.531351 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:37:31.531303    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee14020f-be6f-4053-9eee-5628c14e1526-istio-token\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:37:31.531351 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:37:31.531344    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5mzg\" (UniqueName: \"kubernetes.io/projected/ee14020f-be6f-4053-9eee-5628c14e1526-kube-api-access-k5mzg\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:37:31.531351 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:37:31.531360    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee14020f-be6f-4053-9eee-5628c14e1526-istio-data\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:37:31.531718 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:37:31.531373    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee14020f-be6f-4053-9eee-5628c14e1526-istio-podinfo\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:37:31.531718 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:37:31.531384    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee14020f-be6f-4053-9eee-5628c14e1526-istio-envoy\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:37:31.773884 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:37:31.773850    2561 generic.go:356] "Generic (PLEG): container finished" podID="ee14020f-be6f-4053-9eee-5628c14e1526" containerID="22dacc0c5e2ab9294cb84f184f01d7c871b5cb6ddbdd81452c9631d60b3a9661" exitCode=0
Jul 24 17:37:31.774085 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:37:31.773896    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx"
Jul 24 17:37:31.774085 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:37:31.773921    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx" event={"ID":"ee14020f-be6f-4053-9eee-5628c14e1526","Type":"ContainerDied","Data":"22dacc0c5e2ab9294cb84f184f01d7c871b5cb6ddbdd81452c9631d60b3a9661"}
Jul 24 17:37:31.774085 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:37:31.773964    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx" event={"ID":"ee14020f-be6f-4053-9eee-5628c14e1526","Type":"ContainerDied","Data":"01e3a72d41c961bc8e66f37ff07a3781256bc8dde86fa14308df465d27411a72"}
Jul 24 17:37:31.774085 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:37:31.773984    2561 scope.go:117] "RemoveContainer" containerID="22dacc0c5e2ab9294cb84f184f01d7c871b5cb6ddbdd81452c9631d60b3a9661"
Jul 24 17:37:31.782889 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:37:31.782870    2561 scope.go:117] "RemoveContainer" containerID="17eae129a8f49f9a64b851a62b8066a9db04727d715b0983119ca7db6ca3ccd5"
Jul 24 17:37:31.790241 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:37:31.790223    2561 scope.go:117] "RemoveContainer" containerID="22dacc0c5e2ab9294cb84f184f01d7c871b5cb6ddbdd81452c9631d60b3a9661"
Jul 24 17:37:31.790476 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:37:31.790458    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22dacc0c5e2ab9294cb84f184f01d7c871b5cb6ddbdd81452c9631d60b3a9661\": container with ID starting with 22dacc0c5e2ab9294cb84f184f01d7c871b5cb6ddbdd81452c9631d60b3a9661 not found: ID does not exist" containerID="22dacc0c5e2ab9294cb84f184f01d7c871b5cb6ddbdd81452c9631d60b3a9661"
Jul 24 17:37:31.790525 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:37:31.790482    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22dacc0c5e2ab9294cb84f184f01d7c871b5cb6ddbdd81452c9631d60b3a9661"} err="failed to get container status \"22dacc0c5e2ab9294cb84f184f01d7c871b5cb6ddbdd81452c9631d60b3a9661\": rpc error: code = NotFound desc = could not find container \"22dacc0c5e2ab9294cb84f184f01d7c871b5cb6ddbdd81452c9631d60b3a9661\": container with ID starting with 22dacc0c5e2ab9294cb84f184f01d7c871b5cb6ddbdd81452c9631d60b3a9661 not found: ID does not exist"
Jul 24 17:37:31.790525 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:37:31.790499    2561 scope.go:117] "RemoveContainer" containerID="17eae129a8f49f9a64b851a62b8066a9db04727d715b0983119ca7db6ca3ccd5"
Jul 24 17:37:31.790712 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:37:31.790696    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17eae129a8f49f9a64b851a62b8066a9db04727d715b0983119ca7db6ca3ccd5\": container with ID starting with 17eae129a8f49f9a64b851a62b8066a9db04727d715b0983119ca7db6ca3ccd5 not found: ID does not exist" containerID="17eae129a8f49f9a64b851a62b8066a9db04727d715b0983119ca7db6ca3ccd5"
Jul 24 17:37:31.790755 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:37:31.790716    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17eae129a8f49f9a64b851a62b8066a9db04727d715b0983119ca7db6ca3ccd5"} err="failed to get container status \"17eae129a8f49f9a64b851a62b8066a9db04727d715b0983119ca7db6ca3ccd5\": rpc error: code = NotFound desc = could not find container \"17eae129a8f49f9a64b851a62b8066a9db04727d715b0983119ca7db6ca3ccd5\": container with ID starting with 17eae129a8f49f9a64b851a62b8066a9db04727d715b0983119ca7db6ca3ccd5 not found: ID does not exist"
Jul 24 17:37:31.824394 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:37:31.824365    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx"]
Jul 24 17:37:31.844461 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:37:31.844430    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-4fe99dd6-openshift-default-86b74948cb-5grqx"]
Jul 24 17:37:32.258120 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:37:32.258088    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee14020f-be6f-4053-9eee-5628c14e1526" path="/var/lib/kubelet/pods/ee14020f-be6f-4053-9eee-5628c14e1526/volumes"
Jul 24 17:38:23.125256 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:23.125226    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp"]
Jul 24 17:38:23.125701 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:23.125566    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec59036e-8d96-4c19-b03b-fe72426ba1fd" containerName="main"
Jul 24 17:38:23.125701 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:23.125577    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec59036e-8d96-4c19-b03b-fe72426ba1fd" containerName="main"
Jul 24 17:38:23.125701 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:23.125591    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee14020f-be6f-4053-9eee-5628c14e1526" containerName="istio-proxy"
Jul 24 17:38:23.125701 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:23.125598    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee14020f-be6f-4053-9eee-5628c14e1526" containerName="istio-proxy"
Jul 24 17:38:23.125701 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:23.125662    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee14020f-be6f-4053-9eee-5628c14e1526" containerName="istio-proxy"
Jul 24 17:38:23.125701 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:23.125672    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee14020f-be6f-4053-9eee-5628c14e1526" containerName="istio-proxy"
Jul 24 17:38:23.125701 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:23.125681    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec59036e-8d96-4c19-b03b-fe72426ba1fd" containerName="main"
Jul 24 17:38:23.128500 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:23.128484    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp"
Jul 24 17:38:23.130812 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:23.130790    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-0d8e36-openshift-default-dockercfg-h7m7j\""
Jul 24 17:38:23.130991 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:23.130978    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 24 17:38:23.144762 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:23.144739    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp"]
Jul 24 17:38:23.206229 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:23.206205    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/801807a4-54e6-4bae-a2e5-1ead2485fcc8-istio-token\") pod \"e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp\" (UID: \"801807a4-54e6-4bae-a2e5-1ead2485fcc8\") " pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp"
Jul 24 17:38:23.206355 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:23.206234    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/801807a4-54e6-4bae-a2e5-1ead2485fcc8-istio-envoy\") pod \"e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp\" (UID: \"801807a4-54e6-4bae-a2e5-1ead2485fcc8\") " pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp"
Jul 24 17:38:23.206355 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:23.206257    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfmcj\" (UniqueName: \"kubernetes.io/projected/801807a4-54e6-4bae-a2e5-1ead2485fcc8-kube-api-access-nfmcj\") pod \"e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp\" (UID: \"801807a4-54e6-4bae-a2e5-1ead2485fcc8\") " pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp"
Jul 24 17:38:23.206355 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:23.206275    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/801807a4-54e6-4bae-a2e5-1ead2485fcc8-workload-certs\") pod \"e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp\" (UID: \"801807a4-54e6-4bae-a2e5-1ead2485fcc8\") " pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp"
Jul 24 17:38:23.206525 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:23.206359    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/801807a4-54e6-4bae-a2e5-1ead2485fcc8-credential-socket\") pod \"e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp\" (UID: \"801807a4-54e6-4bae-a2e5-1ead2485fcc8\") " pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp"
Jul 24 17:38:23.206525 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:23.206385    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/801807a4-54e6-4bae-a2e5-1ead2485fcc8-istio-data\") pod \"e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp\" (UID: \"801807a4-54e6-4bae-a2e5-1ead2485fcc8\") " pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp"
Jul 24 17:38:23.206525 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:23.206404    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/801807a4-54e6-4bae-a2e5-1ead2485fcc8-istiod-ca-cert\") pod \"e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp\" (UID: \"801807a4-54e6-4bae-a2e5-1ead2485fcc8\") " pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp"
Jul 24 17:38:23.206525 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:23.206423    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/801807a4-54e6-4bae-a2e5-1ead2485fcc8-workload-socket\") pod \"e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp\" (UID: \"801807a4-54e6-4bae-a2e5-1ead2485fcc8\") " pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp"
Jul 24 17:38:23.206525 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:23.206448    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/801807a4-54e6-4bae-a2e5-1ead2485fcc8-istio-podinfo\") pod \"e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp\" (UID: \"801807a4-54e6-4bae-a2e5-1ead2485fcc8\") " pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp"
Jul 24 17:38:23.307367 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:23.307326    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/801807a4-54e6-4bae-a2e5-1ead2485fcc8-istio-token\") pod \"e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp\" (UID: \"801807a4-54e6-4bae-a2e5-1ead2485fcc8\") " pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp"
Jul 24 17:38:23.307367 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:23.307370    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/801807a4-54e6-4bae-a2e5-1ead2485fcc8-istio-envoy\") pod \"e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp\" (UID: \"801807a4-54e6-4bae-a2e5-1ead2485fcc8\") " pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp"
Jul 24 17:38:23.307542 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:23.307406    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfmcj\" (UniqueName: \"kubernetes.io/projected/801807a4-54e6-4bae-a2e5-1ead2485fcc8-kube-api-access-nfmcj\") pod \"e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp\" (UID: \"801807a4-54e6-4bae-a2e5-1ead2485fcc8\") " pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp"
Jul 24 17:38:23.307542 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:23.307431    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/801807a4-54e6-4bae-a2e5-1ead2485fcc8-workload-certs\") pod \"e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp\" (UID: \"801807a4-54e6-4bae-a2e5-1ead2485fcc8\") " pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp"
Jul 24 17:38:23.307542 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:23.307469    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/801807a4-54e6-4bae-a2e5-1ead2485fcc8-credential-socket\") pod \"e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp\" (UID: \"801807a4-54e6-4bae-a2e5-1ead2485fcc8\") " pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp"
Jul 24 17:38:23.307542 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:23.307501    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/801807a4-54e6-4bae-a2e5-1ead2485fcc8-istio-data\") pod \"e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp\" (UID: \"801807a4-54e6-4bae-a2e5-1ead2485fcc8\") " pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp"
Jul 24 17:38:23.307542 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:23.307527    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/801807a4-54e6-4bae-a2e5-1ead2485fcc8-istiod-ca-cert\") pod \"e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp\" (UID: \"801807a4-54e6-4bae-a2e5-1ead2485fcc8\") " pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp"
Jul 24 17:38:23.307795 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:23.307558    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/801807a4-54e6-4bae-a2e5-1ead2485fcc8-workload-socket\") pod \"e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp\" (UID: \"801807a4-54e6-4bae-a2e5-1ead2485fcc8\") " pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp"
Jul 24 17:38:23.307795 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:23.307593    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/801807a4-54e6-4bae-a2e5-1ead2485fcc8-istio-podinfo\") pod \"e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp\" (UID: \"801807a4-54e6-4bae-a2e5-1ead2485fcc8\") " pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp"
Jul 24 17:38:23.307924 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:23.307903    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/801807a4-54e6-4bae-a2e5-1ead2485fcc8-istio-data\") pod \"e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp\" (UID: \"801807a4-54e6-4bae-a2e5-1ead2485fcc8\") " pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp"
Jul 24 17:38:23.307984 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:23.307942    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/801807a4-54e6-4bae-a2e5-1ead2485fcc8-workload-socket\") pod \"e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp\" (UID: \"801807a4-54e6-4bae-a2e5-1ead2485fcc8\") " pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp"
Jul 24 17:38:23.307984 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:23.307969    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/801807a4-54e6-4bae-a2e5-1ead2485fcc8-credential-socket\") pod \"e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp\" (UID: \"801807a4-54e6-4bae-a2e5-1ead2485fcc8\") " pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp"
Jul 24 17:38:23.308110 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:23.308029    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/801807a4-54e6-4bae-a2e5-1ead2485fcc8-workload-certs\") pod \"e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp\" (UID: \"801807a4-54e6-4bae-a2e5-1ead2485fcc8\") " pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp"
Jul 24 17:38:23.308354 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:23.308331    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/801807a4-54e6-4bae-a2e5-1ead2485fcc8-istiod-ca-cert\") pod \"e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp\" (UID: \"801807a4-54e6-4bae-a2e5-1ead2485fcc8\") " pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp"
Jul 24 17:38:23.309725 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:23.309706    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/801807a4-54e6-4bae-a2e5-1ead2485fcc8-istio-envoy\") pod \"e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp\" (UID: \"801807a4-54e6-4bae-a2e5-1ead2485fcc8\") " pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp"
Jul 24 17:38:23.309976 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:23.309959    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/801807a4-54e6-4bae-a2e5-1ead2485fcc8-istio-podinfo\") pod \"e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp\" (UID: \"801807a4-54e6-4bae-a2e5-1ead2485fcc8\") " pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp"
Jul 24 17:38:23.319687 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:23.319661    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/801807a4-54e6-4bae-a2e5-1ead2485fcc8-istio-token\") pod \"e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp\" (UID: \"801807a4-54e6-4bae-a2e5-1ead2485fcc8\") " pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp"
Jul 24 17:38:23.319891 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:23.319874    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfmcj\" (UniqueName: \"kubernetes.io/projected/801807a4-54e6-4bae-a2e5-1ead2485fcc8-kube-api-access-nfmcj\") pod \"e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp\" (UID: \"801807a4-54e6-4bae-a2e5-1ead2485fcc8\") " pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp"
Jul 24 17:38:23.439228 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:23.439149    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp"
Jul 24 17:38:23.579323 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:23.579299    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp"]
Jul 24 17:38:23.581514 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:38:23.581486    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod801807a4_54e6_4bae_a2e5_1ead2485fcc8.slice/crio-33cd83bc25daf26e98fe999b79c9f2c81b1941feff632ca57dbbc6dd63e6af8f WatchSource:0}: Error finding container 33cd83bc25daf26e98fe999b79c9f2c81b1941feff632ca57dbbc6dd63e6af8f: Status 404 returned error can't find the container with id 33cd83bc25daf26e98fe999b79c9f2c81b1941feff632ca57dbbc6dd63e6af8f
Jul 24 17:38:23.583754 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:23.583722    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:38:23.583837 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:23.583787    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:38:23.583837 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:23.583813    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:38:24.023343 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:24.023310    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp" event={"ID":"801807a4-54e6-4bae-a2e5-1ead2485fcc8","Type":"ContainerStarted","Data":"59c8b8325b865b0194efcb4d890294caac0368a76cd55c50f9f13b392a12322a"}
Jul 24 17:38:24.023518 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:24.023364    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp" event={"ID":"801807a4-54e6-4bae-a2e5-1ead2485fcc8","Type":"ContainerStarted","Data":"33cd83bc25daf26e98fe999b79c9f2c81b1941feff632ca57dbbc6dd63e6af8f"}
Jul 24 17:38:24.044099 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:24.043674    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp" podStartSLOduration=1.043657109 podStartE2EDuration="1.043657109s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:38:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:38:24.042838196 +0000 UTC m=+2088.315698004" watchObservedRunningTime="2026-07-24 17:38:24.043657109 +0000 UTC m=+2088.316516890"
Jul 24 17:38:24.439951 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:24.439916    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp"
Jul 24 17:38:24.444844 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:24.444823    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp"
Jul 24 17:38:25.027828 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:25.027795    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp"
Jul 24 17:38:25.028613 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:25.028594    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp"
Jul 24 17:38:26.836553 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:26.836514    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-0d8e36-56bff4bb6-gr52q"]
Jul 24 17:38:26.836928 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:26.836910    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee14020f-be6f-4053-9eee-5628c14e1526" containerName="istio-proxy"
Jul 24 17:38:26.836973 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:26.836929    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee14020f-be6f-4053-9eee-5628c14e1526" containerName="istio-proxy"
Jul 24 17:38:26.840008 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:26.839991    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-0d8e36-56bff4bb6-gr52q"
Jul 24 17:38:26.846033 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:26.846012    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-0d8e36-dockercfg-f749r\""
Jul 24 17:38:26.846427 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:26.846403    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-0d8e36\""
Jul 24 17:38:26.855790 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:26.855770    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-0d8e36-56bff4bb6-gr52q"]
Jul 24 17:38:26.945468 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:26.945434    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5rvk\" (UniqueName: \"kubernetes.io/projected/0b245132-c25e-4265-a60f-f9ff2602bde4-kube-api-access-b5rvk\") pod \"payload-processing-e2e-inf-a-0d8e36-56bff4bb6-gr52q\" (UID: \"0b245132-c25e-4265-a60f-f9ff2602bde4\") " pod="openshift-ingress/payload-processing-e2e-inf-a-0d8e36-56bff4bb6-gr52q"
Jul 24 17:38:26.945684 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:26.945495    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b245132-c25e-4265-a60f-f9ff2602bde4-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-0d8e36-56bff4bb6-gr52q\" (UID: \"0b245132-c25e-4265-a60f-f9ff2602bde4\") " pod="openshift-ingress/payload-processing-e2e-inf-a-0d8e36-56bff4bb6-gr52q"
Jul 24 17:38:27.046694 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:27.046662    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5rvk\" (UniqueName: \"kubernetes.io/projected/0b245132-c25e-4265-a60f-f9ff2602bde4-kube-api-access-b5rvk\") pod \"payload-processing-e2e-inf-a-0d8e36-56bff4bb6-gr52q\" (UID: \"0b245132-c25e-4265-a60f-f9ff2602bde4\") " pod="openshift-ingress/payload-processing-e2e-inf-a-0d8e36-56bff4bb6-gr52q"
Jul 24 17:38:27.046876 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:27.046729    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b245132-c25e-4265-a60f-f9ff2602bde4-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-0d8e36-56bff4bb6-gr52q\" (UID: \"0b245132-c25e-4265-a60f-f9ff2602bde4\") " pod="openshift-ingress/payload-processing-e2e-inf-a-0d8e36-56bff4bb6-gr52q"
Jul 24 17:38:27.047519 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:27.047494    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b245132-c25e-4265-a60f-f9ff2602bde4-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-0d8e36-56bff4bb6-gr52q\" (UID: \"0b245132-c25e-4265-a60f-f9ff2602bde4\") " pod="openshift-ingress/payload-processing-e2e-inf-a-0d8e36-56bff4bb6-gr52q"
Jul 24 17:38:27.054693 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:27.054673    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5rvk\" (UniqueName: \"kubernetes.io/projected/0b245132-c25e-4265-a60f-f9ff2602bde4-kube-api-access-b5rvk\") pod \"payload-processing-e2e-inf-a-0d8e36-56bff4bb6-gr52q\" (UID: \"0b245132-c25e-4265-a60f-f9ff2602bde4\") " pod="openshift-ingress/payload-processing-e2e-inf-a-0d8e36-56bff4bb6-gr52q"
Jul 24 17:38:27.150811 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:27.150785    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-0d8e36-56bff4bb6-gr52q"
Jul 24 17:38:27.502467 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:27.502442    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-0d8e36-56bff4bb6-gr52q"]
Jul 24 17:38:27.504772 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:38:27.504740    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b245132_c25e_4265_a60f_f9ff2602bde4.slice/crio-727e5c0b8042e5a00fd2c1f76560aa8f25ba0b27ec6d6572107d18426010b30d WatchSource:0}: Error finding container 727e5c0b8042e5a00fd2c1f76560aa8f25ba0b27ec6d6572107d18426010b30d: Status 404 returned error can't find the container with id 727e5c0b8042e5a00fd2c1f76560aa8f25ba0b27ec6d6572107d18426010b30d
Jul 24 17:38:28.044268 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:28.044237    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-0d8e36-56bff4bb6-gr52q" event={"ID":"0b245132-c25e-4265-a60f-f9ff2602bde4","Type":"ContainerStarted","Data":"44e0e83d5d45315b70347d052b56fcf5571d13008209eca40334bb8557bea414"}
Jul 24 17:38:28.044638 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:28.044287    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-0d8e36-56bff4bb6-gr52q" event={"ID":"0b245132-c25e-4265-a60f-f9ff2602bde4","Type":"ContainerStarted","Data":"727e5c0b8042e5a00fd2c1f76560aa8f25ba0b27ec6d6572107d18426010b30d"}
Jul 24 17:38:28.044638 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:28.044321    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-0d8e36-56bff4bb6-gr52q"
Jul 24 17:38:28.070354 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:28.070307    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-0d8e36-56bff4bb6-gr52q" podStartSLOduration=2.070291678 podStartE2EDuration="2.070291678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:38:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:38:28.068919297 +0000 UTC m=+2092.341779096" watchObservedRunningTime="2026-07-24 17:38:28.070291678 +0000 UTC m=+2092.343151458"
Jul 24 17:38:34.823455 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:34.823422    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-746c88-7f955cc69b-x6fxf"]
Jul 24 17:38:34.827110 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:34.827093    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-746c88-7f955cc69b-x6fxf"
Jul 24 17:38:34.830563 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:34.830539    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-746c88\""
Jul 24 17:38:34.855446 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:34.855423    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-746c88-7f955cc69b-x6fxf"]
Jul 24 17:38:35.019139 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:35.019109    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8abb0e32-07b3-4133-9571-6148ffa1ea6d-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-746c88-7f955cc69b-x6fxf\" (UID: \"8abb0e32-07b3-4133-9571-6148ffa1ea6d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-746c88-7f955cc69b-x6fxf"
Jul 24 17:38:35.019292 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:35.019166    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldhwd\" (UniqueName: \"kubernetes.io/projected/8abb0e32-07b3-4133-9571-6148ffa1ea6d-kube-api-access-ldhwd\") pod \"payload-processing-e2e-inf-b-746c88-7f955cc69b-x6fxf\" (UID: \"8abb0e32-07b3-4133-9571-6148ffa1ea6d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-746c88-7f955cc69b-x6fxf"
Jul 24 17:38:35.120051 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:35.119965    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8abb0e32-07b3-4133-9571-6148ffa1ea6d-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-746c88-7f955cc69b-x6fxf\" (UID: \"8abb0e32-07b3-4133-9571-6148ffa1ea6d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-746c88-7f955cc69b-x6fxf"
Jul 24 17:38:35.120051 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:35.120007    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldhwd\" (UniqueName: \"kubernetes.io/projected/8abb0e32-07b3-4133-9571-6148ffa1ea6d-kube-api-access-ldhwd\") pod \"payload-processing-e2e-inf-b-746c88-7f955cc69b-x6fxf\" (UID: \"8abb0e32-07b3-4133-9571-6148ffa1ea6d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-746c88-7f955cc69b-x6fxf"
Jul 24 17:38:35.120737 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:35.120710    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8abb0e32-07b3-4133-9571-6148ffa1ea6d-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-746c88-7f955cc69b-x6fxf\" (UID: \"8abb0e32-07b3-4133-9571-6148ffa1ea6d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-746c88-7f955cc69b-x6fxf"
Jul 24 17:38:35.135075 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:35.135047    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldhwd\" (UniqueName: \"kubernetes.io/projected/8abb0e32-07b3-4133-9571-6148ffa1ea6d-kube-api-access-ldhwd\") pod \"payload-processing-e2e-inf-b-746c88-7f955cc69b-x6fxf\" (UID: \"8abb0e32-07b3-4133-9571-6148ffa1ea6d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-746c88-7f955cc69b-x6fxf"
Jul 24 17:38:35.136863 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:35.136843    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-746c88-7f955cc69b-x6fxf"
Jul 24 17:38:35.488278 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:35.488249    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-746c88-7f955cc69b-x6fxf"]
Jul 24 17:38:35.491418 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:38:35.491390    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8abb0e32_07b3_4133_9571_6148ffa1ea6d.slice/crio-1a971ec530c9d691c22523c15bdeffe6b32f8b4aed78bdc2fff8b851c6e6aab6 WatchSource:0}: Error finding container 1a971ec530c9d691c22523c15bdeffe6b32f8b4aed78bdc2fff8b851c6e6aab6: Status 404 returned error can't find the container with id 1a971ec530c9d691c22523c15bdeffe6b32f8b4aed78bdc2fff8b851c6e6aab6
Jul 24 17:38:36.087391 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:36.087356    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-746c88-7f955cc69b-x6fxf" event={"ID":"8abb0e32-07b3-4133-9571-6148ffa1ea6d","Type":"ContainerStarted","Data":"b1323d6a03030e568b316c0dc257ae008dc2b437249673386d5ddb368b12739e"}
Jul 24 17:38:36.087844 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:36.087408    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-746c88-7f955cc69b-x6fxf" event={"ID":"8abb0e32-07b3-4133-9571-6148ffa1ea6d","Type":"ContainerStarted","Data":"1a971ec530c9d691c22523c15bdeffe6b32f8b4aed78bdc2fff8b851c6e6aab6"}
Jul 24 17:38:36.087844 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:36.087437    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-746c88-7f955cc69b-x6fxf"
Jul 24 17:38:36.108019 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:36.107971    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-746c88-7f955cc69b-x6fxf" podStartSLOduration=2.10795703 podStartE2EDuration="2.10795703s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:38:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:38:36.106656405 +0000 UTC m=+2100.379516186" watchObservedRunningTime="2026-07-24 17:38:36.10795703 +0000 UTC m=+2100.380816810"
Jul 24 17:38:36.316327 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:36.316303    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6h754_860ed1fc-612f-4796-8077-72bc6c5d84db/ovn-acl-logging/0.log"
Jul 24 17:38:36.316327 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:36.316312    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6h754_860ed1fc-612f-4796-8077-72bc6c5d84db/ovn-acl-logging/0.log"
Jul 24 17:38:39.051109 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:39.051053    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-0d8e36-56bff4bb6-gr52q"
Jul 24 17:38:41.069224 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:41.069189    2561 patch_prober.go:28] interesting pod/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 24 17:38:41.069718 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:41.069253    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp" podUID="801807a4-54e6-4bae-a2e5-1ead2485fcc8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 24 17:38:43.123250 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:43.123216    2561 generic.go:356] "Generic (PLEG): container finished" podID="801807a4-54e6-4bae-a2e5-1ead2485fcc8" containerID="59c8b8325b865b0194efcb4d890294caac0368a76cd55c50f9f13b392a12322a" exitCode=0
Jul 24 17:38:43.123649 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:43.123272    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp" event={"ID":"801807a4-54e6-4bae-a2e5-1ead2485fcc8","Type":"ContainerDied","Data":"59c8b8325b865b0194efcb4d890294caac0368a76cd55c50f9f13b392a12322a"}
Jul 24 17:38:43.123692 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:43.123651    2561 scope.go:117] "RemoveContainer" containerID="59c8b8325b865b0194efcb4d890294caac0368a76cd55c50f9f13b392a12322a"
Jul 24 17:38:43.124701 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:43.124668    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:38:43.124751 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:43.124741    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:38:43.124790 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:43.124775    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:38:44.130317 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:44.130279    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp" event={"ID":"801807a4-54e6-4bae-a2e5-1ead2485fcc8","Type":"ContainerStarted","Data":"f7e9f2eaadf1f66794d193c3583b6303759930a158b65c411ac83a7ed4c125fd"}
Jul 24 17:38:44.439972 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:44.439890    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp"
Jul 24 17:38:44.440226 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:44.440204    2561 patch_prober.go:28] interesting pod/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 24 17:38:44.440293 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:44.440257    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp" podUID="801807a4-54e6-4bae-a2e5-1ead2485fcc8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 24 17:38:45.439849 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:45.439818    2561 patch_prober.go:28] interesting pod/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 24 17:38:45.440217 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:45.439874    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp" podUID="801807a4-54e6-4bae-a2e5-1ead2485fcc8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 24 17:38:46.439830 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:46.439793    2561 patch_prober.go:28] interesting pod/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 24 17:38:46.440013 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:46.439858    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp" podUID="801807a4-54e6-4bae-a2e5-1ead2485fcc8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 24 17:38:47.094996 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:47.094967    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-746c88-7f955cc69b-x6fxf"
Jul 24 17:38:47.440261 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:47.440230    2561 patch_prober.go:28] interesting pod/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 24 17:38:47.440660 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:47.440285    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp" podUID="801807a4-54e6-4bae-a2e5-1ead2485fcc8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 24 17:38:47.582670 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:47.582629    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-0d8e36/test-model-0d8e36-kserve-79dd87b9df-57tmk"]
Jul 24 17:38:47.586079 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:47.586036    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-0d8e36/test-model-0d8e36-kserve-79dd87b9df-57tmk"
Jul 24 17:38:47.594252 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:47.594228    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-0d8e36\"/\"default-dockercfg-sk9dp\""
Jul 24 17:38:47.594413 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:47.594389    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-0d8e36\"/\"kube-root-ca.crt\""
Jul 24 17:38:47.594788 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:47.594368    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-0d8e36\"/\"openshift-service-ca.crt\""
Jul 24 17:38:47.594916 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:47.594332    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-0d8e36\"/\"test-model-0d8e36-kserve-self-signed-certs\""
Jul 24 17:38:47.595555 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:47.595534    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-0d8e36/test-model-0d8e36-kserve-79dd87b9df-57tmk"]
Jul 24 17:38:47.648834 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:47.648799    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ee854ce-9fb1-4b85-9b28-7a666486a186-tmp-dir\") pod \"test-model-0d8e36-kserve-79dd87b9df-57tmk\" (UID: \"6ee854ce-9fb1-4b85-9b28-7a666486a186\") " pod="ai-tenant-e2e-inf-a-0d8e36/test-model-0d8e36-kserve-79dd87b9df-57tmk"
Jul 24 17:38:47.648987 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:47.648909    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsqxc\" (UniqueName: \"kubernetes.io/projected/6ee854ce-9fb1-4b85-9b28-7a666486a186-kube-api-access-wsqxc\") pod \"test-model-0d8e36-kserve-79dd87b9df-57tmk\" (UID: \"6ee854ce-9fb1-4b85-9b28-7a666486a186\") " pod="ai-tenant-e2e-inf-a-0d8e36/test-model-0d8e36-kserve-79dd87b9df-57tmk"
Jul 24 17:38:47.648987 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:47.648966    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ee854ce-9fb1-4b85-9b28-7a666486a186-dshm\") pod \"test-model-0d8e36-kserve-79dd87b9df-57tmk\" (UID: \"6ee854ce-9fb1-4b85-9b28-7a666486a186\") " pod="ai-tenant-e2e-inf-a-0d8e36/test-model-0d8e36-kserve-79dd87b9df-57tmk"
Jul 24 17:38:47.648987 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:47.648983    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ee854ce-9fb1-4b85-9b28-7a666486a186-tls-certs\") pod \"test-model-0d8e36-kserve-79dd87b9df-57tmk\" (UID: \"6ee854ce-9fb1-4b85-9b28-7a666486a186\") " pod="ai-tenant-e2e-inf-a-0d8e36/test-model-0d8e36-kserve-79dd87b9df-57tmk"
Jul 24 17:38:47.649112 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:47.649078    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ee854ce-9fb1-4b85-9b28-7a666486a186-home\") pod \"test-model-0d8e36-kserve-79dd87b9df-57tmk\" (UID: \"6ee854ce-9fb1-4b85-9b28-7a666486a186\") " pod="ai-tenant-e2e-inf-a-0d8e36/test-model-0d8e36-kserve-79dd87b9df-57tmk"
Jul 24 17:38:47.649151 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:47.649115    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ee854ce-9fb1-4b85-9b28-7a666486a186-model-cache\") pod \"test-model-0d8e36-kserve-79dd87b9df-57tmk\" (UID: \"6ee854ce-9fb1-4b85-9b28-7a666486a186\") " pod="ai-tenant-e2e-inf-a-0d8e36/test-model-0d8e36-kserve-79dd87b9df-57tmk"
Jul 24 17:38:47.749706 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:47.749628    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ee854ce-9fb1-4b85-9b28-7a666486a186-tmp-dir\") pod \"test-model-0d8e36-kserve-79dd87b9df-57tmk\" (UID: \"6ee854ce-9fb1-4b85-9b28-7a666486a186\") " pod="ai-tenant-e2e-inf-a-0d8e36/test-model-0d8e36-kserve-79dd87b9df-57tmk"
Jul 24 17:38:47.749853 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:47.749716    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsqxc\" (UniqueName: \"kubernetes.io/projected/6ee854ce-9fb1-4b85-9b28-7a666486a186-kube-api-access-wsqxc\") pod \"test-model-0d8e36-kserve-79dd87b9df-57tmk\" (UID: \"6ee854ce-9fb1-4b85-9b28-7a666486a186\") " pod="ai-tenant-e2e-inf-a-0d8e36/test-model-0d8e36-kserve-79dd87b9df-57tmk"
Jul 24 17:38:47.749853 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:47.749775    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ee854ce-9fb1-4b85-9b28-7a666486a186-dshm\") pod \"test-model-0d8e36-kserve-79dd87b9df-57tmk\" (UID: \"6ee854ce-9fb1-4b85-9b28-7a666486a186\") " pod="ai-tenant-e2e-inf-a-0d8e36/test-model-0d8e36-kserve-79dd87b9df-57tmk"
Jul 24 17:38:47.749853 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:47.749797    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ee854ce-9fb1-4b85-9b28-7a666486a186-tls-certs\") pod \"test-model-0d8e36-kserve-79dd87b9df-57tmk\" (UID: \"6ee854ce-9fb1-4b85-9b28-7a666486a186\") " pod="ai-tenant-e2e-inf-a-0d8e36/test-model-0d8e36-kserve-79dd87b9df-57tmk"
Jul 24 17:38:47.749853 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:47.749846    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ee854ce-9fb1-4b85-9b28-7a666486a186-home\") pod \"test-model-0d8e36-kserve-79dd87b9df-57tmk\" (UID: \"6ee854ce-9fb1-4b85-9b28-7a666486a186\") " pod="ai-tenant-e2e-inf-a-0d8e36/test-model-0d8e36-kserve-79dd87b9df-57tmk"
Jul 24 17:38:47.750114 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:47.749886    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ee854ce-9fb1-4b85-9b28-7a666486a186-model-cache\") pod \"test-model-0d8e36-kserve-79dd87b9df-57tmk\" (UID: \"6ee854ce-9fb1-4b85-9b28-7a666486a186\") " pod="ai-tenant-e2e-inf-a-0d8e36/test-model-0d8e36-kserve-79dd87b9df-57tmk"
Jul 24 17:38:47.750186 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:47.750131    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ee854ce-9fb1-4b85-9b28-7a666486a186-tmp-dir\") pod \"test-model-0d8e36-kserve-79dd87b9df-57tmk\" (UID: \"6ee854ce-9fb1-4b85-9b28-7a666486a186\") " pod="ai-tenant-e2e-inf-a-0d8e36/test-model-0d8e36-kserve-79dd87b9df-57tmk"
Jul 24 17:38:47.750246 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:47.750205    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ee854ce-9fb1-4b85-9b28-7a666486a186-model-cache\") pod \"test-model-0d8e36-kserve-79dd87b9df-57tmk\" (UID: \"6ee854ce-9fb1-4b85-9b28-7a666486a186\") " pod="ai-tenant-e2e-inf-a-0d8e36/test-model-0d8e36-kserve-79dd87b9df-57tmk"
Jul 24 17:38:47.750291 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:47.750257    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ee854ce-9fb1-4b85-9b28-7a666486a186-home\") pod \"test-model-0d8e36-kserve-79dd87b9df-57tmk\" (UID: \"6ee854ce-9fb1-4b85-9b28-7a666486a186\") " pod="ai-tenant-e2e-inf-a-0d8e36/test-model-0d8e36-kserve-79dd87b9df-57tmk"
Jul 24 17:38:47.752141 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:47.752117    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ee854ce-9fb1-4b85-9b28-7a666486a186-dshm\") pod \"test-model-0d8e36-kserve-79dd87b9df-57tmk\" (UID: \"6ee854ce-9fb1-4b85-9b28-7a666486a186\") " pod="ai-tenant-e2e-inf-a-0d8e36/test-model-0d8e36-kserve-79dd87b9df-57tmk"
Jul 24 17:38:47.752430 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:47.752411    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ee854ce-9fb1-4b85-9b28-7a666486a186-tls-certs\") pod \"test-model-0d8e36-kserve-79dd87b9df-57tmk\" (UID: \"6ee854ce-9fb1-4b85-9b28-7a666486a186\") " pod="ai-tenant-e2e-inf-a-0d8e36/test-model-0d8e36-kserve-79dd87b9df-57tmk"
Jul 24 17:38:47.758016 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:47.757988    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsqxc\" (UniqueName: \"kubernetes.io/projected/6ee854ce-9fb1-4b85-9b28-7a666486a186-kube-api-access-wsqxc\") pod \"test-model-0d8e36-kserve-79dd87b9df-57tmk\" (UID: \"6ee854ce-9fb1-4b85-9b28-7a666486a186\") " pod="ai-tenant-e2e-inf-a-0d8e36/test-model-0d8e36-kserve-79dd87b9df-57tmk"
Jul 24 17:38:47.902977 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:47.902938    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-0d8e36/test-model-0d8e36-kserve-79dd87b9df-57tmk"
Jul 24 17:38:48.042629 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:48.042602    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-0d8e36/test-model-0d8e36-kserve-79dd87b9df-57tmk"]
Jul 24 17:38:48.044957 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:38:48.044930    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ee854ce_9fb1_4b85_9b28_7a666486a186.slice/crio-33ed1b3d23b3b996f7710da7ca93d54e23984744d49e1946bf824f940e7c8295 WatchSource:0}: Error finding container 33ed1b3d23b3b996f7710da7ca93d54e23984744d49e1946bf824f940e7c8295: Status 404 returned error can't find the container with id 33ed1b3d23b3b996f7710da7ca93d54e23984744d49e1946bf824f940e7c8295
Jul 24 17:38:48.153208 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:48.153170    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-0d8e36/test-model-0d8e36-kserve-79dd87b9df-57tmk" event={"ID":"6ee854ce-9fb1-4b85-9b28-7a666486a186","Type":"ContainerStarted","Data":"5b66d627f04e91047e56202afed243492c6e552400d2dcad30ed5871be007a9c"}
Jul 24 17:38:48.153385 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:48.153222    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-0d8e36/test-model-0d8e36-kserve-79dd87b9df-57tmk" event={"ID":"6ee854ce-9fb1-4b85-9b28-7a666486a186","Type":"ContainerStarted","Data":"33ed1b3d23b3b996f7710da7ca93d54e23984744d49e1946bf824f940e7c8295"}
Jul 24 17:38:48.170678 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:48.170629    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-0d8e36/test-model-0d8e36-kserve-79dd87b9df-57tmk" podStartSLOduration=1.170613242 podStartE2EDuration="1.170613242s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:38:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:38:48.169821978 +0000 UTC m=+2112.442681759" watchObservedRunningTime="2026-07-24 17:38:48.170613242 +0000 UTC m=+2112.443473022"
Jul 24 17:38:48.443573 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:48.443543    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp"
Jul 24 17:38:48.443967 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:48.443929    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp"
Jul 24 17:38:48.444619 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:48.444599    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp"
Jul 24 17:38:57.903441 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:57.903405    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-0d8e36/test-model-0d8e36-kserve-79dd87b9df-57tmk"
Jul 24 17:38:57.903950 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:57.903462    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-0d8e36/test-model-0d8e36-kserve-79dd87b9df-57tmk"
Jul 24 17:38:57.915757 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:57.915727    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-0d8e36/test-model-0d8e36-kserve-79dd87b9df-57tmk"
Jul 24 17:38:58.211171 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:38:58.211099    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-0d8e36/test-model-0d8e36-kserve-79dd87b9df-57tmk"
Jul 24 17:39:58.108135 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:39:58.108104    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-0d8e36/test-model-0d8e36-kserve-79dd87b9df-57tmk"]
Jul 24 17:40:09.890807 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:09.890775    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-0d8e36-56bff4bb6-gr52q"]
Jul 24 17:40:09.891385 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:09.890984    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-0d8e36-56bff4bb6-gr52q" podUID="0b245132-c25e-4265-a60f-f9ff2602bde4" containerName="payload-processing" containerID="cri-o://44e0e83d5d45315b70347d052b56fcf5571d13008209eca40334bb8557bea414" gracePeriod=30
Jul 24 17:40:10.145782 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:10.145715    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-0d8e36-56bff4bb6-gr52q"
Jul 24 17:40:10.216319 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:10.216274    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b5rvk\" (UniqueName: \"kubernetes.io/projected/0b245132-c25e-4265-a60f-f9ff2602bde4-kube-api-access-b5rvk\") pod \"0b245132-c25e-4265-a60f-f9ff2602bde4\" (UID: \"0b245132-c25e-4265-a60f-f9ff2602bde4\") "
Jul 24 17:40:10.216499 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:10.216440    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b245132-c25e-4265-a60f-f9ff2602bde4-plugins-config-volume\") pod \"0b245132-c25e-4265-a60f-f9ff2602bde4\" (UID: \"0b245132-c25e-4265-a60f-f9ff2602bde4\") "
Jul 24 17:40:10.216779 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:10.216756    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b245132-c25e-4265-a60f-f9ff2602bde4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0b245132-c25e-4265-a60f-f9ff2602bde4" (UID: "0b245132-c25e-4265-a60f-f9ff2602bde4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:40:10.218383 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:10.218357    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b245132-c25e-4265-a60f-f9ff2602bde4-kube-api-access-b5rvk" (OuterVolumeSpecName: "kube-api-access-b5rvk") pod "0b245132-c25e-4265-a60f-f9ff2602bde4" (UID: "0b245132-c25e-4265-a60f-f9ff2602bde4"). InnerVolumeSpecName "kube-api-access-b5rvk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:40:10.317546 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:10.317507    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b5rvk\" (UniqueName: \"kubernetes.io/projected/0b245132-c25e-4265-a60f-f9ff2602bde4-kube-api-access-b5rvk\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:40:10.317546 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:10.317540    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b245132-c25e-4265-a60f-f9ff2602bde4-plugins-config-volume\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:40:10.539696 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:10.539613    2561 generic.go:356] "Generic (PLEG): container finished" podID="0b245132-c25e-4265-a60f-f9ff2602bde4" containerID="44e0e83d5d45315b70347d052b56fcf5571d13008209eca40334bb8557bea414" exitCode=0
Jul 24 17:40:10.539696 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:10.539660    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-0d8e36-56bff4bb6-gr52q"
Jul 24 17:40:10.539876 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:10.539697    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-0d8e36-56bff4bb6-gr52q" event={"ID":"0b245132-c25e-4265-a60f-f9ff2602bde4","Type":"ContainerDied","Data":"44e0e83d5d45315b70347d052b56fcf5571d13008209eca40334bb8557bea414"}
Jul 24 17:40:10.539876 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:10.539755    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-0d8e36-56bff4bb6-gr52q" event={"ID":"0b245132-c25e-4265-a60f-f9ff2602bde4","Type":"ContainerDied","Data":"727e5c0b8042e5a00fd2c1f76560aa8f25ba0b27ec6d6572107d18426010b30d"}
Jul 24 17:40:10.539876 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:10.539779    2561 scope.go:117] "RemoveContainer" containerID="44e0e83d5d45315b70347d052b56fcf5571d13008209eca40334bb8557bea414"
Jul 24 17:40:10.551193 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:10.551170    2561 scope.go:117] "RemoveContainer" containerID="44e0e83d5d45315b70347d052b56fcf5571d13008209eca40334bb8557bea414"
Jul 24 17:40:10.551454 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:40:10.551434    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44e0e83d5d45315b70347d052b56fcf5571d13008209eca40334bb8557bea414\": container with ID starting with 44e0e83d5d45315b70347d052b56fcf5571d13008209eca40334bb8557bea414 not found: ID does not exist" containerID="44e0e83d5d45315b70347d052b56fcf5571d13008209eca40334bb8557bea414"
Jul 24 17:40:10.551523 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:10.551466    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44e0e83d5d45315b70347d052b56fcf5571d13008209eca40334bb8557bea414"} err="failed to get container status \"44e0e83d5d45315b70347d052b56fcf5571d13008209eca40334bb8557bea414\": rpc error: code = NotFound desc = could not find container \"44e0e83d5d45315b70347d052b56fcf5571d13008209eca40334bb8557bea414\": container with ID starting with 44e0e83d5d45315b70347d052b56fcf5571d13008209eca40334bb8557bea414 not found: ID does not exist"
Jul 24 17:40:10.555174 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:10.555149    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-0d8e36-56bff4bb6-gr52q"]
Jul 24 17:40:10.559891 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:10.559870    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-0d8e36-56bff4bb6-gr52q"]
Jul 24 17:40:12.258148 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:12.258118    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b245132-c25e-4265-a60f-f9ff2602bde4" path="/var/lib/kubelet/pods/0b245132-c25e-4265-a60f-f9ff2602bde4/volumes"
Jul 24 17:40:13.127172 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:13.127129    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-0d8e36/test-model-0d8e36-kserve-79dd87b9df-57tmk" podUID="6ee854ce-9fb1-4b85-9b28-7a666486a186" containerName="main" containerID="cri-o://5b66d627f04e91047e56202afed243492c6e552400d2dcad30ed5871be007a9c" gracePeriod=45
Jul 24 17:40:13.382684 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:13.382621    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-0d8e36/test-model-0d8e36-kserve-79dd87b9df-57tmk"
Jul 24 17:40:13.446365 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:13.446338    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ee854ce-9fb1-4b85-9b28-7a666486a186-home\") pod \"6ee854ce-9fb1-4b85-9b28-7a666486a186\" (UID: \"6ee854ce-9fb1-4b85-9b28-7a666486a186\") "
Jul 24 17:40:13.446523 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:13.446401    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ee854ce-9fb1-4b85-9b28-7a666486a186-tmp-dir\") pod \"6ee854ce-9fb1-4b85-9b28-7a666486a186\" (UID: \"6ee854ce-9fb1-4b85-9b28-7a666486a186\") "
Jul 24 17:40:13.446523 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:13.446430    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ee854ce-9fb1-4b85-9b28-7a666486a186-model-cache\") pod \"6ee854ce-9fb1-4b85-9b28-7a666486a186\" (UID: \"6ee854ce-9fb1-4b85-9b28-7a666486a186\") "
Jul 24 17:40:13.446523 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:13.446484    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wsqxc\" (UniqueName: \"kubernetes.io/projected/6ee854ce-9fb1-4b85-9b28-7a666486a186-kube-api-access-wsqxc\") pod \"6ee854ce-9fb1-4b85-9b28-7a666486a186\" (UID: \"6ee854ce-9fb1-4b85-9b28-7a666486a186\") "
Jul 24 17:40:13.446699 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:13.446525    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ee854ce-9fb1-4b85-9b28-7a666486a186-tls-certs\") pod \"6ee854ce-9fb1-4b85-9b28-7a666486a186\" (UID: \"6ee854ce-9fb1-4b85-9b28-7a666486a186\") "
Jul 24 17:40:13.446699 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:13.446572    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ee854ce-9fb1-4b85-9b28-7a666486a186-dshm\") pod \"6ee854ce-9fb1-4b85-9b28-7a666486a186\" (UID: \"6ee854ce-9fb1-4b85-9b28-7a666486a186\") "
Jul 24 17:40:13.446699 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:13.446646    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ee854ce-9fb1-4b85-9b28-7a666486a186-home" (OuterVolumeSpecName: "home") pod "6ee854ce-9fb1-4b85-9b28-7a666486a186" (UID: "6ee854ce-9fb1-4b85-9b28-7a666486a186"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:40:13.446853 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:13.446727    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ee854ce-9fb1-4b85-9b28-7a666486a186-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6ee854ce-9fb1-4b85-9b28-7a666486a186" (UID: "6ee854ce-9fb1-4b85-9b28-7a666486a186"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:40:13.446853 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:13.446748    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ee854ce-9fb1-4b85-9b28-7a666486a186-model-cache" (OuterVolumeSpecName: "model-cache") pod "6ee854ce-9fb1-4b85-9b28-7a666486a186" (UID: "6ee854ce-9fb1-4b85-9b28-7a666486a186"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:40:13.446959 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:13.446886    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ee854ce-9fb1-4b85-9b28-7a666486a186-tmp-dir\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:40:13.446959 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:13.446906    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ee854ce-9fb1-4b85-9b28-7a666486a186-model-cache\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:40:13.446959 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:13.446920    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ee854ce-9fb1-4b85-9b28-7a666486a186-home\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:40:13.448632 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:13.448608    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ee854ce-9fb1-4b85-9b28-7a666486a186-dshm" (OuterVolumeSpecName: "dshm") pod "6ee854ce-9fb1-4b85-9b28-7a666486a186" (UID: "6ee854ce-9fb1-4b85-9b28-7a666486a186"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:40:13.449091 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:13.449055    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ee854ce-9fb1-4b85-9b28-7a666486a186-kube-api-access-wsqxc" (OuterVolumeSpecName: "kube-api-access-wsqxc") pod "6ee854ce-9fb1-4b85-9b28-7a666486a186" (UID: "6ee854ce-9fb1-4b85-9b28-7a666486a186"). InnerVolumeSpecName "kube-api-access-wsqxc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:40:13.449182 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:13.449090    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ee854ce-9fb1-4b85-9b28-7a666486a186-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6ee854ce-9fb1-4b85-9b28-7a666486a186" (UID: "6ee854ce-9fb1-4b85-9b28-7a666486a186"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:40:13.547843 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:13.547807    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ee854ce-9fb1-4b85-9b28-7a666486a186-tls-certs\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:40:13.547843 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:13.547835    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ee854ce-9fb1-4b85-9b28-7a666486a186-dshm\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:40:13.547843 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:13.547845    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wsqxc\" (UniqueName: \"kubernetes.io/projected/6ee854ce-9fb1-4b85-9b28-7a666486a186-kube-api-access-wsqxc\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:40:13.557243 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:13.557208    2561 generic.go:356] "Generic (PLEG): container finished" podID="6ee854ce-9fb1-4b85-9b28-7a666486a186" containerID="5b66d627f04e91047e56202afed243492c6e552400d2dcad30ed5871be007a9c" exitCode=0
Jul 24 17:40:13.557380 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:13.557254    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-0d8e36/test-model-0d8e36-kserve-79dd87b9df-57tmk"
Jul 24 17:40:13.557380 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:13.557295    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-0d8e36/test-model-0d8e36-kserve-79dd87b9df-57tmk" event={"ID":"6ee854ce-9fb1-4b85-9b28-7a666486a186","Type":"ContainerDied","Data":"5b66d627f04e91047e56202afed243492c6e552400d2dcad30ed5871be007a9c"}
Jul 24 17:40:13.557380 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:13.557341    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-0d8e36/test-model-0d8e36-kserve-79dd87b9df-57tmk" event={"ID":"6ee854ce-9fb1-4b85-9b28-7a666486a186","Type":"ContainerDied","Data":"33ed1b3d23b3b996f7710da7ca93d54e23984744d49e1946bf824f940e7c8295"}
Jul 24 17:40:13.557380 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:13.557362    2561 scope.go:117] "RemoveContainer" containerID="5b66d627f04e91047e56202afed243492c6e552400d2dcad30ed5871be007a9c"
Jul 24 17:40:13.566762 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:13.566746    2561 scope.go:117] "RemoveContainer" containerID="5b66d627f04e91047e56202afed243492c6e552400d2dcad30ed5871be007a9c"
Jul 24 17:40:13.567032 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:40:13.567010    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b66d627f04e91047e56202afed243492c6e552400d2dcad30ed5871be007a9c\": container with ID starting with 5b66d627f04e91047e56202afed243492c6e552400d2dcad30ed5871be007a9c not found: ID does not exist" containerID="5b66d627f04e91047e56202afed243492c6e552400d2dcad30ed5871be007a9c"
Jul 24 17:40:13.567104 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:13.567038    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b66d627f04e91047e56202afed243492c6e552400d2dcad30ed5871be007a9c"} err="failed to get container status \"5b66d627f04e91047e56202afed243492c6e552400d2dcad30ed5871be007a9c\": rpc error: code = NotFound desc = could not find container \"5b66d627f04e91047e56202afed243492c6e552400d2dcad30ed5871be007a9c\": container with ID starting with 5b66d627f04e91047e56202afed243492c6e552400d2dcad30ed5871be007a9c not found: ID does not exist"
Jul 24 17:40:13.578719 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:13.578695    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-0d8e36/test-model-0d8e36-kserve-79dd87b9df-57tmk"]
Jul 24 17:40:13.581000 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:13.580980    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-0d8e36/test-model-0d8e36-kserve-79dd87b9df-57tmk"]
Jul 24 17:40:14.259909 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:14.259874    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ee854ce-9fb1-4b85-9b28-7a666486a186" path="/var/lib/kubelet/pods/6ee854ce-9fb1-4b85-9b28-7a666486a186/volumes"
Jul 24 17:40:21.370323 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:21.370293    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp"]
Jul 24 17:40:21.370781 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:21.370511    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp" podUID="801807a4-54e6-4bae-a2e5-1ead2485fcc8" containerName="istio-proxy" containerID="cri-o://f7e9f2eaadf1f66794d193c3583b6303759930a158b65c411ac83a7ed4c125fd" gracePeriod=30
Jul 24 17:40:26.619285 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:26.619257    2561 generic.go:356] "Generic (PLEG): container finished" podID="801807a4-54e6-4bae-a2e5-1ead2485fcc8" containerID="f7e9f2eaadf1f66794d193c3583b6303759930a158b65c411ac83a7ed4c125fd" exitCode=0
Jul 24 17:40:26.619650 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:26.619329    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp" event={"ID":"801807a4-54e6-4bae-a2e5-1ead2485fcc8","Type":"ContainerDied","Data":"f7e9f2eaadf1f66794d193c3583b6303759930a158b65c411ac83a7ed4c125fd"}
Jul 24 17:40:26.619650 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:26.619404    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp" event={"ID":"801807a4-54e6-4bae-a2e5-1ead2485fcc8","Type":"ContainerDied","Data":"33cd83bc25daf26e98fe999b79c9f2c81b1941feff632ca57dbbc6dd63e6af8f"}
Jul 24 17:40:26.619650 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:26.619431    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="33cd83bc25daf26e98fe999b79c9f2c81b1941feff632ca57dbbc6dd63e6af8f"
Jul 24 17:40:26.619650 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:26.619452    2561 scope.go:117] "RemoveContainer" containerID="59c8b8325b865b0194efcb4d890294caac0368a76cd55c50f9f13b392a12322a"
Jul 24 17:40:26.621824 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:26.621806    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp"
Jul 24 17:40:26.766615 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:26.766537    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/801807a4-54e6-4bae-a2e5-1ead2485fcc8-istio-token\") pod \"801807a4-54e6-4bae-a2e5-1ead2485fcc8\" (UID: \"801807a4-54e6-4bae-a2e5-1ead2485fcc8\") "
Jul 24 17:40:26.766615 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:26.766582    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nfmcj\" (UniqueName: \"kubernetes.io/projected/801807a4-54e6-4bae-a2e5-1ead2485fcc8-kube-api-access-nfmcj\") pod \"801807a4-54e6-4bae-a2e5-1ead2485fcc8\" (UID: \"801807a4-54e6-4bae-a2e5-1ead2485fcc8\") "
Jul 24 17:40:26.766832 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:26.766631    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/801807a4-54e6-4bae-a2e5-1ead2485fcc8-workload-certs\") pod \"801807a4-54e6-4bae-a2e5-1ead2485fcc8\" (UID: \"801807a4-54e6-4bae-a2e5-1ead2485fcc8\") "
Jul 24 17:40:26.766832 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:26.766646    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/801807a4-54e6-4bae-a2e5-1ead2485fcc8-istio-data\") pod \"801807a4-54e6-4bae-a2e5-1ead2485fcc8\" (UID: \"801807a4-54e6-4bae-a2e5-1ead2485fcc8\") "
Jul 24 17:40:26.766832 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:26.766668    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/801807a4-54e6-4bae-a2e5-1ead2485fcc8-istio-envoy\") pod \"801807a4-54e6-4bae-a2e5-1ead2485fcc8\" (UID: \"801807a4-54e6-4bae-a2e5-1ead2485fcc8\") "
Jul 24 17:40:26.766832 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:26.766690    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/801807a4-54e6-4bae-a2e5-1ead2485fcc8-workload-socket\") pod \"801807a4-54e6-4bae-a2e5-1ead2485fcc8\" (UID: \"801807a4-54e6-4bae-a2e5-1ead2485fcc8\") "
Jul 24 17:40:26.766832 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:26.766753    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/801807a4-54e6-4bae-a2e5-1ead2485fcc8-credential-socket\") pod \"801807a4-54e6-4bae-a2e5-1ead2485fcc8\" (UID: \"801807a4-54e6-4bae-a2e5-1ead2485fcc8\") "
Jul 24 17:40:26.767151 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:26.766988    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/801807a4-54e6-4bae-a2e5-1ead2485fcc8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "801807a4-54e6-4bae-a2e5-1ead2485fcc8" (UID: "801807a4-54e6-4bae-a2e5-1ead2485fcc8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:40:26.767151 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:26.767048    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/801807a4-54e6-4bae-a2e5-1ead2485fcc8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "801807a4-54e6-4bae-a2e5-1ead2485fcc8" (UID: "801807a4-54e6-4bae-a2e5-1ead2485fcc8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:40:26.767151 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:26.767087    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/801807a4-54e6-4bae-a2e5-1ead2485fcc8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "801807a4-54e6-4bae-a2e5-1ead2485fcc8" (UID: "801807a4-54e6-4bae-a2e5-1ead2485fcc8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:40:26.767151 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:26.767116    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/801807a4-54e6-4bae-a2e5-1ead2485fcc8-istiod-ca-cert\") pod \"801807a4-54e6-4bae-a2e5-1ead2485fcc8\" (UID: \"801807a4-54e6-4bae-a2e5-1ead2485fcc8\") "
Jul 24 17:40:26.767377 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:26.767163    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/801807a4-54e6-4bae-a2e5-1ead2485fcc8-istio-podinfo\") pod \"801807a4-54e6-4bae-a2e5-1ead2485fcc8\" (UID: \"801807a4-54e6-4bae-a2e5-1ead2485fcc8\") "
Jul 24 17:40:26.767377 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:26.767351    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/801807a4-54e6-4bae-a2e5-1ead2485fcc8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "801807a4-54e6-4bae-a2e5-1ead2485fcc8" (UID: "801807a4-54e6-4bae-a2e5-1ead2485fcc8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:40:26.767590 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:26.767564    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/801807a4-54e6-4bae-a2e5-1ead2485fcc8-istiod-ca-cert\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:40:26.767590 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:26.767587    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/801807a4-54e6-4bae-a2e5-1ead2485fcc8-workload-certs\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:40:26.767783 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:26.767599    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/801807a4-54e6-4bae-a2e5-1ead2485fcc8-workload-socket\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:40:26.767783 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:26.767612    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/801807a4-54e6-4bae-a2e5-1ead2485fcc8-credential-socket\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:40:26.767783 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:26.767645    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/801807a4-54e6-4bae-a2e5-1ead2485fcc8-istio-data" (OuterVolumeSpecName: "istio-data") pod "801807a4-54e6-4bae-a2e5-1ead2485fcc8" (UID: "801807a4-54e6-4bae-a2e5-1ead2485fcc8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:40:26.768964 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:26.768937    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/801807a4-54e6-4bae-a2e5-1ead2485fcc8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "801807a4-54e6-4bae-a2e5-1ead2485fcc8" (UID: "801807a4-54e6-4bae-a2e5-1ead2485fcc8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:40:26.769147 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:26.769130    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/801807a4-54e6-4bae-a2e5-1ead2485fcc8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "801807a4-54e6-4bae-a2e5-1ead2485fcc8" (UID: "801807a4-54e6-4bae-a2e5-1ead2485fcc8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 17:40:26.769276 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:26.769257    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/801807a4-54e6-4bae-a2e5-1ead2485fcc8-istio-token" (OuterVolumeSpecName: "istio-token") pod "801807a4-54e6-4bae-a2e5-1ead2485fcc8" (UID: "801807a4-54e6-4bae-a2e5-1ead2485fcc8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:40:26.769340 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:26.769254    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/801807a4-54e6-4bae-a2e5-1ead2485fcc8-kube-api-access-nfmcj" (OuterVolumeSpecName: "kube-api-access-nfmcj") pod "801807a4-54e6-4bae-a2e5-1ead2485fcc8" (UID: "801807a4-54e6-4bae-a2e5-1ead2485fcc8"). InnerVolumeSpecName "kube-api-access-nfmcj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:40:26.868840 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:26.868814    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/801807a4-54e6-4bae-a2e5-1ead2485fcc8-istio-token\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:40:26.868840 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:26.868840    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nfmcj\" (UniqueName: \"kubernetes.io/projected/801807a4-54e6-4bae-a2e5-1ead2485fcc8-kube-api-access-nfmcj\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:40:26.869008 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:26.868851    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/801807a4-54e6-4bae-a2e5-1ead2485fcc8-istio-data\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:40:26.869008 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:26.868859    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/801807a4-54e6-4bae-a2e5-1ead2485fcc8-istio-envoy\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:40:26.869008 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:26.868867    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/801807a4-54e6-4bae-a2e5-1ead2485fcc8-istio-podinfo\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:40:27.626160 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:27.626131    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp"
Jul 24 17:40:27.659006 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:27.658982    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp"]
Jul 24 17:40:27.664374 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:27.664350    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-0d8e36-openshift-default-dcd59ff78-fsdfp"]
Jul 24 17:40:28.259204 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:28.259177    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="801807a4-54e6-4bae-a2e5-1ead2485fcc8" path="/var/lib/kubelet/pods/801807a4-54e6-4bae-a2e5-1ead2485fcc8/volumes"
Jul 24 17:40:32.380179 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:32.380145    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-746c88-7f955cc69b-x6fxf"]
Jul 24 17:40:32.380642 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:32.380408    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-746c88-7f955cc69b-x6fxf" podUID="8abb0e32-07b3-4133-9571-6148ffa1ea6d" containerName="payload-processing" containerID="cri-o://b1323d6a03030e568b316c0dc257ae008dc2b437249673386d5ddb368b12739e" gracePeriod=30
Jul 24 17:40:32.626577 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:32.626550    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-746c88-7f955cc69b-x6fxf"
Jul 24 17:40:32.652260 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:32.652203    2561 generic.go:356] "Generic (PLEG): container finished" podID="8abb0e32-07b3-4133-9571-6148ffa1ea6d" containerID="b1323d6a03030e568b316c0dc257ae008dc2b437249673386d5ddb368b12739e" exitCode=0
Jul 24 17:40:32.652260 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:32.652234    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-746c88-7f955cc69b-x6fxf"
Jul 24 17:40:32.652260 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:32.652248    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-746c88-7f955cc69b-x6fxf" event={"ID":"8abb0e32-07b3-4133-9571-6148ffa1ea6d","Type":"ContainerDied","Data":"b1323d6a03030e568b316c0dc257ae008dc2b437249673386d5ddb368b12739e"}
Jul 24 17:40:32.652471 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:32.652293    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-746c88-7f955cc69b-x6fxf" event={"ID":"8abb0e32-07b3-4133-9571-6148ffa1ea6d","Type":"ContainerDied","Data":"1a971ec530c9d691c22523c15bdeffe6b32f8b4aed78bdc2fff8b851c6e6aab6"}
Jul 24 17:40:32.652471 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:32.652316    2561 scope.go:117] "RemoveContainer" containerID="b1323d6a03030e568b316c0dc257ae008dc2b437249673386d5ddb368b12739e"
Jul 24 17:40:32.660541 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:32.660522    2561 scope.go:117] "RemoveContainer" containerID="b1323d6a03030e568b316c0dc257ae008dc2b437249673386d5ddb368b12739e"
Jul 24 17:40:32.660864 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:40:32.660843    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1323d6a03030e568b316c0dc257ae008dc2b437249673386d5ddb368b12739e\": container with ID starting with b1323d6a03030e568b316c0dc257ae008dc2b437249673386d5ddb368b12739e not found: ID does not exist" containerID="b1323d6a03030e568b316c0dc257ae008dc2b437249673386d5ddb368b12739e"
Jul 24 17:40:32.660932 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:32.660878    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1323d6a03030e568b316c0dc257ae008dc2b437249673386d5ddb368b12739e"} err="failed to get container status \"b1323d6a03030e568b316c0dc257ae008dc2b437249673386d5ddb368b12739e\": rpc error: code = NotFound desc = could not find container \"b1323d6a03030e568b316c0dc257ae008dc2b437249673386d5ddb368b12739e\": container with ID starting with b1323d6a03030e568b316c0dc257ae008dc2b437249673386d5ddb368b12739e not found: ID does not exist"
Jul 24 17:40:32.725224 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:32.725196    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8abb0e32-07b3-4133-9571-6148ffa1ea6d-plugins-config-volume\") pod \"8abb0e32-07b3-4133-9571-6148ffa1ea6d\" (UID: \"8abb0e32-07b3-4133-9571-6148ffa1ea6d\") "
Jul 24 17:40:32.725366 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:32.725264    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldhwd\" (UniqueName: \"kubernetes.io/projected/8abb0e32-07b3-4133-9571-6148ffa1ea6d-kube-api-access-ldhwd\") pod \"8abb0e32-07b3-4133-9571-6148ffa1ea6d\" (UID: \"8abb0e32-07b3-4133-9571-6148ffa1ea6d\") "
Jul 24 17:40:32.725630 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:32.725611    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8abb0e32-07b3-4133-9571-6148ffa1ea6d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8abb0e32-07b3-4133-9571-6148ffa1ea6d" (UID: "8abb0e32-07b3-4133-9571-6148ffa1ea6d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:40:32.727285 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:32.727261    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8abb0e32-07b3-4133-9571-6148ffa1ea6d-kube-api-access-ldhwd" (OuterVolumeSpecName: "kube-api-access-ldhwd") pod "8abb0e32-07b3-4133-9571-6148ffa1ea6d" (UID: "8abb0e32-07b3-4133-9571-6148ffa1ea6d"). InnerVolumeSpecName "kube-api-access-ldhwd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:40:32.826721 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:32.826692    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldhwd\" (UniqueName: \"kubernetes.io/projected/8abb0e32-07b3-4133-9571-6148ffa1ea6d-kube-api-access-ldhwd\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:40:32.826721 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:32.826716    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8abb0e32-07b3-4133-9571-6148ffa1ea6d-plugins-config-volume\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:40:32.974185 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:32.974155    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-746c88-7f955cc69b-x6fxf"]
Jul 24 17:40:32.978254 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:32.978230    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-746c88-7f955cc69b-x6fxf"]
Jul 24 17:40:34.258000 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:34.257965    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8abb0e32-07b3-4133-9571-6148ffa1ea6d" path="/var/lib/kubelet/pods/8abb0e32-07b3-4133-9571-6148ffa1ea6d/volumes"
Jul 24 17:40:44.442391 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.442359    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr"]
Jul 24 17:40:44.442743 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.442700    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ee854ce-9fb1-4b85-9b28-7a666486a186" containerName="main"
Jul 24 17:40:44.442743 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.442711    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ee854ce-9fb1-4b85-9b28-7a666486a186" containerName="main"
Jul 24 17:40:44.442743 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.442726    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8abb0e32-07b3-4133-9571-6148ffa1ea6d" containerName="payload-processing"
Jul 24 17:40:44.442743 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.442731    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8abb0e32-07b3-4133-9571-6148ffa1ea6d" containerName="payload-processing"
Jul 24 17:40:44.442743 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.442741    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="801807a4-54e6-4bae-a2e5-1ead2485fcc8" containerName="istio-proxy"
Jul 24 17:40:44.442743 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.442746    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="801807a4-54e6-4bae-a2e5-1ead2485fcc8" containerName="istio-proxy"
Jul 24 17:40:44.442956 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.442755    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b245132-c25e-4265-a60f-f9ff2602bde4" containerName="payload-processing"
Jul 24 17:40:44.442956 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.442761    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b245132-c25e-4265-a60f-f9ff2602bde4" containerName="payload-processing"
Jul 24 17:40:44.442956 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.442768    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="801807a4-54e6-4bae-a2e5-1ead2485fcc8" containerName="istio-proxy"
Jul 24 17:40:44.442956 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.442772    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="801807a4-54e6-4bae-a2e5-1ead2485fcc8" containerName="istio-proxy"
Jul 24 17:40:44.442956 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.442828    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b245132-c25e-4265-a60f-f9ff2602bde4" containerName="payload-processing"
Jul 24 17:40:44.442956 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.442835    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ee854ce-9fb1-4b85-9b28-7a666486a186" containerName="main"
Jul 24 17:40:44.442956 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.442842    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="801807a4-54e6-4bae-a2e5-1ead2485fcc8" containerName="istio-proxy"
Jul 24 17:40:44.442956 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.442849    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="8abb0e32-07b3-4133-9571-6148ffa1ea6d" containerName="payload-processing"
Jul 24 17:40:44.442956 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.442855    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="801807a4-54e6-4bae-a2e5-1ead2485fcc8" containerName="istio-proxy"
Jul 24 17:40:44.445992 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.445974    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr"
Jul 24 17:40:44.448416 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.448387    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 24 17:40:44.448518 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.448424    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-bb341a-openshift-default-dockercfg-8j46k\""
Jul 24 17:40:44.457039 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.457007    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr"]
Jul 24 17:40:44.531533 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.531497    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2fc60da9-4739-4e66-b010-9962edfdbcb8-istiod-ca-cert\") pod \"e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr\" (UID: \"2fc60da9-4739-4e66-b010-9962edfdbcb8\") " pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr"
Jul 24 17:40:44.531651 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.531584    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2fc60da9-4739-4e66-b010-9962edfdbcb8-istio-token\") pod \"e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr\" (UID: \"2fc60da9-4739-4e66-b010-9962edfdbcb8\") " pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr"
Jul 24 17:40:44.531651 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.531610    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2fc60da9-4739-4e66-b010-9962edfdbcb8-istio-envoy\") pod \"e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr\" (UID: \"2fc60da9-4739-4e66-b010-9962edfdbcb8\") " pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr"
Jul 24 17:40:44.531651 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.531624    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2fc60da9-4739-4e66-b010-9962edfdbcb8-istio-podinfo\") pod \"e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr\" (UID: \"2fc60da9-4739-4e66-b010-9962edfdbcb8\") " pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr"
Jul 24 17:40:44.531824 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.531657    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2fc60da9-4739-4e66-b010-9962edfdbcb8-workload-certs\") pod \"e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr\" (UID: \"2fc60da9-4739-4e66-b010-9962edfdbcb8\") " pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr"
Jul 24 17:40:44.531824 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.531733    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fc60da9-4739-4e66-b010-9962edfdbcb8-credential-socket\") pod \"e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr\" (UID: \"2fc60da9-4739-4e66-b010-9962edfdbcb8\") " pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr"
Jul 24 17:40:44.531824 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.531775    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2fc60da9-4739-4e66-b010-9962edfdbcb8-istio-data\") pod \"e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr\" (UID: \"2fc60da9-4739-4e66-b010-9962edfdbcb8\") " pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr"
Jul 24 17:40:44.531973 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.531833    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62thm\" (UniqueName: \"kubernetes.io/projected/2fc60da9-4739-4e66-b010-9962edfdbcb8-kube-api-access-62thm\") pod \"e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr\" (UID: \"2fc60da9-4739-4e66-b010-9962edfdbcb8\") " pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr"
Jul 24 17:40:44.531973 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.531882    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fc60da9-4739-4e66-b010-9962edfdbcb8-workload-socket\") pod \"e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr\" (UID: \"2fc60da9-4739-4e66-b010-9962edfdbcb8\") " pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr"
Jul 24 17:40:44.632945 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.632904    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2fc60da9-4739-4e66-b010-9962edfdbcb8-istio-token\") pod \"e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr\" (UID: \"2fc60da9-4739-4e66-b010-9962edfdbcb8\") " pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr"
Jul 24 17:40:44.632945 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.632952    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2fc60da9-4739-4e66-b010-9962edfdbcb8-istio-envoy\") pod \"e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr\" (UID: \"2fc60da9-4739-4e66-b010-9962edfdbcb8\") " pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr"
Jul 24 17:40:44.633180 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.632968    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2fc60da9-4739-4e66-b010-9962edfdbcb8-istio-podinfo\") pod \"e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr\" (UID: \"2fc60da9-4739-4e66-b010-9962edfdbcb8\") " pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr"
Jul 24 17:40:44.633180 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.633002    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2fc60da9-4739-4e66-b010-9962edfdbcb8-workload-certs\") pod \"e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr\" (UID: \"2fc60da9-4739-4e66-b010-9962edfdbcb8\") " pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr"
Jul 24 17:40:44.633180 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.633036    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fc60da9-4739-4e66-b010-9962edfdbcb8-credential-socket\") pod \"e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr\" (UID: \"2fc60da9-4739-4e66-b010-9962edfdbcb8\") " pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr"
Jul 24 17:40:44.633180 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.633053    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2fc60da9-4739-4e66-b010-9962edfdbcb8-istio-data\") pod \"e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr\" (UID: \"2fc60da9-4739-4e66-b010-9962edfdbcb8\") " pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr"
Jul 24 17:40:44.633180 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.633108    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62thm\" (UniqueName: \"kubernetes.io/projected/2fc60da9-4739-4e66-b010-9962edfdbcb8-kube-api-access-62thm\") pod \"e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr\" (UID: \"2fc60da9-4739-4e66-b010-9962edfdbcb8\") " pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr"
Jul 24 17:40:44.633180 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.633157    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fc60da9-4739-4e66-b010-9962edfdbcb8-workload-socket\") pod \"e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr\" (UID: \"2fc60da9-4739-4e66-b010-9962edfdbcb8\") " pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr"
Jul 24 17:40:44.633467 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.633198    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2fc60da9-4739-4e66-b010-9962edfdbcb8-istiod-ca-cert\") pod \"e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr\" (UID: \"2fc60da9-4739-4e66-b010-9962edfdbcb8\") " pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr"
Jul 24 17:40:44.633531 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.633483    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2fc60da9-4739-4e66-b010-9962edfdbcb8-workload-certs\") pod \"e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr\" (UID: \"2fc60da9-4739-4e66-b010-9962edfdbcb8\") " pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr"
Jul 24 17:40:44.633531 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.633497    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fc60da9-4739-4e66-b010-9962edfdbcb8-workload-socket\") pod \"e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr\" (UID: \"2fc60da9-4739-4e66-b010-9962edfdbcb8\") " pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr"
Jul 24 17:40:44.633637 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.633565    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2fc60da9-4739-4e66-b010-9962edfdbcb8-istio-data\") pod \"e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr\" (UID: \"2fc60da9-4739-4e66-b010-9962edfdbcb8\") " pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr"
Jul 24 17:40:44.633707 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.633645    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fc60da9-4739-4e66-b010-9962edfdbcb8-credential-socket\") pod \"e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr\" (UID: \"2fc60da9-4739-4e66-b010-9962edfdbcb8\") " pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr"
Jul 24 17:40:44.633859 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.633842    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2fc60da9-4739-4e66-b010-9962edfdbcb8-istiod-ca-cert\") pod \"e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr\" (UID: \"2fc60da9-4739-4e66-b010-9962edfdbcb8\") " pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr"
Jul 24 17:40:44.635776 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.635746    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2fc60da9-4739-4e66-b010-9962edfdbcb8-istio-envoy\") pod \"e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr\" (UID: \"2fc60da9-4739-4e66-b010-9962edfdbcb8\") " pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr"
Jul 24 17:40:44.635875 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.635852    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2fc60da9-4739-4e66-b010-9962edfdbcb8-istio-podinfo\") pod \"e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr\" (UID: \"2fc60da9-4739-4e66-b010-9962edfdbcb8\") " pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr"
Jul 24 17:40:44.640716 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.640693    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2fc60da9-4739-4e66-b010-9962edfdbcb8-istio-token\") pod \"e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr\" (UID: \"2fc60da9-4739-4e66-b010-9962edfdbcb8\") " pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr"
Jul 24 17:40:44.641015 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.640996    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62thm\" (UniqueName: \"kubernetes.io/projected/2fc60da9-4739-4e66-b010-9962edfdbcb8-kube-api-access-62thm\") pod \"e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr\" (UID: \"2fc60da9-4739-4e66-b010-9962edfdbcb8\") " pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr"
Jul 24 17:40:44.756189 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.756113    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr"
Jul 24 17:40:44.890161 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.890014    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr"]
Jul 24 17:40:44.892519 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:40:44.892492    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fc60da9_4739_4e66_b010_9962edfdbcb8.slice/crio-607376df5ae7cd468e41fbbc6d36022612c716403795aa4548ca319f02d5fec6 WatchSource:0}: Error finding container 607376df5ae7cd468e41fbbc6d36022612c716403795aa4548ca319f02d5fec6: Status 404 returned error can't find the container with id 607376df5ae7cd468e41fbbc6d36022612c716403795aa4548ca319f02d5fec6
Jul 24 17:40:44.894646 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.894612    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:40:44.894746 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.894714    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:40:44.894812 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:44.894760    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:40:45.715367 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:45.715332    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr" event={"ID":"2fc60da9-4739-4e66-b010-9962edfdbcb8","Type":"ContainerStarted","Data":"cd526131449eb0e9f7d6c98c25b3c8228a16d73f49fae848695c69540a029af8"}
Jul 24 17:40:45.715745 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:45.715381    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr" event={"ID":"2fc60da9-4739-4e66-b010-9962edfdbcb8","Type":"ContainerStarted","Data":"607376df5ae7cd468e41fbbc6d36022612c716403795aa4548ca319f02d5fec6"}
Jul 24 17:40:45.736393 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:45.736346    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr" podStartSLOduration=1.736332191 podStartE2EDuration="1.736332191s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:40:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:40:45.734306765 +0000 UTC m=+2230.007166581" watchObservedRunningTime="2026-07-24 17:40:45.736332191 +0000 UTC m=+2230.009191970"
Jul 24 17:40:45.756287 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:45.756267    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr"
Jul 24 17:40:45.761136 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:45.761114    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr"
Jul 24 17:40:46.720519 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:46.720493    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr"
Jul 24 17:40:46.721565 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:46.721545    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr"
Jul 24 17:40:48.545741 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:48.545685    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-bb341a-78884d5dfd-f2js5"]
Jul 24 17:40:48.549817 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:48.549796    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-bb341a-78884d5dfd-f2js5"
Jul 24 17:40:48.552874 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:48.552848    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-bb341a-dockercfg-jcnsf\""
Jul 24 17:40:48.553262 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:48.553246    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-bb341a\""
Jul 24 17:40:48.560732 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:48.560707    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-bb341a-78884d5dfd-f2js5"]
Jul 24 17:40:48.570772 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:48.570740    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab896da9-6ed3-4a3b-a584-e95b5fc632cf-plugins-config-volume\") pod \"payload-processing-e2e-api-a-bb341a-78884d5dfd-f2js5\" (UID: \"ab896da9-6ed3-4a3b-a584-e95b5fc632cf\") " pod="openshift-ingress/payload-processing-e2e-api-a-bb341a-78884d5dfd-f2js5"
Jul 24 17:40:48.570863 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:48.570819    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bng99\" (UniqueName: \"kubernetes.io/projected/ab896da9-6ed3-4a3b-a584-e95b5fc632cf-kube-api-access-bng99\") pod \"payload-processing-e2e-api-a-bb341a-78884d5dfd-f2js5\" (UID: \"ab896da9-6ed3-4a3b-a584-e95b5fc632cf\") " pod="openshift-ingress/payload-processing-e2e-api-a-bb341a-78884d5dfd-f2js5"
Jul 24 17:40:48.671616 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:48.671583    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bng99\" (UniqueName: \"kubernetes.io/projected/ab896da9-6ed3-4a3b-a584-e95b5fc632cf-kube-api-access-bng99\") pod \"payload-processing-e2e-api-a-bb341a-78884d5dfd-f2js5\" (UID: \"ab896da9-6ed3-4a3b-a584-e95b5fc632cf\") " pod="openshift-ingress/payload-processing-e2e-api-a-bb341a-78884d5dfd-f2js5"
Jul 24 17:40:48.671787 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:48.671651    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab896da9-6ed3-4a3b-a584-e95b5fc632cf-plugins-config-volume\") pod \"payload-processing-e2e-api-a-bb341a-78884d5dfd-f2js5\" (UID: \"ab896da9-6ed3-4a3b-a584-e95b5fc632cf\") " pod="openshift-ingress/payload-processing-e2e-api-a-bb341a-78884d5dfd-f2js5"
Jul 24 17:40:48.672429 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:48.672410    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab896da9-6ed3-4a3b-a584-e95b5fc632cf-plugins-config-volume\") pod \"payload-processing-e2e-api-a-bb341a-78884d5dfd-f2js5\" (UID: \"ab896da9-6ed3-4a3b-a584-e95b5fc632cf\") " pod="openshift-ingress/payload-processing-e2e-api-a-bb341a-78884d5dfd-f2js5"
Jul 24 17:40:48.680183 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:48.680155    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bng99\" (UniqueName: \"kubernetes.io/projected/ab896da9-6ed3-4a3b-a584-e95b5fc632cf-kube-api-access-bng99\") pod \"payload-processing-e2e-api-a-bb341a-78884d5dfd-f2js5\" (UID: \"ab896da9-6ed3-4a3b-a584-e95b5fc632cf\") " pod="openshift-ingress/payload-processing-e2e-api-a-bb341a-78884d5dfd-f2js5"
Jul 24 17:40:48.861690 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:48.861601    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-bb341a-78884d5dfd-f2js5"
Jul 24 17:40:48.995729 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:48.995703    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-bb341a-78884d5dfd-f2js5"]
Jul 24 17:40:48.997386 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:40:48.997361    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab896da9_6ed3_4a3b_a584_e95b5fc632cf.slice/crio-0fd544bec10a820f6462742fdfa65aadf19d97352b1448de961d2f740e701849 WatchSource:0}: Error finding container 0fd544bec10a820f6462742fdfa65aadf19d97352b1448de961d2f740e701849: Status 404 returned error can't find the container with id 0fd544bec10a820f6462742fdfa65aadf19d97352b1448de961d2f740e701849
Jul 24 17:40:49.737767 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:49.737709    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-bb341a-78884d5dfd-f2js5" event={"ID":"ab896da9-6ed3-4a3b-a584-e95b5fc632cf","Type":"ContainerStarted","Data":"e9029540c18fc3df410331aafbadcc9bec588f0f5c5a0f82eddb5919c5ab0190"}
Jul 24 17:40:49.738247 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:49.737786    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-bb341a-78884d5dfd-f2js5" event={"ID":"ab896da9-6ed3-4a3b-a584-e95b5fc632cf","Type":"ContainerStarted","Data":"0fd544bec10a820f6462742fdfa65aadf19d97352b1448de961d2f740e701849"}
Jul 24 17:40:49.738247 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:49.737826    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-bb341a-78884d5dfd-f2js5"
Jul 24 17:40:49.754437 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:49.754386    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-bb341a-78884d5dfd-f2js5" podStartSLOduration=1.754370424 podStartE2EDuration="1.754370424s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:40:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:40:49.753390486 +0000 UTC m=+2234.026250280" watchObservedRunningTime="2026-07-24 17:40:49.754370424 +0000 UTC m=+2234.027230203"
Jul 24 17:40:56.355715 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:56.355682    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-bcb261-5b4f885f8d-qnk9t"]
Jul 24 17:40:56.359744 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:56.359725    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-bcb261-5b4f885f8d-qnk9t"
Jul 24 17:40:56.362195 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:56.362169    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-bcb261\""
Jul 24 17:40:56.362195 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:56.362181    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-bcb261-dockercfg-q9wp9\""
Jul 24 17:40:56.373193 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:56.373170    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-bcb261-5b4f885f8d-qnk9t"]
Jul 24 17:40:56.390596 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:56.390568    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-bcb261-8465bbb78b-dt5q6"]
Jul 24 17:40:56.394331 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:56.394315    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-bcb261-8465bbb78b-dt5q6"
Jul 24 17:40:56.401918 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:56.401874    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-bcb261-8465bbb78b-dt5q6"]
Jul 24 17:40:56.444804 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:56.444766    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzg4t\" (UniqueName: \"kubernetes.io/projected/bec968e2-5ee2-4a06-b68f-b742d5955e00-kube-api-access-dzg4t\") pod \"payload-pre-processing-e2e-api-b-bcb261-5b4f885f8d-qnk9t\" (UID: \"bec968e2-5ee2-4a06-b68f-b742d5955e00\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-bcb261-5b4f885f8d-qnk9t"
Jul 24 17:40:56.444981 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:56.444866    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bec968e2-5ee2-4a06-b68f-b742d5955e00-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-bcb261-5b4f885f8d-qnk9t\" (UID: \"bec968e2-5ee2-4a06-b68f-b742d5955e00\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-bcb261-5b4f885f8d-qnk9t"
Jul 24 17:40:56.444981 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:56.444900    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp8vb\" (UniqueName: \"kubernetes.io/projected/7976521e-a67f-4820-8e3c-5e335f3c4f34-kube-api-access-vp8vb\") pod \"payload-processing-e2e-api-b-bcb261-8465bbb78b-dt5q6\" (UID: \"7976521e-a67f-4820-8e3c-5e335f3c4f34\") " pod="openshift-ingress/payload-processing-e2e-api-b-bcb261-8465bbb78b-dt5q6"
Jul 24 17:40:56.445093 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:56.445010    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7976521e-a67f-4820-8e3c-5e335f3c4f34-plugins-config-volume\") pod \"payload-processing-e2e-api-b-bcb261-8465bbb78b-dt5q6\" (UID: \"7976521e-a67f-4820-8e3c-5e335f3c4f34\") " pod="openshift-ingress/payload-processing-e2e-api-b-bcb261-8465bbb78b-dt5q6"
Jul 24 17:40:56.545620 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:56.545582    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bec968e2-5ee2-4a06-b68f-b742d5955e00-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-bcb261-5b4f885f8d-qnk9t\" (UID: \"bec968e2-5ee2-4a06-b68f-b742d5955e00\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-bcb261-5b4f885f8d-qnk9t"
Jul 24 17:40:56.545832 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:56.545637    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp8vb\" (UniqueName: \"kubernetes.io/projected/7976521e-a67f-4820-8e3c-5e335f3c4f34-kube-api-access-vp8vb\") pod \"payload-processing-e2e-api-b-bcb261-8465bbb78b-dt5q6\" (UID: \"7976521e-a67f-4820-8e3c-5e335f3c4f34\") " pod="openshift-ingress/payload-processing-e2e-api-b-bcb261-8465bbb78b-dt5q6"
Jul 24 17:40:56.545832 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:56.545713    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7976521e-a67f-4820-8e3c-5e335f3c4f34-plugins-config-volume\") pod \"payload-processing-e2e-api-b-bcb261-8465bbb78b-dt5q6\" (UID: \"7976521e-a67f-4820-8e3c-5e335f3c4f34\") " pod="openshift-ingress/payload-processing-e2e-api-b-bcb261-8465bbb78b-dt5q6"
Jul 24 17:40:56.545957 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:56.545829    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzg4t\" (UniqueName: \"kubernetes.io/projected/bec968e2-5ee2-4a06-b68f-b742d5955e00-kube-api-access-dzg4t\") pod \"payload-pre-processing-e2e-api-b-bcb261-5b4f885f8d-qnk9t\" (UID: \"bec968e2-5ee2-4a06-b68f-b742d5955e00\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-bcb261-5b4f885f8d-qnk9t"
Jul 24 17:40:56.546583 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:56.546561    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bec968e2-5ee2-4a06-b68f-b742d5955e00-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-bcb261-5b4f885f8d-qnk9t\" (UID: \"bec968e2-5ee2-4a06-b68f-b742d5955e00\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-bcb261-5b4f885f8d-qnk9t"
Jul 24 17:40:56.546642 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:56.546561    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7976521e-a67f-4820-8e3c-5e335f3c4f34-plugins-config-volume\") pod \"payload-processing-e2e-api-b-bcb261-8465bbb78b-dt5q6\" (UID: \"7976521e-a67f-4820-8e3c-5e335f3c4f34\") " pod="openshift-ingress/payload-processing-e2e-api-b-bcb261-8465bbb78b-dt5q6"
Jul 24 17:40:56.553998 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:56.553972    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzg4t\" (UniqueName: \"kubernetes.io/projected/bec968e2-5ee2-4a06-b68f-b742d5955e00-kube-api-access-dzg4t\") pod \"payload-pre-processing-e2e-api-b-bcb261-5b4f885f8d-qnk9t\" (UID: \"bec968e2-5ee2-4a06-b68f-b742d5955e00\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-bcb261-5b4f885f8d-qnk9t"
Jul 24 17:40:56.554112 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:56.554043    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp8vb\" (UniqueName: \"kubernetes.io/projected/7976521e-a67f-4820-8e3c-5e335f3c4f34-kube-api-access-vp8vb\") pod \"payload-processing-e2e-api-b-bcb261-8465bbb78b-dt5q6\" (UID: \"7976521e-a67f-4820-8e3c-5e335f3c4f34\") " pod="openshift-ingress/payload-processing-e2e-api-b-bcb261-8465bbb78b-dt5q6"
Jul 24 17:40:56.670649 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:56.670608    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-bcb261-5b4f885f8d-qnk9t"
Jul 24 17:40:56.706316 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:56.706281    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-bcb261-8465bbb78b-dt5q6"
Jul 24 17:40:56.840654 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:56.840605    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-bcb261-5b4f885f8d-qnk9t"]
Jul 24 17:40:56.842851 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:40:56.842816    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbec968e2_5ee2_4a06_b68f_b742d5955e00.slice/crio-fff052c6b151789dc485483823d229434dc0e108e9310c944980fdd59121d3f0 WatchSource:0}: Error finding container fff052c6b151789dc485483823d229434dc0e108e9310c944980fdd59121d3f0: Status 404 returned error can't find the container with id fff052c6b151789dc485483823d229434dc0e108e9310c944980fdd59121d3f0
Jul 24 17:40:57.110455 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:40:57.110431    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7976521e_a67f_4820_8e3c_5e335f3c4f34.slice/crio-ba554418d3806a79294e120f07897784e43f881aa9060a66f20c5dec9a0e145c WatchSource:0}: Error finding container ba554418d3806a79294e120f07897784e43f881aa9060a66f20c5dec9a0e145c: Status 404 returned error can't find the container with id ba554418d3806a79294e120f07897784e43f881aa9060a66f20c5dec9a0e145c
Jul 24 17:40:57.121487 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:57.121464    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-bcb261-8465bbb78b-dt5q6"]
Jul 24 17:40:57.782801 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:57.782700    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-bcb261-5b4f885f8d-qnk9t" event={"ID":"bec968e2-5ee2-4a06-b68f-b742d5955e00","Type":"ContainerStarted","Data":"f501afbb8ab080ad3034789292ec25dddeeb05dbb75decb3b17d2958904ebb7d"}
Jul 24 17:40:57.782801 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:57.782761    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-bcb261-5b4f885f8d-qnk9t" event={"ID":"bec968e2-5ee2-4a06-b68f-b742d5955e00","Type":"ContainerStarted","Data":"fff052c6b151789dc485483823d229434dc0e108e9310c944980fdd59121d3f0"}
Jul 24 17:40:57.782801 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:57.782790    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-bcb261-5b4f885f8d-qnk9t"
Jul 24 17:40:57.784226 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:57.784202    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-bcb261-8465bbb78b-dt5q6" event={"ID":"7976521e-a67f-4820-8e3c-5e335f3c4f34","Type":"ContainerStarted","Data":"b46fcfd4666c5541f3d63a3c5de1e19568988b34391ad9f9206e5ddc8fc347cc"}
Jul 24 17:40:57.784340 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:57.784242    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-bcb261-8465bbb78b-dt5q6" event={"ID":"7976521e-a67f-4820-8e3c-5e335f3c4f34","Type":"ContainerStarted","Data":"ba554418d3806a79294e120f07897784e43f881aa9060a66f20c5dec9a0e145c"}
Jul 24 17:40:57.784340 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:57.784269    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-bcb261-8465bbb78b-dt5q6"
Jul 24 17:40:57.799143 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:57.799090    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-bcb261-5b4f885f8d-qnk9t" podStartSLOduration=1.7990757400000001 podStartE2EDuration="1.79907574s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:40:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:40:57.797299669 +0000 UTC m=+2242.070159450" watchObservedRunningTime="2026-07-24 17:40:57.79907574 +0000 UTC m=+2242.071935511"
Jul 24 17:40:57.813986 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:57.813941    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-bcb261-8465bbb78b-dt5q6" podStartSLOduration=1.813928551 podStartE2EDuration="1.813928551s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:40:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:40:57.812193314 +0000 UTC m=+2242.085053115" watchObservedRunningTime="2026-07-24 17:40:57.813928551 +0000 UTC m=+2242.086788372"
Jul 24 17:40:58.790902 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:58.790867    2561 generic.go:356] "Generic (PLEG): container finished" podID="2fc60da9-4739-4e66-b010-9962edfdbcb8" containerID="cd526131449eb0e9f7d6c98c25b3c8228a16d73f49fae848695c69540a029af8" exitCode=0
Jul 24 17:40:58.791433 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:58.790946    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr" event={"ID":"2fc60da9-4739-4e66-b010-9962edfdbcb8","Type":"ContainerDied","Data":"cd526131449eb0e9f7d6c98c25b3c8228a16d73f49fae848695c69540a029af8"}
Jul 24 17:40:58.791519 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:58.791456    2561 scope.go:117] "RemoveContainer" containerID="cd526131449eb0e9f7d6c98c25b3c8228a16d73f49fae848695c69540a029af8"
Jul 24 17:40:58.792465 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:58.792436    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:40:58.792542 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:58.792527    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:40:58.792583 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:58.792562    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:40:59.806260 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:40:59.806212    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr" event={"ID":"2fc60da9-4739-4e66-b010-9962edfdbcb8","Type":"ContainerStarted","Data":"1452e7fdf8c002565a0d36304af66566a79d73f766a988e66beb3035973bbe1e"}
Jul 24 17:41:00.744818 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:00.744788    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-bb341a-78884d5dfd-f2js5"
Jul 24 17:41:00.757463 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:00.757433    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr"
Jul 24 17:41:00.765088 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:00.764148    2561 patch_prober.go:28] interesting pod/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 24 17:41:00.765088 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:00.764199    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr" podUID="2fc60da9-4739-4e66-b010-9962edfdbcb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 24 17:41:01.720999 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:01.720962    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr"
Jul 24 17:41:01.757382 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:01.757345    2561 patch_prober.go:28] interesting pod/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 24 17:41:01.757534 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:01.757407    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr" podUID="2fc60da9-4739-4e66-b010-9962edfdbcb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 24 17:41:02.757307 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:02.757262    2561 patch_prober.go:28] interesting pod/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 24 17:41:02.757796 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:02.757330    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr" podUID="2fc60da9-4739-4e66-b010-9962edfdbcb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 24 17:41:03.763495 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:03.763452    2561 patch_prober.go:28] interesting pod/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 24 17:41:03.763973 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:03.763553    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr" podUID="2fc60da9-4739-4e66-b010-9962edfdbcb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 24 17:41:04.760855 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:04.760825    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr"
Jul 24 17:41:04.761813 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:04.761790    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr"
Jul 24 17:41:08.793014 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:08.792970    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-api-b-bcb261-5b4f885f8d-qnk9t" podUID="bec968e2-5ee2-4a06-b68f-b742d5955e00" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.62:9004: connect: connection refused"
Jul 24 17:41:08.793502 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:08.793485    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-bcb261-8465bbb78b-dt5q6"
Jul 24 17:41:18.792045 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:18.792016    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-bcb261-5b4f885f8d-qnk9t"
Jul 24 17:41:23.956579 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:23.956542    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-bb341a-78884d5dfd-f2js5"]
Jul 24 17:41:23.957134 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:23.956753    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-bb341a-78884d5dfd-f2js5" podUID="ab896da9-6ed3-4a3b-a584-e95b5fc632cf" containerName="payload-processing" containerID="cri-o://e9029540c18fc3df410331aafbadcc9bec588f0f5c5a0f82eddb5919c5ab0190" gracePeriod=30
Jul 24 17:41:24.209004 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:24.208947    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-bb341a-78884d5dfd-f2js5"
Jul 24 17:41:24.310710 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:24.310676    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab896da9-6ed3-4a3b-a584-e95b5fc632cf-plugins-config-volume\") pod \"ab896da9-6ed3-4a3b-a584-e95b5fc632cf\" (UID: \"ab896da9-6ed3-4a3b-a584-e95b5fc632cf\") "
Jul 24 17:41:24.310879 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:24.310766    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bng99\" (UniqueName: \"kubernetes.io/projected/ab896da9-6ed3-4a3b-a584-e95b5fc632cf-kube-api-access-bng99\") pod \"ab896da9-6ed3-4a3b-a584-e95b5fc632cf\" (UID: \"ab896da9-6ed3-4a3b-a584-e95b5fc632cf\") "
Jul 24 17:41:24.311205 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:24.311170    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab896da9-6ed3-4a3b-a584-e95b5fc632cf-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ab896da9-6ed3-4a3b-a584-e95b5fc632cf" (UID: "ab896da9-6ed3-4a3b-a584-e95b5fc632cf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:41:24.312887 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:24.312861    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab896da9-6ed3-4a3b-a584-e95b5fc632cf-kube-api-access-bng99" (OuterVolumeSpecName: "kube-api-access-bng99") pod "ab896da9-6ed3-4a3b-a584-e95b5fc632cf" (UID: "ab896da9-6ed3-4a3b-a584-e95b5fc632cf"). InnerVolumeSpecName "kube-api-access-bng99". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:41:24.412056 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:24.412022    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bng99\" (UniqueName: \"kubernetes.io/projected/ab896da9-6ed3-4a3b-a584-e95b5fc632cf-kube-api-access-bng99\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:41:24.412056 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:24.412048    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab896da9-6ed3-4a3b-a584-e95b5fc632cf-plugins-config-volume\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:41:24.934173 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:24.934139    2561 generic.go:356] "Generic (PLEG): container finished" podID="ab896da9-6ed3-4a3b-a584-e95b5fc632cf" containerID="e9029540c18fc3df410331aafbadcc9bec588f0f5c5a0f82eddb5919c5ab0190" exitCode=0
Jul 24 17:41:24.934357 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:24.934178    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-bb341a-78884d5dfd-f2js5"
Jul 24 17:41:24.934357 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:24.934228    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-bb341a-78884d5dfd-f2js5" event={"ID":"ab896da9-6ed3-4a3b-a584-e95b5fc632cf","Type":"ContainerDied","Data":"e9029540c18fc3df410331aafbadcc9bec588f0f5c5a0f82eddb5919c5ab0190"}
Jul 24 17:41:24.934357 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:24.934279    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-bb341a-78884d5dfd-f2js5" event={"ID":"ab896da9-6ed3-4a3b-a584-e95b5fc632cf","Type":"ContainerDied","Data":"0fd544bec10a820f6462742fdfa65aadf19d97352b1448de961d2f740e701849"}
Jul 24 17:41:24.934357 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:24.934301    2561 scope.go:117] "RemoveContainer" containerID="e9029540c18fc3df410331aafbadcc9bec588f0f5c5a0f82eddb5919c5ab0190"
Jul 24 17:41:24.943238 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:24.943221    2561 scope.go:117] "RemoveContainer" containerID="e9029540c18fc3df410331aafbadcc9bec588f0f5c5a0f82eddb5919c5ab0190"
Jul 24 17:41:24.943476 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:41:24.943457    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9029540c18fc3df410331aafbadcc9bec588f0f5c5a0f82eddb5919c5ab0190\": container with ID starting with e9029540c18fc3df410331aafbadcc9bec588f0f5c5a0f82eddb5919c5ab0190 not found: ID does not exist" containerID="e9029540c18fc3df410331aafbadcc9bec588f0f5c5a0f82eddb5919c5ab0190"
Jul 24 17:41:24.943529 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:24.943484    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9029540c18fc3df410331aafbadcc9bec588f0f5c5a0f82eddb5919c5ab0190"} err="failed to get container status \"e9029540c18fc3df410331aafbadcc9bec588f0f5c5a0f82eddb5919c5ab0190\": rpc error: code = NotFound desc = could not find container \"e9029540c18fc3df410331aafbadcc9bec588f0f5c5a0f82eddb5919c5ab0190\": container with ID starting with e9029540c18fc3df410331aafbadcc9bec588f0f5c5a0f82eddb5919c5ab0190 not found: ID does not exist"
Jul 24 17:41:24.955044 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:24.955023    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-bb341a-78884d5dfd-f2js5"]
Jul 24 17:41:24.959691 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:24.959668    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-bb341a-78884d5dfd-f2js5"]
Jul 24 17:41:26.257861 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:26.257828    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab896da9-6ed3-4a3b-a584-e95b5fc632cf" path="/var/lib/kubelet/pods/ab896da9-6ed3-4a3b-a584-e95b5fc632cf/volumes"
Jul 24 17:41:34.978162 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:34.978120    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr"]
Jul 24 17:41:34.978660 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:34.978348    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr" podUID="2fc60da9-4739-4e66-b010-9962edfdbcb8" containerName="istio-proxy" containerID="cri-o://1452e7fdf8c002565a0d36304af66566a79d73f766a988e66beb3035973bbe1e" gracePeriod=30
Jul 24 17:41:40.229476 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:40.229454    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr"
Jul 24 17:41:40.353673 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:40.353602    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2fc60da9-4739-4e66-b010-9962edfdbcb8-istio-token\") pod \"2fc60da9-4739-4e66-b010-9962edfdbcb8\" (UID: \"2fc60da9-4739-4e66-b010-9962edfdbcb8\") "
Jul 24 17:41:40.353673 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:40.353639    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fc60da9-4739-4e66-b010-9962edfdbcb8-workload-socket\") pod \"2fc60da9-4739-4e66-b010-9962edfdbcb8\" (UID: \"2fc60da9-4739-4e66-b010-9962edfdbcb8\") "
Jul 24 17:41:40.353863 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:40.353676    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2fc60da9-4739-4e66-b010-9962edfdbcb8-istio-podinfo\") pod \"2fc60da9-4739-4e66-b010-9962edfdbcb8\" (UID: \"2fc60da9-4739-4e66-b010-9962edfdbcb8\") "
Jul 24 17:41:40.353863 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:40.353760    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2fc60da9-4739-4e66-b010-9962edfdbcb8-istio-data\") pod \"2fc60da9-4739-4e66-b010-9962edfdbcb8\" (UID: \"2fc60da9-4739-4e66-b010-9962edfdbcb8\") "
Jul 24 17:41:40.353863 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:40.353791    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fc60da9-4739-4e66-b010-9962edfdbcb8-credential-socket\") pod \"2fc60da9-4739-4e66-b010-9962edfdbcb8\" (UID: \"2fc60da9-4739-4e66-b010-9962edfdbcb8\") "
Jul 24 17:41:40.353863 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:40.353833    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2fc60da9-4739-4e66-b010-9962edfdbcb8-istiod-ca-cert\") pod \"2fc60da9-4739-4e66-b010-9962edfdbcb8\" (UID: \"2fc60da9-4739-4e66-b010-9962edfdbcb8\") "
Jul 24 17:41:40.354102 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:40.353878    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62thm\" (UniqueName: \"kubernetes.io/projected/2fc60da9-4739-4e66-b010-9962edfdbcb8-kube-api-access-62thm\") pod \"2fc60da9-4739-4e66-b010-9962edfdbcb8\" (UID: \"2fc60da9-4739-4e66-b010-9962edfdbcb8\") "
Jul 24 17:41:40.354102 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:40.353901    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2fc60da9-4739-4e66-b010-9962edfdbcb8-istio-envoy\") pod \"2fc60da9-4739-4e66-b010-9962edfdbcb8\" (UID: \"2fc60da9-4739-4e66-b010-9962edfdbcb8\") "
Jul 24 17:41:40.354102 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:40.353929    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2fc60da9-4739-4e66-b010-9962edfdbcb8-workload-certs\") pod \"2fc60da9-4739-4e66-b010-9962edfdbcb8\" (UID: \"2fc60da9-4739-4e66-b010-9962edfdbcb8\") "
Jul 24 17:41:40.354102 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:40.353944    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fc60da9-4739-4e66-b010-9962edfdbcb8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2fc60da9-4739-4e66-b010-9962edfdbcb8" (UID: "2fc60da9-4739-4e66-b010-9962edfdbcb8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:41:40.354102 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:40.354042    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fc60da9-4739-4e66-b010-9962edfdbcb8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2fc60da9-4739-4e66-b010-9962edfdbcb8" (UID: "2fc60da9-4739-4e66-b010-9962edfdbcb8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:41:40.354467 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:40.354274    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fc60da9-4739-4e66-b010-9962edfdbcb8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2fc60da9-4739-4e66-b010-9962edfdbcb8" (UID: "2fc60da9-4739-4e66-b010-9962edfdbcb8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:41:40.354467 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:40.354299    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fc60da9-4739-4e66-b010-9962edfdbcb8-credential-socket\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:41:40.354467 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:40.354320    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fc60da9-4739-4e66-b010-9962edfdbcb8-workload-socket\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:41:40.354467 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:40.354369    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fc60da9-4739-4e66-b010-9962edfdbcb8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2fc60da9-4739-4e66-b010-9962edfdbcb8" (UID: "2fc60da9-4739-4e66-b010-9962edfdbcb8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:41:40.354835 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:40.354811    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fc60da9-4739-4e66-b010-9962edfdbcb8-istio-data" (OuterVolumeSpecName: "istio-data") pod "2fc60da9-4739-4e66-b010-9962edfdbcb8" (UID: "2fc60da9-4739-4e66-b010-9962edfdbcb8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:41:40.356025 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:40.356001    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2fc60da9-4739-4e66-b010-9962edfdbcb8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2fc60da9-4739-4e66-b010-9962edfdbcb8" (UID: "2fc60da9-4739-4e66-b010-9962edfdbcb8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 17:41:40.356163 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:40.356049    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fc60da9-4739-4e66-b010-9962edfdbcb8-istio-token" (OuterVolumeSpecName: "istio-token") pod "2fc60da9-4739-4e66-b010-9962edfdbcb8" (UID: "2fc60da9-4739-4e66-b010-9962edfdbcb8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:41:40.356263 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:40.356244    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fc60da9-4739-4e66-b010-9962edfdbcb8-kube-api-access-62thm" (OuterVolumeSpecName: "kube-api-access-62thm") pod "2fc60da9-4739-4e66-b010-9962edfdbcb8" (UID: "2fc60da9-4739-4e66-b010-9962edfdbcb8"). InnerVolumeSpecName "kube-api-access-62thm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:41:40.356630 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:40.356606    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fc60da9-4739-4e66-b010-9962edfdbcb8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2fc60da9-4739-4e66-b010-9962edfdbcb8" (UID: "2fc60da9-4739-4e66-b010-9962edfdbcb8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:41:40.455299 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:40.455275    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2fc60da9-4739-4e66-b010-9962edfdbcb8-istio-data\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:41:40.455299 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:40.455296    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2fc60da9-4739-4e66-b010-9962edfdbcb8-istiod-ca-cert\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:41:40.455443 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:40.455305    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62thm\" (UniqueName: \"kubernetes.io/projected/2fc60da9-4739-4e66-b010-9962edfdbcb8-kube-api-access-62thm\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:41:40.455443 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:40.455314    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2fc60da9-4739-4e66-b010-9962edfdbcb8-istio-envoy\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:41:40.455443 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:40.455323    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2fc60da9-4739-4e66-b010-9962edfdbcb8-workload-certs\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:41:40.455443 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:40.455330    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2fc60da9-4739-4e66-b010-9962edfdbcb8-istio-token\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:41:40.455443 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:40.455337    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2fc60da9-4739-4e66-b010-9962edfdbcb8-istio-podinfo\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:41:41.012613 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:41.012577    2561 generic.go:356] "Generic (PLEG): container finished" podID="2fc60da9-4739-4e66-b010-9962edfdbcb8" containerID="1452e7fdf8c002565a0d36304af66566a79d73f766a988e66beb3035973bbe1e" exitCode=0
Jul 24 17:41:41.012810 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:41.012623    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr"
Jul 24 17:41:41.012810 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:41.012666    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr" event={"ID":"2fc60da9-4739-4e66-b010-9962edfdbcb8","Type":"ContainerDied","Data":"1452e7fdf8c002565a0d36304af66566a79d73f766a988e66beb3035973bbe1e"}
Jul 24 17:41:41.012810 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:41.012722    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr" event={"ID":"2fc60da9-4739-4e66-b010-9962edfdbcb8","Type":"ContainerDied","Data":"607376df5ae7cd468e41fbbc6d36022612c716403795aa4548ca319f02d5fec6"}
Jul 24 17:41:41.012810 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:41.012745    2561 scope.go:117] "RemoveContainer" containerID="1452e7fdf8c002565a0d36304af66566a79d73f766a988e66beb3035973bbe1e"
Jul 24 17:41:41.022253 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:41.022235    2561 scope.go:117] "RemoveContainer" containerID="cd526131449eb0e9f7d6c98c25b3c8228a16d73f49fae848695c69540a029af8"
Jul 24 17:41:41.030194 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:41.030180    2561 scope.go:117] "RemoveContainer" containerID="1452e7fdf8c002565a0d36304af66566a79d73f766a988e66beb3035973bbe1e"
Jul 24 17:41:41.030448 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:41:41.030410    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1452e7fdf8c002565a0d36304af66566a79d73f766a988e66beb3035973bbe1e\": container with ID starting with 1452e7fdf8c002565a0d36304af66566a79d73f766a988e66beb3035973bbe1e not found: ID does not exist" containerID="1452e7fdf8c002565a0d36304af66566a79d73f766a988e66beb3035973bbe1e"
Jul 24 17:41:41.030497 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:41.030454    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1452e7fdf8c002565a0d36304af66566a79d73f766a988e66beb3035973bbe1e"} err="failed to get container status \"1452e7fdf8c002565a0d36304af66566a79d73f766a988e66beb3035973bbe1e\": rpc error: code = NotFound desc = could not find container \"1452e7fdf8c002565a0d36304af66566a79d73f766a988e66beb3035973bbe1e\": container with ID starting with 1452e7fdf8c002565a0d36304af66566a79d73f766a988e66beb3035973bbe1e not found: ID does not exist"
Jul 24 17:41:41.030497 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:41.030469    2561 scope.go:117] "RemoveContainer" containerID="cd526131449eb0e9f7d6c98c25b3c8228a16d73f49fae848695c69540a029af8"
Jul 24 17:41:41.030682 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:41:41.030664    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd526131449eb0e9f7d6c98c25b3c8228a16d73f49fae848695c69540a029af8\": container with ID starting with cd526131449eb0e9f7d6c98c25b3c8228a16d73f49fae848695c69540a029af8 not found: ID does not exist" containerID="cd526131449eb0e9f7d6c98c25b3c8228a16d73f49fae848695c69540a029af8"
Jul 24 17:41:41.030731 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:41.030688    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd526131449eb0e9f7d6c98c25b3c8228a16d73f49fae848695c69540a029af8"} err="failed to get container status \"cd526131449eb0e9f7d6c98c25b3c8228a16d73f49fae848695c69540a029af8\": rpc error: code = NotFound desc = could not find container \"cd526131449eb0e9f7d6c98c25b3c8228a16d73f49fae848695c69540a029af8\": container with ID starting with cd526131449eb0e9f7d6c98c25b3c8228a16d73f49fae848695c69540a029af8 not found: ID does not exist"
Jul 24 17:41:41.033363 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:41.033344    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr"]
Jul 24 17:41:41.037593 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:41.037572    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-bb341a-openshift-default-796f67899d-fnvdr"]
Jul 24 17:41:42.258836 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:42.258806    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fc60da9-4739-4e66-b010-9962edfdbcb8" path="/var/lib/kubelet/pods/2fc60da9-4739-4e66-b010-9962edfdbcb8/volumes"
Jul 24 17:41:51.045983 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:51.045947    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-bcb261-8465bbb78b-dt5q6"]
Jul 24 17:41:51.046496 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:51.046246    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-bcb261-8465bbb78b-dt5q6" podUID="7976521e-a67f-4820-8e3c-5e335f3c4f34" containerName="payload-processing" containerID="cri-o://b46fcfd4666c5541f3d63a3c5de1e19568988b34391ad9f9206e5ddc8fc347cc" gracePeriod=30
Jul 24 17:41:51.053318 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:51.053281    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-bcb261-5b4f885f8d-qnk9t"]
Jul 24 17:41:51.053514 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:51.053486    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-bcb261-5b4f885f8d-qnk9t" podUID="bec968e2-5ee2-4a06-b68f-b742d5955e00" containerName="payload-pre-processing" containerID="cri-o://f501afbb8ab080ad3034789292ec25dddeeb05dbb75decb3b17d2958904ebb7d" gracePeriod=30
Jul 24 17:41:51.325151 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:51.325128    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-bcb261-8465bbb78b-dt5q6"
Jul 24 17:41:51.327906 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:51.327887    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-bcb261-5b4f885f8d-qnk9t"
Jul 24 17:41:51.453663 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:51.453635    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vp8vb\" (UniqueName: \"kubernetes.io/projected/7976521e-a67f-4820-8e3c-5e335f3c4f34-kube-api-access-vp8vb\") pod \"7976521e-a67f-4820-8e3c-5e335f3c4f34\" (UID: \"7976521e-a67f-4820-8e3c-5e335f3c4f34\") "
Jul 24 17:41:51.453817 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:51.453711    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzg4t\" (UniqueName: \"kubernetes.io/projected/bec968e2-5ee2-4a06-b68f-b742d5955e00-kube-api-access-dzg4t\") pod \"bec968e2-5ee2-4a06-b68f-b742d5955e00\" (UID: \"bec968e2-5ee2-4a06-b68f-b742d5955e00\") "
Jul 24 17:41:51.453817 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:51.453739    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7976521e-a67f-4820-8e3c-5e335f3c4f34-plugins-config-volume\") pod \"7976521e-a67f-4820-8e3c-5e335f3c4f34\" (UID: \"7976521e-a67f-4820-8e3c-5e335f3c4f34\") "
Jul 24 17:41:51.453817 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:51.453803    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bec968e2-5ee2-4a06-b68f-b742d5955e00-plugins-config-volume\") pod \"bec968e2-5ee2-4a06-b68f-b742d5955e00\" (UID: \"bec968e2-5ee2-4a06-b68f-b742d5955e00\") "
Jul 24 17:41:51.454256 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:51.454225    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7976521e-a67f-4820-8e3c-5e335f3c4f34-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7976521e-a67f-4820-8e3c-5e335f3c4f34" (UID: "7976521e-a67f-4820-8e3c-5e335f3c4f34"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:41:51.454394 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:51.454227    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bec968e2-5ee2-4a06-b68f-b742d5955e00-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bec968e2-5ee2-4a06-b68f-b742d5955e00" (UID: "bec968e2-5ee2-4a06-b68f-b742d5955e00"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:41:51.455730 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:51.455705    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bec968e2-5ee2-4a06-b68f-b742d5955e00-kube-api-access-dzg4t" (OuterVolumeSpecName: "kube-api-access-dzg4t") pod "bec968e2-5ee2-4a06-b68f-b742d5955e00" (UID: "bec968e2-5ee2-4a06-b68f-b742d5955e00"). InnerVolumeSpecName "kube-api-access-dzg4t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:41:51.455828 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:51.455736    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7976521e-a67f-4820-8e3c-5e335f3c4f34-kube-api-access-vp8vb" (OuterVolumeSpecName: "kube-api-access-vp8vb") pod "7976521e-a67f-4820-8e3c-5e335f3c4f34" (UID: "7976521e-a67f-4820-8e3c-5e335f3c4f34"). InnerVolumeSpecName "kube-api-access-vp8vb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:41:51.554693 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:51.554627    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vp8vb\" (UniqueName: \"kubernetes.io/projected/7976521e-a67f-4820-8e3c-5e335f3c4f34-kube-api-access-vp8vb\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:41:51.554693 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:51.554651    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzg4t\" (UniqueName: \"kubernetes.io/projected/bec968e2-5ee2-4a06-b68f-b742d5955e00-kube-api-access-dzg4t\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:41:51.554693 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:51.554660    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7976521e-a67f-4820-8e3c-5e335f3c4f34-plugins-config-volume\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:41:51.554693 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:51.554668    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bec968e2-5ee2-4a06-b68f-b742d5955e00-plugins-config-volume\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:41:52.070469 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:52.070442    2561 generic.go:356] "Generic (PLEG): container finished" podID="bec968e2-5ee2-4a06-b68f-b742d5955e00" containerID="f501afbb8ab080ad3034789292ec25dddeeb05dbb75decb3b17d2958904ebb7d" exitCode=0
Jul 24 17:41:52.070782 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:52.070482    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-bcb261-5b4f885f8d-qnk9t"
Jul 24 17:41:52.070782 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:52.070524    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-bcb261-5b4f885f8d-qnk9t" event={"ID":"bec968e2-5ee2-4a06-b68f-b742d5955e00","Type":"ContainerDied","Data":"f501afbb8ab080ad3034789292ec25dddeeb05dbb75decb3b17d2958904ebb7d"}
Jul 24 17:41:52.070782 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:52.070576    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-bcb261-5b4f885f8d-qnk9t" event={"ID":"bec968e2-5ee2-4a06-b68f-b742d5955e00","Type":"ContainerDied","Data":"fff052c6b151789dc485483823d229434dc0e108e9310c944980fdd59121d3f0"}
Jul 24 17:41:52.070782 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:52.070605    2561 scope.go:117] "RemoveContainer" containerID="f501afbb8ab080ad3034789292ec25dddeeb05dbb75decb3b17d2958904ebb7d"
Jul 24 17:41:52.071927 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:52.071912    2561 generic.go:356] "Generic (PLEG): container finished" podID="7976521e-a67f-4820-8e3c-5e335f3c4f34" containerID="b46fcfd4666c5541f3d63a3c5de1e19568988b34391ad9f9206e5ddc8fc347cc" exitCode=0
Jul 24 17:41:52.072026 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:52.071944    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-bcb261-8465bbb78b-dt5q6" event={"ID":"7976521e-a67f-4820-8e3c-5e335f3c4f34","Type":"ContainerDied","Data":"b46fcfd4666c5541f3d63a3c5de1e19568988b34391ad9f9206e5ddc8fc347cc"}
Jul 24 17:41:52.072026 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:52.071959    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-bcb261-8465bbb78b-dt5q6"
Jul 24 17:41:52.072026 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:52.071992    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-bcb261-8465bbb78b-dt5q6" event={"ID":"7976521e-a67f-4820-8e3c-5e335f3c4f34","Type":"ContainerDied","Data":"ba554418d3806a79294e120f07897784e43f881aa9060a66f20c5dec9a0e145c"}
Jul 24 17:41:52.080688 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:52.080673    2561 scope.go:117] "RemoveContainer" containerID="f501afbb8ab080ad3034789292ec25dddeeb05dbb75decb3b17d2958904ebb7d"
Jul 24 17:41:52.080925 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:41:52.080906    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f501afbb8ab080ad3034789292ec25dddeeb05dbb75decb3b17d2958904ebb7d\": container with ID starting with f501afbb8ab080ad3034789292ec25dddeeb05dbb75decb3b17d2958904ebb7d not found: ID does not exist" containerID="f501afbb8ab080ad3034789292ec25dddeeb05dbb75decb3b17d2958904ebb7d"
Jul 24 17:41:52.080998 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:52.080933    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f501afbb8ab080ad3034789292ec25dddeeb05dbb75decb3b17d2958904ebb7d"} err="failed to get container status \"f501afbb8ab080ad3034789292ec25dddeeb05dbb75decb3b17d2958904ebb7d\": rpc error: code = NotFound desc = could not find container \"f501afbb8ab080ad3034789292ec25dddeeb05dbb75decb3b17d2958904ebb7d\": container with ID starting with f501afbb8ab080ad3034789292ec25dddeeb05dbb75decb3b17d2958904ebb7d not found: ID does not exist"
Jul 24 17:41:52.080998 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:52.080951    2561 scope.go:117] "RemoveContainer" containerID="b46fcfd4666c5541f3d63a3c5de1e19568988b34391ad9f9206e5ddc8fc347cc"
Jul 24 17:41:52.088544 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:52.088525    2561 scope.go:117] "RemoveContainer" containerID="b46fcfd4666c5541f3d63a3c5de1e19568988b34391ad9f9206e5ddc8fc347cc"
Jul 24 17:41:52.088792 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:41:52.088774    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b46fcfd4666c5541f3d63a3c5de1e19568988b34391ad9f9206e5ddc8fc347cc\": container with ID starting with b46fcfd4666c5541f3d63a3c5de1e19568988b34391ad9f9206e5ddc8fc347cc not found: ID does not exist" containerID="b46fcfd4666c5541f3d63a3c5de1e19568988b34391ad9f9206e5ddc8fc347cc"
Jul 24 17:41:52.088832 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:52.088799    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b46fcfd4666c5541f3d63a3c5de1e19568988b34391ad9f9206e5ddc8fc347cc"} err="failed to get container status \"b46fcfd4666c5541f3d63a3c5de1e19568988b34391ad9f9206e5ddc8fc347cc\": rpc error: code = NotFound desc = could not find container \"b46fcfd4666c5541f3d63a3c5de1e19568988b34391ad9f9206e5ddc8fc347cc\": container with ID starting with b46fcfd4666c5541f3d63a3c5de1e19568988b34391ad9f9206e5ddc8fc347cc not found: ID does not exist"
Jul 24 17:41:52.093275 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:52.093254    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-bcb261-5b4f885f8d-qnk9t"]
Jul 24 17:41:52.099202 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:52.099184    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-bcb261-5b4f885f8d-qnk9t"]
Jul 24 17:41:52.109995 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:52.109976    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-bcb261-8465bbb78b-dt5q6"]
Jul 24 17:41:52.116881 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:52.116862    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-bcb261-8465bbb78b-dt5q6"]
Jul 24 17:41:52.258865 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:52.258833    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7976521e-a67f-4820-8e3c-5e335f3c4f34" path="/var/lib/kubelet/pods/7976521e-a67f-4820-8e3c-5e335f3c4f34/volumes"
Jul 24 17:41:52.259285 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:41:52.259268    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bec968e2-5ee2-4a06-b68f-b742d5955e00" path="/var/lib/kubelet/pods/bec968e2-5ee2-4a06-b68f-b742d5955e00/volumes"
Jul 24 17:42:03.051390 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.051356    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht"]
Jul 24 17:42:03.052102 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.051972    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fc60da9-4739-4e66-b010-9962edfdbcb8" containerName="istio-proxy"
Jul 24 17:42:03.052102 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.051989    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fc60da9-4739-4e66-b010-9962edfdbcb8" containerName="istio-proxy"
Jul 24 17:42:03.052102 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.052003    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7976521e-a67f-4820-8e3c-5e335f3c4f34" containerName="payload-processing"
Jul 24 17:42:03.052102 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.052012    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7976521e-a67f-4820-8e3c-5e335f3c4f34" containerName="payload-processing"
Jul 24 17:42:03.052102 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.052026    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab896da9-6ed3-4a3b-a584-e95b5fc632cf" containerName="payload-processing"
Jul 24 17:42:03.052102 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.052036    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab896da9-6ed3-4a3b-a584-e95b5fc632cf" containerName="payload-processing"
Jul 24 17:42:03.052102 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.052048    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bec968e2-5ee2-4a06-b68f-b742d5955e00" containerName="payload-pre-processing"
Jul 24 17:42:03.052102 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.052057    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="bec968e2-5ee2-4a06-b68f-b742d5955e00" containerName="payload-pre-processing"
Jul 24 17:42:03.052102 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.052088    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fc60da9-4739-4e66-b010-9962edfdbcb8" containerName="istio-proxy"
Jul 24 17:42:03.052102 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.052097    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fc60da9-4739-4e66-b010-9962edfdbcb8" containerName="istio-proxy"
Jul 24 17:42:03.052451 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.052178    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7976521e-a67f-4820-8e3c-5e335f3c4f34" containerName="payload-processing"
Jul 24 17:42:03.052451 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.052190    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fc60da9-4739-4e66-b010-9962edfdbcb8" containerName="istio-proxy"
Jul 24 17:42:03.052451 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.052202    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="bec968e2-5ee2-4a06-b68f-b742d5955e00" containerName="payload-pre-processing"
Jul 24 17:42:03.052451 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.052214    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fc60da9-4739-4e66-b010-9962edfdbcb8" containerName="istio-proxy"
Jul 24 17:42:03.052451 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.052223    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab896da9-6ed3-4a3b-a584-e95b5fc632cf" containerName="payload-processing"
Jul 24 17:42:03.055608 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.055590    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht"
Jul 24 17:42:03.058239 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.058217    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 24 17:42:03.058363 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.058266    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-028d4b-openshift-default-dockercfg-b6z2z\""
Jul 24 17:42:03.070637 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.070613    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht"]
Jul 24 17:42:03.159619 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.159585    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9778eb53-fada-43c6-9492-647ad301cd29-workload-socket\") pod \"e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht\" (UID: \"9778eb53-fada-43c6-9492-647ad301cd29\") " pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht"
Jul 24 17:42:03.159771 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.159623    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9778eb53-fada-43c6-9492-647ad301cd29-istio-envoy\") pod \"e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht\" (UID: \"9778eb53-fada-43c6-9492-647ad301cd29\") " pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht"
Jul 24 17:42:03.159771 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.159648    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9778eb53-fada-43c6-9492-647ad301cd29-istiod-ca-cert\") pod \"e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht\" (UID: \"9778eb53-fada-43c6-9492-647ad301cd29\") " pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht"
Jul 24 17:42:03.159771 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.159714    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46mrt\" (UniqueName: \"kubernetes.io/projected/9778eb53-fada-43c6-9492-647ad301cd29-kube-api-access-46mrt\") pod \"e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht\" (UID: \"9778eb53-fada-43c6-9492-647ad301cd29\") " pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht"
Jul 24 17:42:03.159771 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.159749    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9778eb53-fada-43c6-9492-647ad301cd29-workload-certs\") pod \"e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht\" (UID: \"9778eb53-fada-43c6-9492-647ad301cd29\") " pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht"
Jul 24 17:42:03.159923 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.159786    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9778eb53-fada-43c6-9492-647ad301cd29-credential-socket\") pod \"e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht\" (UID: \"9778eb53-fada-43c6-9492-647ad301cd29\") " pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht"
Jul 24 17:42:03.159923 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.159833    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9778eb53-fada-43c6-9492-647ad301cd29-istio-token\") pod \"e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht\" (UID: \"9778eb53-fada-43c6-9492-647ad301cd29\") " pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht"
Jul 24 17:42:03.159923 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.159882    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9778eb53-fada-43c6-9492-647ad301cd29-istio-data\") pod \"e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht\" (UID: \"9778eb53-fada-43c6-9492-647ad301cd29\") " pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht"
Jul 24 17:42:03.159923 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.159902    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9778eb53-fada-43c6-9492-647ad301cd29-istio-podinfo\") pod \"e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht\" (UID: \"9778eb53-fada-43c6-9492-647ad301cd29\") " pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht"
Jul 24 17:42:03.260997 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.260956    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46mrt\" (UniqueName: \"kubernetes.io/projected/9778eb53-fada-43c6-9492-647ad301cd29-kube-api-access-46mrt\") pod \"e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht\" (UID: \"9778eb53-fada-43c6-9492-647ad301cd29\") " pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht"
Jul 24 17:42:03.260997 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.260999    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9778eb53-fada-43c6-9492-647ad301cd29-workload-certs\") pod \"e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht\" (UID: \"9778eb53-fada-43c6-9492-647ad301cd29\") " pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht"
Jul 24 17:42:03.261243 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.261025    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9778eb53-fada-43c6-9492-647ad301cd29-credential-socket\") pod \"e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht\" (UID: \"9778eb53-fada-43c6-9492-647ad301cd29\") " pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht"
Jul 24 17:42:03.261243 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.261055    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9778eb53-fada-43c6-9492-647ad301cd29-istio-token\") pod \"e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht\" (UID: \"9778eb53-fada-43c6-9492-647ad301cd29\") " pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht"
Jul 24 17:42:03.261243 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.261107    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9778eb53-fada-43c6-9492-647ad301cd29-istio-data\") pod \"e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht\" (UID: \"9778eb53-fada-43c6-9492-647ad301cd29\") " pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht"
Jul 24 17:42:03.261243 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.261125    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9778eb53-fada-43c6-9492-647ad301cd29-istio-podinfo\") pod \"e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht\" (UID: \"9778eb53-fada-43c6-9492-647ad301cd29\") " pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht"
Jul 24 17:42:03.261243 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.261151    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9778eb53-fada-43c6-9492-647ad301cd29-workload-socket\") pod \"e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht\" (UID: \"9778eb53-fada-43c6-9492-647ad301cd29\") " pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht"
Jul 24 17:42:03.261243 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.261176    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9778eb53-fada-43c6-9492-647ad301cd29-istio-envoy\") pod \"e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht\" (UID: \"9778eb53-fada-43c6-9492-647ad301cd29\") " pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht"
Jul 24 17:42:03.261243 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.261200    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9778eb53-fada-43c6-9492-647ad301cd29-istiod-ca-cert\") pod \"e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht\" (UID: \"9778eb53-fada-43c6-9492-647ad301cd29\") " pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht"
Jul 24 17:42:03.261630 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.261436    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9778eb53-fada-43c6-9492-647ad301cd29-workload-certs\") pod \"e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht\" (UID: \"9778eb53-fada-43c6-9492-647ad301cd29\") " pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht"
Jul 24 17:42:03.261630 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.261481    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9778eb53-fada-43c6-9492-647ad301cd29-credential-socket\") pod \"e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht\" (UID: \"9778eb53-fada-43c6-9492-647ad301cd29\") " pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht"
Jul 24 17:42:03.261630 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.261510    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9778eb53-fada-43c6-9492-647ad301cd29-istio-data\") pod \"e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht\" (UID: \"9778eb53-fada-43c6-9492-647ad301cd29\") " pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht"
Jul 24 17:42:03.261630 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.261597    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9778eb53-fada-43c6-9492-647ad301cd29-workload-socket\") pod \"e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht\" (UID: \"9778eb53-fada-43c6-9492-647ad301cd29\") " pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht"
Jul 24 17:42:03.261875 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.261852    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9778eb53-fada-43c6-9492-647ad301cd29-istiod-ca-cert\") pod \"e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht\" (UID: \"9778eb53-fada-43c6-9492-647ad301cd29\") " pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht"
Jul 24 17:42:03.263415 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.263395    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9778eb53-fada-43c6-9492-647ad301cd29-istio-envoy\") pod \"e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht\" (UID: \"9778eb53-fada-43c6-9492-647ad301cd29\") " pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht"
Jul 24 17:42:03.263558 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.263540    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9778eb53-fada-43c6-9492-647ad301cd29-istio-podinfo\") pod \"e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht\" (UID: \"9778eb53-fada-43c6-9492-647ad301cd29\") " pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht"
Jul 24 17:42:03.283323 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.283301    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9778eb53-fada-43c6-9492-647ad301cd29-istio-token\") pod \"e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht\" (UID: \"9778eb53-fada-43c6-9492-647ad301cd29\") " pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht"
Jul 24 17:42:03.283538 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.283519    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46mrt\" (UniqueName: \"kubernetes.io/projected/9778eb53-fada-43c6-9492-647ad301cd29-kube-api-access-46mrt\") pod \"e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht\" (UID: \"9778eb53-fada-43c6-9492-647ad301cd29\") " pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht"
Jul 24 17:42:03.366006 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.365931    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht"
Jul 24 17:42:03.499628 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.499602    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht"]
Jul 24 17:42:03.502123 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:42:03.502099    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9778eb53_fada_43c6_9492_647ad301cd29.slice/crio-5d79fd868a89fdd91d116c065c14ffa811c37777508679a6f31ef5514cc5a309 WatchSource:0}: Error finding container 5d79fd868a89fdd91d116c065c14ffa811c37777508679a6f31ef5514cc5a309: Status 404 returned error can't find the container with id 5d79fd868a89fdd91d116c065c14ffa811c37777508679a6f31ef5514cc5a309
Jul 24 17:42:03.504227 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.504197    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:42:03.504327 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.504259    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:42:03.504327 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:03.504287    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:42:04.135356 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:04.135323    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht" event={"ID":"9778eb53-fada-43c6-9492-647ad301cd29","Type":"ContainerStarted","Data":"3e73e8b9daada9d37d0d5d817c78fbcaeb838197fe916ec473e9638a99dc8e94"}
Jul 24 17:42:04.135718 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:04.135374    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht" event={"ID":"9778eb53-fada-43c6-9492-647ad301cd29","Type":"ContainerStarted","Data":"5d79fd868a89fdd91d116c065c14ffa811c37777508679a6f31ef5514cc5a309"}
Jul 24 17:42:04.155343 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:04.155297    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht" podStartSLOduration=1.155282978 podStartE2EDuration="1.155282978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:42:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:42:04.154557202 +0000 UTC m=+2308.427417018" watchObservedRunningTime="2026-07-24 17:42:04.155282978 +0000 UTC m=+2308.428142759"
Jul 24 17:42:04.366959 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:04.366926    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht"
Jul 24 17:42:04.371588 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:04.371567    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht"
Jul 24 17:42:05.140785 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:05.140759    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht"
Jul 24 17:42:05.141836 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:05.141817    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht"
Jul 24 17:42:07.124486 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:07.124446    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-028d4b-84569f6774-h6qlw"]
Jul 24 17:42:07.127274 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:07.127256    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-028d4b-84569f6774-h6qlw"
Jul 24 17:42:07.131185 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:07.131161    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-028d4b-dockercfg-lttnd\""
Jul 24 17:42:07.131371 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:07.131354    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-028d4b\""
Jul 24 17:42:07.143153 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:07.143124    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-028d4b-84569f6774-h6qlw"]
Jul 24 17:42:07.296258 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:07.296224    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7vnc\" (UniqueName: \"kubernetes.io/projected/657e4762-5f5b-43c6-84c2-4d2b0dbbcad2-kube-api-access-b7vnc\") pod \"payload-processing-e2e-shared-a-028d4b-84569f6774-h6qlw\" (UID: \"657e4762-5f5b-43c6-84c2-4d2b0dbbcad2\") " pod="openshift-ingress/payload-processing-e2e-shared-a-028d4b-84569f6774-h6qlw"
Jul 24 17:42:07.296445 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:07.296414    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/657e4762-5f5b-43c6-84c2-4d2b0dbbcad2-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-028d4b-84569f6774-h6qlw\" (UID: \"657e4762-5f5b-43c6-84c2-4d2b0dbbcad2\") " pod="openshift-ingress/payload-processing-e2e-shared-a-028d4b-84569f6774-h6qlw"
Jul 24 17:42:07.397661 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:07.397577    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/657e4762-5f5b-43c6-84c2-4d2b0dbbcad2-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-028d4b-84569f6774-h6qlw\" (UID: \"657e4762-5f5b-43c6-84c2-4d2b0dbbcad2\") " pod="openshift-ingress/payload-processing-e2e-shared-a-028d4b-84569f6774-h6qlw"
Jul 24 17:42:07.397661 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:07.397625    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7vnc\" (UniqueName: \"kubernetes.io/projected/657e4762-5f5b-43c6-84c2-4d2b0dbbcad2-kube-api-access-b7vnc\") pod \"payload-processing-e2e-shared-a-028d4b-84569f6774-h6qlw\" (UID: \"657e4762-5f5b-43c6-84c2-4d2b0dbbcad2\") " pod="openshift-ingress/payload-processing-e2e-shared-a-028d4b-84569f6774-h6qlw"
Jul 24 17:42:07.398364 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:07.398341    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/657e4762-5f5b-43c6-84c2-4d2b0dbbcad2-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-028d4b-84569f6774-h6qlw\" (UID: \"657e4762-5f5b-43c6-84c2-4d2b0dbbcad2\") " pod="openshift-ingress/payload-processing-e2e-shared-a-028d4b-84569f6774-h6qlw"
Jul 24 17:42:07.407286 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:07.407263    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7vnc\" (UniqueName: \"kubernetes.io/projected/657e4762-5f5b-43c6-84c2-4d2b0dbbcad2-kube-api-access-b7vnc\") pod \"payload-processing-e2e-shared-a-028d4b-84569f6774-h6qlw\" (UID: \"657e4762-5f5b-43c6-84c2-4d2b0dbbcad2\") " pod="openshift-ingress/payload-processing-e2e-shared-a-028d4b-84569f6774-h6qlw"
Jul 24 17:42:07.437956 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:07.437929    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-028d4b-84569f6774-h6qlw"
Jul 24 17:42:07.572278 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:07.572208    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-028d4b-84569f6774-h6qlw"]
Jul 24 17:42:07.574434 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:42:07.574409    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod657e4762_5f5b_43c6_84c2_4d2b0dbbcad2.slice/crio-a44fc97b514f40fd942f83dfa6008392ab27ce1636f7845f05f7681f5dff6efe WatchSource:0}: Error finding container a44fc97b514f40fd942f83dfa6008392ab27ce1636f7845f05f7681f5dff6efe: Status 404 returned error can't find the container with id a44fc97b514f40fd942f83dfa6008392ab27ce1636f7845f05f7681f5dff6efe
Jul 24 17:42:08.158418 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:08.158379    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-028d4b-84569f6774-h6qlw" event={"ID":"657e4762-5f5b-43c6-84c2-4d2b0dbbcad2","Type":"ContainerStarted","Data":"bfeb3d60e59380ff5331674b1a85f3f19652c647215de3fc4f44f66ee3f8bbab"}
Jul 24 17:42:08.158877 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:08.158435    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-028d4b-84569f6774-h6qlw" event={"ID":"657e4762-5f5b-43c6-84c2-4d2b0dbbcad2","Type":"ContainerStarted","Data":"a44fc97b514f40fd942f83dfa6008392ab27ce1636f7845f05f7681f5dff6efe"}
Jul 24 17:42:08.158877 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:08.158517    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-028d4b-84569f6774-h6qlw"
Jul 24 17:42:08.176497 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:08.176450    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-028d4b-84569f6774-h6qlw" podStartSLOduration=1.176436572 podStartE2EDuration="1.176436572s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:42:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:42:08.175186553 +0000 UTC m=+2312.448046335" watchObservedRunningTime="2026-07-24 17:42:08.176436572 +0000 UTC m=+2312.449296353"
Jul 24 17:42:15.094307 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:15.094269    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-a11aa7-74fb86cfd6-vvk5b"]
Jul 24 17:42:15.097032 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:15.097007    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-a11aa7-74fb86cfd6-vvk5b"
Jul 24 17:42:15.099946 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:15.099921    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-a11aa7-dockercfg-jz5w9\""
Jul 24 17:42:15.100051 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:15.099948    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-a11aa7\""
Jul 24 17:42:15.107812 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:15.107791    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-a11aa7-74fb86cfd6-vvk5b"]
Jul 24 17:42:15.176671 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:15.176625    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da154062-46c4-45ea-a282-1ca418c591a3-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-a11aa7-74fb86cfd6-vvk5b\" (UID: \"da154062-46c4-45ea-a282-1ca418c591a3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-a11aa7-74fb86cfd6-vvk5b"
Jul 24 17:42:15.177190 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:15.177164    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vxtl\" (UniqueName: \"kubernetes.io/projected/da154062-46c4-45ea-a282-1ca418c591a3-kube-api-access-6vxtl\") pod \"payload-processing-e2e-shared-b-a11aa7-74fb86cfd6-vvk5b\" (UID: \"da154062-46c4-45ea-a282-1ca418c591a3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-a11aa7-74fb86cfd6-vvk5b"
Jul 24 17:42:15.278230 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:15.278184    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da154062-46c4-45ea-a282-1ca418c591a3-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-a11aa7-74fb86cfd6-vvk5b\" (UID: \"da154062-46c4-45ea-a282-1ca418c591a3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-a11aa7-74fb86cfd6-vvk5b"
Jul 24 17:42:15.279003 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:15.278603    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vxtl\" (UniqueName: \"kubernetes.io/projected/da154062-46c4-45ea-a282-1ca418c591a3-kube-api-access-6vxtl\") pod \"payload-processing-e2e-shared-b-a11aa7-74fb86cfd6-vvk5b\" (UID: \"da154062-46c4-45ea-a282-1ca418c591a3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-a11aa7-74fb86cfd6-vvk5b"
Jul 24 17:42:15.279271 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:15.279244    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da154062-46c4-45ea-a282-1ca418c591a3-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-a11aa7-74fb86cfd6-vvk5b\" (UID: \"da154062-46c4-45ea-a282-1ca418c591a3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-a11aa7-74fb86cfd6-vvk5b"
Jul 24 17:42:15.287571 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:15.287547    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vxtl\" (UniqueName: \"kubernetes.io/projected/da154062-46c4-45ea-a282-1ca418c591a3-kube-api-access-6vxtl\") pod \"payload-processing-e2e-shared-b-a11aa7-74fb86cfd6-vvk5b\" (UID: \"da154062-46c4-45ea-a282-1ca418c591a3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-a11aa7-74fb86cfd6-vvk5b"
Jul 24 17:42:15.407727 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:15.407698    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-a11aa7-74fb86cfd6-vvk5b"
Jul 24 17:42:15.585093 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:15.585049    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-a11aa7-74fb86cfd6-vvk5b"]
Jul 24 17:42:15.585229 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:42:15.585144    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda154062_46c4_45ea_a282_1ca418c591a3.slice/crio-f0bcd666f33e5bff7b29f9b94330beb0b3163475e1acaafce6ae21411df68cf7 WatchSource:0}: Error finding container f0bcd666f33e5bff7b29f9b94330beb0b3163475e1acaafce6ae21411df68cf7: Status 404 returned error can't find the container with id f0bcd666f33e5bff7b29f9b94330beb0b3163475e1acaafce6ae21411df68cf7
Jul 24 17:42:16.200201 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:16.200162    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-a11aa7-74fb86cfd6-vvk5b" event={"ID":"da154062-46c4-45ea-a282-1ca418c591a3","Type":"ContainerStarted","Data":"610efc1f4936c36c3b3633d9c6bd4a38f32a8d39e4752eaf95e028adb7613d02"}
Jul 24 17:42:16.200640 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:16.200222    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-a11aa7-74fb86cfd6-vvk5b" event={"ID":"da154062-46c4-45ea-a282-1ca418c591a3","Type":"ContainerStarted","Data":"f0bcd666f33e5bff7b29f9b94330beb0b3163475e1acaafce6ae21411df68cf7"}
Jul 24 17:42:16.200640 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:16.200274    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-a11aa7-74fb86cfd6-vvk5b"
Jul 24 17:42:16.217511 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:16.217462    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-a11aa7-74fb86cfd6-vvk5b" podStartSLOduration=1.217448298 podStartE2EDuration="1.217448298s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:42:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:42:16.215656294 +0000 UTC m=+2320.488516094" watchObservedRunningTime="2026-07-24 17:42:16.217448298 +0000 UTC m=+2320.490308131"
Jul 24 17:42:19.166250 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:19.166215    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-028d4b-84569f6774-h6qlw"
Jul 24 17:42:21.183219 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:21.183180    2561 patch_prober.go:28] interesting pod/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 24 17:42:21.183630 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:21.183266    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht" podUID="9778eb53-fada-43c6-9492-647ad301cd29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 24 17:42:22.234651 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:22.234620    2561 generic.go:356] "Generic (PLEG): container finished" podID="9778eb53-fada-43c6-9492-647ad301cd29" containerID="3e73e8b9daada9d37d0d5d817c78fbcaeb838197fe916ec473e9638a99dc8e94" exitCode=0
Jul 24 17:42:22.235078 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:22.234696    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht" event={"ID":"9778eb53-fada-43c6-9492-647ad301cd29","Type":"ContainerDied","Data":"3e73e8b9daada9d37d0d5d817c78fbcaeb838197fe916ec473e9638a99dc8e94"}
Jul 24 17:42:22.235165 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:22.235148    2561 scope.go:117] "RemoveContainer" containerID="3e73e8b9daada9d37d0d5d817c78fbcaeb838197fe916ec473e9638a99dc8e94"
Jul 24 17:42:22.236176 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:22.236150    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:42:22.236244 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:22.236215    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:42:22.236281 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:22.236244    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:42:23.242025 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:23.241991    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht" event={"ID":"9778eb53-fada-43c6-9492-647ad301cd29","Type":"ContainerStarted","Data":"4d2460a858b3195236878bc072c781a888e3eaf5d3579c2f5f5be66f825cd362"}
Jul 24 17:42:23.366434 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:23.366354    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht"
Jul 24 17:42:23.366707 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:23.366685    2561 patch_prober.go:28] interesting pod/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Jul 24 17:42:23.366860 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:23.366835    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht" podUID="9778eb53-fada-43c6-9492-647ad301cd29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Jul 24 17:42:24.366684 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:24.366639    2561 patch_prober.go:28] interesting pod/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Jul 24 17:42:24.367200 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:24.366704    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht" podUID="9778eb53-fada-43c6-9492-647ad301cd29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Jul 24 17:42:25.367115 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:25.367080    2561 patch_prober.go:28] interesting pod/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Jul 24 17:42:25.367671 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:25.367640    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht" podUID="9778eb53-fada-43c6-9492-647ad301cd29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Jul 24 17:42:26.366433 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:26.366395    2561 patch_prober.go:28] interesting pod/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Jul 24 17:42:26.366613 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:26.366474    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht" podUID="9778eb53-fada-43c6-9492-647ad301cd29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Jul 24 17:42:27.207781 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:27.207752    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-a11aa7-74fb86cfd6-vvk5b"
Jul 24 17:42:27.370305 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:27.370275    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht"
Jul 24 17:42:27.370659 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:27.370641    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht"
Jul 24 17:42:27.371227 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:27.371207    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht"
Jul 24 17:42:38.588002 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:38.587966    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-028d4b/auth-test-model-028d4b-kserve-668fd589ff-sb4zk"]
Jul 24 17:42:38.591570 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:38.591550    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-028d4b/auth-test-model-028d4b-kserve-668fd589ff-sb4zk"
Jul 24 17:42:38.596015 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:38.595987    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-028d4b\"/\"kube-root-ca.crt\""
Jul 24 17:42:38.596818 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:38.596797    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-028d4b\"/\"auth-test-model-028d4b-kserve-self-signed-certs\""
Jul 24 17:42:38.596952 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:38.596838    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-028d4b\"/\"openshift-service-ca.crt\""
Jul 24 17:42:38.596952 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:38.596844    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-028d4b\"/\"default-dockercfg-7p4cw\""
Jul 24 17:42:38.609344 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:38.609318    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-028d4b/auth-test-model-028d4b-kserve-668fd589ff-sb4zk"]
Jul 24 17:42:38.706414 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:38.706380    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5cc4b3de-23c1-4bfd-a348-9d9e0efa8910-home\") pod \"auth-test-model-028d4b-kserve-668fd589ff-sb4zk\" (UID: \"5cc4b3de-23c1-4bfd-a348-9d9e0efa8910\") " pod="ai-tenant-e2e-shared-a-028d4b/auth-test-model-028d4b-kserve-668fd589ff-sb4zk"
Jul 24 17:42:38.706414 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:38.706411    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5cc4b3de-23c1-4bfd-a348-9d9e0efa8910-dshm\") pod \"auth-test-model-028d4b-kserve-668fd589ff-sb4zk\" (UID: \"5cc4b3de-23c1-4bfd-a348-9d9e0efa8910\") " pod="ai-tenant-e2e-shared-a-028d4b/auth-test-model-028d4b-kserve-668fd589ff-sb4zk"
Jul 24 17:42:38.706603 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:38.706435    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5cc4b3de-23c1-4bfd-a348-9d9e0efa8910-model-cache\") pod \"auth-test-model-028d4b-kserve-668fd589ff-sb4zk\" (UID: \"5cc4b3de-23c1-4bfd-a348-9d9e0efa8910\") " pod="ai-tenant-e2e-shared-a-028d4b/auth-test-model-028d4b-kserve-668fd589ff-sb4zk"
Jul 24 17:42:38.706603 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:38.706454    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5cc4b3de-23c1-4bfd-a348-9d9e0efa8910-tmp-dir\") pod \"auth-test-model-028d4b-kserve-668fd589ff-sb4zk\" (UID: \"5cc4b3de-23c1-4bfd-a348-9d9e0efa8910\") " pod="ai-tenant-e2e-shared-a-028d4b/auth-test-model-028d4b-kserve-668fd589ff-sb4zk"
Jul 24 17:42:38.706603 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:38.706521    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5cc4b3de-23c1-4bfd-a348-9d9e0efa8910-tls-certs\") pod \"auth-test-model-028d4b-kserve-668fd589ff-sb4zk\" (UID: \"5cc4b3de-23c1-4bfd-a348-9d9e0efa8910\") " pod="ai-tenant-e2e-shared-a-028d4b/auth-test-model-028d4b-kserve-668fd589ff-sb4zk"
Jul 24 17:42:38.706603 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:38.706555    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glgkg\" (UniqueName: \"kubernetes.io/projected/5cc4b3de-23c1-4bfd-a348-9d9e0efa8910-kube-api-access-glgkg\") pod \"auth-test-model-028d4b-kserve-668fd589ff-sb4zk\" (UID: \"5cc4b3de-23c1-4bfd-a348-9d9e0efa8910\") " pod="ai-tenant-e2e-shared-a-028d4b/auth-test-model-028d4b-kserve-668fd589ff-sb4zk"
Jul 24 17:42:38.807325 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:38.807283    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5cc4b3de-23c1-4bfd-a348-9d9e0efa8910-home\") pod \"auth-test-model-028d4b-kserve-668fd589ff-sb4zk\" (UID: \"5cc4b3de-23c1-4bfd-a348-9d9e0efa8910\") " pod="ai-tenant-e2e-shared-a-028d4b/auth-test-model-028d4b-kserve-668fd589ff-sb4zk"
Jul 24 17:42:38.807501 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:38.807328    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5cc4b3de-23c1-4bfd-a348-9d9e0efa8910-dshm\") pod \"auth-test-model-028d4b-kserve-668fd589ff-sb4zk\" (UID: \"5cc4b3de-23c1-4bfd-a348-9d9e0efa8910\") " pod="ai-tenant-e2e-shared-a-028d4b/auth-test-model-028d4b-kserve-668fd589ff-sb4zk"
Jul 24 17:42:38.807501 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:38.807369    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5cc4b3de-23c1-4bfd-a348-9d9e0efa8910-model-cache\") pod \"auth-test-model-028d4b-kserve-668fd589ff-sb4zk\" (UID: \"5cc4b3de-23c1-4bfd-a348-9d9e0efa8910\") " pod="ai-tenant-e2e-shared-a-028d4b/auth-test-model-028d4b-kserve-668fd589ff-sb4zk"
Jul 24 17:42:38.807501 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:38.807477    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5cc4b3de-23c1-4bfd-a348-9d9e0efa8910-tmp-dir\") pod \"auth-test-model-028d4b-kserve-668fd589ff-sb4zk\" (UID: \"5cc4b3de-23c1-4bfd-a348-9d9e0efa8910\") " pod="ai-tenant-e2e-shared-a-028d4b/auth-test-model-028d4b-kserve-668fd589ff-sb4zk"
Jul 24 17:42:38.807674 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:38.807526    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5cc4b3de-23c1-4bfd-a348-9d9e0efa8910-tls-certs\") pod \"auth-test-model-028d4b-kserve-668fd589ff-sb4zk\" (UID: \"5cc4b3de-23c1-4bfd-a348-9d9e0efa8910\") " pod="ai-tenant-e2e-shared-a-028d4b/auth-test-model-028d4b-kserve-668fd589ff-sb4zk"
Jul 24 17:42:38.807674 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:38.807558    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glgkg\" (UniqueName: \"kubernetes.io/projected/5cc4b3de-23c1-4bfd-a348-9d9e0efa8910-kube-api-access-glgkg\") pod \"auth-test-model-028d4b-kserve-668fd589ff-sb4zk\" (UID: \"5cc4b3de-23c1-4bfd-a348-9d9e0efa8910\") " pod="ai-tenant-e2e-shared-a-028d4b/auth-test-model-028d4b-kserve-668fd589ff-sb4zk"
Jul 24 17:42:38.807787 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:38.807713    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5cc4b3de-23c1-4bfd-a348-9d9e0efa8910-home\") pod \"auth-test-model-028d4b-kserve-668fd589ff-sb4zk\" (UID: \"5cc4b3de-23c1-4bfd-a348-9d9e0efa8910\") " pod="ai-tenant-e2e-shared-a-028d4b/auth-test-model-028d4b-kserve-668fd589ff-sb4zk"
Jul 24 17:42:38.807787 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:38.807759    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5cc4b3de-23c1-4bfd-a348-9d9e0efa8910-model-cache\") pod \"auth-test-model-028d4b-kserve-668fd589ff-sb4zk\" (UID: \"5cc4b3de-23c1-4bfd-a348-9d9e0efa8910\") " pod="ai-tenant-e2e-shared-a-028d4b/auth-test-model-028d4b-kserve-668fd589ff-sb4zk"
Jul 24 17:42:38.807896 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:38.807848    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5cc4b3de-23c1-4bfd-a348-9d9e0efa8910-tmp-dir\") pod \"auth-test-model-028d4b-kserve-668fd589ff-sb4zk\" (UID: \"5cc4b3de-23c1-4bfd-a348-9d9e0efa8910\") " pod="ai-tenant-e2e-shared-a-028d4b/auth-test-model-028d4b-kserve-668fd589ff-sb4zk"
Jul 24 17:42:38.809825 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:38.809798    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5cc4b3de-23c1-4bfd-a348-9d9e0efa8910-dshm\") pod \"auth-test-model-028d4b-kserve-668fd589ff-sb4zk\" (UID: \"5cc4b3de-23c1-4bfd-a348-9d9e0efa8910\") " pod="ai-tenant-e2e-shared-a-028d4b/auth-test-model-028d4b-kserve-668fd589ff-sb4zk"
Jul 24 17:42:38.809992 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:38.809976    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5cc4b3de-23c1-4bfd-a348-9d9e0efa8910-tls-certs\") pod \"auth-test-model-028d4b-kserve-668fd589ff-sb4zk\" (UID: \"5cc4b3de-23c1-4bfd-a348-9d9e0efa8910\") " pod="ai-tenant-e2e-shared-a-028d4b/auth-test-model-028d4b-kserve-668fd589ff-sb4zk"
Jul 24 17:42:38.819151 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:38.819131    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glgkg\" (UniqueName: \"kubernetes.io/projected/5cc4b3de-23c1-4bfd-a348-9d9e0efa8910-kube-api-access-glgkg\") pod \"auth-test-model-028d4b-kserve-668fd589ff-sb4zk\" (UID: \"5cc4b3de-23c1-4bfd-a348-9d9e0efa8910\") " pod="ai-tenant-e2e-shared-a-028d4b/auth-test-model-028d4b-kserve-668fd589ff-sb4zk"
Jul 24 17:42:38.900722 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:38.900698    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-028d4b/auth-test-model-028d4b-kserve-668fd589ff-sb4zk"
Jul 24 17:42:39.033731 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:39.033707    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-028d4b/auth-test-model-028d4b-kserve-668fd589ff-sb4zk"]
Jul 24 17:42:39.035769 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:42:39.035737    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5cc4b3de_23c1_4bfd_a348_9d9e0efa8910.slice/crio-537d4a5f92735e81c1ccf5d3809ea274ad0bf592c2cf154515663765ae97a854 WatchSource:0}: Error finding container 537d4a5f92735e81c1ccf5d3809ea274ad0bf592c2cf154515663765ae97a854: Status 404 returned error can't find the container with id 537d4a5f92735e81c1ccf5d3809ea274ad0bf592c2cf154515663765ae97a854
Jul 24 17:42:39.317463 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:39.317366    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-028d4b/auth-test-model-028d4b-kserve-668fd589ff-sb4zk" event={"ID":"5cc4b3de-23c1-4bfd-a348-9d9e0efa8910","Type":"ContainerStarted","Data":"b882fa30b3e7ef5d17701be7c7fd10ceabe5bb87233c8e5d5ce9187b4749d8da"}
Jul 24 17:42:39.317463 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:39.317409    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-028d4b/auth-test-model-028d4b-kserve-668fd589ff-sb4zk" event={"ID":"5cc4b3de-23c1-4bfd-a348-9d9e0efa8910","Type":"ContainerStarted","Data":"537d4a5f92735e81c1ccf5d3809ea274ad0bf592c2cf154515663765ae97a854"}
Jul 24 17:42:39.336352 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:39.336306    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-028d4b/auth-test-model-028d4b-kserve-668fd589ff-sb4zk" podStartSLOduration=1.336290816 podStartE2EDuration="1.336290816s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:42:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:42:39.333920536 +0000 UTC m=+2343.606780342" watchObservedRunningTime="2026-07-24 17:42:39.336290816 +0000 UTC m=+2343.609150597"
Jul 24 17:42:48.900844 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:48.900814    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-028d4b/auth-test-model-028d4b-kserve-668fd589ff-sb4zk"
Jul 24 17:42:48.901359 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:48.900863    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-028d4b/auth-test-model-028d4b-kserve-668fd589ff-sb4zk"
Jul 24 17:42:48.912933 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:48.912909    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-028d4b/auth-test-model-028d4b-kserve-668fd589ff-sb4zk"
Jul 24 17:42:49.376429 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:42:49.376399    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-028d4b/auth-test-model-028d4b-kserve-668fd589ff-sb4zk"
Jul 24 17:43:36.348092 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:43:36.348040    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6h754_860ed1fc-612f-4796-8077-72bc6c5d84db/ovn-acl-logging/0.log"
Jul 24 17:43:36.349054 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:43:36.349035    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6h754_860ed1fc-612f-4796-8077-72bc6c5d84db/ovn-acl-logging/0.log"
Jul 24 17:45:08.569030 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:08.568994    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-028d4b/auth-test-model-028d4b-kserve-668fd589ff-sb4zk"]
Jul 24 17:45:23.277389 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:23.277359    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-028d4b/sub-test-model-028d4b-kserve-7d759b68f5-j9qms"]
Jul 24 17:45:23.279917 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:23.279897    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-028d4b/sub-test-model-028d4b-kserve-7d759b68f5-j9qms"
Jul 24 17:45:23.282208 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:23.282189    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-028d4b\"/\"sub-test-model-028d4b-kserve-self-signed-certs\""
Jul 24 17:45:23.294186 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:23.294166    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-028d4b/sub-test-model-028d4b-kserve-7d759b68f5-j9qms"]
Jul 24 17:45:23.437660 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:23.437628    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/071b1529-c1e3-40d6-83da-cdbf2a97a5dc-dshm\") pod \"sub-test-model-028d4b-kserve-7d759b68f5-j9qms\" (UID: \"071b1529-c1e3-40d6-83da-cdbf2a97a5dc\") " pod="ai-tenant-e2e-shared-a-028d4b/sub-test-model-028d4b-kserve-7d759b68f5-j9qms"
Jul 24 17:45:23.437851 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:23.437674    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/071b1529-c1e3-40d6-83da-cdbf2a97a5dc-tmp-dir\") pod \"sub-test-model-028d4b-kserve-7d759b68f5-j9qms\" (UID: \"071b1529-c1e3-40d6-83da-cdbf2a97a5dc\") " pod="ai-tenant-e2e-shared-a-028d4b/sub-test-model-028d4b-kserve-7d759b68f5-j9qms"
Jul 24 17:45:23.437851 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:23.437705    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/071b1529-c1e3-40d6-83da-cdbf2a97a5dc-tls-certs\") pod \"sub-test-model-028d4b-kserve-7d759b68f5-j9qms\" (UID: \"071b1529-c1e3-40d6-83da-cdbf2a97a5dc\") " pod="ai-tenant-e2e-shared-a-028d4b/sub-test-model-028d4b-kserve-7d759b68f5-j9qms"
Jul 24 17:45:23.437851 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:23.437783    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/071b1529-c1e3-40d6-83da-cdbf2a97a5dc-home\") pod \"sub-test-model-028d4b-kserve-7d759b68f5-j9qms\" (UID: \"071b1529-c1e3-40d6-83da-cdbf2a97a5dc\") " pod="ai-tenant-e2e-shared-a-028d4b/sub-test-model-028d4b-kserve-7d759b68f5-j9qms"
Jul 24 17:45:23.437851 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:23.437819    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7m9bh\" (UniqueName: \"kubernetes.io/projected/071b1529-c1e3-40d6-83da-cdbf2a97a5dc-kube-api-access-7m9bh\") pod \"sub-test-model-028d4b-kserve-7d759b68f5-j9qms\" (UID: \"071b1529-c1e3-40d6-83da-cdbf2a97a5dc\") " pod="ai-tenant-e2e-shared-a-028d4b/sub-test-model-028d4b-kserve-7d759b68f5-j9qms"
Jul 24 17:45:23.437851 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:23.437845    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/071b1529-c1e3-40d6-83da-cdbf2a97a5dc-model-cache\") pod \"sub-test-model-028d4b-kserve-7d759b68f5-j9qms\" (UID: \"071b1529-c1e3-40d6-83da-cdbf2a97a5dc\") " pod="ai-tenant-e2e-shared-a-028d4b/sub-test-model-028d4b-kserve-7d759b68f5-j9qms"
Jul 24 17:45:23.538881 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:23.538788    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/071b1529-c1e3-40d6-83da-cdbf2a97a5dc-home\") pod \"sub-test-model-028d4b-kserve-7d759b68f5-j9qms\" (UID: \"071b1529-c1e3-40d6-83da-cdbf2a97a5dc\") " pod="ai-tenant-e2e-shared-a-028d4b/sub-test-model-028d4b-kserve-7d759b68f5-j9qms"
Jul 24 17:45:23.538881 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:23.538824    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7m9bh\" (UniqueName: \"kubernetes.io/projected/071b1529-c1e3-40d6-83da-cdbf2a97a5dc-kube-api-access-7m9bh\") pod \"sub-test-model-028d4b-kserve-7d759b68f5-j9qms\" (UID: \"071b1529-c1e3-40d6-83da-cdbf2a97a5dc\") " pod="ai-tenant-e2e-shared-a-028d4b/sub-test-model-028d4b-kserve-7d759b68f5-j9qms"
Jul 24 17:45:23.538881 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:23.538843    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/071b1529-c1e3-40d6-83da-cdbf2a97a5dc-model-cache\") pod \"sub-test-model-028d4b-kserve-7d759b68f5-j9qms\" (UID: \"071b1529-c1e3-40d6-83da-cdbf2a97a5dc\") " pod="ai-tenant-e2e-shared-a-028d4b/sub-test-model-028d4b-kserve-7d759b68f5-j9qms"
Jul 24 17:45:23.539236 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:23.538940    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/071b1529-c1e3-40d6-83da-cdbf2a97a5dc-dshm\") pod \"sub-test-model-028d4b-kserve-7d759b68f5-j9qms\" (UID: \"071b1529-c1e3-40d6-83da-cdbf2a97a5dc\") " pod="ai-tenant-e2e-shared-a-028d4b/sub-test-model-028d4b-kserve-7d759b68f5-j9qms"
Jul 24 17:45:23.539236 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:23.538989    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/071b1529-c1e3-40d6-83da-cdbf2a97a5dc-tmp-dir\") pod \"sub-test-model-028d4b-kserve-7d759b68f5-j9qms\" (UID: \"071b1529-c1e3-40d6-83da-cdbf2a97a5dc\") " pod="ai-tenant-e2e-shared-a-028d4b/sub-test-model-028d4b-kserve-7d759b68f5-j9qms"
Jul 24 17:45:23.539236 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:23.539030    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/071b1529-c1e3-40d6-83da-cdbf2a97a5dc-tls-certs\") pod \"sub-test-model-028d4b-kserve-7d759b68f5-j9qms\" (UID: \"071b1529-c1e3-40d6-83da-cdbf2a97a5dc\") " pod="ai-tenant-e2e-shared-a-028d4b/sub-test-model-028d4b-kserve-7d759b68f5-j9qms"
Jul 24 17:45:23.539375 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:23.539283    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/071b1529-c1e3-40d6-83da-cdbf2a97a5dc-home\") pod \"sub-test-model-028d4b-kserve-7d759b68f5-j9qms\" (UID: \"071b1529-c1e3-40d6-83da-cdbf2a97a5dc\") " pod="ai-tenant-e2e-shared-a-028d4b/sub-test-model-028d4b-kserve-7d759b68f5-j9qms"
Jul 24 17:45:23.539375 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:23.539336    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/071b1529-c1e3-40d6-83da-cdbf2a97a5dc-model-cache\") pod \"sub-test-model-028d4b-kserve-7d759b68f5-j9qms\" (UID: \"071b1529-c1e3-40d6-83da-cdbf2a97a5dc\") " pod="ai-tenant-e2e-shared-a-028d4b/sub-test-model-028d4b-kserve-7d759b68f5-j9qms"
Jul 24 17:45:23.539451 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:23.539372    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/071b1529-c1e3-40d6-83da-cdbf2a97a5dc-tmp-dir\") pod \"sub-test-model-028d4b-kserve-7d759b68f5-j9qms\" (UID: \"071b1529-c1e3-40d6-83da-cdbf2a97a5dc\") " pod="ai-tenant-e2e-shared-a-028d4b/sub-test-model-028d4b-kserve-7d759b68f5-j9qms"
Jul 24 17:45:23.541183 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:23.541158    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/071b1529-c1e3-40d6-83da-cdbf2a97a5dc-dshm\") pod \"sub-test-model-028d4b-kserve-7d759b68f5-j9qms\" (UID: \"071b1529-c1e3-40d6-83da-cdbf2a97a5dc\") " pod="ai-tenant-e2e-shared-a-028d4b/sub-test-model-028d4b-kserve-7d759b68f5-j9qms"
Jul 24 17:45:23.541481 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:23.541461    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/071b1529-c1e3-40d6-83da-cdbf2a97a5dc-tls-certs\") pod \"sub-test-model-028d4b-kserve-7d759b68f5-j9qms\" (UID: \"071b1529-c1e3-40d6-83da-cdbf2a97a5dc\") " pod="ai-tenant-e2e-shared-a-028d4b/sub-test-model-028d4b-kserve-7d759b68f5-j9qms"
Jul 24 17:45:23.546816 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:23.546791    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7m9bh\" (UniqueName: \"kubernetes.io/projected/071b1529-c1e3-40d6-83da-cdbf2a97a5dc-kube-api-access-7m9bh\") pod \"sub-test-model-028d4b-kserve-7d759b68f5-j9qms\" (UID: \"071b1529-c1e3-40d6-83da-cdbf2a97a5dc\") " pod="ai-tenant-e2e-shared-a-028d4b/sub-test-model-028d4b-kserve-7d759b68f5-j9qms"
Jul 24 17:45:23.588135 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:23.588097    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-028d4b/auth-test-model-028d4b-kserve-668fd589ff-sb4zk" podUID="5cc4b3de-23c1-4bfd-a348-9d9e0efa8910" containerName="main" containerID="cri-o://b882fa30b3e7ef5d17701be7c7fd10ceabe5bb87233c8e5d5ce9187b4749d8da" gracePeriod=45
Jul 24 17:45:23.589614 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:23.589593    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-028d4b/sub-test-model-028d4b-kserve-7d759b68f5-j9qms"
Jul 24 17:45:23.717943 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:23.717917    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-028d4b/sub-test-model-028d4b-kserve-7d759b68f5-j9qms"]
Jul 24 17:45:23.720417 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:45:23.720393    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod071b1529_c1e3_40d6_83da_cdbf2a97a5dc.slice/crio-690af4d53d369c3518f6c0034627ecc73655e4dbf0f85f3f67db2af050411765 WatchSource:0}: Error finding container 690af4d53d369c3518f6c0034627ecc73655e4dbf0f85f3f67db2af050411765: Status 404 returned error can't find the container with id 690af4d53d369c3518f6c0034627ecc73655e4dbf0f85f3f67db2af050411765
Jul 24 17:45:23.828993 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:23.828971    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-028d4b/auth-test-model-028d4b-kserve-668fd589ff-sb4zk"
Jul 24 17:45:23.944167 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:23.944137    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5cc4b3de-23c1-4bfd-a348-9d9e0efa8910-model-cache\") pod \"5cc4b3de-23c1-4bfd-a348-9d9e0efa8910\" (UID: \"5cc4b3de-23c1-4bfd-a348-9d9e0efa8910\") "
Jul 24 17:45:23.944167 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:23.944167    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5cc4b3de-23c1-4bfd-a348-9d9e0efa8910-tls-certs\") pod \"5cc4b3de-23c1-4bfd-a348-9d9e0efa8910\" (UID: \"5cc4b3de-23c1-4bfd-a348-9d9e0efa8910\") "
Jul 24 17:45:23.944389 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:23.944210    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5cc4b3de-23c1-4bfd-a348-9d9e0efa8910-dshm\") pod \"5cc4b3de-23c1-4bfd-a348-9d9e0efa8910\" (UID: \"5cc4b3de-23c1-4bfd-a348-9d9e0efa8910\") "
Jul 24 17:45:23.944389 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:23.944294    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5cc4b3de-23c1-4bfd-a348-9d9e0efa8910-tmp-dir\") pod \"5cc4b3de-23c1-4bfd-a348-9d9e0efa8910\" (UID: \"5cc4b3de-23c1-4bfd-a348-9d9e0efa8910\") "
Jul 24 17:45:23.944389 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:23.944335    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5cc4b3de-23c1-4bfd-a348-9d9e0efa8910-home\") pod \"5cc4b3de-23c1-4bfd-a348-9d9e0efa8910\" (UID: \"5cc4b3de-23c1-4bfd-a348-9d9e0efa8910\") "
Jul 24 17:45:23.944389 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:23.944356    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-glgkg\" (UniqueName: \"kubernetes.io/projected/5cc4b3de-23c1-4bfd-a348-9d9e0efa8910-kube-api-access-glgkg\") pod \"5cc4b3de-23c1-4bfd-a348-9d9e0efa8910\" (UID: \"5cc4b3de-23c1-4bfd-a348-9d9e0efa8910\") "
Jul 24 17:45:23.944608 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:23.944390    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cc4b3de-23c1-4bfd-a348-9d9e0efa8910-model-cache" (OuterVolumeSpecName: "model-cache") pod "5cc4b3de-23c1-4bfd-a348-9d9e0efa8910" (UID: "5cc4b3de-23c1-4bfd-a348-9d9e0efa8910"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:45:23.944608 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:23.944525    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cc4b3de-23c1-4bfd-a348-9d9e0efa8910-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5cc4b3de-23c1-4bfd-a348-9d9e0efa8910" (UID: "5cc4b3de-23c1-4bfd-a348-9d9e0efa8910"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:45:23.944608 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:23.944554    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cc4b3de-23c1-4bfd-a348-9d9e0efa8910-home" (OuterVolumeSpecName: "home") pod "5cc4b3de-23c1-4bfd-a348-9d9e0efa8910" (UID: "5cc4b3de-23c1-4bfd-a348-9d9e0efa8910"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:45:23.944734 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:23.944666    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5cc4b3de-23c1-4bfd-a348-9d9e0efa8910-tmp-dir\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:45:23.944734 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:23.944684    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5cc4b3de-23c1-4bfd-a348-9d9e0efa8910-home\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:45:23.944734 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:23.944698    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5cc4b3de-23c1-4bfd-a348-9d9e0efa8910-model-cache\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:45:23.946342 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:23.946318    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cc4b3de-23c1-4bfd-a348-9d9e0efa8910-kube-api-access-glgkg" (OuterVolumeSpecName: "kube-api-access-glgkg") pod "5cc4b3de-23c1-4bfd-a348-9d9e0efa8910" (UID: "5cc4b3de-23c1-4bfd-a348-9d9e0efa8910"). InnerVolumeSpecName "kube-api-access-glgkg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:45:23.946435 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:23.946344    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cc4b3de-23c1-4bfd-a348-9d9e0efa8910-dshm" (OuterVolumeSpecName: "dshm") pod "5cc4b3de-23c1-4bfd-a348-9d9e0efa8910" (UID: "5cc4b3de-23c1-4bfd-a348-9d9e0efa8910"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:45:23.946435 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:23.946357    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cc4b3de-23c1-4bfd-a348-9d9e0efa8910-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5cc4b3de-23c1-4bfd-a348-9d9e0efa8910" (UID: "5cc4b3de-23c1-4bfd-a348-9d9e0efa8910"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:45:24.046192 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:24.046166    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-glgkg\" (UniqueName: \"kubernetes.io/projected/5cc4b3de-23c1-4bfd-a348-9d9e0efa8910-kube-api-access-glgkg\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:45:24.046192 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:24.046190    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5cc4b3de-23c1-4bfd-a348-9d9e0efa8910-tls-certs\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:45:24.046192 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:24.046199    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5cc4b3de-23c1-4bfd-a348-9d9e0efa8910-dshm\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:45:24.104121 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:24.104024    2561 generic.go:356] "Generic (PLEG): container finished" podID="5cc4b3de-23c1-4bfd-a348-9d9e0efa8910" containerID="b882fa30b3e7ef5d17701be7c7fd10ceabe5bb87233c8e5d5ce9187b4749d8da" exitCode=0
Jul 24 17:45:24.104121 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:24.104095    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-028d4b/auth-test-model-028d4b-kserve-668fd589ff-sb4zk"
Jul 24 17:45:24.104314 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:24.104117    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-028d4b/auth-test-model-028d4b-kserve-668fd589ff-sb4zk" event={"ID":"5cc4b3de-23c1-4bfd-a348-9d9e0efa8910","Type":"ContainerDied","Data":"b882fa30b3e7ef5d17701be7c7fd10ceabe5bb87233c8e5d5ce9187b4749d8da"}
Jul 24 17:45:24.104314 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:24.104156    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-028d4b/auth-test-model-028d4b-kserve-668fd589ff-sb4zk" event={"ID":"5cc4b3de-23c1-4bfd-a348-9d9e0efa8910","Type":"ContainerDied","Data":"537d4a5f92735e81c1ccf5d3809ea274ad0bf592c2cf154515663765ae97a854"}
Jul 24 17:45:24.104314 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:24.104177    2561 scope.go:117] "RemoveContainer" containerID="b882fa30b3e7ef5d17701be7c7fd10ceabe5bb87233c8e5d5ce9187b4749d8da"
Jul 24 17:45:24.105727 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:24.105703    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-028d4b/sub-test-model-028d4b-kserve-7d759b68f5-j9qms" event={"ID":"071b1529-c1e3-40d6-83da-cdbf2a97a5dc","Type":"ContainerStarted","Data":"d7272a8a2d3779cdd575f6be46b3b1605479afd5a1b1b2c27da6806c9f937e00"}
Jul 24 17:45:24.105831 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:24.105733    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-028d4b/sub-test-model-028d4b-kserve-7d759b68f5-j9qms" event={"ID":"071b1529-c1e3-40d6-83da-cdbf2a97a5dc","Type":"ContainerStarted","Data":"690af4d53d369c3518f6c0034627ecc73655e4dbf0f85f3f67db2af050411765"}
Jul 24 17:45:24.112863 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:24.112847    2561 scope.go:117] "RemoveContainer" containerID="b882fa30b3e7ef5d17701be7c7fd10ceabe5bb87233c8e5d5ce9187b4749d8da"
Jul 24 17:45:24.113220 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:45:24.113202    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b882fa30b3e7ef5d17701be7c7fd10ceabe5bb87233c8e5d5ce9187b4749d8da\": container with ID starting with b882fa30b3e7ef5d17701be7c7fd10ceabe5bb87233c8e5d5ce9187b4749d8da not found: ID does not exist" containerID="b882fa30b3e7ef5d17701be7c7fd10ceabe5bb87233c8e5d5ce9187b4749d8da"
Jul 24 17:45:24.113279 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:24.113227    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b882fa30b3e7ef5d17701be7c7fd10ceabe5bb87233c8e5d5ce9187b4749d8da"} err="failed to get container status \"b882fa30b3e7ef5d17701be7c7fd10ceabe5bb87233c8e5d5ce9187b4749d8da\": rpc error: code = NotFound desc = could not find container \"b882fa30b3e7ef5d17701be7c7fd10ceabe5bb87233c8e5d5ce9187b4749d8da\": container with ID starting with b882fa30b3e7ef5d17701be7c7fd10ceabe5bb87233c8e5d5ce9187b4749d8da not found: ID does not exist"
Jul 24 17:45:24.125782 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:24.125743    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-028d4b/sub-test-model-028d4b-kserve-7d759b68f5-j9qms" podStartSLOduration=1.125731168 podStartE2EDuration="1.125731168s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:45:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:45:24.124028197 +0000 UTC m=+2508.396888003" watchObservedRunningTime="2026-07-24 17:45:24.125731168 +0000 UTC m=+2508.398590997"
Jul 24 17:45:24.138056 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:24.138034    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-028d4b/auth-test-model-028d4b-kserve-668fd589ff-sb4zk"]
Jul 24 17:45:24.142368 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:24.142348    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-028d4b/auth-test-model-028d4b-kserve-668fd589ff-sb4zk"]
Jul 24 17:45:24.258583 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:24.258559    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cc4b3de-23c1-4bfd-a348-9d9e0efa8910" path="/var/lib/kubelet/pods/5cc4b3de-23c1-4bfd-a348-9d9e0efa8910/volumes"
Jul 24 17:45:33.589760 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:33.589722    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-028d4b/sub-test-model-028d4b-kserve-7d759b68f5-j9qms"
Jul 24 17:45:33.590214 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:33.590010    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-028d4b/sub-test-model-028d4b-kserve-7d759b68f5-j9qms"
Jul 24 17:45:33.602501 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:33.602481    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-028d4b/sub-test-model-028d4b-kserve-7d759b68f5-j9qms"
Jul 24 17:45:34.169237 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:34.169206    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-028d4b/sub-test-model-028d4b-kserve-7d759b68f5-j9qms"
Jul 24 17:45:36.502490 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:45:36.502460    2561 scope.go:117] "RemoveContainer" containerID="f7e9f2eaadf1f66794d193c3583b6303759930a158b65c411ac83a7ed4c125fd"
Jul 24 17:46:37.738334 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:46:37.738298    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-028d4b/sub-test-model-028d4b-kserve-7d759b68f5-j9qms"]
Jul 24 17:46:52.756952 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:46:52.756887    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-028d4b/sub-test-model-028d4b-kserve-7d759b68f5-j9qms" podUID="071b1529-c1e3-40d6-83da-cdbf2a97a5dc" containerName="main" containerID="cri-o://d7272a8a2d3779cdd575f6be46b3b1605479afd5a1b1b2c27da6806c9f937e00" gracePeriod=45
Jul 24 17:46:53.011101 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:46:53.011007    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-028d4b/sub-test-model-028d4b-kserve-7d759b68f5-j9qms"
Jul 24 17:46:53.054082 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:46:53.054039    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/071b1529-c1e3-40d6-83da-cdbf2a97a5dc-tmp-dir\") pod \"071b1529-c1e3-40d6-83da-cdbf2a97a5dc\" (UID: \"071b1529-c1e3-40d6-83da-cdbf2a97a5dc\") "
Jul 24 17:46:53.054243 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:46:53.054114    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/071b1529-c1e3-40d6-83da-cdbf2a97a5dc-home\") pod \"071b1529-c1e3-40d6-83da-cdbf2a97a5dc\" (UID: \"071b1529-c1e3-40d6-83da-cdbf2a97a5dc\") "
Jul 24 17:46:53.054243 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:46:53.054167    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/071b1529-c1e3-40d6-83da-cdbf2a97a5dc-tls-certs\") pod \"071b1529-c1e3-40d6-83da-cdbf2a97a5dc\" (UID: \"071b1529-c1e3-40d6-83da-cdbf2a97a5dc\") "
Jul 24 17:46:53.054243 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:46:53.054234    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/071b1529-c1e3-40d6-83da-cdbf2a97a5dc-model-cache\") pod \"071b1529-c1e3-40d6-83da-cdbf2a97a5dc\" (UID: \"071b1529-c1e3-40d6-83da-cdbf2a97a5dc\") "
Jul 24 17:46:53.054423 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:46:53.054276    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7m9bh\" (UniqueName: \"kubernetes.io/projected/071b1529-c1e3-40d6-83da-cdbf2a97a5dc-kube-api-access-7m9bh\") pod \"071b1529-c1e3-40d6-83da-cdbf2a97a5dc\" (UID: \"071b1529-c1e3-40d6-83da-cdbf2a97a5dc\") "
Jul 24 17:46:53.054423 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:46:53.054310    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/071b1529-c1e3-40d6-83da-cdbf2a97a5dc-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "071b1529-c1e3-40d6-83da-cdbf2a97a5dc" (UID: "071b1529-c1e3-40d6-83da-cdbf2a97a5dc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:46:53.054423 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:46:53.054328    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/071b1529-c1e3-40d6-83da-cdbf2a97a5dc-dshm\") pod \"071b1529-c1e3-40d6-83da-cdbf2a97a5dc\" (UID: \"071b1529-c1e3-40d6-83da-cdbf2a97a5dc\") "
Jul 24 17:46:53.054423 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:46:53.054392    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/071b1529-c1e3-40d6-83da-cdbf2a97a5dc-home" (OuterVolumeSpecName: "home") pod "071b1529-c1e3-40d6-83da-cdbf2a97a5dc" (UID: "071b1529-c1e3-40d6-83da-cdbf2a97a5dc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:46:53.054599 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:46:53.054477    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/071b1529-c1e3-40d6-83da-cdbf2a97a5dc-model-cache" (OuterVolumeSpecName: "model-cache") pod "071b1529-c1e3-40d6-83da-cdbf2a97a5dc" (UID: "071b1529-c1e3-40d6-83da-cdbf2a97a5dc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:46:53.054729 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:46:53.054710    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/071b1529-c1e3-40d6-83da-cdbf2a97a5dc-model-cache\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:46:53.054788 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:46:53.054734    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/071b1529-c1e3-40d6-83da-cdbf2a97a5dc-tmp-dir\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:46:53.054788 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:46:53.054748    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/071b1529-c1e3-40d6-83da-cdbf2a97a5dc-home\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:46:53.056390 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:46:53.056365    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/071b1529-c1e3-40d6-83da-cdbf2a97a5dc-kube-api-access-7m9bh" (OuterVolumeSpecName: "kube-api-access-7m9bh") pod "071b1529-c1e3-40d6-83da-cdbf2a97a5dc" (UID: "071b1529-c1e3-40d6-83da-cdbf2a97a5dc"). InnerVolumeSpecName "kube-api-access-7m9bh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:46:53.056550 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:46:53.056436    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/071b1529-c1e3-40d6-83da-cdbf2a97a5dc-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "071b1529-c1e3-40d6-83da-cdbf2a97a5dc" (UID: "071b1529-c1e3-40d6-83da-cdbf2a97a5dc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:46:53.056798 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:46:53.056780    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/071b1529-c1e3-40d6-83da-cdbf2a97a5dc-dshm" (OuterVolumeSpecName: "dshm") pod "071b1529-c1e3-40d6-83da-cdbf2a97a5dc" (UID: "071b1529-c1e3-40d6-83da-cdbf2a97a5dc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:46:53.155378 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:46:53.155353    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/071b1529-c1e3-40d6-83da-cdbf2a97a5dc-tls-certs\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:46:53.155378 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:46:53.155375    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7m9bh\" (UniqueName: \"kubernetes.io/projected/071b1529-c1e3-40d6-83da-cdbf2a97a5dc-kube-api-access-7m9bh\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:46:53.155539 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:46:53.155384    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/071b1529-c1e3-40d6-83da-cdbf2a97a5dc-dshm\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:46:53.529513 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:46:53.529479    2561 generic.go:356] "Generic (PLEG): container finished" podID="071b1529-c1e3-40d6-83da-cdbf2a97a5dc" containerID="d7272a8a2d3779cdd575f6be46b3b1605479afd5a1b1b2c27da6806c9f937e00" exitCode=0
Jul 24 17:46:53.529713 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:46:53.529521    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-028d4b/sub-test-model-028d4b-kserve-7d759b68f5-j9qms"
Jul 24 17:46:53.529713 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:46:53.529563    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-028d4b/sub-test-model-028d4b-kserve-7d759b68f5-j9qms" event={"ID":"071b1529-c1e3-40d6-83da-cdbf2a97a5dc","Type":"ContainerDied","Data":"d7272a8a2d3779cdd575f6be46b3b1605479afd5a1b1b2c27da6806c9f937e00"}
Jul 24 17:46:53.529713 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:46:53.529608    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-028d4b/sub-test-model-028d4b-kserve-7d759b68f5-j9qms" event={"ID":"071b1529-c1e3-40d6-83da-cdbf2a97a5dc","Type":"ContainerDied","Data":"690af4d53d369c3518f6c0034627ecc73655e4dbf0f85f3f67db2af050411765"}
Jul 24 17:46:53.529713 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:46:53.529629    2561 scope.go:117] "RemoveContainer" containerID="d7272a8a2d3779cdd575f6be46b3b1605479afd5a1b1b2c27da6806c9f937e00"
Jul 24 17:46:53.538514 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:46:53.538497    2561 scope.go:117] "RemoveContainer" containerID="d7272a8a2d3779cdd575f6be46b3b1605479afd5a1b1b2c27da6806c9f937e00"
Jul 24 17:46:53.538782 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:46:53.538759    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7272a8a2d3779cdd575f6be46b3b1605479afd5a1b1b2c27da6806c9f937e00\": container with ID starting with d7272a8a2d3779cdd575f6be46b3b1605479afd5a1b1b2c27da6806c9f937e00 not found: ID does not exist" containerID="d7272a8a2d3779cdd575f6be46b3b1605479afd5a1b1b2c27da6806c9f937e00"
Jul 24 17:46:53.538847 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:46:53.538793    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7272a8a2d3779cdd575f6be46b3b1605479afd5a1b1b2c27da6806c9f937e00"} err="failed to get container status \"d7272a8a2d3779cdd575f6be46b3b1605479afd5a1b1b2c27da6806c9f937e00\": rpc error: code = NotFound desc = could not find container \"d7272a8a2d3779cdd575f6be46b3b1605479afd5a1b1b2c27da6806c9f937e00\": container with ID starting with d7272a8a2d3779cdd575f6be46b3b1605479afd5a1b1b2c27da6806c9f937e00 not found: ID does not exist"
Jul 24 17:46:53.551038 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:46:53.551015    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-028d4b/sub-test-model-028d4b-kserve-7d759b68f5-j9qms"]
Jul 24 17:46:53.557253 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:46:53.557234    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-028d4b/sub-test-model-028d4b-kserve-7d759b68f5-j9qms"]
Jul 24 17:46:54.258192 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:46:54.258158    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="071b1529-c1e3-40d6-83da-cdbf2a97a5dc" path="/var/lib/kubelet/pods/071b1529-c1e3-40d6-83da-cdbf2a97a5dc/volumes"
Jul 24 17:48:04.033447 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:04.033405    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7450-139924532374832"]
Jul 24 17:48:04.033911 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:04.033789    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="071b1529-c1e3-40d6-83da-cdbf2a97a5dc" containerName="main"
Jul 24 17:48:04.033911 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:04.033802    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="071b1529-c1e3-40d6-83da-cdbf2a97a5dc" containerName="main"
Jul 24 17:48:04.033911 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:04.033822    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cc4b3de-23c1-4bfd-a348-9d9e0efa8910" containerName="main"
Jul 24 17:48:04.033911 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:04.033828    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cc4b3de-23c1-4bfd-a348-9d9e0efa8910" containerName="main"
Jul 24 17:48:04.033911 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:04.033891    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="071b1529-c1e3-40d6-83da-cdbf2a97a5dc" containerName="main"
Jul 24 17:48:04.033911 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:04.033900    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cc4b3de-23c1-4bfd-a348-9d9e0efa8910" containerName="main"
Jul 24 17:48:04.036936 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:04.036920    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7450-139924532374832"
Jul 24 17:48:04.039537 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:04.039512    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-l8bvt\""
Jul 24 17:48:04.040752 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:04.040724    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7450-139924532374832"]
Jul 24 17:48:04.118763 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:04.118734    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85ssh\" (UniqueName: \"kubernetes.io/projected/3231e4c5-0c29-4b18-ab68-7bf546d1c060-kube-api-access-85ssh\") pod \"test-curl-7450-139924532374832\" (UID: \"3231e4c5-0c29-4b18-ab68-7bf546d1c060\") " pod="opendatahub/test-curl-7450-139924532374832"
Jul 24 17:48:04.220019 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:04.219984    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85ssh\" (UniqueName: \"kubernetes.io/projected/3231e4c5-0c29-4b18-ab68-7bf546d1c060-kube-api-access-85ssh\") pod \"test-curl-7450-139924532374832\" (UID: \"3231e4c5-0c29-4b18-ab68-7bf546d1c060\") " pod="opendatahub/test-curl-7450-139924532374832"
Jul 24 17:48:04.228174 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:04.228143    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85ssh\" (UniqueName: \"kubernetes.io/projected/3231e4c5-0c29-4b18-ab68-7bf546d1c060-kube-api-access-85ssh\") pod \"test-curl-7450-139924532374832\" (UID: \"3231e4c5-0c29-4b18-ab68-7bf546d1c060\") " pod="opendatahub/test-curl-7450-139924532374832"
Jul 24 17:48:04.347781 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:04.347695    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7450-139924532374832"
Jul 24 17:48:04.476757 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:04.476733    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7450-139924532374832"]
Jul 24 17:48:04.478368 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:48:04.478342    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3231e4c5_0c29_4b18_ab68_7bf546d1c060.slice/crio-a8250bf716d02a35fe3108b6bbffeb2ebb1bae62d93799b9f98dcb96ddb707d3 WatchSource:0}: Error finding container a8250bf716d02a35fe3108b6bbffeb2ebb1bae62d93799b9f98dcb96ddb707d3: Status 404 returned error can't find the container with id a8250bf716d02a35fe3108b6bbffeb2ebb1bae62d93799b9f98dcb96ddb707d3
Jul 24 17:48:04.479745 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:04.479726    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 17:48:04.871032 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:04.870992    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7450-139924532374832" event={"ID":"3231e4c5-0c29-4b18-ab68-7bf546d1c060","Type":"ContainerStarted","Data":"a8250bf716d02a35fe3108b6bbffeb2ebb1bae62d93799b9f98dcb96ddb707d3"}
Jul 24 17:48:05.876630 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:05.876594    2561 generic.go:356] "Generic (PLEG): container finished" podID="3231e4c5-0c29-4b18-ab68-7bf546d1c060" containerID="6b74b2a6e8d978d5ac25361daf2c3f207a9c4f3b499a59dedac636043ea7264c" exitCode=0
Jul 24 17:48:05.877053 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:05.876646    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7450-139924532374832" event={"ID":"3231e4c5-0c29-4b18-ab68-7bf546d1c060","Type":"ContainerDied","Data":"6b74b2a6e8d978d5ac25361daf2c3f207a9c4f3b499a59dedac636043ea7264c"}
Jul 24 17:48:07.011440 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:07.011415    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7450-139924532374832"
Jul 24 17:48:07.050847 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:07.050823    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7450-139924532374832_3231e4c5-0c29-4b18-ab68-7bf546d1c060/test-curl-7450-139924532374832/0.log"
Jul 24 17:48:07.073413 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:07.073388    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7450-139924532374832"]
Jul 24 17:48:07.080562 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:07.080526    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7450-139924532374832"]
Jul 24 17:48:07.146258 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:07.146193    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85ssh\" (UniqueName: \"kubernetes.io/projected/3231e4c5-0c29-4b18-ab68-7bf546d1c060-kube-api-access-85ssh\") pod \"3231e4c5-0c29-4b18-ab68-7bf546d1c060\" (UID: \"3231e4c5-0c29-4b18-ab68-7bf546d1c060\") "
Jul 24 17:48:07.148309 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:07.148278    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3231e4c5-0c29-4b18-ab68-7bf546d1c060-kube-api-access-85ssh" (OuterVolumeSpecName: "kube-api-access-85ssh") pod "3231e4c5-0c29-4b18-ab68-7bf546d1c060" (UID: "3231e4c5-0c29-4b18-ab68-7bf546d1c060"). InnerVolumeSpecName "kube-api-access-85ssh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:48:07.232887 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:07.232865    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7450-139924532372656"]
Jul 24 17:48:07.233250 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:07.233237    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3231e4c5-0c29-4b18-ab68-7bf546d1c060" containerName="test-curl-7450-139924532374832"
Jul 24 17:48:07.233316 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:07.233251    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3231e4c5-0c29-4b18-ab68-7bf546d1c060" containerName="test-curl-7450-139924532374832"
Jul 24 17:48:07.233359 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:07.233318    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3231e4c5-0c29-4b18-ab68-7bf546d1c060" containerName="test-curl-7450-139924532374832"
Jul 24 17:48:07.236219 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:07.236205    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7450-139924532372656"
Jul 24 17:48:07.248197 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:07.247961    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85ssh\" (UniqueName: \"kubernetes.io/projected/3231e4c5-0c29-4b18-ab68-7bf546d1c060-kube-api-access-85ssh\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:48:07.249689 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:07.249666    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7450-139924532372656"]
Jul 24 17:48:07.354835 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:07.349271    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hps8h\" (UniqueName: \"kubernetes.io/projected/3a7734a2-61a2-4745-b3e2-f895c4ae5246-kube-api-access-hps8h\") pod \"test-curl-7450-139924532372656\" (UID: \"3a7734a2-61a2-4745-b3e2-f895c4ae5246\") " pod="opendatahub/test-curl-7450-139924532372656"
Jul 24 17:48:07.449997 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:07.449907    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hps8h\" (UniqueName: \"kubernetes.io/projected/3a7734a2-61a2-4745-b3e2-f895c4ae5246-kube-api-access-hps8h\") pod \"test-curl-7450-139924532372656\" (UID: \"3a7734a2-61a2-4745-b3e2-f895c4ae5246\") " pod="opendatahub/test-curl-7450-139924532372656"
Jul 24 17:48:07.460459 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:07.460423    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hps8h\" (UniqueName: \"kubernetes.io/projected/3a7734a2-61a2-4745-b3e2-f895c4ae5246-kube-api-access-hps8h\") pod \"test-curl-7450-139924532372656\" (UID: \"3a7734a2-61a2-4745-b3e2-f895c4ae5246\") " pod="opendatahub/test-curl-7450-139924532372656"
Jul 24 17:48:07.545230 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:07.545197    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7450-139924532372656"
Jul 24 17:48:07.671427 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:07.671392    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7450-139924532372656"]
Jul 24 17:48:07.674038 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:48:07.674011    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3a7734a2_61a2_4745_b3e2_f895c4ae5246.slice/crio-1ed7a777703faa39ba057791f474d81d61699f92ed43c3597d59d462c140f7d5 WatchSource:0}: Error finding container 1ed7a777703faa39ba057791f474d81d61699f92ed43c3597d59d462c140f7d5: Status 404 returned error can't find the container with id 1ed7a777703faa39ba057791f474d81d61699f92ed43c3597d59d462c140f7d5
Jul 24 17:48:07.888036 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:07.888008    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7450-139924532374832"
Jul 24 17:48:07.888232 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:07.888035    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a8250bf716d02a35fe3108b6bbffeb2ebb1bae62d93799b9f98dcb96ddb707d3"
Jul 24 17:48:07.889193 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:07.889163    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7450-139924532372656" event={"ID":"3a7734a2-61a2-4745-b3e2-f895c4ae5246","Type":"ContainerStarted","Data":"1ed7a777703faa39ba057791f474d81d61699f92ed43c3597d59d462c140f7d5"}
Jul 24 17:48:07.898341 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:48:07.898318    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7450-139924532374832\" is forbidden: User \"system:node:ip-10-0-137-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-137.ec2.internal' and this object" podUID="3231e4c5-0c29-4b18-ab68-7bf546d1c060" pod="opendatahub/test-curl-7450-139924532374832"
Jul 24 17:48:08.259454 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:08.259383    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3231e4c5-0c29-4b18-ab68-7bf546d1c060" path="/var/lib/kubelet/pods/3231e4c5-0c29-4b18-ab68-7bf546d1c060/volumes"
Jul 24 17:48:08.895583 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:08.895553    2561 generic.go:356] "Generic (PLEG): container finished" podID="3a7734a2-61a2-4745-b3e2-f895c4ae5246" containerID="941c4ed4ecc3bec29e2614c081fb04541422ad55042ae167536951e8516200e7" exitCode=0
Jul 24 17:48:08.895740 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:08.895632    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7450-139924532372656" event={"ID":"3a7734a2-61a2-4745-b3e2-f895c4ae5246","Type":"ContainerDied","Data":"941c4ed4ecc3bec29e2614c081fb04541422ad55042ae167536951e8516200e7"}
Jul 24 17:48:10.025920 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:10.025892    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7450-139924532372656"
Jul 24 17:48:10.048667 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:10.048641    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7450-139924532372656_3a7734a2-61a2-4745-b3e2-f895c4ae5246/test-curl-7450-139924532372656/0.log"
Jul 24 17:48:10.072902 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:10.072872    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7450-139924532372656"]
Jul 24 17:48:10.076967 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:10.076942    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7450-139924532372656"]
Jul 24 17:48:10.174238 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:10.174176    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hps8h\" (UniqueName: \"kubernetes.io/projected/3a7734a2-61a2-4745-b3e2-f895c4ae5246-kube-api-access-hps8h\") pod \"3a7734a2-61a2-4745-b3e2-f895c4ae5246\" (UID: \"3a7734a2-61a2-4745-b3e2-f895c4ae5246\") "
Jul 24 17:48:10.176196 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:10.176169    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a7734a2-61a2-4745-b3e2-f895c4ae5246-kube-api-access-hps8h" (OuterVolumeSpecName: "kube-api-access-hps8h") pod "3a7734a2-61a2-4745-b3e2-f895c4ae5246" (UID: "3a7734a2-61a2-4745-b3e2-f895c4ae5246"). InnerVolumeSpecName "kube-api-access-hps8h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:48:10.241364 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:10.241336    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7450-139924528314096"]
Jul 24 17:48:10.241718 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:10.241706    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a7734a2-61a2-4745-b3e2-f895c4ae5246" containerName="test-curl-7450-139924532372656"
Jul 24 17:48:10.241761 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:10.241720    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a7734a2-61a2-4745-b3e2-f895c4ae5246" containerName="test-curl-7450-139924532372656"
Jul 24 17:48:10.241800 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:10.241786    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a7734a2-61a2-4745-b3e2-f895c4ae5246" containerName="test-curl-7450-139924532372656"
Jul 24 17:48:10.244805 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:10.244790    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7450-139924528314096"
Jul 24 17:48:10.251047 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:10.251027    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7450-139924528314096"]
Jul 24 17:48:10.260272 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:10.260247    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a7734a2-61a2-4745-b3e2-f895c4ae5246" path="/var/lib/kubelet/pods/3a7734a2-61a2-4745-b3e2-f895c4ae5246/volumes"
Jul 24 17:48:10.275506 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:10.275472    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hps8h\" (UniqueName: \"kubernetes.io/projected/3a7734a2-61a2-4745-b3e2-f895c4ae5246-kube-api-access-hps8h\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:48:10.376199 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:10.376155    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v99nd\" (UniqueName: \"kubernetes.io/projected/a21e6964-0f5c-47d9-ba57-2cb73388451c-kube-api-access-v99nd\") pod \"test-curl-7450-139924528314096\" (UID: \"a21e6964-0f5c-47d9-ba57-2cb73388451c\") " pod="opendatahub/test-curl-7450-139924528314096"
Jul 24 17:48:10.476764 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:10.476688    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v99nd\" (UniqueName: \"kubernetes.io/projected/a21e6964-0f5c-47d9-ba57-2cb73388451c-kube-api-access-v99nd\") pod \"test-curl-7450-139924528314096\" (UID: \"a21e6964-0f5c-47d9-ba57-2cb73388451c\") " pod="opendatahub/test-curl-7450-139924528314096"
Jul 24 17:48:10.486111 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:10.486086    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v99nd\" (UniqueName: \"kubernetes.io/projected/a21e6964-0f5c-47d9-ba57-2cb73388451c-kube-api-access-v99nd\") pod \"test-curl-7450-139924528314096\" (UID: \"a21e6964-0f5c-47d9-ba57-2cb73388451c\") " pod="opendatahub/test-curl-7450-139924528314096"
Jul 24 17:48:10.554945 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:10.554913    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7450-139924528314096"
Jul 24 17:48:10.685384 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:10.685339    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7450-139924528314096"]
Jul 24 17:48:10.687475 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:48:10.687444    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda21e6964_0f5c_47d9_ba57_2cb73388451c.slice/crio-423a0007473ff6409b5aa3904107fdc302fb6d82103612d1b3d54e96c1cebf88 WatchSource:0}: Error finding container 423a0007473ff6409b5aa3904107fdc302fb6d82103612d1b3d54e96c1cebf88: Status 404 returned error can't find the container with id 423a0007473ff6409b5aa3904107fdc302fb6d82103612d1b3d54e96c1cebf88
Jul 24 17:48:10.905977 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:10.905947    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7450-139924532372656"
Jul 24 17:48:10.906193 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:10.905988    2561 scope.go:117] "RemoveContainer" containerID="941c4ed4ecc3bec29e2614c081fb04541422ad55042ae167536951e8516200e7"
Jul 24 17:48:10.907320 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:10.907297    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7450-139924528314096" event={"ID":"a21e6964-0f5c-47d9-ba57-2cb73388451c","Type":"ContainerStarted","Data":"423a0007473ff6409b5aa3904107fdc302fb6d82103612d1b3d54e96c1cebf88"}
Jul 24 17:48:11.913530 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:11.913497    2561 generic.go:356] "Generic (PLEG): container finished" podID="a21e6964-0f5c-47d9-ba57-2cb73388451c" containerID="d4eef178125ad92781b843722183af5eb9cedad8238b5322b9233286bd421de7" exitCode=0
Jul 24 17:48:11.913967 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:11.913568    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7450-139924528314096" event={"ID":"a21e6964-0f5c-47d9-ba57-2cb73388451c","Type":"ContainerDied","Data":"d4eef178125ad92781b843722183af5eb9cedad8238b5322b9233286bd421de7"}
Jul 24 17:48:13.055145 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:13.055117    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7450-139924528314096"
Jul 24 17:48:13.075284 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:13.075252    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7450-139924528314096_a21e6964-0f5c-47d9-ba57-2cb73388451c/test-curl-7450-139924528314096/0.log"
Jul 24 17:48:13.101051 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:13.101027    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7450-139924528314096"]
Jul 24 17:48:13.105348 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:13.105325    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7450-139924528314096"]
Jul 24 17:48:13.204669 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:13.204582    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v99nd\" (UniqueName: \"kubernetes.io/projected/a21e6964-0f5c-47d9-ba57-2cb73388451c-kube-api-access-v99nd\") pod \"a21e6964-0f5c-47d9-ba57-2cb73388451c\" (UID: \"a21e6964-0f5c-47d9-ba57-2cb73388451c\") "
Jul 24 17:48:13.206655 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:13.206632    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a21e6964-0f5c-47d9-ba57-2cb73388451c-kube-api-access-v99nd" (OuterVolumeSpecName: "kube-api-access-v99nd") pod "a21e6964-0f5c-47d9-ba57-2cb73388451c" (UID: "a21e6964-0f5c-47d9-ba57-2cb73388451c"). InnerVolumeSpecName "kube-api-access-v99nd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:48:13.232161 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:13.232135    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7450-139924528314096"]
Jul 24 17:48:13.232527 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:13.232514    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a21e6964-0f5c-47d9-ba57-2cb73388451c" containerName="test-curl-7450-139924528314096"
Jul 24 17:48:13.232574 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:13.232528    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a21e6964-0f5c-47d9-ba57-2cb73388451c" containerName="test-curl-7450-139924528314096"
Jul 24 17:48:13.232616 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:13.232588    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a21e6964-0f5c-47d9-ba57-2cb73388451c" containerName="test-curl-7450-139924528314096"
Jul 24 17:48:13.235521 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:13.235504    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7450-139924528314096"
Jul 24 17:48:13.242771 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:13.242751    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7450-139924528314096"]
Jul 24 17:48:13.305875 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:13.305843    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v99nd\" (UniqueName: \"kubernetes.io/projected/a21e6964-0f5c-47d9-ba57-2cb73388451c-kube-api-access-v99nd\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:48:13.406427 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:13.406393    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brcck\" (UniqueName: \"kubernetes.io/projected/79c51b64-04f2-4fc2-bef4-f56238595f13-kube-api-access-brcck\") pod \"test-curl-7450-139924528314096\" (UID: \"79c51b64-04f2-4fc2-bef4-f56238595f13\") " pod="opendatahub/test-curl-7450-139924528314096"
Jul 24 17:48:13.507340 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:13.507250    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brcck\" (UniqueName: \"kubernetes.io/projected/79c51b64-04f2-4fc2-bef4-f56238595f13-kube-api-access-brcck\") pod \"test-curl-7450-139924528314096\" (UID: \"79c51b64-04f2-4fc2-bef4-f56238595f13\") " pod="opendatahub/test-curl-7450-139924528314096"
Jul 24 17:48:13.515516 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:13.515490    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brcck\" (UniqueName: \"kubernetes.io/projected/79c51b64-04f2-4fc2-bef4-f56238595f13-kube-api-access-brcck\") pod \"test-curl-7450-139924528314096\" (UID: \"79c51b64-04f2-4fc2-bef4-f56238595f13\") " pod="opendatahub/test-curl-7450-139924528314096"
Jul 24 17:48:13.544589 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:13.544554    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7450-139924528314096"
Jul 24 17:48:13.674626 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:13.674595    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7450-139924528314096"]
Jul 24 17:48:13.677927 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:48:13.677905    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod79c51b64_04f2_4fc2_bef4_f56238595f13.slice/crio-083cfc1ffeaac0d9394125f59c2314c312caf5aaf7ecbe4bd91a0a21f9e4e5c7 WatchSource:0}: Error finding container 083cfc1ffeaac0d9394125f59c2314c312caf5aaf7ecbe4bd91a0a21f9e4e5c7: Status 404 returned error can't find the container with id 083cfc1ffeaac0d9394125f59c2314c312caf5aaf7ecbe4bd91a0a21f9e4e5c7
Jul 24 17:48:13.924722 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:13.924682    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7450-139924528314096" event={"ID":"79c51b64-04f2-4fc2-bef4-f56238595f13","Type":"ContainerStarted","Data":"083cfc1ffeaac0d9394125f59c2314c312caf5aaf7ecbe4bd91a0a21f9e4e5c7"}
Jul 24 17:48:13.925795 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:13.925776    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="423a0007473ff6409b5aa3904107fdc302fb6d82103612d1b3d54e96c1cebf88"
Jul 24 17:48:13.925937 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:13.925807    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7450-139924528314096"
Jul 24 17:48:13.937610 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:13.937579    2561 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7450-139924528314096" oldPodUID="a21e6964-0f5c-47d9-ba57-2cb73388451c" podUID="79c51b64-04f2-4fc2-bef4-f56238595f13"
Jul 24 17:48:14.258742 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:14.258661    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a21e6964-0f5c-47d9-ba57-2cb73388451c" path="/var/lib/kubelet/pods/a21e6964-0f5c-47d9-ba57-2cb73388451c/volumes"
Jul 24 17:48:14.931356 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:14.931320    2561 generic.go:356] "Generic (PLEG): container finished" podID="79c51b64-04f2-4fc2-bef4-f56238595f13" containerID="1d93cfe7ff6d9e2fe2e48afb53818aebe88136cabfd89cbe145b61963e1a3991" exitCode=0
Jul 24 17:48:14.931541 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:14.931410    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7450-139924528314096" event={"ID":"79c51b64-04f2-4fc2-bef4-f56238595f13","Type":"ContainerDied","Data":"1d93cfe7ff6d9e2fe2e48afb53818aebe88136cabfd89cbe145b61963e1a3991"}
Jul 24 17:48:16.064515 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:16.064491    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7450-139924528314096"
Jul 24 17:48:16.085732 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:16.085713    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7450-139924528314096_79c51b64-04f2-4fc2-bef4-f56238595f13/test-curl-7450-139924528314096/0.log"
Jul 24 17:48:16.111231 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:16.111203    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7450-139924528314096"]
Jul 24 17:48:16.116640 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:16.116611    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7450-139924528314096"]
Jul 24 17:48:16.126326 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:16.126301    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-brcck\" (UniqueName: \"kubernetes.io/projected/79c51b64-04f2-4fc2-bef4-f56238595f13-kube-api-access-brcck\") pod \"79c51b64-04f2-4fc2-bef4-f56238595f13\" (UID: \"79c51b64-04f2-4fc2-bef4-f56238595f13\") "
Jul 24 17:48:16.128321 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:16.128302    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79c51b64-04f2-4fc2-bef4-f56238595f13-kube-api-access-brcck" (OuterVolumeSpecName: "kube-api-access-brcck") pod "79c51b64-04f2-4fc2-bef4-f56238595f13" (UID: "79c51b64-04f2-4fc2-bef4-f56238595f13"). InnerVolumeSpecName "kube-api-access-brcck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:48:16.227033 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:16.226974    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brcck\" (UniqueName: \"kubernetes.io/projected/79c51b64-04f2-4fc2-bef4-f56238595f13-kube-api-access-brcck\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:48:16.236118 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:16.236087    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7450-139924532336080"]
Jul 24 17:48:16.236514 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:16.236496    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79c51b64-04f2-4fc2-bef4-f56238595f13" containerName="test-curl-7450-139924528314096"
Jul 24 17:48:16.236585 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:16.236516    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="79c51b64-04f2-4fc2-bef4-f56238595f13" containerName="test-curl-7450-139924528314096"
Jul 24 17:48:16.236644 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:16.236636    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="79c51b64-04f2-4fc2-bef4-f56238595f13" containerName="test-curl-7450-139924528314096"
Jul 24 17:48:16.239663 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:16.239645    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7450-139924532336080"
Jul 24 17:48:16.245917 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:16.245894    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7450-139924532336080"]
Jul 24 17:48:16.263873 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:16.263837    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79c51b64-04f2-4fc2-bef4-f56238595f13" path="/var/lib/kubelet/pods/79c51b64-04f2-4fc2-bef4-f56238595f13/volumes"
Jul 24 17:48:16.327777 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:16.327744    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs82c\" (UniqueName: \"kubernetes.io/projected/5812c91f-75eb-40bf-861d-a0b57a77a041-kube-api-access-vs82c\") pod \"test-curl-7450-139924532336080\" (UID: \"5812c91f-75eb-40bf-861d-a0b57a77a041\") " pod="opendatahub/test-curl-7450-139924532336080"
Jul 24 17:48:16.428279 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:16.428248    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vs82c\" (UniqueName: \"kubernetes.io/projected/5812c91f-75eb-40bf-861d-a0b57a77a041-kube-api-access-vs82c\") pod \"test-curl-7450-139924532336080\" (UID: \"5812c91f-75eb-40bf-861d-a0b57a77a041\") " pod="opendatahub/test-curl-7450-139924532336080"
Jul 24 17:48:16.436729 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:16.436706    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs82c\" (UniqueName: \"kubernetes.io/projected/5812c91f-75eb-40bf-861d-a0b57a77a041-kube-api-access-vs82c\") pod \"test-curl-7450-139924532336080\" (UID: \"5812c91f-75eb-40bf-861d-a0b57a77a041\") " pod="opendatahub/test-curl-7450-139924532336080"
Jul 24 17:48:16.550232 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:16.550157    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7450-139924532336080"
Jul 24 17:48:16.679745 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:16.679721    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7450-139924532336080"]
Jul 24 17:48:16.681563 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:48:16.681535    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5812c91f_75eb_40bf_861d_a0b57a77a041.slice/crio-b0debc7416ad855459f379de2c6facfe65ce6e5d612dd5e640008caeaf2ec6cf WatchSource:0}: Error finding container b0debc7416ad855459f379de2c6facfe65ce6e5d612dd5e640008caeaf2ec6cf: Status 404 returned error can't find the container with id b0debc7416ad855459f379de2c6facfe65ce6e5d612dd5e640008caeaf2ec6cf
Jul 24 17:48:16.942922 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:16.942885    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7450-139924528314096"
Jul 24 17:48:16.942922 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:16.942916    2561 scope.go:117] "RemoveContainer" containerID="1d93cfe7ff6d9e2fe2e48afb53818aebe88136cabfd89cbe145b61963e1a3991"
Jul 24 17:48:16.944203 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:16.944030    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7450-139924532336080" event={"ID":"5812c91f-75eb-40bf-861d-a0b57a77a041","Type":"ContainerStarted","Data":"b0debc7416ad855459f379de2c6facfe65ce6e5d612dd5e640008caeaf2ec6cf"}
Jul 24 17:48:17.950874 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:17.950838    2561 generic.go:356] "Generic (PLEG): container finished" podID="5812c91f-75eb-40bf-861d-a0b57a77a041" containerID="5c2ded0ae8c265675f4c2cd4a0ed1254fa5e13af523517b91998c9ecb70cbae4" exitCode=0
Jul 24 17:48:17.951273 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:17.950910    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7450-139924532336080" event={"ID":"5812c91f-75eb-40bf-861d-a0b57a77a041","Type":"ContainerDied","Data":"5c2ded0ae8c265675f4c2cd4a0ed1254fa5e13af523517b91998c9ecb70cbae4"}
Jul 24 17:48:19.088395 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:19.088370    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7450-139924532336080"
Jul 24 17:48:19.110864 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:19.110838    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7450-139924532336080_5812c91f-75eb-40bf-861d-a0b57a77a041/test-curl-7450-139924532336080/0.log"
Jul 24 17:48:19.134851 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:19.134816    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7450-139924532336080"]
Jul 24 17:48:19.140822 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:19.140793    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7450-139924532336080"]
Jul 24 17:48:19.151792 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:19.151769    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vs82c\" (UniqueName: \"kubernetes.io/projected/5812c91f-75eb-40bf-861d-a0b57a77a041-kube-api-access-vs82c\") pod \"5812c91f-75eb-40bf-861d-a0b57a77a041\" (UID: \"5812c91f-75eb-40bf-861d-a0b57a77a041\") "
Jul 24 17:48:19.153870 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:19.153844    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5812c91f-75eb-40bf-861d-a0b57a77a041-kube-api-access-vs82c" (OuterVolumeSpecName: "kube-api-access-vs82c") pod "5812c91f-75eb-40bf-861d-a0b57a77a041" (UID: "5812c91f-75eb-40bf-861d-a0b57a77a041"). InnerVolumeSpecName "kube-api-access-vs82c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:48:19.253167 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:19.253082    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vs82c\" (UniqueName: \"kubernetes.io/projected/5812c91f-75eb-40bf-861d-a0b57a77a041-kube-api-access-vs82c\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:48:19.255102 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:19.255059    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7450-139924532336080"]
Jul 24 17:48:19.255522 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:19.255504    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5812c91f-75eb-40bf-861d-a0b57a77a041" containerName="test-curl-7450-139924532336080"
Jul 24 17:48:19.255600 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:19.255525    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5812c91f-75eb-40bf-861d-a0b57a77a041" containerName="test-curl-7450-139924532336080"
Jul 24 17:48:19.255661 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:19.255631    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5812c91f-75eb-40bf-861d-a0b57a77a041" containerName="test-curl-7450-139924532336080"
Jul 24 17:48:19.258524 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:19.258506    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7450-139924532336080"
Jul 24 17:48:19.262812 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:19.262791    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7450-139924532336080"]
Jul 24 17:48:19.353962 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:19.353931    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlqk5\" (UniqueName: \"kubernetes.io/projected/fd1f25ef-5ef5-44e7-b261-c357d17ca0ca-kube-api-access-dlqk5\") pod \"test-curl-7450-139924532336080\" (UID: \"fd1f25ef-5ef5-44e7-b261-c357d17ca0ca\") " pod="opendatahub/test-curl-7450-139924532336080"
Jul 24 17:48:19.455444 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:19.455408    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlqk5\" (UniqueName: \"kubernetes.io/projected/fd1f25ef-5ef5-44e7-b261-c357d17ca0ca-kube-api-access-dlqk5\") pod \"test-curl-7450-139924532336080\" (UID: \"fd1f25ef-5ef5-44e7-b261-c357d17ca0ca\") " pod="opendatahub/test-curl-7450-139924532336080"
Jul 24 17:48:19.463644 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:19.463620    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlqk5\" (UniqueName: \"kubernetes.io/projected/fd1f25ef-5ef5-44e7-b261-c357d17ca0ca-kube-api-access-dlqk5\") pod \"test-curl-7450-139924532336080\" (UID: \"fd1f25ef-5ef5-44e7-b261-c357d17ca0ca\") " pod="opendatahub/test-curl-7450-139924532336080"
Jul 24 17:48:19.569034 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:19.568959    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7450-139924532336080"
Jul 24 17:48:19.702399 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:19.702375    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7450-139924532336080"]
Jul 24 17:48:19.704652 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:48:19.704625    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfd1f25ef_5ef5_44e7_b261_c357d17ca0ca.slice/crio-ebe1bd93a3596fb1a3b557ee10e8073c57658d8fcf99708d6e63795309f69a79 WatchSource:0}: Error finding container ebe1bd93a3596fb1a3b557ee10e8073c57658d8fcf99708d6e63795309f69a79: Status 404 returned error can't find the container with id ebe1bd93a3596fb1a3b557ee10e8073c57658d8fcf99708d6e63795309f69a79
Jul 24 17:48:19.961608 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:19.961580    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7450-139924532336080"
Jul 24 17:48:19.961786 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:19.961612    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b0debc7416ad855459f379de2c6facfe65ce6e5d612dd5e640008caeaf2ec6cf"
Jul 24 17:48:19.962650 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:19.962627    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7450-139924532336080" event={"ID":"fd1f25ef-5ef5-44e7-b261-c357d17ca0ca","Type":"ContainerStarted","Data":"ebe1bd93a3596fb1a3b557ee10e8073c57658d8fcf99708d6e63795309f69a79"}
Jul 24 17:48:19.973613 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:19.973590    2561 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7450-139924532336080" oldPodUID="5812c91f-75eb-40bf-861d-a0b57a77a041" podUID="fd1f25ef-5ef5-44e7-b261-c357d17ca0ca"
Jul 24 17:48:20.264766 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:20.264681    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5812c91f-75eb-40bf-861d-a0b57a77a041" path="/var/lib/kubelet/pods/5812c91f-75eb-40bf-861d-a0b57a77a041/volumes"
Jul 24 17:48:20.968596 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:20.968560    2561 generic.go:356] "Generic (PLEG): container finished" podID="fd1f25ef-5ef5-44e7-b261-c357d17ca0ca" containerID="bfd659eb5f6359224a9b018222e1541101c61d0fafb96072aefc21fa96b2fa14" exitCode=0
Jul 24 17:48:20.968779 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:20.968601    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7450-139924532336080" event={"ID":"fd1f25ef-5ef5-44e7-b261-c357d17ca0ca","Type":"ContainerDied","Data":"bfd659eb5f6359224a9b018222e1541101c61d0fafb96072aefc21fa96b2fa14"}
Jul 24 17:48:22.097929 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:22.097905    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7450-139924532336080"
Jul 24 17:48:22.121730 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:22.121704    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7450-139924532336080_fd1f25ef-5ef5-44e7-b261-c357d17ca0ca/test-curl-7450-139924532336080/0.log"
Jul 24 17:48:22.148548 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:22.148516    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7450-139924532336080"]
Jul 24 17:48:22.152154 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:22.152133    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7450-139924532336080"]
Jul 24 17:48:22.179689 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:22.179670    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dlqk5\" (UniqueName: \"kubernetes.io/projected/fd1f25ef-5ef5-44e7-b261-c357d17ca0ca-kube-api-access-dlqk5\") pod \"fd1f25ef-5ef5-44e7-b261-c357d17ca0ca\" (UID: \"fd1f25ef-5ef5-44e7-b261-c357d17ca0ca\") "
Jul 24 17:48:22.181613 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:22.181589    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd1f25ef-5ef5-44e7-b261-c357d17ca0ca-kube-api-access-dlqk5" (OuterVolumeSpecName: "kube-api-access-dlqk5") pod "fd1f25ef-5ef5-44e7-b261-c357d17ca0ca" (UID: "fd1f25ef-5ef5-44e7-b261-c357d17ca0ca"). InnerVolumeSpecName "kube-api-access-dlqk5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:48:22.258026 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:22.257966    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd1f25ef-5ef5-44e7-b261-c357d17ca0ca" path="/var/lib/kubelet/pods/fd1f25ef-5ef5-44e7-b261-c357d17ca0ca/volumes"
Jul 24 17:48:22.281328 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:22.281304    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlqk5\" (UniqueName: \"kubernetes.io/projected/fd1f25ef-5ef5-44e7-b261-c357d17ca0ca-kube-api-access-dlqk5\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:48:22.979216 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:22.979190    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7450-139924532336080"
Jul 24 17:48:22.979395 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:22.979195    2561 scope.go:117] "RemoveContainer" containerID="bfd659eb5f6359224a9b018222e1541101c61d0fafb96072aefc21fa96b2fa14"
Jul 24 17:48:23.066841 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:23.066806    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr"]
Jul 24 17:48:23.067228 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:23.067215    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd1f25ef-5ef5-44e7-b261-c357d17ca0ca" containerName="test-curl-7450-139924532336080"
Jul 24 17:48:23.067284 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:23.067230    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd1f25ef-5ef5-44e7-b261-c357d17ca0ca" containerName="test-curl-7450-139924532336080"
Jul 24 17:48:23.067320 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:23.067293    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd1f25ef-5ef5-44e7-b261-c357d17ca0ca" containerName="test-curl-7450-139924532336080"
Jul 24 17:48:23.071600 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:23.071583    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr"
Jul 24 17:48:23.078566 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:23.078542    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-052d9d-openshift-default-dockercfg-vmg8s\""
Jul 24 17:48:23.086031 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:23.086006    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr"]
Jul 24 17:48:23.089425 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:23.089404    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/69b93d70-269f-4a4a-a55b-73f0918a3e04-istio-token\") pod \"e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr\" (UID: \"69b93d70-269f-4a4a-a55b-73f0918a3e04\") " pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr"
Jul 24 17:48:23.089545 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:23.089438    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/69b93d70-269f-4a4a-a55b-73f0918a3e04-credential-socket\") pod \"e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr\" (UID: \"69b93d70-269f-4a4a-a55b-73f0918a3e04\") " pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr"
Jul 24 17:48:23.089614 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:23.089534    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/69b93d70-269f-4a4a-a55b-73f0918a3e04-istio-envoy\") pod \"e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr\" (UID: \"69b93d70-269f-4a4a-a55b-73f0918a3e04\") " pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr"
Jul 24 17:48:23.089675 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:23.089626    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/69b93d70-269f-4a4a-a55b-73f0918a3e04-workload-socket\") pod \"e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr\" (UID: \"69b93d70-269f-4a4a-a55b-73f0918a3e04\") " pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr"
Jul 24 17:48:23.089675 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:23.089664    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/69b93d70-269f-4a4a-a55b-73f0918a3e04-istiod-ca-cert\") pod \"e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr\" (UID: \"69b93d70-269f-4a4a-a55b-73f0918a3e04\") " pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr"
Jul 24 17:48:23.089781 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:23.089703    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/69b93d70-269f-4a4a-a55b-73f0918a3e04-istio-data\") pod \"e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr\" (UID: \"69b93d70-269f-4a4a-a55b-73f0918a3e04\") " pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr"
Jul 24 17:48:23.089781 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:23.089729    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zc5h9\" (UniqueName: \"kubernetes.io/projected/69b93d70-269f-4a4a-a55b-73f0918a3e04-kube-api-access-zc5h9\") pod \"e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr\" (UID: \"69b93d70-269f-4a4a-a55b-73f0918a3e04\") " pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr"
Jul 24 17:48:23.089879 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:23.089826    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/69b93d70-269f-4a4a-a55b-73f0918a3e04-workload-certs\") pod \"e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr\" (UID: \"69b93d70-269f-4a4a-a55b-73f0918a3e04\") " pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr"
Jul 24 17:48:23.089922 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:23.089897    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/69b93d70-269f-4a4a-a55b-73f0918a3e04-istio-podinfo\") pod \"e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr\" (UID: \"69b93d70-269f-4a4a-a55b-73f0918a3e04\") " pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr"
Jul 24 17:48:23.190677 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:23.190646    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/69b93d70-269f-4a4a-a55b-73f0918a3e04-istio-data\") pod \"e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr\" (UID: \"69b93d70-269f-4a4a-a55b-73f0918a3e04\") " pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr"
Jul 24 17:48:23.190677 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:23.190680    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zc5h9\" (UniqueName: \"kubernetes.io/projected/69b93d70-269f-4a4a-a55b-73f0918a3e04-kube-api-access-zc5h9\") pod \"e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr\" (UID: \"69b93d70-269f-4a4a-a55b-73f0918a3e04\") " pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr"
Jul 24 17:48:23.191212 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:23.190771    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/69b93d70-269f-4a4a-a55b-73f0918a3e04-workload-certs\") pod \"e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr\" (UID: \"69b93d70-269f-4a4a-a55b-73f0918a3e04\") " pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr"
Jul 24 17:48:23.191212 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:23.190822    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/69b93d70-269f-4a4a-a55b-73f0918a3e04-istio-podinfo\") pod \"e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr\" (UID: \"69b93d70-269f-4a4a-a55b-73f0918a3e04\") " pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr"
Jul 24 17:48:23.191212 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:23.190847    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/69b93d70-269f-4a4a-a55b-73f0918a3e04-istio-token\") pod \"e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr\" (UID: \"69b93d70-269f-4a4a-a55b-73f0918a3e04\") " pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr"
Jul 24 17:48:23.191212 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:23.190881    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/69b93d70-269f-4a4a-a55b-73f0918a3e04-credential-socket\") pod \"e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr\" (UID: \"69b93d70-269f-4a4a-a55b-73f0918a3e04\") " pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr"
Jul 24 17:48:23.191212 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:23.190936    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/69b93d70-269f-4a4a-a55b-73f0918a3e04-istio-envoy\") pod \"e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr\" (UID: \"69b93d70-269f-4a4a-a55b-73f0918a3e04\") " pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr"
Jul 24 17:48:23.191212 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:23.190975    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/69b93d70-269f-4a4a-a55b-73f0918a3e04-workload-socket\") pod \"e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr\" (UID: \"69b93d70-269f-4a4a-a55b-73f0918a3e04\") " pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr"
Jul 24 17:48:23.191212 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:23.190998    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/69b93d70-269f-4a4a-a55b-73f0918a3e04-istiod-ca-cert\") pod \"e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr\" (UID: \"69b93d70-269f-4a4a-a55b-73f0918a3e04\") " pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr"
Jul 24 17:48:23.191212 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:23.191105    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/69b93d70-269f-4a4a-a55b-73f0918a3e04-istio-data\") pod \"e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr\" (UID: \"69b93d70-269f-4a4a-a55b-73f0918a3e04\") " pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr"
Jul 24 17:48:23.191212 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:23.191181    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/69b93d70-269f-4a4a-a55b-73f0918a3e04-workload-certs\") pod \"e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr\" (UID: \"69b93d70-269f-4a4a-a55b-73f0918a3e04\") " pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr"
Jul 24 17:48:23.191662 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:23.191342    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/69b93d70-269f-4a4a-a55b-73f0918a3e04-credential-socket\") pod \"e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr\" (UID: \"69b93d70-269f-4a4a-a55b-73f0918a3e04\") " pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr"
Jul 24 17:48:23.191662 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:23.191386    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/69b93d70-269f-4a4a-a55b-73f0918a3e04-workload-socket\") pod \"e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr\" (UID: \"69b93d70-269f-4a4a-a55b-73f0918a3e04\") " pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr"
Jul 24 17:48:23.191662 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:23.191617    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/69b93d70-269f-4a4a-a55b-73f0918a3e04-istiod-ca-cert\") pod \"e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr\" (UID: \"69b93d70-269f-4a4a-a55b-73f0918a3e04\") " pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr"
Jul 24 17:48:23.193230 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:23.193208    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/69b93d70-269f-4a4a-a55b-73f0918a3e04-istio-envoy\") pod \"e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr\" (UID: \"69b93d70-269f-4a4a-a55b-73f0918a3e04\") " pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr"
Jul 24 17:48:23.193348 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:23.193333    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/69b93d70-269f-4a4a-a55b-73f0918a3e04-istio-podinfo\") pod \"e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr\" (UID: \"69b93d70-269f-4a4a-a55b-73f0918a3e04\") " pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr"
Jul 24 17:48:23.199705 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:23.199681    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/69b93d70-269f-4a4a-a55b-73f0918a3e04-istio-token\") pod \"e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr\" (UID: \"69b93d70-269f-4a4a-a55b-73f0918a3e04\") " pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr"
Jul 24 17:48:23.199852 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:23.199831    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zc5h9\" (UniqueName: \"kubernetes.io/projected/69b93d70-269f-4a4a-a55b-73f0918a3e04-kube-api-access-zc5h9\") pod \"e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr\" (UID: \"69b93d70-269f-4a4a-a55b-73f0918a3e04\") " pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr"
Jul 24 17:48:23.381465 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:23.381441    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr"
Jul 24 17:48:23.521323 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:23.521203    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr"]
Jul 24 17:48:23.523948 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:48:23.523919    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69b93d70_269f_4a4a_a55b_73f0918a3e04.slice/crio-255c660a1f3cc386d139e489de0267a46fb87ae9610f0d8ea43b3ee40b39cd52 WatchSource:0}: Error finding container 255c660a1f3cc386d139e489de0267a46fb87ae9610f0d8ea43b3ee40b39cd52: Status 404 returned error can't find the container with id 255c660a1f3cc386d139e489de0267a46fb87ae9610f0d8ea43b3ee40b39cd52
Jul 24 17:48:23.526260 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:23.526226    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:48:23.526354 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:23.526308    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:48:23.526422 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:23.526350    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:48:23.986330 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:23.986294    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr" event={"ID":"69b93d70-269f-4a4a-a55b-73f0918a3e04","Type":"ContainerStarted","Data":"946833d5a0bf256cbf7ec513a95ce45b92498db342eac14bc6b32d6968099b31"}
Jul 24 17:48:23.986513 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:23.986352    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr" event={"ID":"69b93d70-269f-4a4a-a55b-73f0918a3e04","Type":"ContainerStarted","Data":"255c660a1f3cc386d139e489de0267a46fb87ae9610f0d8ea43b3ee40b39cd52"}
Jul 24 17:48:24.009681 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:24.009634    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr" podStartSLOduration=1.009617446 podStartE2EDuration="1.009617446s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:48:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:48:24.008654224 +0000 UTC m=+2688.281514031" watchObservedRunningTime="2026-07-24 17:48:24.009617446 +0000 UTC m=+2688.282477226"
Jul 24 17:48:24.382558 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:24.382528    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr"
Jul 24 17:48:24.388542 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:24.388515    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr"
Jul 24 17:48:24.991973 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:24.991943    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr"
Jul 24 17:48:24.992817 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:24.992797    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr"
Jul 24 17:48:36.409405 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:36.409378    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6h754_860ed1fc-612f-4796-8077-72bc6c5d84db/ovn-acl-logging/0.log"
Jul 24 17:48:36.412363 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:36.412342    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6h754_860ed1fc-612f-4796-8077-72bc6c5d84db/ovn-acl-logging/0.log"
Jul 24 17:48:40.992649 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:40.992594    2561 patch_prober.go:28] interesting pod/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 24 17:48:40.993248 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:40.992689    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr" podUID="69b93d70-269f-4a4a-a55b-73f0918a3e04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 24 17:48:43.103945 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:43.103911    2561 generic.go:356] "Generic (PLEG): container finished" podID="69b93d70-269f-4a4a-a55b-73f0918a3e04" containerID="946833d5a0bf256cbf7ec513a95ce45b92498db342eac14bc6b32d6968099b31" exitCode=0
Jul 24 17:48:43.104385 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:43.103986    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr" event={"ID":"69b93d70-269f-4a4a-a55b-73f0918a3e04","Type":"ContainerDied","Data":"946833d5a0bf256cbf7ec513a95ce45b92498db342eac14bc6b32d6968099b31"}
Jul 24 17:48:43.104429 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:43.104405    2561 scope.go:117] "RemoveContainer" containerID="946833d5a0bf256cbf7ec513a95ce45b92498db342eac14bc6b32d6968099b31"
Jul 24 17:48:43.105552 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:43.105525    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:48:43.105621 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:43.105590    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:48:43.105658 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:43.105627    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:48:44.111464 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:44.111429    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr" event={"ID":"69b93d70-269f-4a4a-a55b-73f0918a3e04","Type":"ContainerStarted","Data":"9b2496051c8fe24d0592f73ce641cb1a3a6c710f79b6e113b055914533964ee1"}
Jul 24 17:48:44.381638 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:44.381601    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr"
Jul 24 17:48:44.381939 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:44.381912    2561 patch_prober.go:28] interesting pod/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Jul 24 17:48:44.382035 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:44.381977    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr" podUID="69b93d70-269f-4a4a-a55b-73f0918a3e04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Jul 24 17:48:45.382485 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:45.382448    2561 patch_prober.go:28] interesting pod/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Jul 24 17:48:45.382887 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:45.382499    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr" podUID="69b93d70-269f-4a4a-a55b-73f0918a3e04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Jul 24 17:48:46.382154 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:46.382115    2561 patch_prober.go:28] interesting pod/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Jul 24 17:48:46.382428 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:46.382401    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr" podUID="69b93d70-269f-4a4a-a55b-73f0918a3e04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Jul 24 17:48:47.381839 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:47.381807    2561 patch_prober.go:28] interesting pod/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Jul 24 17:48:47.382309 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:47.381868    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr" podUID="69b93d70-269f-4a4a-a55b-73f0918a3e04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Jul 24 17:48:48.385382 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:48.385353    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr"
Jul 24 17:48:48.385762 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:48.385740    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr"
Jul 24 17:48:48.386365 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:48:48.386345    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr"
Jul 24 17:49:26.183646 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:49:26.183612    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-052d9d/ipp-route-052d9d-kserve-84b8ff55-h8x5q"]
Jul 24 17:49:26.187392 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:49:26.187368    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-052d9d/ipp-route-052d9d-kserve-84b8ff55-h8x5q"
Jul 24 17:49:26.190612 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:49:26.190592    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-052d9d\"/\"kube-root-ca.crt\""
Jul 24 17:49:26.190844 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:49:26.190592    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-052d9d\"/\"openshift-service-ca.crt\""
Jul 24 17:49:26.190949 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:49:26.190592    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-052d9d\"/\"ipp-route-052d9d-kserve-self-signed-certs\""
Jul 24 17:49:26.190949 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:49:26.190614    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-052d9d\"/\"default-dockercfg-7mqp6\""
Jul 24 17:49:26.198074 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:49:26.198039    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-052d9d/ipp-route-052d9d-kserve-84b8ff55-h8x5q"]
Jul 24 17:49:26.304464 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:49:26.304437    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqb9v\" (UniqueName: \"kubernetes.io/projected/9ca3245c-bf1b-4095-bde3-d6cf39dc83fb-kube-api-access-lqb9v\") pod \"ipp-route-052d9d-kserve-84b8ff55-h8x5q\" (UID: \"9ca3245c-bf1b-4095-bde3-d6cf39dc83fb\") " pod="ai-tenant-e2e-ipp-a-052d9d/ipp-route-052d9d-kserve-84b8ff55-h8x5q"
Jul 24 17:49:26.304628 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:49:26.304479    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ca3245c-bf1b-4095-bde3-d6cf39dc83fb-dshm\") pod \"ipp-route-052d9d-kserve-84b8ff55-h8x5q\" (UID: \"9ca3245c-bf1b-4095-bde3-d6cf39dc83fb\") " pod="ai-tenant-e2e-ipp-a-052d9d/ipp-route-052d9d-kserve-84b8ff55-h8x5q"
Jul 24 17:49:26.304628 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:49:26.304514    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ca3245c-bf1b-4095-bde3-d6cf39dc83fb-tmp-dir\") pod \"ipp-route-052d9d-kserve-84b8ff55-h8x5q\" (UID: \"9ca3245c-bf1b-4095-bde3-d6cf39dc83fb\") " pod="ai-tenant-e2e-ipp-a-052d9d/ipp-route-052d9d-kserve-84b8ff55-h8x5q"
Jul 24 17:49:26.304628 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:49:26.304572    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ca3245c-bf1b-4095-bde3-d6cf39dc83fb-home\") pod \"ipp-route-052d9d-kserve-84b8ff55-h8x5q\" (UID: \"9ca3245c-bf1b-4095-bde3-d6cf39dc83fb\") " pod="ai-tenant-e2e-ipp-a-052d9d/ipp-route-052d9d-kserve-84b8ff55-h8x5q"
Jul 24 17:49:26.304628 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:49:26.304601    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ca3245c-bf1b-4095-bde3-d6cf39dc83fb-model-cache\") pod \"ipp-route-052d9d-kserve-84b8ff55-h8x5q\" (UID: \"9ca3245c-bf1b-4095-bde3-d6cf39dc83fb\") " pod="ai-tenant-e2e-ipp-a-052d9d/ipp-route-052d9d-kserve-84b8ff55-h8x5q"
Jul 24 17:49:26.304628 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:49:26.304618    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ca3245c-bf1b-4095-bde3-d6cf39dc83fb-tls-certs\") pod \"ipp-route-052d9d-kserve-84b8ff55-h8x5q\" (UID: \"9ca3245c-bf1b-4095-bde3-d6cf39dc83fb\") " pod="ai-tenant-e2e-ipp-a-052d9d/ipp-route-052d9d-kserve-84b8ff55-h8x5q"
Jul 24 17:49:26.405950 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:49:26.405924    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ca3245c-bf1b-4095-bde3-d6cf39dc83fb-home\") pod \"ipp-route-052d9d-kserve-84b8ff55-h8x5q\" (UID: \"9ca3245c-bf1b-4095-bde3-d6cf39dc83fb\") " pod="ai-tenant-e2e-ipp-a-052d9d/ipp-route-052d9d-kserve-84b8ff55-h8x5q"
Jul 24 17:49:26.405950 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:49:26.405953    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ca3245c-bf1b-4095-bde3-d6cf39dc83fb-model-cache\") pod \"ipp-route-052d9d-kserve-84b8ff55-h8x5q\" (UID: \"9ca3245c-bf1b-4095-bde3-d6cf39dc83fb\") " pod="ai-tenant-e2e-ipp-a-052d9d/ipp-route-052d9d-kserve-84b8ff55-h8x5q"
Jul 24 17:49:26.406216 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:49:26.405970    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ca3245c-bf1b-4095-bde3-d6cf39dc83fb-tls-certs\") pod \"ipp-route-052d9d-kserve-84b8ff55-h8x5q\" (UID: \"9ca3245c-bf1b-4095-bde3-d6cf39dc83fb\") " pod="ai-tenant-e2e-ipp-a-052d9d/ipp-route-052d9d-kserve-84b8ff55-h8x5q"
Jul 24 17:49:26.406216 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:49:26.406037    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqb9v\" (UniqueName: \"kubernetes.io/projected/9ca3245c-bf1b-4095-bde3-d6cf39dc83fb-kube-api-access-lqb9v\") pod \"ipp-route-052d9d-kserve-84b8ff55-h8x5q\" (UID: \"9ca3245c-bf1b-4095-bde3-d6cf39dc83fb\") " pod="ai-tenant-e2e-ipp-a-052d9d/ipp-route-052d9d-kserve-84b8ff55-h8x5q"
Jul 24 17:49:26.406216 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:49:26.406103    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ca3245c-bf1b-4095-bde3-d6cf39dc83fb-dshm\") pod \"ipp-route-052d9d-kserve-84b8ff55-h8x5q\" (UID: \"9ca3245c-bf1b-4095-bde3-d6cf39dc83fb\") " pod="ai-tenant-e2e-ipp-a-052d9d/ipp-route-052d9d-kserve-84b8ff55-h8x5q"
Jul 24 17:49:26.406216 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:49:26.406144    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ca3245c-bf1b-4095-bde3-d6cf39dc83fb-tmp-dir\") pod \"ipp-route-052d9d-kserve-84b8ff55-h8x5q\" (UID: \"9ca3245c-bf1b-4095-bde3-d6cf39dc83fb\") " pod="ai-tenant-e2e-ipp-a-052d9d/ipp-route-052d9d-kserve-84b8ff55-h8x5q"
Jul 24 17:49:26.406435 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:49:26.406322    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ca3245c-bf1b-4095-bde3-d6cf39dc83fb-home\") pod \"ipp-route-052d9d-kserve-84b8ff55-h8x5q\" (UID: \"9ca3245c-bf1b-4095-bde3-d6cf39dc83fb\") " pod="ai-tenant-e2e-ipp-a-052d9d/ipp-route-052d9d-kserve-84b8ff55-h8x5q"
Jul 24 17:49:26.406435 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:49:26.406375    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ca3245c-bf1b-4095-bde3-d6cf39dc83fb-model-cache\") pod \"ipp-route-052d9d-kserve-84b8ff55-h8x5q\" (UID: \"9ca3245c-bf1b-4095-bde3-d6cf39dc83fb\") " pod="ai-tenant-e2e-ipp-a-052d9d/ipp-route-052d9d-kserve-84b8ff55-h8x5q"
Jul 24 17:49:26.406435 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:49:26.406425    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ca3245c-bf1b-4095-bde3-d6cf39dc83fb-tmp-dir\") pod \"ipp-route-052d9d-kserve-84b8ff55-h8x5q\" (UID: \"9ca3245c-bf1b-4095-bde3-d6cf39dc83fb\") " pod="ai-tenant-e2e-ipp-a-052d9d/ipp-route-052d9d-kserve-84b8ff55-h8x5q"
Jul 24 17:49:26.408368 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:49:26.408344    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ca3245c-bf1b-4095-bde3-d6cf39dc83fb-dshm\") pod \"ipp-route-052d9d-kserve-84b8ff55-h8x5q\" (UID: \"9ca3245c-bf1b-4095-bde3-d6cf39dc83fb\") " pod="ai-tenant-e2e-ipp-a-052d9d/ipp-route-052d9d-kserve-84b8ff55-h8x5q"
Jul 24 17:49:26.408598 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:49:26.408578    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ca3245c-bf1b-4095-bde3-d6cf39dc83fb-tls-certs\") pod \"ipp-route-052d9d-kserve-84b8ff55-h8x5q\" (UID: \"9ca3245c-bf1b-4095-bde3-d6cf39dc83fb\") " pod="ai-tenant-e2e-ipp-a-052d9d/ipp-route-052d9d-kserve-84b8ff55-h8x5q"
Jul 24 17:49:26.414051 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:49:26.414028    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqb9v\" (UniqueName: \"kubernetes.io/projected/9ca3245c-bf1b-4095-bde3-d6cf39dc83fb-kube-api-access-lqb9v\") pod \"ipp-route-052d9d-kserve-84b8ff55-h8x5q\" (UID: \"9ca3245c-bf1b-4095-bde3-d6cf39dc83fb\") " pod="ai-tenant-e2e-ipp-a-052d9d/ipp-route-052d9d-kserve-84b8ff55-h8x5q"
Jul 24 17:49:26.497773 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:49:26.497712    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-052d9d/ipp-route-052d9d-kserve-84b8ff55-h8x5q"
Jul 24 17:49:26.632277 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:49:26.632251    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-052d9d/ipp-route-052d9d-kserve-84b8ff55-h8x5q"]
Jul 24 17:49:26.634412 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:49:26.634388    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ca3245c_bf1b_4095_bde3_d6cf39dc83fb.slice/crio-a78f26ce09c98f246cdb85ce63e83125e539c1f7b0d5d3db2914babc4ade7151 WatchSource:0}: Error finding container a78f26ce09c98f246cdb85ce63e83125e539c1f7b0d5d3db2914babc4ade7151: Status 404 returned error can't find the container with id a78f26ce09c98f246cdb85ce63e83125e539c1f7b0d5d3db2914babc4ade7151
Jul 24 17:49:27.321313 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:49:27.321282    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-052d9d/ipp-route-052d9d-kserve-84b8ff55-h8x5q" event={"ID":"9ca3245c-bf1b-4095-bde3-d6cf39dc83fb","Type":"ContainerStarted","Data":"2dc6ff7cf06ecd40cdce98e55664890711def5b1101a579006df8abe2dc42a4d"}
Jul 24 17:49:27.321313 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:49:27.321321    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-052d9d/ipp-route-052d9d-kserve-84b8ff55-h8x5q" event={"ID":"9ca3245c-bf1b-4095-bde3-d6cf39dc83fb","Type":"ContainerStarted","Data":"a78f26ce09c98f246cdb85ce63e83125e539c1f7b0d5d3db2914babc4ade7151"}
Jul 24 17:49:27.338220 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:49:27.338179    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-052d9d/ipp-route-052d9d-kserve-84b8ff55-h8x5q" podStartSLOduration=1.338164299 podStartE2EDuration="1.338164299s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:49:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:49:27.336650148 +0000 UTC m=+2751.609509930" watchObservedRunningTime="2026-07-24 17:49:27.338164299 +0000 UTC m=+2751.611024078"
Jul 24 17:49:36.497981 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:49:36.497948    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-052d9d/ipp-route-052d9d-kserve-84b8ff55-h8x5q"
Jul 24 17:49:36.498340 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:49:36.498106    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-052d9d/ipp-route-052d9d-kserve-84b8ff55-h8x5q"
Jul 24 17:49:36.510443 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:49:36.510419    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-052d9d/ipp-route-052d9d-kserve-84b8ff55-h8x5q"
Jul 24 17:49:37.382003 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:49:37.381972    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-052d9d/ipp-route-052d9d-kserve-84b8ff55-h8x5q"
Jul 24 17:50:04.831409 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:04.831332    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26"]
Jul 24 17:50:04.835032 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:04.835011    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26"
Jul 24 17:50:04.837791 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:04.837772    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-9bc868-openshift-default-dockercfg-t95g6\""
Jul 24 17:50:04.848367 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:04.848345    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26"]
Jul 24 17:50:04.954502 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:04.954468    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-istio-token\") pod \"e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26\" (UID: \"b76d2967-b58d-4282-bb38-ff8a8a2a53d7\") " pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26"
Jul 24 17:50:04.954671 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:04.954515    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m896r\" (UniqueName: \"kubernetes.io/projected/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-kube-api-access-m896r\") pod \"e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26\" (UID: \"b76d2967-b58d-4282-bb38-ff8a8a2a53d7\") " pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26"
Jul 24 17:50:04.954671 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:04.954550    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-credential-socket\") pod \"e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26\" (UID: \"b76d2967-b58d-4282-bb38-ff8a8a2a53d7\") " pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26"
Jul 24 17:50:04.954671 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:04.954615    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-istio-envoy\") pod \"e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26\" (UID: \"b76d2967-b58d-4282-bb38-ff8a8a2a53d7\") " pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26"
Jul 24 17:50:04.954671 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:04.954642    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-istiod-ca-cert\") pod \"e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26\" (UID: \"b76d2967-b58d-4282-bb38-ff8a8a2a53d7\") " pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26"
Jul 24 17:50:04.954671 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:04.954659    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-istio-podinfo\") pod \"e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26\" (UID: \"b76d2967-b58d-4282-bb38-ff8a8a2a53d7\") " pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26"
Jul 24 17:50:04.954860 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:04.954679    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-istio-data\") pod \"e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26\" (UID: \"b76d2967-b58d-4282-bb38-ff8a8a2a53d7\") " pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26"
Jul 24 17:50:04.954860 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:04.954738    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-workload-certs\") pod \"e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26\" (UID: \"b76d2967-b58d-4282-bb38-ff8a8a2a53d7\") " pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26"
Jul 24 17:50:04.954860 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:04.954785    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-workload-socket\") pod \"e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26\" (UID: \"b76d2967-b58d-4282-bb38-ff8a8a2a53d7\") " pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26"
Jul 24 17:50:05.055957 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:05.055926    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-istiod-ca-cert\") pod \"e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26\" (UID: \"b76d2967-b58d-4282-bb38-ff8a8a2a53d7\") " pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26"
Jul 24 17:50:05.055957 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:05.055962    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-istio-podinfo\") pod \"e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26\" (UID: \"b76d2967-b58d-4282-bb38-ff8a8a2a53d7\") " pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26"
Jul 24 17:50:05.056200 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:05.055983    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-istio-data\") pod \"e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26\" (UID: \"b76d2967-b58d-4282-bb38-ff8a8a2a53d7\") " pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26"
Jul 24 17:50:05.056200 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:05.056094    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-workload-certs\") pod \"e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26\" (UID: \"b76d2967-b58d-4282-bb38-ff8a8a2a53d7\") " pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26"
Jul 24 17:50:05.056200 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:05.056140    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-workload-socket\") pod \"e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26\" (UID: \"b76d2967-b58d-4282-bb38-ff8a8a2a53d7\") " pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26"
Jul 24 17:50:05.056200 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:05.056169    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-istio-token\") pod \"e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26\" (UID: \"b76d2967-b58d-4282-bb38-ff8a8a2a53d7\") " pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26"
Jul 24 17:50:05.056426 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:05.056222    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m896r\" (UniqueName: \"kubernetes.io/projected/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-kube-api-access-m896r\") pod \"e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26\" (UID: \"b76d2967-b58d-4282-bb38-ff8a8a2a53d7\") " pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26"
Jul 24 17:50:05.056426 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:05.056278    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-credential-socket\") pod \"e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26\" (UID: \"b76d2967-b58d-4282-bb38-ff8a8a2a53d7\") " pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26"
Jul 24 17:50:05.056426 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:05.056383    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-istio-envoy\") pod \"e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26\" (UID: \"b76d2967-b58d-4282-bb38-ff8a8a2a53d7\") " pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26"
Jul 24 17:50:05.056426 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:05.056392    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-istio-data\") pod \"e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26\" (UID: \"b76d2967-b58d-4282-bb38-ff8a8a2a53d7\") " pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26"
Jul 24 17:50:05.056610 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:05.056480    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-workload-certs\") pod \"e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26\" (UID: \"b76d2967-b58d-4282-bb38-ff8a8a2a53d7\") " pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26"
Jul 24 17:50:05.056676 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:05.056634    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-workload-socket\") pod \"e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26\" (UID: \"b76d2967-b58d-4282-bb38-ff8a8a2a53d7\") " pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26"
Jul 24 17:50:05.056838 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:05.056818    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-credential-socket\") pod \"e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26\" (UID: \"b76d2967-b58d-4282-bb38-ff8a8a2a53d7\") " pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26"
Jul 24 17:50:05.057021 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:05.057002    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-istiod-ca-cert\") pod \"e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26\" (UID: \"b76d2967-b58d-4282-bb38-ff8a8a2a53d7\") " pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26"
Jul 24 17:50:05.058451 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:05.058431    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-istio-envoy\") pod \"e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26\" (UID: \"b76d2967-b58d-4282-bb38-ff8a8a2a53d7\") " pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26"
Jul 24 17:50:05.058518 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:05.058497    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-istio-podinfo\") pod \"e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26\" (UID: \"b76d2967-b58d-4282-bb38-ff8a8a2a53d7\") " pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26"
Jul 24 17:50:05.064331 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:05.064308    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-istio-token\") pod \"e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26\" (UID: \"b76d2967-b58d-4282-bb38-ff8a8a2a53d7\") " pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26"
Jul 24 17:50:05.064571 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:05.064552    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m896r\" (UniqueName: \"kubernetes.io/projected/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-kube-api-access-m896r\") pod \"e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26\" (UID: \"b76d2967-b58d-4282-bb38-ff8a8a2a53d7\") " pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26"
Jul 24 17:50:05.145448 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:05.145354    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26"
Jul 24 17:50:05.286217 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:05.286189    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26"]
Jul 24 17:50:05.287757 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:50:05.287724    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb76d2967_b58d_4282_bb38_ff8a8a2a53d7.slice/crio-b71f9710fee6c4a8cc87c5e9b0c739308610c21725e4e6867f351cef5ea9fe6d WatchSource:0}: Error finding container b71f9710fee6c4a8cc87c5e9b0c739308610c21725e4e6867f351cef5ea9fe6d: Status 404 returned error can't find the container with id b71f9710fee6c4a8cc87c5e9b0c739308610c21725e4e6867f351cef5ea9fe6d
Jul 24 17:50:05.290016 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:05.289984    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:50:05.290139 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:05.290046    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:50:05.290139 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:05.290102    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:50:05.518355 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:05.518268    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26" event={"ID":"b76d2967-b58d-4282-bb38-ff8a8a2a53d7","Type":"ContainerStarted","Data":"f11d56f3807700ef4ca1717c390b2bda8ec3c93bf5e60457ef6fc94be8473861"}
Jul 24 17:50:05.518355 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:05.518323    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26" event={"ID":"b76d2967-b58d-4282-bb38-ff8a8a2a53d7","Type":"ContainerStarted","Data":"b71f9710fee6c4a8cc87c5e9b0c739308610c21725e4e6867f351cef5ea9fe6d"}
Jul 24 17:50:05.538854 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:05.538807    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26" podStartSLOduration=1.538792803 podStartE2EDuration="1.538792803s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:50:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:50:05.537107356 +0000 UTC m=+2789.809967158" watchObservedRunningTime="2026-07-24 17:50:05.538792803 +0000 UTC m=+2789.811652583"
Jul 24 17:50:06.146428 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:06.146389    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26"
Jul 24 17:50:06.152574 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:06.152548    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26"
Jul 24 17:50:06.523987 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:06.523910    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26"
Jul 24 17:50:06.524854 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:06.524833    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26"
Jul 24 17:50:08.374778 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:08.374749    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-9bc868-8bc5888d4-gfz5w"]
Jul 24 17:50:08.378326 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:08.378304    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9bc868-8bc5888d4-gfz5w"
Jul 24 17:50:08.382698 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:08.382675    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-9bc868\""
Jul 24 17:50:08.385569 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:08.385309    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-9bc868-dockercfg-2c9wn\""
Jul 24 17:50:08.391431 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:08.391410    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-9bc868-8bc5888d4-gfz5w"]
Jul 24 17:50:08.493682 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:08.493640    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zmhk\" (UniqueName: \"kubernetes.io/projected/161293f4-151f-442e-8186-a87b44ddc1ca-kube-api-access-8zmhk\") pod \"payload-processing-e2e-ipp-cleanup-9bc868-8bc5888d4-gfz5w\" (UID: \"161293f4-151f-442e-8186-a87b44ddc1ca\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9bc868-8bc5888d4-gfz5w"
Jul 24 17:50:08.493893 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:08.493845    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/161293f4-151f-442e-8186-a87b44ddc1ca-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-9bc868-8bc5888d4-gfz5w\" (UID: \"161293f4-151f-442e-8186-a87b44ddc1ca\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9bc868-8bc5888d4-gfz5w"
Jul 24 17:50:08.595331 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:08.595295    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/161293f4-151f-442e-8186-a87b44ddc1ca-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-9bc868-8bc5888d4-gfz5w\" (UID: \"161293f4-151f-442e-8186-a87b44ddc1ca\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9bc868-8bc5888d4-gfz5w"
Jul 24 17:50:08.595502 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:08.595350    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zmhk\" (UniqueName: \"kubernetes.io/projected/161293f4-151f-442e-8186-a87b44ddc1ca-kube-api-access-8zmhk\") pod \"payload-processing-e2e-ipp-cleanup-9bc868-8bc5888d4-gfz5w\" (UID: \"161293f4-151f-442e-8186-a87b44ddc1ca\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9bc868-8bc5888d4-gfz5w"
Jul 24 17:50:08.596034 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:08.596013    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/161293f4-151f-442e-8186-a87b44ddc1ca-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-9bc868-8bc5888d4-gfz5w\" (UID: \"161293f4-151f-442e-8186-a87b44ddc1ca\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9bc868-8bc5888d4-gfz5w"
Jul 24 17:50:08.605028 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:08.605003    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zmhk\" (UniqueName: \"kubernetes.io/projected/161293f4-151f-442e-8186-a87b44ddc1ca-kube-api-access-8zmhk\") pod \"payload-processing-e2e-ipp-cleanup-9bc868-8bc5888d4-gfz5w\" (UID: \"161293f4-151f-442e-8186-a87b44ddc1ca\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9bc868-8bc5888d4-gfz5w"
Jul 24 17:50:08.689164 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:08.689087    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9bc868-8bc5888d4-gfz5w"
Jul 24 17:50:08.825339 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:08.825263    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-9bc868-8bc5888d4-gfz5w"]
Jul 24 17:50:08.827740 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:50:08.827708    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod161293f4_151f_442e_8186_a87b44ddc1ca.slice/crio-25a9c94f5398cecce7be47c7d675e2362df94c410713f733e9d75c743e230679 WatchSource:0}: Error finding container 25a9c94f5398cecce7be47c7d675e2362df94c410713f733e9d75c743e230679: Status 404 returned error can't find the container with id 25a9c94f5398cecce7be47c7d675e2362df94c410713f733e9d75c743e230679
Jul 24 17:50:09.543429 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:09.543397    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9bc868-8bc5888d4-gfz5w" event={"ID":"161293f4-151f-442e-8186-a87b44ddc1ca","Type":"ContainerStarted","Data":"d7e72b61d067e2aefc22efd3d0748602f45e3bb06b71b14e6f06a54f8407dd01"}
Jul 24 17:50:09.543812 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:09.543447    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9bc868-8bc5888d4-gfz5w" event={"ID":"161293f4-151f-442e-8186-a87b44ddc1ca","Type":"ContainerStarted","Data":"25a9c94f5398cecce7be47c7d675e2362df94c410713f733e9d75c743e230679"}
Jul 24 17:50:09.543812 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:09.543490    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9bc868-8bc5888d4-gfz5w"
Jul 24 17:50:09.562195 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:09.562126    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9bc868-8bc5888d4-gfz5w" podStartSLOduration=1.562107886 podStartE2EDuration="1.562107886s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:50:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:50:09.559116286 +0000 UTC m=+2793.831976084" watchObservedRunningTime="2026-07-24 17:50:09.562107886 +0000 UTC m=+2793.834967668"
Jul 24 17:50:20.550712 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:20.550680    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9bc868-8bc5888d4-gfz5w"
Jul 24 17:50:21.525593 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:21.525557    2561 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Jul 24 17:50:21.525818 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:21.525622    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26" podUID="b76d2967-b58d-4282-bb38-ff8a8a2a53d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Jul 24 17:50:21.616664 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:21.616631    2561 generic.go:356] "Generic (PLEG): container finished" podID="b76d2967-b58d-4282-bb38-ff8a8a2a53d7" containerID="f11d56f3807700ef4ca1717c390b2bda8ec3c93bf5e60457ef6fc94be8473861" exitCode=0
Jul 24 17:50:21.617056 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:21.616679    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26" event={"ID":"b76d2967-b58d-4282-bb38-ff8a8a2a53d7","Type":"ContainerDied","Data":"f11d56f3807700ef4ca1717c390b2bda8ec3c93bf5e60457ef6fc94be8473861"}
Jul 24 17:50:21.617056 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:21.617052    2561 scope.go:117] "RemoveContainer" containerID="f11d56f3807700ef4ca1717c390b2bda8ec3c93bf5e60457ef6fc94be8473861"
Jul 24 17:50:21.618237 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:21.618209    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:50:21.618293 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:21.618279    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:50:21.618329 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:21.618308    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:50:22.623673 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:22.623635    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26" event={"ID":"b76d2967-b58d-4282-bb38-ff8a8a2a53d7","Type":"ContainerStarted","Data":"3807354b70d8338a1573b3bdc6136698dbfe52d048f75fc9fce92327d437ddf0"}
Jul 24 17:50:23.145933 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:23.145897    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26"
Jul 24 17:50:23.146209 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:23.146186    2561 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Jul 24 17:50:23.146270 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:23.146236    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26" podUID="b76d2967-b58d-4282-bb38-ff8a8a2a53d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Jul 24 17:50:24.146356 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:24.146314    2561 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Jul 24 17:50:24.146770 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:24.146376    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26" podUID="b76d2967-b58d-4282-bb38-ff8a8a2a53d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Jul 24 17:50:25.145860 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:25.145817    2561 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Jul 24 17:50:25.146048 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:25.145886    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26" podUID="b76d2967-b58d-4282-bb38-ff8a8a2a53d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Jul 24 17:50:26.145976 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:26.145939    2561 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Jul 24 17:50:26.146431 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:26.145995    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26" podUID="b76d2967-b58d-4282-bb38-ff8a8a2a53d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Jul 24 17:50:27.150401 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:27.150370    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26"
Jul 24 17:50:27.150775 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:27.150714    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26"
Jul 24 17:50:27.151316 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:27.151299    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26"
Jul 24 17:50:33.438588 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:33.438550    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-9bc868-8bc5888d4-gfz5w"]
Jul 24 17:50:33.439007 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:33.438809    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9bc868-8bc5888d4-gfz5w" podUID="161293f4-151f-442e-8186-a87b44ddc1ca" containerName="payload-processing" containerID="cri-o://d7e72b61d067e2aefc22efd3d0748602f45e3bb06b71b14e6f06a54f8407dd01" gracePeriod=30
Jul 24 17:50:33.686551 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:33.686519    2561 generic.go:356] "Generic (PLEG): container finished" podID="161293f4-151f-442e-8186-a87b44ddc1ca" containerID="d7e72b61d067e2aefc22efd3d0748602f45e3bb06b71b14e6f06a54f8407dd01" exitCode=0
Jul 24 17:50:33.686694 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:33.686588    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9bc868-8bc5888d4-gfz5w" event={"ID":"161293f4-151f-442e-8186-a87b44ddc1ca","Type":"ContainerDied","Data":"d7e72b61d067e2aefc22efd3d0748602f45e3bb06b71b14e6f06a54f8407dd01"}
Jul 24 17:50:33.686694 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:33.686645    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9bc868-8bc5888d4-gfz5w" event={"ID":"161293f4-151f-442e-8186-a87b44ddc1ca","Type":"ContainerDied","Data":"25a9c94f5398cecce7be47c7d675e2362df94c410713f733e9d75c743e230679"}
Jul 24 17:50:33.686694 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:33.686663    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="25a9c94f5398cecce7be47c7d675e2362df94c410713f733e9d75c743e230679"
Jul 24 17:50:33.696319 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:33.696265    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9bc868-8bc5888d4-gfz5w"
Jul 24 17:50:33.764943 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:33.764916    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/161293f4-151f-442e-8186-a87b44ddc1ca-plugins-config-volume\") pod \"161293f4-151f-442e-8186-a87b44ddc1ca\" (UID: \"161293f4-151f-442e-8186-a87b44ddc1ca\") "
Jul 24 17:50:33.765150 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:33.765004    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8zmhk\" (UniqueName: \"kubernetes.io/projected/161293f4-151f-442e-8186-a87b44ddc1ca-kube-api-access-8zmhk\") pod \"161293f4-151f-442e-8186-a87b44ddc1ca\" (UID: \"161293f4-151f-442e-8186-a87b44ddc1ca\") "
Jul 24 17:50:33.765412 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:33.765387    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/161293f4-151f-442e-8186-a87b44ddc1ca-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "161293f4-151f-442e-8186-a87b44ddc1ca" (UID: "161293f4-151f-442e-8186-a87b44ddc1ca"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:50:33.767104 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:33.767045    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/161293f4-151f-442e-8186-a87b44ddc1ca-kube-api-access-8zmhk" (OuterVolumeSpecName: "kube-api-access-8zmhk") pod "161293f4-151f-442e-8186-a87b44ddc1ca" (UID: "161293f4-151f-442e-8186-a87b44ddc1ca"). InnerVolumeSpecName "kube-api-access-8zmhk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:50:33.865687 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:33.865651    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/161293f4-151f-442e-8186-a87b44ddc1ca-plugins-config-volume\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:50:33.865687 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:33.865683    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8zmhk\" (UniqueName: \"kubernetes.io/projected/161293f4-151f-442e-8186-a87b44ddc1ca-kube-api-access-8zmhk\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:50:34.691855 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:34.691822    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9bc868-8bc5888d4-gfz5w"
Jul 24 17:50:34.707743 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:34.707715    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-9bc868-8bc5888d4-gfz5w"]
Jul 24 17:50:34.712098 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:34.712073    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-9bc868-8bc5888d4-gfz5w"]
Jul 24 17:50:36.259258 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:36.259219    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="161293f4-151f-442e-8186-a87b44ddc1ca" path="/var/lib/kubelet/pods/161293f4-151f-442e-8186-a87b44ddc1ca/volumes"
Jul 24 17:50:44.889325 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:44.889289    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26"]
Jul 24 17:50:44.889713 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:44.889502    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26" podUID="b76d2967-b58d-4282-bb38-ff8a8a2a53d7" containerName="istio-proxy" containerID="cri-o://3807354b70d8338a1573b3bdc6136698dbfe52d048f75fc9fce92327d437ddf0" gracePeriod=30
Jul 24 17:50:50.152870 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:50.152844    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26"
Jul 24 17:50:50.214240 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:50.214168    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-workload-certs\") pod \"b76d2967-b58d-4282-bb38-ff8a8a2a53d7\" (UID: \"b76d2967-b58d-4282-bb38-ff8a8a2a53d7\") "
Jul 24 17:50:50.214240 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:50.214230    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-workload-socket\") pod \"b76d2967-b58d-4282-bb38-ff8a8a2a53d7\" (UID: \"b76d2967-b58d-4282-bb38-ff8a8a2a53d7\") "
Jul 24 17:50:50.214433 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:50.214253    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m896r\" (UniqueName: \"kubernetes.io/projected/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-kube-api-access-m896r\") pod \"b76d2967-b58d-4282-bb38-ff8a8a2a53d7\" (UID: \"b76d2967-b58d-4282-bb38-ff8a8a2a53d7\") "
Jul 24 17:50:50.214433 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:50.214273    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-istio-token\") pod \"b76d2967-b58d-4282-bb38-ff8a8a2a53d7\" (UID: \"b76d2967-b58d-4282-bb38-ff8a8a2a53d7\") "
Jul 24 17:50:50.214433 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:50.214321    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-istio-envoy\") pod \"b76d2967-b58d-4282-bb38-ff8a8a2a53d7\" (UID: \"b76d2967-b58d-4282-bb38-ff8a8a2a53d7\") "
Jul 24 17:50:50.214433 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:50.214395    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-istiod-ca-cert\") pod \"b76d2967-b58d-4282-bb38-ff8a8a2a53d7\" (UID: \"b76d2967-b58d-4282-bb38-ff8a8a2a53d7\") "
Jul 24 17:50:50.214433 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:50.214417    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-istio-data\") pod \"b76d2967-b58d-4282-bb38-ff8a8a2a53d7\" (UID: \"b76d2967-b58d-4282-bb38-ff8a8a2a53d7\") "
Jul 24 17:50:50.214700 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:50.214432    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b76d2967-b58d-4282-bb38-ff8a8a2a53d7" (UID: "b76d2967-b58d-4282-bb38-ff8a8a2a53d7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:50:50.214700 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:50.214454    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-credential-socket\") pod \"b76d2967-b58d-4282-bb38-ff8a8a2a53d7\" (UID: \"b76d2967-b58d-4282-bb38-ff8a8a2a53d7\") "
Jul 24 17:50:50.214700 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:50.214484    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-istio-podinfo\") pod \"b76d2967-b58d-4282-bb38-ff8a8a2a53d7\" (UID: \"b76d2967-b58d-4282-bb38-ff8a8a2a53d7\") "
Jul 24 17:50:50.214700 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:50.214536    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b76d2967-b58d-4282-bb38-ff8a8a2a53d7" (UID: "b76d2967-b58d-4282-bb38-ff8a8a2a53d7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:50:50.215632 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:50.214713    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b76d2967-b58d-4282-bb38-ff8a8a2a53d7" (UID: "b76d2967-b58d-4282-bb38-ff8a8a2a53d7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:50:50.215775 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:50.215672    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b76d2967-b58d-4282-bb38-ff8a8a2a53d7" (UID: "b76d2967-b58d-4282-bb38-ff8a8a2a53d7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:50:50.218017 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:50.216229    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-istio-data" (OuterVolumeSpecName: "istio-data") pod "b76d2967-b58d-4282-bb38-ff8a8a2a53d7" (UID: "b76d2967-b58d-4282-bb38-ff8a8a2a53d7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:50:50.218017 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:50.216625    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-workload-certs\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:50:50.218017 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:50.216648    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-workload-socket\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:50:50.218017 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:50.216892    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-kube-api-access-m896r" (OuterVolumeSpecName: "kube-api-access-m896r") pod "b76d2967-b58d-4282-bb38-ff8a8a2a53d7" (UID: "b76d2967-b58d-4282-bb38-ff8a8a2a53d7"). InnerVolumeSpecName "kube-api-access-m896r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:50:50.218017 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:50.217159    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-istio-token" (OuterVolumeSpecName: "istio-token") pod "b76d2967-b58d-4282-bb38-ff8a8a2a53d7" (UID: "b76d2967-b58d-4282-bb38-ff8a8a2a53d7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:50:50.221137 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:50.219190    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b76d2967-b58d-4282-bb38-ff8a8a2a53d7" (UID: "b76d2967-b58d-4282-bb38-ff8a8a2a53d7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:50:50.224627 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:50.224598    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b76d2967-b58d-4282-bb38-ff8a8a2a53d7" (UID: "b76d2967-b58d-4282-bb38-ff8a8a2a53d7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 17:50:50.317828 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:50.317799    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-credential-socket\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:50:50.317828 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:50.317826    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-istio-podinfo\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:50:50.318015 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:50.317837    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m896r\" (UniqueName: \"kubernetes.io/projected/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-kube-api-access-m896r\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:50:50.318015 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:50.317847    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-istio-token\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:50:50.318015 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:50.317855    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-istio-envoy\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:50:50.318015 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:50.317862    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-istiod-ca-cert\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:50:50.318015 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:50.317870    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b76d2967-b58d-4282-bb38-ff8a8a2a53d7-istio-data\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:50:50.773188 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:50.773150    2561 generic.go:356] "Generic (PLEG): container finished" podID="b76d2967-b58d-4282-bb38-ff8a8a2a53d7" containerID="3807354b70d8338a1573b3bdc6136698dbfe52d048f75fc9fce92327d437ddf0" exitCode=0
Jul 24 17:50:50.773372 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:50.773218    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26"
Jul 24 17:50:50.773372 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:50.773216    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26" event={"ID":"b76d2967-b58d-4282-bb38-ff8a8a2a53d7","Type":"ContainerDied","Data":"3807354b70d8338a1573b3bdc6136698dbfe52d048f75fc9fce92327d437ddf0"}
Jul 24 17:50:50.773372 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:50.773341    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26" event={"ID":"b76d2967-b58d-4282-bb38-ff8a8a2a53d7","Type":"ContainerDied","Data":"b71f9710fee6c4a8cc87c5e9b0c739308610c21725e4e6867f351cef5ea9fe6d"}
Jul 24 17:50:50.773484 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:50.773372    2561 scope.go:117] "RemoveContainer" containerID="3807354b70d8338a1573b3bdc6136698dbfe52d048f75fc9fce92327d437ddf0"
Jul 24 17:50:50.782375 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:50.782363    2561 scope.go:117] "RemoveContainer" containerID="f11d56f3807700ef4ca1717c390b2bda8ec3c93bf5e60457ef6fc94be8473861"
Jul 24 17:50:50.790533 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:50.790510    2561 scope.go:117] "RemoveContainer" containerID="3807354b70d8338a1573b3bdc6136698dbfe52d048f75fc9fce92327d437ddf0"
Jul 24 17:50:50.790792 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:50:50.790774    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3807354b70d8338a1573b3bdc6136698dbfe52d048f75fc9fce92327d437ddf0\": container with ID starting with 3807354b70d8338a1573b3bdc6136698dbfe52d048f75fc9fce92327d437ddf0 not found: ID does not exist" containerID="3807354b70d8338a1573b3bdc6136698dbfe52d048f75fc9fce92327d437ddf0"
Jul 24 17:50:50.790872 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:50.790797    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3807354b70d8338a1573b3bdc6136698dbfe52d048f75fc9fce92327d437ddf0"} err="failed to get container status \"3807354b70d8338a1573b3bdc6136698dbfe52d048f75fc9fce92327d437ddf0\": rpc error: code = NotFound desc = could not find container \"3807354b70d8338a1573b3bdc6136698dbfe52d048f75fc9fce92327d437ddf0\": container with ID starting with 3807354b70d8338a1573b3bdc6136698dbfe52d048f75fc9fce92327d437ddf0 not found: ID does not exist"
Jul 24 17:50:50.790872 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:50.790813    2561 scope.go:117] "RemoveContainer" containerID="f11d56f3807700ef4ca1717c390b2bda8ec3c93bf5e60457ef6fc94be8473861"
Jul 24 17:50:50.790985 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:50.790942    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26"]
Jul 24 17:50:50.791035 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:50:50.791020    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f11d56f3807700ef4ca1717c390b2bda8ec3c93bf5e60457ef6fc94be8473861\": container with ID starting with f11d56f3807700ef4ca1717c390b2bda8ec3c93bf5e60457ef6fc94be8473861 not found: ID does not exist" containerID="f11d56f3807700ef4ca1717c390b2bda8ec3c93bf5e60457ef6fc94be8473861"
Jul 24 17:50:50.791132 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:50.791039    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f11d56f3807700ef4ca1717c390b2bda8ec3c93bf5e60457ef6fc94be8473861"} err="failed to get container status \"f11d56f3807700ef4ca1717c390b2bda8ec3c93bf5e60457ef6fc94be8473861\": rpc error: code = NotFound desc = could not find container \"f11d56f3807700ef4ca1717c390b2bda8ec3c93bf5e60457ef6fc94be8473861\": container with ID starting with f11d56f3807700ef4ca1717c390b2bda8ec3c93bf5e60457ef6fc94be8473861 not found: ID does not exist"
Jul 24 17:50:50.794829 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:50.794809    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-9bc868-openshift-default-75776d86d-nzj26"]
Jul 24 17:50:52.258388 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:50:52.258358    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b76d2967-b58d-4282-bb38-ff8a8a2a53d7" path="/var/lib/kubelet/pods/b76d2967-b58d-4282-bb38-ff8a8a2a53d7/volumes"
Jul 24 17:51:14.073045 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:51:14.073005    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-052d9d/ipp-route-052d9d-kserve-84b8ff55-h8x5q"]
Jul 24 17:51:29.092459 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:51:29.092372    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-052d9d/ipp-route-052d9d-kserve-84b8ff55-h8x5q" podUID="9ca3245c-bf1b-4095-bde3-d6cf39dc83fb" containerName="main" containerID="cri-o://2dc6ff7cf06ecd40cdce98e55664890711def5b1101a579006df8abe2dc42a4d" gracePeriod=45
Jul 24 17:51:29.341431 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:51:29.341409    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-052d9d/ipp-route-052d9d-kserve-84b8ff55-h8x5q"
Jul 24 17:51:29.482137 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:51:29.482106    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ca3245c-bf1b-4095-bde3-d6cf39dc83fb-model-cache\") pod \"9ca3245c-bf1b-4095-bde3-d6cf39dc83fb\" (UID: \"9ca3245c-bf1b-4095-bde3-d6cf39dc83fb\") "
Jul 24 17:51:29.482318 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:51:29.482158    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ca3245c-bf1b-4095-bde3-d6cf39dc83fb-dshm\") pod \"9ca3245c-bf1b-4095-bde3-d6cf39dc83fb\" (UID: \"9ca3245c-bf1b-4095-bde3-d6cf39dc83fb\") "
Jul 24 17:51:29.482318 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:51:29.482237    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ca3245c-bf1b-4095-bde3-d6cf39dc83fb-tls-certs\") pod \"9ca3245c-bf1b-4095-bde3-d6cf39dc83fb\" (UID: \"9ca3245c-bf1b-4095-bde3-d6cf39dc83fb\") "
Jul 24 17:51:29.482318 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:51:29.482275    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ca3245c-bf1b-4095-bde3-d6cf39dc83fb-tmp-dir\") pod \"9ca3245c-bf1b-4095-bde3-d6cf39dc83fb\" (UID: \"9ca3245c-bf1b-4095-bde3-d6cf39dc83fb\") "
Jul 24 17:51:29.482318 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:51:29.482315    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ca3245c-bf1b-4095-bde3-d6cf39dc83fb-home\") pod \"9ca3245c-bf1b-4095-bde3-d6cf39dc83fb\" (UID: \"9ca3245c-bf1b-4095-bde3-d6cf39dc83fb\") "
Jul 24 17:51:29.482552 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:51:29.482347    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lqb9v\" (UniqueName: \"kubernetes.io/projected/9ca3245c-bf1b-4095-bde3-d6cf39dc83fb-kube-api-access-lqb9v\") pod \"9ca3245c-bf1b-4095-bde3-d6cf39dc83fb\" (UID: \"9ca3245c-bf1b-4095-bde3-d6cf39dc83fb\") "
Jul 24 17:51:29.482552 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:51:29.482419    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ca3245c-bf1b-4095-bde3-d6cf39dc83fb-model-cache" (OuterVolumeSpecName: "model-cache") pod "9ca3245c-bf1b-4095-bde3-d6cf39dc83fb" (UID: "9ca3245c-bf1b-4095-bde3-d6cf39dc83fb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:51:29.482650 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:51:29.482585    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ca3245c-bf1b-4095-bde3-d6cf39dc83fb-home" (OuterVolumeSpecName: "home") pod "9ca3245c-bf1b-4095-bde3-d6cf39dc83fb" (UID: "9ca3245c-bf1b-4095-bde3-d6cf39dc83fb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:51:29.482717 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:51:29.482592    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ca3245c-bf1b-4095-bde3-d6cf39dc83fb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9ca3245c-bf1b-4095-bde3-d6cf39dc83fb" (UID: "9ca3245c-bf1b-4095-bde3-d6cf39dc83fb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:51:29.482717 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:51:29.482702    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ca3245c-bf1b-4095-bde3-d6cf39dc83fb-home\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:51:29.482717 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:51:29.482715    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ca3245c-bf1b-4095-bde3-d6cf39dc83fb-model-cache\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:51:29.484481 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:51:29.484457    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ca3245c-bf1b-4095-bde3-d6cf39dc83fb-dshm" (OuterVolumeSpecName: "dshm") pod "9ca3245c-bf1b-4095-bde3-d6cf39dc83fb" (UID: "9ca3245c-bf1b-4095-bde3-d6cf39dc83fb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:51:29.484592 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:51:29.484497    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ca3245c-bf1b-4095-bde3-d6cf39dc83fb-kube-api-access-lqb9v" (OuterVolumeSpecName: "kube-api-access-lqb9v") pod "9ca3245c-bf1b-4095-bde3-d6cf39dc83fb" (UID: "9ca3245c-bf1b-4095-bde3-d6cf39dc83fb"). InnerVolumeSpecName "kube-api-access-lqb9v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:51:29.484592 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:51:29.484506    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ca3245c-bf1b-4095-bde3-d6cf39dc83fb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9ca3245c-bf1b-4095-bde3-d6cf39dc83fb" (UID: "9ca3245c-bf1b-4095-bde3-d6cf39dc83fb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:51:29.584137 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:51:29.584113    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ca3245c-bf1b-4095-bde3-d6cf39dc83fb-tls-certs\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:51:29.584137 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:51:29.584134    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ca3245c-bf1b-4095-bde3-d6cf39dc83fb-tmp-dir\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:51:29.584270 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:51:29.584143    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqb9v\" (UniqueName: \"kubernetes.io/projected/9ca3245c-bf1b-4095-bde3-d6cf39dc83fb-kube-api-access-lqb9v\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:51:29.584270 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:51:29.584152    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ca3245c-bf1b-4095-bde3-d6cf39dc83fb-dshm\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:51:29.973119 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:51:29.973084    2561 generic.go:356] "Generic (PLEG): container finished" podID="9ca3245c-bf1b-4095-bde3-d6cf39dc83fb" containerID="2dc6ff7cf06ecd40cdce98e55664890711def5b1101a579006df8abe2dc42a4d" exitCode=0
Jul 24 17:51:29.973289 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:51:29.973133    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-052d9d/ipp-route-052d9d-kserve-84b8ff55-h8x5q"
Jul 24 17:51:29.973289 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:51:29.973166    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-052d9d/ipp-route-052d9d-kserve-84b8ff55-h8x5q" event={"ID":"9ca3245c-bf1b-4095-bde3-d6cf39dc83fb","Type":"ContainerDied","Data":"2dc6ff7cf06ecd40cdce98e55664890711def5b1101a579006df8abe2dc42a4d"}
Jul 24 17:51:29.973289 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:51:29.973218    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-052d9d/ipp-route-052d9d-kserve-84b8ff55-h8x5q" event={"ID":"9ca3245c-bf1b-4095-bde3-d6cf39dc83fb","Type":"ContainerDied","Data":"a78f26ce09c98f246cdb85ce63e83125e539c1f7b0d5d3db2914babc4ade7151"}
Jul 24 17:51:29.973289 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:51:29.973239    2561 scope.go:117] "RemoveContainer" containerID="2dc6ff7cf06ecd40cdce98e55664890711def5b1101a579006df8abe2dc42a4d"
Jul 24 17:51:29.982431 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:51:29.982415    2561 scope.go:117] "RemoveContainer" containerID="2dc6ff7cf06ecd40cdce98e55664890711def5b1101a579006df8abe2dc42a4d"
Jul 24 17:51:29.982674 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:51:29.982652    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2dc6ff7cf06ecd40cdce98e55664890711def5b1101a579006df8abe2dc42a4d\": container with ID starting with 2dc6ff7cf06ecd40cdce98e55664890711def5b1101a579006df8abe2dc42a4d not found: ID does not exist" containerID="2dc6ff7cf06ecd40cdce98e55664890711def5b1101a579006df8abe2dc42a4d"
Jul 24 17:51:29.982748 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:51:29.982682    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dc6ff7cf06ecd40cdce98e55664890711def5b1101a579006df8abe2dc42a4d"} err="failed to get container status \"2dc6ff7cf06ecd40cdce98e55664890711def5b1101a579006df8abe2dc42a4d\": rpc error: code = NotFound desc = could not find container \"2dc6ff7cf06ecd40cdce98e55664890711def5b1101a579006df8abe2dc42a4d\": container with ID starting with 2dc6ff7cf06ecd40cdce98e55664890711def5b1101a579006df8abe2dc42a4d not found: ID does not exist"
Jul 24 17:51:29.997023 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:51:29.997000    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-052d9d/ipp-route-052d9d-kserve-84b8ff55-h8x5q"]
Jul 24 17:51:30.003712 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:51:30.003691    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-052d9d/ipp-route-052d9d-kserve-84b8ff55-h8x5q"]
Jul 24 17:51:30.259278 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:51:30.259203    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ca3245c-bf1b-4095-bde3-d6cf39dc83fb" path="/var/lib/kubelet/pods/9ca3245c-bf1b-4095-bde3-d6cf39dc83fb/volumes"
Jul 24 17:52:03.539104 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:03.539053    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr"]
Jul 24 17:52:03.539715 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:03.539275    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr" podUID="69b93d70-269f-4a4a-a55b-73f0918a3e04" containerName="istio-proxy" containerID="cri-o://9b2496051c8fe24d0592f73ce641cb1a3a6c710f79b6e113b055914533964ee1" gracePeriod=30
Jul 24 17:52:08.791201 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:08.791178    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr"
Jul 24 17:52:08.832653 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:08.832581    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/69b93d70-269f-4a4a-a55b-73f0918a3e04-workload-socket\") pod \"69b93d70-269f-4a4a-a55b-73f0918a3e04\" (UID: \"69b93d70-269f-4a4a-a55b-73f0918a3e04\") "
Jul 24 17:52:08.832653 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:08.832639    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zc5h9\" (UniqueName: \"kubernetes.io/projected/69b93d70-269f-4a4a-a55b-73f0918a3e04-kube-api-access-zc5h9\") pod \"69b93d70-269f-4a4a-a55b-73f0918a3e04\" (UID: \"69b93d70-269f-4a4a-a55b-73f0918a3e04\") "
Jul 24 17:52:08.832829 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:08.832671    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/69b93d70-269f-4a4a-a55b-73f0918a3e04-workload-certs\") pod \"69b93d70-269f-4a4a-a55b-73f0918a3e04\" (UID: \"69b93d70-269f-4a4a-a55b-73f0918a3e04\") "
Jul 24 17:52:08.832829 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:08.832697    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/69b93d70-269f-4a4a-a55b-73f0918a3e04-istio-podinfo\") pod \"69b93d70-269f-4a4a-a55b-73f0918a3e04\" (UID: \"69b93d70-269f-4a4a-a55b-73f0918a3e04\") "
Jul 24 17:52:08.832829 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:08.832759    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/69b93d70-269f-4a4a-a55b-73f0918a3e04-istio-token\") pod \"69b93d70-269f-4a4a-a55b-73f0918a3e04\" (UID: \"69b93d70-269f-4a4a-a55b-73f0918a3e04\") "
Jul 24 17:52:08.832829 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:08.832823    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/69b93d70-269f-4a4a-a55b-73f0918a3e04-istiod-ca-cert\") pod \"69b93d70-269f-4a4a-a55b-73f0918a3e04\" (UID: \"69b93d70-269f-4a4a-a55b-73f0918a3e04\") "
Jul 24 17:52:08.833052 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:08.832862    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/69b93d70-269f-4a4a-a55b-73f0918a3e04-credential-socket\") pod \"69b93d70-269f-4a4a-a55b-73f0918a3e04\" (UID: \"69b93d70-269f-4a4a-a55b-73f0918a3e04\") "
Jul 24 17:52:08.833052 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:08.832880    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69b93d70-269f-4a4a-a55b-73f0918a3e04-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "69b93d70-269f-4a4a-a55b-73f0918a3e04" (UID: "69b93d70-269f-4a4a-a55b-73f0918a3e04"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:52:08.833052 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:08.832922    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/69b93d70-269f-4a4a-a55b-73f0918a3e04-istio-data\") pod \"69b93d70-269f-4a4a-a55b-73f0918a3e04\" (UID: \"69b93d70-269f-4a4a-a55b-73f0918a3e04\") "
Jul 24 17:52:08.833052 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:08.832973    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/69b93d70-269f-4a4a-a55b-73f0918a3e04-istio-envoy\") pod \"69b93d70-269f-4a4a-a55b-73f0918a3e04\" (UID: \"69b93d70-269f-4a4a-a55b-73f0918a3e04\") "
Jul 24 17:52:08.833052 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:08.833012    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69b93d70-269f-4a4a-a55b-73f0918a3e04-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "69b93d70-269f-4a4a-a55b-73f0918a3e04" (UID: "69b93d70-269f-4a4a-a55b-73f0918a3e04"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:52:08.833420 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:08.833319    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/69b93d70-269f-4a4a-a55b-73f0918a3e04-workload-socket\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:52:08.833420 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:08.833342    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/69b93d70-269f-4a4a-a55b-73f0918a3e04-workload-certs\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:52:08.833420 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:08.833394    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69b93d70-269f-4a4a-a55b-73f0918a3e04-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "69b93d70-269f-4a4a-a55b-73f0918a3e04" (UID: "69b93d70-269f-4a4a-a55b-73f0918a3e04"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:52:08.833587 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:08.833455    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69b93d70-269f-4a4a-a55b-73f0918a3e04-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "69b93d70-269f-4a4a-a55b-73f0918a3e04" (UID: "69b93d70-269f-4a4a-a55b-73f0918a3e04"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:52:08.833896 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:08.833871    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69b93d70-269f-4a4a-a55b-73f0918a3e04-istio-data" (OuterVolumeSpecName: "istio-data") pod "69b93d70-269f-4a4a-a55b-73f0918a3e04" (UID: "69b93d70-269f-4a4a-a55b-73f0918a3e04"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:52:08.835041 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:08.835009    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/69b93d70-269f-4a4a-a55b-73f0918a3e04-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "69b93d70-269f-4a4a-a55b-73f0918a3e04" (UID: "69b93d70-269f-4a4a-a55b-73f0918a3e04"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 17:52:08.835041 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:08.835025    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69b93d70-269f-4a4a-a55b-73f0918a3e04-istio-token" (OuterVolumeSpecName: "istio-token") pod "69b93d70-269f-4a4a-a55b-73f0918a3e04" (UID: "69b93d70-269f-4a4a-a55b-73f0918a3e04"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:52:08.835254 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:08.835233    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69b93d70-269f-4a4a-a55b-73f0918a3e04-kube-api-access-zc5h9" (OuterVolumeSpecName: "kube-api-access-zc5h9") pod "69b93d70-269f-4a4a-a55b-73f0918a3e04" (UID: "69b93d70-269f-4a4a-a55b-73f0918a3e04"). InnerVolumeSpecName "kube-api-access-zc5h9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:52:08.835616 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:08.835598    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69b93d70-269f-4a4a-a55b-73f0918a3e04-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "69b93d70-269f-4a4a-a55b-73f0918a3e04" (UID: "69b93d70-269f-4a4a-a55b-73f0918a3e04"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:52:08.933815 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:08.933783    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/69b93d70-269f-4a4a-a55b-73f0918a3e04-istio-data\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:52:08.933815 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:08.933808    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/69b93d70-269f-4a4a-a55b-73f0918a3e04-istio-envoy\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:52:08.933815 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:08.933817    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zc5h9\" (UniqueName: \"kubernetes.io/projected/69b93d70-269f-4a4a-a55b-73f0918a3e04-kube-api-access-zc5h9\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:52:08.934033 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:08.933826    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/69b93d70-269f-4a4a-a55b-73f0918a3e04-istio-podinfo\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:52:08.934033 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:08.933835    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/69b93d70-269f-4a4a-a55b-73f0918a3e04-istio-token\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:52:08.934033 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:08.933843    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/69b93d70-269f-4a4a-a55b-73f0918a3e04-istiod-ca-cert\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:52:08.934033 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:08.933851    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/69b93d70-269f-4a4a-a55b-73f0918a3e04-credential-socket\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:52:09.178167 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:09.178139    2561 generic.go:356] "Generic (PLEG): container finished" podID="69b93d70-269f-4a4a-a55b-73f0918a3e04" containerID="9b2496051c8fe24d0592f73ce641cb1a3a6c710f79b6e113b055914533964ee1" exitCode=0
Jul 24 17:52:09.178329 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:09.178209    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr"
Jul 24 17:52:09.178329 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:09.178229    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr" event={"ID":"69b93d70-269f-4a4a-a55b-73f0918a3e04","Type":"ContainerDied","Data":"9b2496051c8fe24d0592f73ce641cb1a3a6c710f79b6e113b055914533964ee1"}
Jul 24 17:52:09.178329 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:09.178286    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr" event={"ID":"69b93d70-269f-4a4a-a55b-73f0918a3e04","Type":"ContainerDied","Data":"255c660a1f3cc386d139e489de0267a46fb87ae9610f0d8ea43b3ee40b39cd52"}
Jul 24 17:52:09.178329 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:09.178315    2561 scope.go:117] "RemoveContainer" containerID="9b2496051c8fe24d0592f73ce641cb1a3a6c710f79b6e113b055914533964ee1"
Jul 24 17:52:09.187675 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:09.187658    2561 scope.go:117] "RemoveContainer" containerID="946833d5a0bf256cbf7ec513a95ce45b92498db342eac14bc6b32d6968099b31"
Jul 24 17:52:09.195474 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:09.195457    2561 scope.go:117] "RemoveContainer" containerID="9b2496051c8fe24d0592f73ce641cb1a3a6c710f79b6e113b055914533964ee1"
Jul 24 17:52:09.195707 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:52:09.195691    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b2496051c8fe24d0592f73ce641cb1a3a6c710f79b6e113b055914533964ee1\": container with ID starting with 9b2496051c8fe24d0592f73ce641cb1a3a6c710f79b6e113b055914533964ee1 not found: ID does not exist" containerID="9b2496051c8fe24d0592f73ce641cb1a3a6c710f79b6e113b055914533964ee1"
Jul 24 17:52:09.195755 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:09.195712    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b2496051c8fe24d0592f73ce641cb1a3a6c710f79b6e113b055914533964ee1"} err="failed to get container status \"9b2496051c8fe24d0592f73ce641cb1a3a6c710f79b6e113b055914533964ee1\": rpc error: code = NotFound desc = could not find container \"9b2496051c8fe24d0592f73ce641cb1a3a6c710f79b6e113b055914533964ee1\": container with ID starting with 9b2496051c8fe24d0592f73ce641cb1a3a6c710f79b6e113b055914533964ee1 not found: ID does not exist"
Jul 24 17:52:09.195755 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:09.195727    2561 scope.go:117] "RemoveContainer" containerID="946833d5a0bf256cbf7ec513a95ce45b92498db342eac14bc6b32d6968099b31"
Jul 24 17:52:09.195922 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:52:09.195906    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"946833d5a0bf256cbf7ec513a95ce45b92498db342eac14bc6b32d6968099b31\": container with ID starting with 946833d5a0bf256cbf7ec513a95ce45b92498db342eac14bc6b32d6968099b31 not found: ID does not exist" containerID="946833d5a0bf256cbf7ec513a95ce45b92498db342eac14bc6b32d6968099b31"
Jul 24 17:52:09.195967 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:09.195926    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"946833d5a0bf256cbf7ec513a95ce45b92498db342eac14bc6b32d6968099b31"} err="failed to get container status \"946833d5a0bf256cbf7ec513a95ce45b92498db342eac14bc6b32d6968099b31\": rpc error: code = NotFound desc = could not find container \"946833d5a0bf256cbf7ec513a95ce45b92498db342eac14bc6b32d6968099b31\": container with ID starting with 946833d5a0bf256cbf7ec513a95ce45b92498db342eac14bc6b32d6968099b31 not found: ID does not exist"
Jul 24 17:52:09.213377 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:09.213354    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr"]
Jul 24 17:52:09.216315 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:09.216294    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-052d9d-openshift-default-645f694f4-c9qsr"]
Jul 24 17:52:10.258642 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:10.258613    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69b93d70-269f-4a4a-a55b-73f0918a3e04" path="/var/lib/kubelet/pods/69b93d70-269f-4a4a-a55b-73f0918a3e04/volumes"
Jul 24 17:52:36.626381 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:36.626349    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-028d4b-84569f6774-h6qlw"]
Jul 24 17:52:36.626830 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:36.626634    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-028d4b-84569f6774-h6qlw" podUID="657e4762-5f5b-43c6-84c2-4d2b0dbbcad2" containerName="payload-processing" containerID="cri-o://bfeb3d60e59380ff5331674b1a85f3f19652c647215de3fc4f44f66ee3f8bbab" gracePeriod=30
Jul 24 17:52:36.891218 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:36.891189    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-028d4b-84569f6774-h6qlw"
Jul 24 17:52:36.991235 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:36.991203    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b7vnc\" (UniqueName: \"kubernetes.io/projected/657e4762-5f5b-43c6-84c2-4d2b0dbbcad2-kube-api-access-b7vnc\") pod \"657e4762-5f5b-43c6-84c2-4d2b0dbbcad2\" (UID: \"657e4762-5f5b-43c6-84c2-4d2b0dbbcad2\") "
Jul 24 17:52:36.991414 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:36.991361    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/657e4762-5f5b-43c6-84c2-4d2b0dbbcad2-plugins-config-volume\") pod \"657e4762-5f5b-43c6-84c2-4d2b0dbbcad2\" (UID: \"657e4762-5f5b-43c6-84c2-4d2b0dbbcad2\") "
Jul 24 17:52:36.991759 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:36.991737    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/657e4762-5f5b-43c6-84c2-4d2b0dbbcad2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "657e4762-5f5b-43c6-84c2-4d2b0dbbcad2" (UID: "657e4762-5f5b-43c6-84c2-4d2b0dbbcad2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:52:36.993461 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:36.993427    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/657e4762-5f5b-43c6-84c2-4d2b0dbbcad2-kube-api-access-b7vnc" (OuterVolumeSpecName: "kube-api-access-b7vnc") pod "657e4762-5f5b-43c6-84c2-4d2b0dbbcad2" (UID: "657e4762-5f5b-43c6-84c2-4d2b0dbbcad2"). InnerVolumeSpecName "kube-api-access-b7vnc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:52:37.092515 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:37.092477    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/657e4762-5f5b-43c6-84c2-4d2b0dbbcad2-plugins-config-volume\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:52:37.092515 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:37.092507    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b7vnc\" (UniqueName: \"kubernetes.io/projected/657e4762-5f5b-43c6-84c2-4d2b0dbbcad2-kube-api-access-b7vnc\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:52:37.320087 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:37.320029    2561 generic.go:356] "Generic (PLEG): container finished" podID="657e4762-5f5b-43c6-84c2-4d2b0dbbcad2" containerID="bfeb3d60e59380ff5331674b1a85f3f19652c647215de3fc4f44f66ee3f8bbab" exitCode=0
Jul 24 17:52:37.320087 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:37.320081    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-028d4b-84569f6774-h6qlw"
Jul 24 17:52:37.320317 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:37.320118    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-028d4b-84569f6774-h6qlw" event={"ID":"657e4762-5f5b-43c6-84c2-4d2b0dbbcad2","Type":"ContainerDied","Data":"bfeb3d60e59380ff5331674b1a85f3f19652c647215de3fc4f44f66ee3f8bbab"}
Jul 24 17:52:37.320317 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:37.320170    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-028d4b-84569f6774-h6qlw" event={"ID":"657e4762-5f5b-43c6-84c2-4d2b0dbbcad2","Type":"ContainerDied","Data":"a44fc97b514f40fd942f83dfa6008392ab27ce1636f7845f05f7681f5dff6efe"}
Jul 24 17:52:37.320317 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:37.320196    2561 scope.go:117] "RemoveContainer" containerID="bfeb3d60e59380ff5331674b1a85f3f19652c647215de3fc4f44f66ee3f8bbab"
Jul 24 17:52:37.329716 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:37.329700    2561 scope.go:117] "RemoveContainer" containerID="bfeb3d60e59380ff5331674b1a85f3f19652c647215de3fc4f44f66ee3f8bbab"
Jul 24 17:52:37.329949 ip-10-0-137-137 kubenswrapper[2561]: E0724 17:52:37.329931    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfeb3d60e59380ff5331674b1a85f3f19652c647215de3fc4f44f66ee3f8bbab\": container with ID starting with bfeb3d60e59380ff5331674b1a85f3f19652c647215de3fc4f44f66ee3f8bbab not found: ID does not exist" containerID="bfeb3d60e59380ff5331674b1a85f3f19652c647215de3fc4f44f66ee3f8bbab"
Jul 24 17:52:37.329997 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:37.329956    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfeb3d60e59380ff5331674b1a85f3f19652c647215de3fc4f44f66ee3f8bbab"} err="failed to get container status \"bfeb3d60e59380ff5331674b1a85f3f19652c647215de3fc4f44f66ee3f8bbab\": rpc error: code = NotFound desc = could not find container \"bfeb3d60e59380ff5331674b1a85f3f19652c647215de3fc4f44f66ee3f8bbab\": container with ID starting with bfeb3d60e59380ff5331674b1a85f3f19652c647215de3fc4f44f66ee3f8bbab not found: ID does not exist"
Jul 24 17:52:37.342602 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:37.342580    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-028d4b-84569f6774-h6qlw"]
Jul 24 17:52:37.348132 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:37.348109    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-028d4b-84569f6774-h6qlw"]
Jul 24 17:52:38.264507 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:38.264476    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="657e4762-5f5b-43c6-84c2-4d2b0dbbcad2" path="/var/lib/kubelet/pods/657e4762-5f5b-43c6-84c2-4d2b0dbbcad2/volumes"
Jul 24 17:52:48.275000 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:48.274960    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht"]
Jul 24 17:52:48.275516 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:48.275251    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht" podUID="9778eb53-fada-43c6-9492-647ad301cd29" containerName="istio-proxy" containerID="cri-o://4d2460a858b3195236878bc072c781a888e3eaf5d3579c2f5f5be66f825cd362" gracePeriod=30
Jul 24 17:52:53.407682 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:53.407652    2561 generic.go:356] "Generic (PLEG): container finished" podID="9778eb53-fada-43c6-9492-647ad301cd29" containerID="4d2460a858b3195236878bc072c781a888e3eaf5d3579c2f5f5be66f825cd362" exitCode=0
Jul 24 17:52:53.408075 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:53.407720    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht" event={"ID":"9778eb53-fada-43c6-9492-647ad301cd29","Type":"ContainerDied","Data":"4d2460a858b3195236878bc072c781a888e3eaf5d3579c2f5f5be66f825cd362"}
Jul 24 17:52:53.408075 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:53.407779    2561 scope.go:117] "RemoveContainer" containerID="3e73e8b9daada9d37d0d5d817c78fbcaeb838197fe916ec473e9638a99dc8e94"
Jul 24 17:52:53.519828 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:53.519799    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht"
Jul 24 17:52:53.642273 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:53.642244    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9778eb53-fada-43c6-9492-647ad301cd29-istio-data\") pod \"9778eb53-fada-43c6-9492-647ad301cd29\" (UID: \"9778eb53-fada-43c6-9492-647ad301cd29\") "
Jul 24 17:52:53.642440 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:53.642294    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46mrt\" (UniqueName: \"kubernetes.io/projected/9778eb53-fada-43c6-9492-647ad301cd29-kube-api-access-46mrt\") pod \"9778eb53-fada-43c6-9492-647ad301cd29\" (UID: \"9778eb53-fada-43c6-9492-647ad301cd29\") "
Jul 24 17:52:53.642440 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:53.642327    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9778eb53-fada-43c6-9492-647ad301cd29-istiod-ca-cert\") pod \"9778eb53-fada-43c6-9492-647ad301cd29\" (UID: \"9778eb53-fada-43c6-9492-647ad301cd29\") "
Jul 24 17:52:53.642440 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:53.642369    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9778eb53-fada-43c6-9492-647ad301cd29-workload-socket\") pod \"9778eb53-fada-43c6-9492-647ad301cd29\" (UID: \"9778eb53-fada-43c6-9492-647ad301cd29\") "
Jul 24 17:52:53.642440 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:53.642392    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9778eb53-fada-43c6-9492-647ad301cd29-istio-envoy\") pod \"9778eb53-fada-43c6-9492-647ad301cd29\" (UID: \"9778eb53-fada-43c6-9492-647ad301cd29\") "
Jul 24 17:52:53.642655 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:53.642485    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9778eb53-fada-43c6-9492-647ad301cd29-istio-podinfo\") pod \"9778eb53-fada-43c6-9492-647ad301cd29\" (UID: \"9778eb53-fada-43c6-9492-647ad301cd29\") "
Jul 24 17:52:53.642655 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:53.642542    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9778eb53-fada-43c6-9492-647ad301cd29-workload-certs\") pod \"9778eb53-fada-43c6-9492-647ad301cd29\" (UID: \"9778eb53-fada-43c6-9492-647ad301cd29\") "
Jul 24 17:52:53.642655 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:53.642577    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9778eb53-fada-43c6-9492-647ad301cd29-istio-token\") pod \"9778eb53-fada-43c6-9492-647ad301cd29\" (UID: \"9778eb53-fada-43c6-9492-647ad301cd29\") "
Jul 24 17:52:53.642655 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:53.642636    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9778eb53-fada-43c6-9492-647ad301cd29-credential-socket\") pod \"9778eb53-fada-43c6-9492-647ad301cd29\" (UID: \"9778eb53-fada-43c6-9492-647ad301cd29\") "
Jul 24 17:52:53.642873 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:53.642704    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9778eb53-fada-43c6-9492-647ad301cd29-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9778eb53-fada-43c6-9492-647ad301cd29" (UID: "9778eb53-fada-43c6-9492-647ad301cd29"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:52:53.642941 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:53.642867    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9778eb53-fada-43c6-9492-647ad301cd29-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9778eb53-fada-43c6-9492-647ad301cd29" (UID: "9778eb53-fada-43c6-9492-647ad301cd29"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:52:53.642941 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:53.642900    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9778eb53-fada-43c6-9492-647ad301cd29-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9778eb53-fada-43c6-9492-647ad301cd29" (UID: "9778eb53-fada-43c6-9492-647ad301cd29"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:52:53.643093 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:53.642954    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9778eb53-fada-43c6-9492-647ad301cd29-workload-socket\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:52:53.643093 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:53.642972    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9778eb53-fada-43c6-9492-647ad301cd29-workload-certs\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:52:53.643209 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:53.643089    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9778eb53-fada-43c6-9492-647ad301cd29-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9778eb53-fada-43c6-9492-647ad301cd29" (UID: "9778eb53-fada-43c6-9492-647ad301cd29"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:52:53.643270 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:53.643237    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9778eb53-fada-43c6-9492-647ad301cd29-istio-data" (OuterVolumeSpecName: "istio-data") pod "9778eb53-fada-43c6-9492-647ad301cd29" (UID: "9778eb53-fada-43c6-9492-647ad301cd29"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:52:53.644795 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:53.644770    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9778eb53-fada-43c6-9492-647ad301cd29-istio-token" (OuterVolumeSpecName: "istio-token") pod "9778eb53-fada-43c6-9492-647ad301cd29" (UID: "9778eb53-fada-43c6-9492-647ad301cd29"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:52:53.644923 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:53.644856    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9778eb53-fada-43c6-9492-647ad301cd29-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9778eb53-fada-43c6-9492-647ad301cd29" (UID: "9778eb53-fada-43c6-9492-647ad301cd29"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:52:53.645037 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:53.645015    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9778eb53-fada-43c6-9492-647ad301cd29-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9778eb53-fada-43c6-9492-647ad301cd29" (UID: "9778eb53-fada-43c6-9492-647ad301cd29"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 17:52:53.645110 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:53.645040    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9778eb53-fada-43c6-9492-647ad301cd29-kube-api-access-46mrt" (OuterVolumeSpecName: "kube-api-access-46mrt") pod "9778eb53-fada-43c6-9492-647ad301cd29" (UID: "9778eb53-fada-43c6-9492-647ad301cd29"). InnerVolumeSpecName "kube-api-access-46mrt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:52:53.744084 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:53.744034    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46mrt\" (UniqueName: \"kubernetes.io/projected/9778eb53-fada-43c6-9492-647ad301cd29-kube-api-access-46mrt\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:52:53.744084 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:53.744079    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9778eb53-fada-43c6-9492-647ad301cd29-istiod-ca-cert\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:52:53.744084 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:53.744090    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9778eb53-fada-43c6-9492-647ad301cd29-istio-envoy\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:52:53.744293 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:53.744099    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9778eb53-fada-43c6-9492-647ad301cd29-istio-podinfo\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:52:53.744293 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:53.744108    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9778eb53-fada-43c6-9492-647ad301cd29-istio-token\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:52:53.744293 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:53.744116    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9778eb53-fada-43c6-9492-647ad301cd29-credential-socket\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:52:53.744293 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:53.744124    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9778eb53-fada-43c6-9492-647ad301cd29-istio-data\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:52:54.413652 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:54.413618    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht"
Jul 24 17:52:54.414090 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:54.413648    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht" event={"ID":"9778eb53-fada-43c6-9492-647ad301cd29","Type":"ContainerDied","Data":"5d79fd868a89fdd91d116c065c14ffa811c37777508679a6f31ef5514cc5a309"}
Jul 24 17:52:54.414090 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:54.413703    2561 scope.go:117] "RemoveContainer" containerID="4d2460a858b3195236878bc072c781a888e3eaf5d3579c2f5f5be66f825cd362"
Jul 24 17:52:54.448819 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:54.448789    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht"]
Jul 24 17:52:54.455505 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:54.455481    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-028d4b-openshift-default-6555cbd844-p8tht"]
Jul 24 17:52:56.259475 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:56.259443    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9778eb53-fada-43c6-9492-647ad301cd29" path="/var/lib/kubelet/pods/9778eb53-fada-43c6-9492-647ad301cd29/volumes"
Jul 24 17:52:59.253763 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:59.253676    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-a11aa7-74fb86cfd6-vvk5b"]
Jul 24 17:52:59.254230 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:59.253897    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-a11aa7-74fb86cfd6-vvk5b" podUID="da154062-46c4-45ea-a282-1ca418c591a3" containerName="payload-processing" containerID="cri-o://610efc1f4936c36c3b3633d9c6bd4a38f32a8d39e4752eaf95e028adb7613d02" gracePeriod=30
Jul 24 17:52:59.442856 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:59.442829    2561 generic.go:356] "Generic (PLEG): container finished" podID="da154062-46c4-45ea-a282-1ca418c591a3" containerID="610efc1f4936c36c3b3633d9c6bd4a38f32a8d39e4752eaf95e028adb7613d02" exitCode=0
Jul 24 17:52:59.443003 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:59.442883    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-a11aa7-74fb86cfd6-vvk5b" event={"ID":"da154062-46c4-45ea-a282-1ca418c591a3","Type":"ContainerDied","Data":"610efc1f4936c36c3b3633d9c6bd4a38f32a8d39e4752eaf95e028adb7613d02"}
Jul 24 17:52:59.499663 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:59.499638    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-a11aa7-74fb86cfd6-vvk5b"
Jul 24 17:52:59.600278 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:59.600184    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vxtl\" (UniqueName: \"kubernetes.io/projected/da154062-46c4-45ea-a282-1ca418c591a3-kube-api-access-6vxtl\") pod \"da154062-46c4-45ea-a282-1ca418c591a3\" (UID: \"da154062-46c4-45ea-a282-1ca418c591a3\") "
Jul 24 17:52:59.600448 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:59.600305    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da154062-46c4-45ea-a282-1ca418c591a3-plugins-config-volume\") pod \"da154062-46c4-45ea-a282-1ca418c591a3\" (UID: \"da154062-46c4-45ea-a282-1ca418c591a3\") "
Jul 24 17:52:59.600679 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:59.600658    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da154062-46c4-45ea-a282-1ca418c591a3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "da154062-46c4-45ea-a282-1ca418c591a3" (UID: "da154062-46c4-45ea-a282-1ca418c591a3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:52:59.602270 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:59.602239    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da154062-46c4-45ea-a282-1ca418c591a3-kube-api-access-6vxtl" (OuterVolumeSpecName: "kube-api-access-6vxtl") pod "da154062-46c4-45ea-a282-1ca418c591a3" (UID: "da154062-46c4-45ea-a282-1ca418c591a3"). InnerVolumeSpecName "kube-api-access-6vxtl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:52:59.701738 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:59.701712    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da154062-46c4-45ea-a282-1ca418c591a3-plugins-config-volume\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:52:59.701738 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:52:59.701737    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vxtl\" (UniqueName: \"kubernetes.io/projected/da154062-46c4-45ea-a282-1ca418c591a3-kube-api-access-6vxtl\") on node \"ip-10-0-137-137.ec2.internal\" DevicePath \"\""
Jul 24 17:53:00.448818 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:00.448785    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-a11aa7-74fb86cfd6-vvk5b"
Jul 24 17:53:00.449233 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:00.448815    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-a11aa7-74fb86cfd6-vvk5b" event={"ID":"da154062-46c4-45ea-a282-1ca418c591a3","Type":"ContainerDied","Data":"f0bcd666f33e5bff7b29f9b94330beb0b3163475e1acaafce6ae21411df68cf7"}
Jul 24 17:53:00.449233 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:00.448875    2561 scope.go:117] "RemoveContainer" containerID="610efc1f4936c36c3b3633d9c6bd4a38f32a8d39e4752eaf95e028adb7613d02"
Jul 24 17:53:00.464819 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:00.464793    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-a11aa7-74fb86cfd6-vvk5b"]
Jul 24 17:53:00.466355 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:00.466336    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-a11aa7-74fb86cfd6-vvk5b"]
Jul 24 17:53:02.258531 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:02.258502    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da154062-46c4-45ea-a282-1ca418c591a3" path="/var/lib/kubelet/pods/da154062-46c4-45ea-a282-1ca418c591a3/volumes"
Jul 24 17:53:16.767494 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:16.767465    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-75f9bdd58d-ls6r2_0d71feeb-49cd-4e8c-a97b-fcb85b82b8b6/manager/0.log"
Jul 24 17:53:17.237231 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:17.237204    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bc8c4649b-k45wz_c2a23b89-a681-4cf6-87f0-d26575452a98/copy-manifests/0.log"
Jul 24 17:53:17.243724 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:17.243703    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bc8c4649b-k45wz_c2a23b89-a681-4cf6-87f0-d26575452a98/manager/0.log"
Jul 24 17:53:18.155248 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:18.155222    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-n4gkz_cf688127-37be-462b-b440-df3c76568622/postgres/0.log"
Jul 24 17:53:19.764719 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:19.764689    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-9srb9_17cce661-6425-481c-bec6-aa11fcf5283a/kuadrant-console-plugin/0.log"
Jul 24 17:53:20.805421 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:20.805392    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d6f9cf76-dxns9_19a0a0a6-a5ff-47ba-ab95-f0ecb6297bcd/kube-auth-proxy/0.log"
Jul 24 17:53:21.146871 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:21.146841    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-tcv7b_4ddec504-5e0c-48b7-bdfa-a2f2a6439453/payload-pre-processing/0.log"
Jul 24 17:53:21.720108 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:21.720076    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-bfgzg_5acbbe26-d973-45e6-b91d-879724bb05d2/main/0.log"
Jul 24 17:53:21.831330 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:21.831300    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-wbrg4_539f073c-e8b9-48a2-92a0-399cce1ec28f/main/0.log"
Jul 24 17:53:22.266193 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:22.266161    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-zkjqh_7ae3a26d-98e6-4b63-bb13-d72dfa5dd9fc/main/0.log"
Jul 24 17:53:27.772178 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:27.772142    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jgdcp/must-gather-tz7p2"]
Jul 24 17:53:27.772568 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:27.772482    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ca3245c-bf1b-4095-bde3-d6cf39dc83fb" containerName="main"
Jul 24 17:53:27.772568 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:27.772493    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ca3245c-bf1b-4095-bde3-d6cf39dc83fb" containerName="main"
Jul 24 17:53:27.772568 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:27.772503    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b76d2967-b58d-4282-bb38-ff8a8a2a53d7" containerName="istio-proxy"
Jul 24 17:53:27.772568 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:27.772508    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b76d2967-b58d-4282-bb38-ff8a8a2a53d7" containerName="istio-proxy"
Jul 24 17:53:27.772568 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:27.772517    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="657e4762-5f5b-43c6-84c2-4d2b0dbbcad2" containerName="payload-processing"
Jul 24 17:53:27.772568 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:27.772522    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="657e4762-5f5b-43c6-84c2-4d2b0dbbcad2" containerName="payload-processing"
Jul 24 17:53:27.772568 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:27.772528    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da154062-46c4-45ea-a282-1ca418c591a3" containerName="payload-processing"
Jul 24 17:53:27.772568 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:27.772533    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="da154062-46c4-45ea-a282-1ca418c591a3" containerName="payload-processing"
Jul 24 17:53:27.772568 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:27.772540    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69b93d70-269f-4a4a-a55b-73f0918a3e04" containerName="istio-proxy"
Jul 24 17:53:27.772568 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:27.772545    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="69b93d70-269f-4a4a-a55b-73f0918a3e04" containerName="istio-proxy"
Jul 24 17:53:27.772568 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:27.772559    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b76d2967-b58d-4282-bb38-ff8a8a2a53d7" containerName="istio-proxy"
Jul 24 17:53:27.772568 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:27.772564    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b76d2967-b58d-4282-bb38-ff8a8a2a53d7" containerName="istio-proxy"
Jul 24 17:53:27.772568 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:27.772573    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9778eb53-fada-43c6-9492-647ad301cd29" containerName="istio-proxy"
Jul 24 17:53:27.773035 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:27.772578    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9778eb53-fada-43c6-9492-647ad301cd29" containerName="istio-proxy"
Jul 24 17:53:27.773035 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:27.772585    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9778eb53-fada-43c6-9492-647ad301cd29" containerName="istio-proxy"
Jul 24 17:53:27.773035 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:27.772590    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9778eb53-fada-43c6-9492-647ad301cd29" containerName="istio-proxy"
Jul 24 17:53:27.773035 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:27.772601    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="161293f4-151f-442e-8186-a87b44ddc1ca" containerName="payload-processing"
Jul 24 17:53:27.773035 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:27.772607    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="161293f4-151f-442e-8186-a87b44ddc1ca" containerName="payload-processing"
Jul 24 17:53:27.773035 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:27.772662    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9778eb53-fada-43c6-9492-647ad301cd29" containerName="istio-proxy"
Jul 24 17:53:27.773035 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:27.772670    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="69b93d70-269f-4a4a-a55b-73f0918a3e04" containerName="istio-proxy"
Jul 24 17:53:27.773035 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:27.772677    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ca3245c-bf1b-4095-bde3-d6cf39dc83fb" containerName="main"
Jul 24 17:53:27.773035 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:27.772683    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="da154062-46c4-45ea-a282-1ca418c591a3" containerName="payload-processing"
Jul 24 17:53:27.773035 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:27.772688    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9778eb53-fada-43c6-9492-647ad301cd29" containerName="istio-proxy"
Jul 24 17:53:27.773035 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:27.772694    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b76d2967-b58d-4282-bb38-ff8a8a2a53d7" containerName="istio-proxy"
Jul 24 17:53:27.773035 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:27.772698    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="657e4762-5f5b-43c6-84c2-4d2b0dbbcad2" containerName="payload-processing"
Jul 24 17:53:27.773035 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:27.772706    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="161293f4-151f-442e-8186-a87b44ddc1ca" containerName="payload-processing"
Jul 24 17:53:27.773035 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:27.772766    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69b93d70-269f-4a4a-a55b-73f0918a3e04" containerName="istio-proxy"
Jul 24 17:53:27.773035 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:27.772771    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="69b93d70-269f-4a4a-a55b-73f0918a3e04" containerName="istio-proxy"
Jul 24 17:53:27.773035 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:27.772827    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="69b93d70-269f-4a4a-a55b-73f0918a3e04" containerName="istio-proxy"
Jul 24 17:53:27.773035 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:27.772833    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b76d2967-b58d-4282-bb38-ff8a8a2a53d7" containerName="istio-proxy"
Jul 24 17:53:27.775923 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:27.775907    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jgdcp/must-gather-tz7p2"
Jul 24 17:53:27.777929 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:27.777901    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jgdcp\"/\"openshift-service-ca.crt\""
Jul 24 17:53:27.778045 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:27.777928    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jgdcp\"/\"kube-root-ca.crt\""
Jul 24 17:53:27.778045 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:27.777938    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jgdcp\"/\"default-dockercfg-6zhq5\""
Jul 24 17:53:27.782903 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:27.782642    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jgdcp/must-gather-tz7p2"]
Jul 24 17:53:27.845252 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:27.845225    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skrj2\" (UniqueName: \"kubernetes.io/projected/dc7ef4fb-9609-4c2f-9071-7fce70cae3b5-kube-api-access-skrj2\") pod \"must-gather-tz7p2\" (UID: \"dc7ef4fb-9609-4c2f-9071-7fce70cae3b5\") " pod="openshift-must-gather-jgdcp/must-gather-tz7p2"
Jul 24 17:53:27.845371 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:27.845271    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/dc7ef4fb-9609-4c2f-9071-7fce70cae3b5-must-gather-output\") pod \"must-gather-tz7p2\" (UID: \"dc7ef4fb-9609-4c2f-9071-7fce70cae3b5\") " pod="openshift-must-gather-jgdcp/must-gather-tz7p2"
Jul 24 17:53:27.946340 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:27.946310    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skrj2\" (UniqueName: \"kubernetes.io/projected/dc7ef4fb-9609-4c2f-9071-7fce70cae3b5-kube-api-access-skrj2\") pod \"must-gather-tz7p2\" (UID: \"dc7ef4fb-9609-4c2f-9071-7fce70cae3b5\") " pod="openshift-must-gather-jgdcp/must-gather-tz7p2"
Jul 24 17:53:27.946476 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:27.946356    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/dc7ef4fb-9609-4c2f-9071-7fce70cae3b5-must-gather-output\") pod \"must-gather-tz7p2\" (UID: \"dc7ef4fb-9609-4c2f-9071-7fce70cae3b5\") " pod="openshift-must-gather-jgdcp/must-gather-tz7p2"
Jul 24 17:53:27.946628 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:27.946614    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/dc7ef4fb-9609-4c2f-9071-7fce70cae3b5-must-gather-output\") pod \"must-gather-tz7p2\" (UID: \"dc7ef4fb-9609-4c2f-9071-7fce70cae3b5\") " pod="openshift-must-gather-jgdcp/must-gather-tz7p2"
Jul 24 17:53:27.954497 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:27.954475    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skrj2\" (UniqueName: \"kubernetes.io/projected/dc7ef4fb-9609-4c2f-9071-7fce70cae3b5-kube-api-access-skrj2\") pod \"must-gather-tz7p2\" (UID: \"dc7ef4fb-9609-4c2f-9071-7fce70cae3b5\") " pod="openshift-must-gather-jgdcp/must-gather-tz7p2"
Jul 24 17:53:28.085727 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:28.085657    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jgdcp/must-gather-tz7p2"
Jul 24 17:53:28.213895 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:28.213711    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jgdcp/must-gather-tz7p2"]
Jul 24 17:53:28.216050 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:53:28.216010    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddc7ef4fb_9609_4c2f_9071_7fce70cae3b5.slice/crio-6e21877af70542add14df36562a125635bfa1cb7309552aea3e0378c3b5dacc1 WatchSource:0}: Error finding container 6e21877af70542add14df36562a125635bfa1cb7309552aea3e0378c3b5dacc1: Status 404 returned error can't find the container with id 6e21877af70542add14df36562a125635bfa1cb7309552aea3e0378c3b5dacc1
Jul 24 17:53:28.217849 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:28.217832    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 17:53:28.581490 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:28.581456    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jgdcp/must-gather-tz7p2" event={"ID":"dc7ef4fb-9609-4c2f-9071-7fce70cae3b5","Type":"ContainerStarted","Data":"6e21877af70542add14df36562a125635bfa1cb7309552aea3e0378c3b5dacc1"}
Jul 24 17:53:29.590553 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:29.590518    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jgdcp/must-gather-tz7p2" event={"ID":"dc7ef4fb-9609-4c2f-9071-7fce70cae3b5","Type":"ContainerStarted","Data":"d58b837202d702000a09f4a98c455a5c59d4b70636ca468d4279bc0ad8c1bd93"}
Jul 24 17:53:29.591124 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:29.590567    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jgdcp/must-gather-tz7p2" event={"ID":"dc7ef4fb-9609-4c2f-9071-7fce70cae3b5","Type":"ContainerStarted","Data":"52256d336bc334567c2a07834c3d645bb097e491c2a28b543f20f3414f405a1b"}
Jul 24 17:53:29.609776 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:29.609416    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jgdcp/must-gather-tz7p2" podStartSLOduration=1.782848039 podStartE2EDuration="2.609396725s" totalImagesPullingTime="826.548686ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:53:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:53:29.607176094 +0000 UTC m=+2993.880035873" watchObservedRunningTime="2026-07-24 17:53:29.609396725 +0000 UTC m=+2993.882256507"
Jul 24 17:53:30.543742 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:30.543710    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cb4sr_9dc126a1-da76-4146-95f2-0571132022cc/global-pull-secret-syncer/0.log"
Jul 24 17:53:30.755845 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:30.755814    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zfklt_84981543-70cb-4811-b2fc-ea793ef9e2bc/konnectivity-agent/0.log"
Jul 24 17:53:30.804671 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:30.804586    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-137.ec2.internal_e430400d966265945a7f713410a6d520/haproxy/0.log"
Jul 24 17:53:35.930420 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:35.930386    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-9srb9_17cce661-6425-481c-bec6-aa11fcf5283a/kuadrant-console-plugin/0.log"
Jul 24 17:53:36.480720 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:36.480683    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6h754_860ed1fc-612f-4796-8077-72bc6c5d84db/ovn-acl-logging/0.log"
Jul 24 17:53:36.488784 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:36.488754    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6h754_860ed1fc-612f-4796-8077-72bc6c5d84db/ovn-acl-logging/0.log"
Jul 24 17:53:38.539445 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:38.539411    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5cb8c7df6c-5xvcw_f3a1a2e0-45c5-4e2a-891e-5bfb77e0290c/metrics-server/0.log"
Jul 24 17:53:38.566947 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:38.566914    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-xvwdc_43e861c2-0ff1-44d1-a581-189b08438cfe/monitoring-plugin/0.log"
Jul 24 17:53:38.688979 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:38.688902    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vvs5h_bc9558a6-efd8-46c7-a5e2-807aca327889/node-exporter/0.log"
Jul 24 17:53:38.715376 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:38.715343    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vvs5h_bc9558a6-efd8-46c7-a5e2-807aca327889/kube-rbac-proxy/0.log"
Jul 24 17:53:38.738133 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:38.738054    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vvs5h_bc9558a6-efd8-46c7-a5e2-807aca327889/init-textfile/0.log"
Jul 24 17:53:38.862700 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:38.862670    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-lzn9g_f1703ffc-11b3-4490-b19a-25d45846e879/kube-rbac-proxy-main/0.log"
Jul 24 17:53:38.895982 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:38.895947    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-lzn9g_f1703ffc-11b3-4490-b19a-25d45846e879/kube-rbac-proxy-self/0.log"
Jul 24 17:53:38.918816 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:38.918786    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-lzn9g_f1703ffc-11b3-4490-b19a-25d45846e879/openshift-state-metrics/0.log"
Jul 24 17:53:38.964170 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:38.964095    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_04714f9c-4dd0-48a0-81cc-3e3d42031243/prometheus/0.log"
Jul 24 17:53:38.995100 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:38.995056    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_04714f9c-4dd0-48a0-81cc-3e3d42031243/config-reloader/0.log"
Jul 24 17:53:39.026881 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:39.026846    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_04714f9c-4dd0-48a0-81cc-3e3d42031243/thanos-sidecar/0.log"
Jul 24 17:53:39.059681 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:39.059653    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_04714f9c-4dd0-48a0-81cc-3e3d42031243/kube-rbac-proxy-web/0.log"
Jul 24 17:53:39.090664 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:39.090634    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_04714f9c-4dd0-48a0-81cc-3e3d42031243/kube-rbac-proxy/0.log"
Jul 24 17:53:39.117005 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:39.116978    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_04714f9c-4dd0-48a0-81cc-3e3d42031243/kube-rbac-proxy-thanos/0.log"
Jul 24 17:53:39.147036 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:39.147011    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_04714f9c-4dd0-48a0-81cc-3e3d42031243/init-config-reloader/0.log"
Jul 24 17:53:39.234823 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:39.234753    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-kmsz8_4765bb82-e6fb-44d5-b082-863d36c33ab8/prometheus-operator-admission-webhook/0.log"
Jul 24 17:53:39.267790 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:39.267762    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5555b8589f-77h7b_e919b56f-3fec-452a-b78a-5e8ec355fde2/telemeter-client/0.log"
Jul 24 17:53:39.291937 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:39.291911    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5555b8589f-77h7b_e919b56f-3fec-452a-b78a-5e8ec355fde2/reload/0.log"
Jul 24 17:53:39.314855 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:39.314822    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5555b8589f-77h7b_e919b56f-3fec-452a-b78a-5e8ec355fde2/kube-rbac-proxy/0.log"
Jul 24 17:53:39.351356 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:39.351329    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-65668b444c-5xnm9_5292d7ba-a5f5-4e59-8f81-a53625204204/thanos-query/0.log"
Jul 24 17:53:39.373607 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:39.373579    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-65668b444c-5xnm9_5292d7ba-a5f5-4e59-8f81-a53625204204/kube-rbac-proxy-web/0.log"
Jul 24 17:53:39.397325 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:39.397281    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-65668b444c-5xnm9_5292d7ba-a5f5-4e59-8f81-a53625204204/kube-rbac-proxy/0.log"
Jul 24 17:53:39.420032 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:39.419999    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-65668b444c-5xnm9_5292d7ba-a5f5-4e59-8f81-a53625204204/prom-label-proxy/0.log"
Jul 24 17:53:39.441476 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:39.441449    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-65668b444c-5xnm9_5292d7ba-a5f5-4e59-8f81-a53625204204/kube-rbac-proxy-rules/0.log"
Jul 24 17:53:39.465412 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:39.465383    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-65668b444c-5xnm9_5292d7ba-a5f5-4e59-8f81-a53625204204/kube-rbac-proxy-metrics/0.log"
Jul 24 17:53:40.118529 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:40.118494    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jgdcp/perf-node-gather-daemonset-ps2ck"]
Jul 24 17:53:40.123682 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:40.123653    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jgdcp/perf-node-gather-daemonset-ps2ck"
Jul 24 17:53:40.131374 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:40.131346    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jgdcp/perf-node-gather-daemonset-ps2ck"]
Jul 24 17:53:40.189085 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:40.189012    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/92e451f2-033c-463b-81a9-4cb9e9f2d468-podres\") pod \"perf-node-gather-daemonset-ps2ck\" (UID: \"92e451f2-033c-463b-81a9-4cb9e9f2d468\") " pod="openshift-must-gather-jgdcp/perf-node-gather-daemonset-ps2ck"
Jul 24 17:53:40.189278 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:40.189118    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/92e451f2-033c-463b-81a9-4cb9e9f2d468-proc\") pod \"perf-node-gather-daemonset-ps2ck\" (UID: \"92e451f2-033c-463b-81a9-4cb9e9f2d468\") " pod="openshift-must-gather-jgdcp/perf-node-gather-daemonset-ps2ck"
Jul 24 17:53:40.189278 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:40.189166    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92e451f2-033c-463b-81a9-4cb9e9f2d468-sys\") pod \"perf-node-gather-daemonset-ps2ck\" (UID: \"92e451f2-033c-463b-81a9-4cb9e9f2d468\") " pod="openshift-must-gather-jgdcp/perf-node-gather-daemonset-ps2ck"
Jul 24 17:53:40.189278 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:40.189211    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/92e451f2-033c-463b-81a9-4cb9e9f2d468-lib-modules\") pod \"perf-node-gather-daemonset-ps2ck\" (UID: \"92e451f2-033c-463b-81a9-4cb9e9f2d468\") " pod="openshift-must-gather-jgdcp/perf-node-gather-daemonset-ps2ck"
Jul 24 17:53:40.189463 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:40.189292    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82qs5\" (UniqueName: \"kubernetes.io/projected/92e451f2-033c-463b-81a9-4cb9e9f2d468-kube-api-access-82qs5\") pod \"perf-node-gather-daemonset-ps2ck\" (UID: \"92e451f2-033c-463b-81a9-4cb9e9f2d468\") " pod="openshift-must-gather-jgdcp/perf-node-gather-daemonset-ps2ck"
Jul 24 17:53:40.290709 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:40.290670    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/92e451f2-033c-463b-81a9-4cb9e9f2d468-lib-modules\") pod \"perf-node-gather-daemonset-ps2ck\" (UID: \"92e451f2-033c-463b-81a9-4cb9e9f2d468\") " pod="openshift-must-gather-jgdcp/perf-node-gather-daemonset-ps2ck"
Jul 24 17:53:40.290891 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:40.290820    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82qs5\" (UniqueName: \"kubernetes.io/projected/92e451f2-033c-463b-81a9-4cb9e9f2d468-kube-api-access-82qs5\") pod \"perf-node-gather-daemonset-ps2ck\" (UID: \"92e451f2-033c-463b-81a9-4cb9e9f2d468\") " pod="openshift-must-gather-jgdcp/perf-node-gather-daemonset-ps2ck"
Jul 24 17:53:40.290966 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:40.290898    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/92e451f2-033c-463b-81a9-4cb9e9f2d468-lib-modules\") pod \"perf-node-gather-daemonset-ps2ck\" (UID: \"92e451f2-033c-463b-81a9-4cb9e9f2d468\") " pod="openshift-must-gather-jgdcp/perf-node-gather-daemonset-ps2ck"
Jul 24 17:53:40.290966 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:40.290914    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/92e451f2-033c-463b-81a9-4cb9e9f2d468-podres\") pod \"perf-node-gather-daemonset-ps2ck\" (UID: \"92e451f2-033c-463b-81a9-4cb9e9f2d468\") " pod="openshift-must-gather-jgdcp/perf-node-gather-daemonset-ps2ck"
Jul 24 17:53:40.291110 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:40.290972    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/92e451f2-033c-463b-81a9-4cb9e9f2d468-proc\") pod \"perf-node-gather-daemonset-ps2ck\" (UID: \"92e451f2-033c-463b-81a9-4cb9e9f2d468\") " pod="openshift-must-gather-jgdcp/perf-node-gather-daemonset-ps2ck"
Jul 24 17:53:40.291110 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:40.291010    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92e451f2-033c-463b-81a9-4cb9e9f2d468-sys\") pod \"perf-node-gather-daemonset-ps2ck\" (UID: \"92e451f2-033c-463b-81a9-4cb9e9f2d468\") " pod="openshift-must-gather-jgdcp/perf-node-gather-daemonset-ps2ck"
Jul 24 17:53:40.291110 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:40.291037    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/92e451f2-033c-463b-81a9-4cb9e9f2d468-podres\") pod \"perf-node-gather-daemonset-ps2ck\" (UID: \"92e451f2-033c-463b-81a9-4cb9e9f2d468\") " pod="openshift-must-gather-jgdcp/perf-node-gather-daemonset-ps2ck"
Jul 24 17:53:40.291260 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:40.291119    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/92e451f2-033c-463b-81a9-4cb9e9f2d468-proc\") pod \"perf-node-gather-daemonset-ps2ck\" (UID: \"92e451f2-033c-463b-81a9-4cb9e9f2d468\") " pod="openshift-must-gather-jgdcp/perf-node-gather-daemonset-ps2ck"
Jul 24 17:53:40.291260 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:40.291133    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92e451f2-033c-463b-81a9-4cb9e9f2d468-sys\") pod \"perf-node-gather-daemonset-ps2ck\" (UID: \"92e451f2-033c-463b-81a9-4cb9e9f2d468\") " pod="openshift-must-gather-jgdcp/perf-node-gather-daemonset-ps2ck"
Jul 24 17:53:40.299741 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:40.299711    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82qs5\" (UniqueName: \"kubernetes.io/projected/92e451f2-033c-463b-81a9-4cb9e9f2d468-kube-api-access-82qs5\") pod \"perf-node-gather-daemonset-ps2ck\" (UID: \"92e451f2-033c-463b-81a9-4cb9e9f2d468\") " pod="openshift-must-gather-jgdcp/perf-node-gather-daemonset-ps2ck"
Jul 24 17:53:40.438143 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:40.438112    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jgdcp/perf-node-gather-daemonset-ps2ck"
Jul 24 17:53:40.615084 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:40.614200    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jgdcp/perf-node-gather-daemonset-ps2ck"]
Jul 24 17:53:40.619557 ip-10-0-137-137 kubenswrapper[2561]: W0724 17:53:40.619529    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod92e451f2_033c_463b_81a9_4cb9e9f2d468.slice/crio-48c8119207ad6ede452cd8eff4e2e8d6331b6cdf541afbb5f95b5d5f20a9df1d WatchSource:0}: Error finding container 48c8119207ad6ede452cd8eff4e2e8d6331b6cdf541afbb5f95b5d5f20a9df1d: Status 404 returned error can't find the container with id 48c8119207ad6ede452cd8eff4e2e8d6331b6cdf541afbb5f95b5d5f20a9df1d
Jul 24 17:53:40.695112 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:40.694017    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jgdcp/perf-node-gather-daemonset-ps2ck" event={"ID":"92e451f2-033c-463b-81a9-4cb9e9f2d468","Type":"ContainerStarted","Data":"48c8119207ad6ede452cd8eff4e2e8d6331b6cdf541afbb5f95b5d5f20a9df1d"}
Jul 24 17:53:41.639452 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:41.639406    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-57976c8db5-22j9z_5c75a52a-1152-4d4a-9763-fb258ee18fc6/console/0.log"
Jul 24 17:53:41.708674 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:41.708637    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jgdcp/perf-node-gather-daemonset-ps2ck" event={"ID":"92e451f2-033c-463b-81a9-4cb9e9f2d468","Type":"ContainerStarted","Data":"b1f17620497f67b6c359f50d7e76ecdcd8752300765d56f985f913b597df4cf5"}
Jul 24 17:53:41.709039 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:41.709015    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jgdcp/perf-node-gather-daemonset-ps2ck"
Jul 24 17:53:43.276093 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:43.276043    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mqrd4_f4a7c818-7b8a-4e56-9daf-1bbef23e5556/dns/0.log"
Jul 24 17:53:43.298273 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:43.298244    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mqrd4_f4a7c818-7b8a-4e56-9daf-1bbef23e5556/kube-rbac-proxy/0.log"
Jul 24 17:53:43.396370 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:43.396345    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jvnt9_7127ce91-7986-4e71-9b22-ce42a081f632/dns-node-resolver/0.log"
Jul 24 17:53:44.038677 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:44.038646    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rq942_ce9e534e-4a16-4593-9bbf-689859d14bb0/node-ca/0.log"
Jul 24 17:53:45.244977 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:45.244948    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d6f9cf76-dxns9_19a0a0a6-a5ff-47ba-ab95-f0ecb6297bcd/kube-auth-proxy/0.log"
Jul 24 17:53:45.425077 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:45.425036    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-tcv7b_4ddec504-5e0c-48b7-bdfa-a2f2a6439453/payload-pre-processing/0.log"
Jul 24 17:53:46.364112 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:46.364043    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qm622_347e062f-f8e0-42fa-8cb6-c2f264d2c099/serve-healthcheck-canary/0.log"
Jul 24 17:53:46.962834 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:46.962800    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lrxjp_dd5047c6-18d1-42cd-9b00-0b86a9b075e8/kube-rbac-proxy/0.log"
Jul 24 17:53:46.984409 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:46.984386    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lrxjp_dd5047c6-18d1-42cd-9b00-0b86a9b075e8/exporter/0.log"
Jul 24 17:53:47.007505 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:47.007471    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lrxjp_dd5047c6-18d1-42cd-9b00-0b86a9b075e8/extractor/0.log"
Jul 24 17:53:47.727007 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:47.726972    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jgdcp/perf-node-gather-daemonset-ps2ck"
Jul 24 17:53:47.745348 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:47.745294    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jgdcp/perf-node-gather-daemonset-ps2ck" podStartSLOduration=7.745274113 podStartE2EDuration="7.745274113s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:53:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:53:41.727716435 +0000 UTC m=+3006.000576215" watchObservedRunningTime="2026-07-24 17:53:47.745274113 +0000 UTC m=+3012.018133895"
Jul 24 17:53:49.692053 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:49.691678    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-75f9bdd58d-ls6r2_0d71feeb-49cd-4e8c-a97b-fcb85b82b8b6/manager/0.log"
Jul 24 17:53:49.884097 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:49.884051    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bc8c4649b-k45wz_c2a23b89-a681-4cf6-87f0-d26575452a98/manager/0.log"
Jul 24 17:53:49.914519 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:49.914490    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bc8c4649b-k45wz_c2a23b89-a681-4cf6-87f0-d26575452a98/copy-manifests/0.log"
Jul 24 17:53:51.152270 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:51.152234    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d6f9cf76-dxns9_19a0a0a6-a5ff-47ba-ab95-f0ecb6297bcd/kube-auth-proxy/0.log"
Jul 24 17:53:51.255536 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:51.255503    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-tcv7b_4ddec504-5e0c-48b7-bdfa-a2f2a6439453/payload-pre-processing/0.log"
Jul 24 17:53:51.338142 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:51.338110    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-65bbc66f6-jwp9d_d952e704-9d9d-4bcd-863d-3ea06e0a5726/manager/0.log"
Jul 24 17:53:51.373087 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:51.373040    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-65shk_1268e7be-96da-4645-9832-f86f232f3458/openshift-lws-operator/0.log"
Jul 24 17:53:53.020570 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:53.020542    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d6f9cf76-dxns9_19a0a0a6-a5ff-47ba-ab95-f0ecb6297bcd/kube-auth-proxy/0.log"
Jul 24 17:53:53.130804 ip-10-0-137-137 kubenswrapper[2561]: I0724 17:53:53.130773    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-tcv7b_4ddec504-5e0c-48b7-bdfa-a2f2a6439453/payload-pre-processing/0.log"