Jul 24 19:24:41.534334 ip-10-0-133-84 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 24 19:24:41.534348 ip-10-0-133-84 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 24 19:24:41.534357 ip-10-0-133-84 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 24 19:24:41.534650 ip-10-0-133-84 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 24 19:24:51.783269 ip-10-0-133-84 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 24 19:24:51.783286 ip-10-0-133-84 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 0062f60558324f61a39a1206d2d09ff4 --
Jul 24 19:26:51.364786 ip-10-0-133-84 systemd[1]: Starting Kubernetes Kubelet...
Jul 24 19:26:51.780168 ip-10-0-133-84 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 19:26:51.780168 ip-10-0-133-84 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 24 19:26:51.780168 ip-10-0-133-84 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 19:26:51.780168 ip-10-0-133-84 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 24 19:26:51.780168 ip-10-0-133-84 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 19:26:51.780867 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.780215    2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 24 19:26:51.785609 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785593    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 19:26:51.785609 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785608    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 19:26:51.785680 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785612    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 19:26:51.785680 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785616    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 19:26:51.785680 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785619    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 19:26:51.785680 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785623    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 19:26:51.785680 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785626    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 19:26:51.785680 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785653    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 19:26:51.785680 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785658    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 19:26:51.785680 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785661    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 19:26:51.785680 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785665    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 19:26:51.785680 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785669    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 19:26:51.785680 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785672    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 19:26:51.785680 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785675    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 19:26:51.785680 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785678    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 19:26:51.785680 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785681    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 19:26:51.785680 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785685    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 19:26:51.785680 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785688    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 19:26:51.786065 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785691    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 19:26:51.786065 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785694    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 19:26:51.786065 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785697    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 19:26:51.786065 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785699    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 19:26:51.786065 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785702    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 19:26:51.786065 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785705    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 19:26:51.786065 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785707    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 19:26:51.786065 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785709    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 19:26:51.786065 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785712    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 19:26:51.786065 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785714    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 19:26:51.786065 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785717    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 19:26:51.786065 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785720    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 19:26:51.786065 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785722    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 19:26:51.786065 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785724    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 19:26:51.786065 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785727    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 19:26:51.786065 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785730    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 19:26:51.786065 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785732    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 19:26:51.786065 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785734    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 19:26:51.786065 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785737    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 19:26:51.786065 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785739    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 19:26:51.786563 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785742    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 19:26:51.786563 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785745    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 19:26:51.786563 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785747    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 19:26:51.786563 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785750    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 19:26:51.786563 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785759    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 19:26:51.786563 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785763    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 19:26:51.786563 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785765    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 19:26:51.786563 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785768    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 19:26:51.786563 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785771    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 19:26:51.786563 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785773    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 19:26:51.786563 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785777    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 19:26:51.786563 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785781    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 19:26:51.786563 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785785    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 19:26:51.786563 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785789    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 19:26:51.786563 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785792    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 19:26:51.786563 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785796    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 19:26:51.786563 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785799    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 19:26:51.786563 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785802    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 19:26:51.787085 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785804    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 19:26:51.787085 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785807    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 19:26:51.787085 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785809    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 19:26:51.787085 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785812    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 19:26:51.787085 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785815    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 19:26:51.787085 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785818    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 19:26:51.787085 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785820    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 19:26:51.787085 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785822    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 19:26:51.787085 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785825    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 19:26:51.787085 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785827    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 19:26:51.787085 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785830    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 19:26:51.787085 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785832    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 19:26:51.787085 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785835    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 19:26:51.787085 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785837    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 19:26:51.787085 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785840    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 19:26:51.787085 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785843    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 19:26:51.787085 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785845    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 19:26:51.787085 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785848    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 19:26:51.787085 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785850    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 19:26:51.787085 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785854    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 19:26:51.787598 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785857    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 19:26:51.787598 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785859    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 19:26:51.787598 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785862    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 19:26:51.787598 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785864    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 19:26:51.787598 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785866    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 19:26:51.787598 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785869    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 19:26:51.787598 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785871    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 19:26:51.787598 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785875    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 19:26:51.787598 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785878    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 19:26:51.787598 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785880    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 19:26:51.787598 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785883    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 19:26:51.787598 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785885    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 19:26:51.787598 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785888    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 19:26:51.787598 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785890    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 19:26:51.787598 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785893    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 19:26:51.787598 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785895    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 19:26:51.787598 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785898    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 19:26:51.787598 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785901    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 19:26:51.787598 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785904    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 19:26:51.788059 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785907    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 19:26:51.788059 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785910    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 19:26:51.788059 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785912    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 19:26:51.788059 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.785915    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 19:26:51.788059 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786612    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 19:26:51.788059 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786619    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 19:26:51.788059 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786622    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 19:26:51.788059 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786625    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 19:26:51.788059 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786628    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 19:26:51.788059 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786634    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 19:26:51.788059 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786636    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 19:26:51.788059 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786639    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 19:26:51.788059 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786641    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 19:26:51.788059 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786644    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 19:26:51.788059 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786646    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 19:26:51.788059 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786649    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 19:26:51.788059 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786651    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 19:26:51.788059 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786654    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 19:26:51.788059 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786656    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 19:26:51.788059 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786659    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 19:26:51.788560 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786662    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 19:26:51.788560 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786665    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 19:26:51.788560 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786668    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 19:26:51.788560 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786670    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 19:26:51.788560 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786673    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 19:26:51.788560 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786675    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 19:26:51.788560 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786678    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 19:26:51.788560 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786681    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 19:26:51.788560 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786684    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 19:26:51.788560 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786686    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 19:26:51.788560 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786688    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 19:26:51.788560 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786691    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 19:26:51.788560 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786693    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 19:26:51.788560 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786696    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 19:26:51.788560 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786698    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 19:26:51.788560 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786701    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 19:26:51.788560 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786703    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 19:26:51.788560 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786706    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 19:26:51.788560 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786708    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 19:26:51.788560 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786711    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 19:26:51.789041 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786714    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 19:26:51.789041 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786717    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 19:26:51.789041 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786720    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 19:26:51.789041 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786723    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 19:26:51.789041 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786725    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 19:26:51.789041 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786728    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 19:26:51.789041 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786730    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 19:26:51.789041 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786733    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 19:26:51.789041 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786736    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 19:26:51.789041 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786738    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 19:26:51.789041 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786741    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 19:26:51.789041 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786744    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 19:26:51.789041 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786748    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 19:26:51.789041 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786750    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 19:26:51.789041 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786753    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 19:26:51.789041 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786755    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 19:26:51.789041 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786758    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 19:26:51.789041 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786760    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 19:26:51.789041 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786763    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 19:26:51.789041 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786765    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 19:26:51.789559 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786768    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 19:26:51.789559 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786770    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 19:26:51.789559 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786775    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 19:26:51.789559 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786778    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 19:26:51.789559 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786781    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 19:26:51.789559 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786784    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 19:26:51.789559 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786787    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 19:26:51.789559 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786790    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 19:26:51.789559 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786793    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 19:26:51.789559 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786795    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 19:26:51.789559 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786798    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 19:26:51.789559 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786801    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 19:26:51.789559 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786803    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 19:26:51.789559 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786806    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 19:26:51.789559 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786808    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 19:26:51.789559 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786811    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 19:26:51.789559 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786814    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 19:26:51.789559 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786817    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 19:26:51.789559 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786819    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 19:26:51.790033 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786822    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 19:26:51.790033 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786825    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 19:26:51.790033 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786830    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 19:26:51.790033 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786833    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 19:26:51.790033 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786835    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 19:26:51.790033 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786838    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 19:26:51.790033 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786841    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 19:26:51.790033 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786843    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 19:26:51.790033 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786862    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 19:26:51.790033 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786866    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 19:26:51.790033 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786869    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 19:26:51.790033 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786872    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 19:26:51.790033 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786875    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 19:26:51.790033 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786877    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 19:26:51.790033 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786881    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 19:26:51.790033 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786883    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 19:26:51.790033 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786886    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 19:26:51.790033 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786888    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 19:26:51.790033 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786891    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 19:26:51.790033 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786893    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 19:26:51.790539 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786896    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 19:26:51.790539 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786898    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 19:26:51.790539 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786902    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 19:26:51.790539 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.786906    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 19:26:51.790539 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787270    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 19:26:51.790539 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787275    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 19:26:51.790539 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787278    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 19:26:51.790539 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787281    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 19:26:51.790539 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787284    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 19:26:51.790539 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787286    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 19:26:51.790539 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787289    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 19:26:51.790539 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787292    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 19:26:51.790539 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787295    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 19:26:51.790539 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787298    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 19:26:51.790539 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787300    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 19:26:51.790539 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787303    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 19:26:51.790539 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787306    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 19:26:51.790539 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787308    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 19:26:51.790539 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787311    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 19:26:51.790539 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787313    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 19:26:51.791072 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787316    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 19:26:51.791072 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787319    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 19:26:51.791072 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787321    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 19:26:51.791072 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787324    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 19:26:51.791072 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787326    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 19:26:51.791072 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787328    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 19:26:51.791072 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787331    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 19:26:51.791072 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787334    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 19:26:51.791072 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787336    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 19:26:51.791072 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787339    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 19:26:51.791072 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787342    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 19:26:51.791072 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787344    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 19:26:51.791072 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787347    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 19:26:51.791072 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787351    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 19:26:51.791072 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787354    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 19:26:51.791072 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787357    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 19:26:51.791072 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787360    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 19:26:51.791072 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787363    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 19:26:51.791072 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787366    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 19:26:51.791554 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787369    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 19:26:51.791554 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787372    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 19:26:51.791554 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787375    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 19:26:51.791554 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787377    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 19:26:51.791554 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787380    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 19:26:51.791554 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787383    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 19:26:51.791554 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787386    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 19:26:51.791554 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787389    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 19:26:51.791554 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787391    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 19:26:51.791554 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787394    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 19:26:51.791554 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787397    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 19:26:51.791554 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787401    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 19:26:51.791554 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787404    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 19:26:51.791554 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787407    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 19:26:51.791554 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787411    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 19:26:51.791554 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787414    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 19:26:51.791554 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787416    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 19:26:51.791554 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787419    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 19:26:51.791554 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787422    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 19:26:51.791554 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787426    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 19:26:51.792045 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787429    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 19:26:51.792045 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787432    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 19:26:51.792045 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787435    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 19:26:51.792045 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787438    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 19:26:51.792045 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787441    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 19:26:51.792045 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787443    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 19:26:51.792045 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787446    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 19:26:51.792045 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787449    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 19:26:51.792045 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787452    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 19:26:51.792045 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787455    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 19:26:51.792045 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787457    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 19:26:51.792045 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787459    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 19:26:51.792045 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787462    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 19:26:51.792045 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787464    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 19:26:51.792045 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787467    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 19:26:51.792045 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787469    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 19:26:51.792045 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787472    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 19:26:51.792045 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787474    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 19:26:51.792045 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787477    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 19:26:51.792045 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787496    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 19:26:51.792584 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787499    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 19:26:51.792584 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787502    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 19:26:51.792584 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787504    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 19:26:51.792584 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787507    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 19:26:51.792584 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787509    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 19:26:51.792584 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787512    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 19:26:51.792584 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787515    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 19:26:51.792584 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787517    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 19:26:51.792584 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787519    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 19:26:51.792584 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787522    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 19:26:51.792584 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787524    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 19:26:51.792584 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787527    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 19:26:51.792584 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787530    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 19:26:51.792584 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787532    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 19:26:51.792584 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787534    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 19:26:51.792584 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787537    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 19:26:51.792584 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787540    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 19:26:51.792584 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787542    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 19:26:51.792584 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787544    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 19:26:51.793043 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787548    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 19:26:51.793043 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787550    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 19:26:51.793043 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787553    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 19:26:51.793043 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787555    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 19:26:51.793043 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.787558    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 19:26:51.793043 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787625    2567 flags.go:64] FLAG: --address="0.0.0.0"
Jul 24 19:26:51.793043 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787636    2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 24 19:26:51.793043 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787642    2567 flags.go:64] FLAG: --anonymous-auth="true"
Jul 24 19:26:51.793043 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787647    2567 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 24 19:26:51.793043 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787652    2567 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 24 19:26:51.793043 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787655    2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 24 19:26:51.793043 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787659    2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 24 19:26:51.793043 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787663    2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 24 19:26:51.793043 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787667    2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 24 19:26:51.793043 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787670    2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 24 19:26:51.793043 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787673    2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 24 19:26:51.793043 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787676    2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 24 19:26:51.793043 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787680    2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 24 19:26:51.793043 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787683    2567 flags.go:64] FLAG: --cgroup-root=""
Jul 24 19:26:51.793043 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787686    2567 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 24 19:26:51.793043 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787689    2567 flags.go:64] FLAG: --client-ca-file=""
Jul 24 19:26:51.793043 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787691    2567 flags.go:64] FLAG: --cloud-provider="external"
Jul 24 19:26:51.793043 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787694    2567 flags.go:64] FLAG: --cluster-dns="[]"
Jul 24 19:26:51.793609 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787698    2567 flags.go:64] FLAG: --cluster-domain=""
Jul 24 19:26:51.793609 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787701    2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 24 19:26:51.793609 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787704    2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 24 19:26:51.793609 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787707    2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 24 19:26:51.793609 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787710    2567 flags.go:64] FLAG: --container-log-max-files="5"
Jul 24 19:26:51.793609 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787713    2567 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 24 19:26:51.793609 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787716    2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 24 19:26:51.793609 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787719    2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 24 19:26:51.793609 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787723    2567 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 24 19:26:51.793609 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787728    2567 flags.go:64] FLAG: --contention-profiling="false"
Jul 24 19:26:51.793609 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787731    2567 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 24 19:26:51.793609 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787734    2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 24 19:26:51.793609 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787737    2567 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 24 19:26:51.793609 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787740    2567 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 24 19:26:51.793609 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787745    2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 24 19:26:51.793609 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787748    2567 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 24 19:26:51.793609 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787751    2567 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 24 19:26:51.793609 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787754    2567 flags.go:64] FLAG: --enable-load-reader="false"
Jul 24 19:26:51.793609 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787756    2567 flags.go:64] FLAG: --enable-server="true"
Jul 24 19:26:51.793609 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787760    2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 24 19:26:51.793609 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787765    2567 flags.go:64] FLAG: --event-burst="100"
Jul 24 19:26:51.793609 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787768    2567 flags.go:64] FLAG: --event-qps="50"
Jul 24 19:26:51.793609 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787771    2567 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 24 19:26:51.793609 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787774    2567 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 24 19:26:51.794193 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787776    2567 flags.go:64] FLAG: --eviction-hard=""
Jul 24 19:26:51.794193 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787780    2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 24 19:26:51.794193 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787783    2567 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 24 19:26:51.794193 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787785    2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 24 19:26:51.794193 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787788    2567 flags.go:64] FLAG: --eviction-soft=""
Jul 24 19:26:51.794193 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787791    2567 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 24 19:26:51.794193 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787794    2567 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 24 19:26:51.794193 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787796    2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 24 19:26:51.794193 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787799    2567 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 24 19:26:51.794193 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787802    2567 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 24 19:26:51.794193 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787805    2567 flags.go:64] FLAG: --fail-swap-on="true"
Jul 24 19:26:51.794193 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787807    2567 flags.go:64] FLAG: --feature-gates=""
Jul 24 19:26:51.794193 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787811    2567 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 24 19:26:51.794193 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787814    2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 24 19:26:51.794193 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787817    2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 24 19:26:51.794193 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787820    2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 24 19:26:51.794193 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787823    2567 flags.go:64] FLAG: --healthz-port="10248"
Jul 24 19:26:51.794193 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787828    2567 flags.go:64] FLAG: --help="false"
Jul 24 19:26:51.794193 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787830    2567 flags.go:64] FLAG: --hostname-override="ip-10-0-133-84.ec2.internal"
Jul 24 19:26:51.794193 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787833    2567 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 24 19:26:51.794193 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787836    2567 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 24 19:26:51.794193 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787839    2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 24 19:26:51.794193 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787843    2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 24 19:26:51.794193 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787846    2567 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 24 19:26:51.794861 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787849    2567 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 24 19:26:51.794861 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787852    2567 flags.go:64] FLAG: --image-service-endpoint=""
Jul 24 19:26:51.794861 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787854    2567 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 24 19:26:51.794861 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787857    2567 flags.go:64] FLAG: --kube-api-burst="100"
Jul 24 19:26:51.794861 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787861    2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 24 19:26:51.794861 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787865    2567 flags.go:64] FLAG: --kube-api-qps="50"
Jul 24 19:26:51.794861 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787868    2567 flags.go:64] FLAG: --kube-reserved=""
Jul 24 19:26:51.794861 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787870    2567 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 24 19:26:51.794861 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787873    2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 24 19:26:51.794861 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787876    2567 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 24 19:26:51.794861 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787879    2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 24 19:26:51.794861 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787881    2567 flags.go:64] FLAG: --lock-file=""
Jul 24 19:26:51.794861 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787884    2567 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 24 19:26:51.794861 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787887    2567 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 24 19:26:51.794861 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787890    2567 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 24 19:26:51.794861 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787895    2567 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 24 19:26:51.794861 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787898    2567 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 24 19:26:51.794861 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787901    2567 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 24 19:26:51.794861 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787903    2567 flags.go:64] FLAG: --logging-format="text"
Jul 24 19:26:51.794861 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787906    2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 24 19:26:51.794861 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787909    2567 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 24 19:26:51.794861 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787912    2567 flags.go:64] FLAG: --manifest-url=""
Jul 24 19:26:51.794861 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787915    2567 flags.go:64] FLAG: --manifest-url-header=""
Jul 24 19:26:51.794861 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787919    2567 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 24 19:26:51.794861 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787921    2567 flags.go:64] FLAG: --max-open-files="1000000"
Jul 24 19:26:51.795470 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787926    2567 flags.go:64] FLAG: --max-pods="110"
Jul 24 19:26:51.795470 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787929    2567 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 24 19:26:51.795470 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787932    2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 24 19:26:51.795470 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787935    2567 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 24 19:26:51.795470 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787938    2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 24 19:26:51.795470 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787941    2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 24 19:26:51.795470 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787944    2567 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 24 19:26:51.795470 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787947    2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 24 19:26:51.795470 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787954    2567 flags.go:64] FLAG: --node-status-max-images="50"
Jul 24 19:26:51.795470 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787957    2567 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 24 19:26:51.795470 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787960    2567 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 24 19:26:51.795470 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787963    2567 flags.go:64] FLAG: --pod-cidr=""
Jul 24 19:26:51.795470 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787966    2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 24 19:26:51.795470 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787972    2567 flags.go:64] FLAG: --pod-manifest-path=""
Jul 24 19:26:51.795470 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787974    2567 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 24 19:26:51.795470 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787977    2567 flags.go:64] FLAG: --pods-per-core="0"
Jul 24 19:26:51.795470 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787980    2567 flags.go:64] FLAG: --port="10250"
Jul 24 19:26:51.795470 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787983    2567 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 24 19:26:51.795470 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787986    2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03889aaa5decdd8e1"
Jul 24 19:26:51.795470 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787989    2567 flags.go:64] FLAG: --qos-reserved=""
Jul 24 19:26:51.795470 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787992    2567 flags.go:64] FLAG: --read-only-port="10255"
Jul 24 19:26:51.795470 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787995    2567 flags.go:64] FLAG: --register-node="true"
Jul 24 19:26:51.795470 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.787998    2567 flags.go:64] FLAG: --register-with-taints=""
Jul 24 19:26:51.795470 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.788001    2567 flags.go:64] FLAG: --registry-burst="10"
Jul 24 19:26:51.796107 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.788004    2567 flags.go:64] FLAG: --registry-qps="5"
Jul 24 19:26:51.796107 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.788007    2567 flags.go:64] FLAG: --reserved-cpus=""
Jul 24 19:26:51.796107 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.788010    2567 flags.go:64] FLAG: --reserved-memory=""
Jul 24 19:26:51.796107 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.788013    2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 24 19:26:51.796107 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.788016    2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 24 19:26:51.796107 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.788019    2567 flags.go:64] FLAG: --rotate-certificates="false"
Jul 24 19:26:51.796107 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.788021    2567 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 24 19:26:51.796107 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.788024    2567 flags.go:64] FLAG: --runonce="false"
Jul 24 19:26:51.796107 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.788028    2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 24 19:26:51.796107 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.788031    2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 24 19:26:51.796107 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.788034    2567 flags.go:64] FLAG: --seccomp-default="false"
Jul 24 19:26:51.796107 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.788037    2567 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 24 19:26:51.796107 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.788039    2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 24 19:26:51.796107 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.788042    2567 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 24 19:26:51.796107 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.788045    2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 24 19:26:51.796107 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.788048    2567 flags.go:64] FLAG: --storage-driver-password="root"
Jul 24 19:26:51.796107 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.788051    2567 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 24 19:26:51.796107 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.788054    2567 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 24 19:26:51.796107 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.788056    2567 flags.go:64] FLAG: --storage-driver-user="root"
Jul 24 19:26:51.796107 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.788059    2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 24 19:26:51.796107 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.788062    2567 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 24 19:26:51.796107 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.788065    2567 flags.go:64] FLAG: --system-cgroups=""
Jul 24 19:26:51.796107 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.788068    2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 24 19:26:51.796107 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.788073    2567 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 24 19:26:51.796107 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.788076    2567 flags.go:64] FLAG: --tls-cert-file=""
Jul 24 19:26:51.796731 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.788079    2567 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 24 19:26:51.796731 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.788082    2567 flags.go:64] FLAG: --tls-min-version=""
Jul 24 19:26:51.796731 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.788085    2567 flags.go:64] FLAG: --tls-private-key-file=""
Jul 24 19:26:51.796731 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.788088    2567 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 24 19:26:51.796731 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.788091    2567 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 24 19:26:51.796731 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.788093    2567 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 24 19:26:51.796731 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.788096    2567 flags.go:64] FLAG: --v="2"
Jul 24 19:26:51.796731 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.788100    2567 flags.go:64] FLAG: --version="false"
Jul 24 19:26:51.796731 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.788104    2567 flags.go:64] FLAG: --vmodule=""
Jul 24 19:26:51.796731 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.788107    2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 24 19:26:51.796731 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.788110    2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 24 19:26:51.796731 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788236    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 19:26:51.796731 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788239    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 19:26:51.796731 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788243    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 19:26:51.796731 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788245    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 19:26:51.796731 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788250    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 19:26:51.796731 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788252    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 19:26:51.796731 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788255    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 19:26:51.796731 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788257    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 19:26:51.796731 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788260    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 19:26:51.796731 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788262    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 19:26:51.796731 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788267    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 19:26:51.797265 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788270    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 19:26:51.797265 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788273    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 19:26:51.797265 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788275    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 19:26:51.797265 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788278    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 19:26:51.797265 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788281    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 19:26:51.797265 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788283    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 19:26:51.797265 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788286    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 19:26:51.797265 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788294    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 19:26:51.797265 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788297    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 19:26:51.797265 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788300    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 19:26:51.797265 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788302    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 19:26:51.797265 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788305    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 19:26:51.797265 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788307    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 19:26:51.797265 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788310    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 19:26:51.797265 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788312    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 19:26:51.797265 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788314    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 19:26:51.797265 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788317    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 19:26:51.797265 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788319    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 19:26:51.797265 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788322    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 19:26:51.797265 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788325    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 19:26:51.797780 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788327    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 19:26:51.797780 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788329    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 19:26:51.797780 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788332    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 19:26:51.797780 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788334    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 19:26:51.797780 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788337    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 19:26:51.797780 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788340    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 19:26:51.797780 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788343    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 19:26:51.797780 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788345    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 19:26:51.797780 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788348    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 19:26:51.797780 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788350    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 19:26:51.797780 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788353    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 19:26:51.797780 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788358    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 19:26:51.797780 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788360    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 19:26:51.797780 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788363    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 19:26:51.797780 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788365    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 19:26:51.797780 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788368    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 19:26:51.797780 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788370    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 19:26:51.797780 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788373    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 19:26:51.797780 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788375    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 19:26:51.797780 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788377    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 19:26:51.798345 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788380    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 19:26:51.798345 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788384    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 19:26:51.798345 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788387    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 19:26:51.798345 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788390    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 19:26:51.798345 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788392    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 19:26:51.798345 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788395    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 19:26:51.798345 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788397    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 19:26:51.798345 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788401    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 19:26:51.798345 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788405    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 19:26:51.798345 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788408    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 19:26:51.798345 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788410    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 19:26:51.798345 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788413    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 19:26:51.798345 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788415    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 19:26:51.798345 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788418    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 19:26:51.798345 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788420    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 19:26:51.798345 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788423    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 19:26:51.798345 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788425    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 19:26:51.798345 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788429    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 19:26:51.798345 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788432    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 19:26:51.799104 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788434    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 19:26:51.799104 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788437    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 19:26:51.799104 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788439    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 19:26:51.799104 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788442    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 19:26:51.799104 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788445    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 19:26:51.799104 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788448    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 19:26:51.799104 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788450    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 19:26:51.799104 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788453    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 19:26:51.799104 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788456    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 19:26:51.799104 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788459    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 19:26:51.799104 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788461    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 19:26:51.799104 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788464    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 19:26:51.799104 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788466    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 19:26:51.799104 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788469    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 19:26:51.799104 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788473    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 19:26:51.799104 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788476    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 19:26:51.799104 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788494    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 19:26:51.799104 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788497    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 19:26:51.799104 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788500    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 19:26:51.799663 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788503    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 19:26:51.799663 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788505    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 19:26:51.799663 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788508    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 19:26:51.799663 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788511    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 19:26:51.799663 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788513    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 19:26:51.799663 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788516    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 19:26:51.799663 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788518    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 19:26:51.799663 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788527    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 19:26:51.799663 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788529    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 19:26:51.799663 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.788532    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 19:26:51.799663 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.789567    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 19:26:51.799663 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.796467    2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 24 19:26:51.799663 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.796499    2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 24 19:26:51.799663 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.796514    2567 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 24 19:26:51.799663 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.796521    2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 24 19:26:51.800049 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796577    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 19:26:51.800049 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796583    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 19:26:51.800049 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796586    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 19:26:51.800049 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796589    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 19:26:51.800049 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796592    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 19:26:51.800049 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796595    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 19:26:51.800049 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796598    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 19:26:51.800049 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796601    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 19:26:51.800049 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796604    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 19:26:51.800049 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796606    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 19:26:51.800049 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796609    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 19:26:51.800049 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796611    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 19:26:51.800049 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796614    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 19:26:51.800049 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796617    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 19:26:51.800049 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796619    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 19:26:51.800049 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796622    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 19:26:51.800049 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796624    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 19:26:51.800049 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796627    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 19:26:51.800049 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796630    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 19:26:51.800049 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796632    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 19:26:51.800544 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796635    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 19:26:51.800544 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796637    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 19:26:51.800544 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796640    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 19:26:51.800544 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796642    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 19:26:51.800544 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796645    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 19:26:51.800544 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796648    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 19:26:51.800544 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796650    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 19:26:51.800544 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796653    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 19:26:51.800544 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796655    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 19:26:51.800544 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796659    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 19:26:51.800544 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796662    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 19:26:51.800544 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796664    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 19:26:51.800544 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796667    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 19:26:51.800544 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796669    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 19:26:51.800544 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796673    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 19:26:51.800544 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796676    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 19:26:51.800544 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796679    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 19:26:51.800544 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796682    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 19:26:51.800544 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796684    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 19:26:51.800544 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796687    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 19:26:51.801118 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796690    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 19:26:51.801118 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796692    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 19:26:51.801118 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796694    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 19:26:51.801118 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796697    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 19:26:51.801118 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796699    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 19:26:51.801118 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796702    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 19:26:51.801118 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796704    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 19:26:51.801118 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796707    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 19:26:51.801118 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796709    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 19:26:51.801118 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796712    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 19:26:51.801118 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796714    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 19:26:51.801118 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796717    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 19:26:51.801118 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796720    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 19:26:51.801118 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796722    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 19:26:51.801118 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796725    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 19:26:51.801118 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796727    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 19:26:51.801118 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796730    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 19:26:51.801118 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796732    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 19:26:51.801118 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796735    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 19:26:51.801118 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796738    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 19:26:51.801638 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796740    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 19:26:51.801638 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796744    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 19:26:51.801638 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796748    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 19:26:51.801638 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796751    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 19:26:51.801638 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796753    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 19:26:51.801638 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796756    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 19:26:51.801638 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796758    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 19:26:51.801638 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796761    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 19:26:51.801638 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796763    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 19:26:51.801638 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796766    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 19:26:51.801638 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796768    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 19:26:51.801638 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796771    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 19:26:51.801638 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796774    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 19:26:51.801638 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796776    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 19:26:51.801638 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796779    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 19:26:51.801638 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796781    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 19:26:51.801638 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796784    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 19:26:51.801638 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796786    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 19:26:51.801638 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796789    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 19:26:51.801638 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796792    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 19:26:51.802115 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796794    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 19:26:51.802115 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796797    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 19:26:51.802115 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796800    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 19:26:51.802115 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796802    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 19:26:51.802115 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796806    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 19:26:51.802115 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796809    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 19:26:51.802115 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796811    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 19:26:51.802115 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796814    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 19:26:51.802115 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796816    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 19:26:51.802115 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796819    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 19:26:51.802115 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796823    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 19:26:51.802115 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796827    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 19:26:51.802115 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796831    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 19:26:51.802115 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796835    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 19:26:51.802115 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796838    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 19:26:51.802115 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796841    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 19:26:51.802115 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796844    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 19:26:51.802115 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796847    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 19:26:51.802115 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796850    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 19:26:51.802696 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.796855    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 19:26:51.802696 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796985    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 19:26:51.802696 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796991    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 19:26:51.802696 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796994    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 19:26:51.802696 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.796997    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 19:26:51.802696 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797000    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 19:26:51.802696 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797003    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 19:26:51.802696 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797005    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 19:26:51.802696 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797008    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 19:26:51.802696 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797011    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 19:26:51.802696 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797015    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 19:26:51.802696 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797019    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 19:26:51.802696 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797023    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 19:26:51.802696 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797026    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 19:26:51.802696 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797028    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 19:26:51.803070 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797031    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 19:26:51.803070 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797034    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 19:26:51.803070 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797037    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 19:26:51.803070 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797040    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 19:26:51.803070 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797043    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 19:26:51.803070 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797045    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 19:26:51.803070 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797048    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 19:26:51.803070 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797050    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 19:26:51.803070 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797053    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 19:26:51.803070 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797055    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 19:26:51.803070 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797058    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 19:26:51.803070 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797061    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 19:26:51.803070 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797064    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 19:26:51.803070 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797067    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 19:26:51.803070 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797070    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 19:26:51.803070 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797073    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 19:26:51.803070 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797075    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 19:26:51.803070 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797078    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 19:26:51.803070 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797080    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 19:26:51.803070 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797082    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 19:26:51.803567 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797085    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 19:26:51.803567 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797087    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 19:26:51.803567 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797090    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 19:26:51.803567 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797092    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 19:26:51.803567 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797095    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 19:26:51.803567 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797097    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 19:26:51.803567 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797100    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 19:26:51.803567 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797102    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 19:26:51.803567 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797104    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 19:26:51.803567 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797107    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 19:26:51.803567 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797109    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 19:26:51.803567 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797112    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 19:26:51.803567 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797114    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 19:26:51.803567 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797116    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 19:26:51.803567 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797119    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 19:26:51.803567 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797123    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 19:26:51.803567 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797126    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 19:26:51.803567 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797129    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 19:26:51.803567 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797132    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 19:26:51.803567 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797134    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 19:26:51.804063 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797137    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 19:26:51.804063 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797140    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 19:26:51.804063 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797142    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 19:26:51.804063 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797145    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 19:26:51.804063 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797148    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 19:26:51.804063 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797150    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 19:26:51.804063 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797153    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 19:26:51.804063 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797156    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 19:26:51.804063 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797158    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 19:26:51.804063 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797161    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 19:26:51.804063 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797163    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 19:26:51.804063 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797166    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 19:26:51.804063 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797168    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 19:26:51.804063 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797172    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 19:26:51.804063 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797175    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 19:26:51.804063 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797178    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 19:26:51.804063 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797181    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 19:26:51.804063 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797184    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 19:26:51.804063 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797186    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 19:26:51.804542 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797189    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 19:26:51.804542 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797191    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 19:26:51.804542 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797194    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 19:26:51.804542 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797196    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 19:26:51.804542 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797199    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 19:26:51.804542 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797201    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 19:26:51.804542 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797204    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 19:26:51.804542 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797206    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 19:26:51.804542 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797208    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 19:26:51.804542 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797211    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 19:26:51.804542 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797213    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 19:26:51.804542 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797216    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 19:26:51.804542 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797218    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 19:26:51.804542 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797221    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 19:26:51.804542 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797223    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 19:26:51.804542 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797226    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 19:26:51.804542 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797228    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 19:26:51.804542 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797231    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 19:26:51.804542 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797234    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 19:26:51.804542 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797236    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 19:26:51.805025 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797239    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 19:26:51.805025 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797242    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 19:26:51.805025 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797244    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 19:26:51.805025 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797247    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 19:26:51.805025 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797249    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 19:26:51.805025 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:51.797251    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 19:26:51.805025 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.797256    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 19:26:51.805025 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.797357    2567 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 24 19:26:51.805025 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.803579    2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 24 19:26:51.805284 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.805111    2567 server.go:1019] "Starting client certificate rotation"
Jul 24 19:26:51.805284 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.805211    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 19:26:51.805284 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.805243    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 19:26:51.807872 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.807859    2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 19:26:51.809388 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.809369    2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 19:26:51.820224 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.820208    2567 log.go:25] "Validated CRI v1 runtime API"
Jul 24 19:26:51.822361 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.822347    2567 log.go:25] "Validated CRI v1 image API"
Jul 24 19:26:51.825424 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.825404    2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 24 19:26:51.827907 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.827889    2567 fs.go:135] Filesystem UUIDs: map[4a2d2edd-066a-41c8-ad2a-cd8f674ad74b:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 da138734-257f-4f40-bf26-3f02337a698b:/dev/nvme0n1p4]
Jul 24 19:26:51.827961 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.827908    2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 24 19:26:51.832775 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.832759    2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 19:26:51.834190 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.834078    2567 manager.go:216] Machine: {Timestamp:2026-07-24 19:26:51.832623721 +0000 UTC m=+0.351243753 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3069493 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2925bb5a41aa6015bef6e952f8a9c2 SystemUUID:ec2925bb-5a41-aa60-15be-f6e952f8a9c2 BootID:0062f605-5832-4f61-a39a-1206d2d09ff4 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:39:84:b5:6a:5d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:39:84:b5:6a:5d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fe:32:ce:09:ec:bc Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 24 19:26:51.834190 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.834188    2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 24 19:26:51.834289 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.834270    2567 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 24 19:26:51.837089 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.837066    2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 24 19:26:51.837219 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.837092    2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-84.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 24 19:26:51.837818 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.837808    2567 topology_manager.go:138] "Creating topology manager with none policy"
Jul 24 19:26:51.837857 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.837821    2567 container_manager_linux.go:309] "Creating device plugin manager"
Jul 24 19:26:51.837857 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.837829    2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 19:26:51.838593 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.838582    2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 19:26:51.839821 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.839811    2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 24 19:26:51.842794 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.842783    2567 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 19:26:51.842902 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.842893    2567 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 24 19:26:51.842948 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.842923    2567 kubelet.go:486] "Attempting to sync node with API server"
Jul 24 19:26:51.842948 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.842933    2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 24 19:26:51.842948 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.842945    2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 24 19:26:51.843056 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.842957    2567 kubelet.go:398] "Adding apiserver pod source"
Jul 24 19:26:51.843056 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.842965    2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 24 19:26:51.843330 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.843318    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 19:26:51.843366 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.843338    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 19:26:51.846273 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.846249    2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 24 19:26:51.847976 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.847958    2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 24 19:26:51.848042 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.848005    2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 24 19:26:51.848732 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.848721    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 24 19:26:51.848780 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.848738    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 24 19:26:51.848780 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.848744    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 24 19:26:51.848780 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.848751    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 24 19:26:51.848780 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.848759    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 24 19:26:51.848780 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.848765    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 24 19:26:51.848947 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.848938    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 24 19:26:51.848977 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.848948    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 24 19:26:51.848977 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.848956    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 24 19:26:51.848977 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.848961    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 24 19:26:51.848977 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.848970    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 24 19:26:51.848977 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.848978    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 24 19:26:51.849747 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.849735    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 24 19:26:51.849747 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.849745    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 24 19:26:51.853111 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.853096    2567 server.go:1268] "Started kubelet"
Jul 24 19:26:51.853199 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.853174    2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 24 19:26:51.853199 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.853190    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4nk8z"
Jul 24 19:26:51.853310 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.853189    2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 24 19:26:51.853310 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.853253    2567 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 24 19:26:51.853864 ip-10-0-133-84 systemd[1]: Started Kubernetes Kubelet.
Jul 24 19:26:51.854754 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.854665    2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-84.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 19:26:51.854834 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:51.854794    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-84.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 24 19:26:51.854914 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:51.854894    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 24 19:26:51.854974 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.854959    2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 24 19:26:51.855763 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.855747    2567 server.go:310] "Adding debug handlers to kubelet server"
Jul 24 19:26:51.858723 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:51.858703    2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 24 19:26:51.858783 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:51.857764    2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-84.ec2.internal.18c55062a08f6014  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-84.ec2.internal,UID:ip-10-0-133-84.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-84.ec2.internal,},FirstTimestamp:2026-07-24 19:26:51.853037588 +0000 UTC m=+0.371657620,LastTimestamp:2026-07-24 19:26:51.853037588 +0000 UTC m=+0.371657620,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-84.ec2.internal,}"
Jul 24 19:26:51.859406 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.859392    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4nk8z"
Jul 24 19:26:51.863713 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.863688    2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 24 19:26:51.863713 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.863703    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 24 19:26:51.863893 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:51.863876    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-84.ec2.internal\" not found"
Jul 24 19:26:51.864287 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.864270    2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 24 19:26:51.864287 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.864277    2567 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 24 19:26:51.864408 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.864297    2567 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 24 19:26:51.864408 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.864397    2567 reconstruct.go:97] "Volume reconstruction finished"
Jul 24 19:26:51.864408 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.864406    2567 reconciler.go:29] "Reconciler: start to sync state"
Jul 24 19:26:51.864758 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.864740    2567 factory.go:55] Registering systemd factory
Jul 24 19:26:51.864758 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.864756    2567 factory.go:223] Registration of the systemd container factory successfully
Jul 24 19:26:51.864964 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.864950    2567 factory.go:153] Registering CRI-O factory
Jul 24 19:26:51.865037 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.864968    2567 factory.go:223] Registration of the crio container factory successfully
Jul 24 19:26:51.865037 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.865013    2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 24 19:26:51.865037 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.865034    2567 factory.go:103] Registering Raw factory
Jul 24 19:26:51.865173 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.865049    2567 manager.go:1196] Started watching for new ooms in manager
Jul 24 19:26:51.865534 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.865513    2567 manager.go:349] Starting recovery of all containers
Jul 24 19:26:51.875091 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.875065    2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 19:26:51.877021 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.876996    2567 manager.go:354] Recovery completed
Jul 24 19:26:51.878205 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:51.878179    2567 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-133-84.ec2.internal\" not found" node="ip-10-0-133-84.ec2.internal"
Jul 24 19:26:51.882638 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.882623    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 19:26:51.884635 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.884617    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-84.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 19:26:51.884724 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.884653    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-84.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 19:26:51.884724 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.884668    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-84.ec2.internal" event="NodeHasSufficientPID"
Jul 24 19:26:51.885235 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.885216    2567 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 24 19:26:51.885235 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.885228    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 19:26:51.885235 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.885230    2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 24 19:26:51.885384 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.885247    2567 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 19:26:51.885889 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.885873    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-84.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 19:26:51.885955 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.885906    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-84.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 19:26:51.885955 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.885921    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-84.ec2.internal" event="NodeHasSufficientPID"
Jul 24 19:26:51.886413 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.886400    2567 policy_none.go:49] "None policy: Start"
Jul 24 19:26:51.886452 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.886415    2567 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 24 19:26:51.886452 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.886425    2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 24 19:26:51.887743 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.887733    2567 policy_none.go:47] "Start"
Jul 24 19:26:51.926278 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.926103    2567 manager.go:337] "Starting Device Plugin manager"
Jul 24 19:26:51.926365 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:51.926304    2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 24 19:26:51.926365 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.926317    2567 server.go:87] "Starting device plugin registration server"
Jul 24 19:26:51.926595 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.926584    2567 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 24 19:26:51.926628 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.926598    2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 24 19:26:51.926723 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.926704    2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 24 19:26:51.926804 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.926792    2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 24 19:26:51.926853 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:51.926805    2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 24 19:26:51.927321 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:51.927300    2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 24 19:26:51.927392 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:51.927350    2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-84.ec2.internal\" not found"
Jul 24 19:26:52.027727 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.027697    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 19:26:52.028907 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.028640    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-84.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 19:26:52.028907 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.028668    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-84.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 19:26:52.028907 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.028680    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-84.ec2.internal" event="NodeHasSufficientPID"
Jul 24 19:26:52.028907 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.028706    2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-84.ec2.internal"
Jul 24 19:26:52.037009 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.036957    2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-84.ec2.internal"
Jul 24 19:26:52.037009 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:52.036983    2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-84.ec2.internal\": node \"ip-10-0-133-84.ec2.internal\" not found"
Jul 24 19:26:52.054029 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:52.054001    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-84.ec2.internal\" not found"
Jul 24 19:26:52.063769 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.063734    2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 24 19:26:52.065029 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.065011    2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 24 19:26:52.065095 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.065045    2567 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 24 19:26:52.065095 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.065067    2567 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 24 19:26:52.065184 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:52.065099    2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 24 19:26:52.067305 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.067289    2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 19:26:52.154278 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:52.154243    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-84.ec2.internal\" not found"
Jul 24 19:26:52.165538 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.165504    2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-84.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-84.ec2.internal"]
Jul 24 19:26:52.165659 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.165575    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 19:26:52.166553 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.166536    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-84.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 19:26:52.166623 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.166568    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-84.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 19:26:52.166623 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.166583    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-84.ec2.internal" event="NodeHasSufficientPID"
Jul 24 19:26:52.167848 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.167836    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 19:26:52.167980 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.167964    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-84.ec2.internal"
Jul 24 19:26:52.168019 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.167996    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 19:26:52.168701 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.168684    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-84.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 19:26:52.168795 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.168691    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-84.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 19:26:52.168795 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.168718    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-84.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 19:26:52.168795 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.168730    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-84.ec2.internal" event="NodeHasSufficientPID"
Jul 24 19:26:52.168795 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.168740    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-84.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 19:26:52.168795 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.168756    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-84.ec2.internal" event="NodeHasSufficientPID"
Jul 24 19:26:52.170010 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.169993    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-84.ec2.internal"
Jul 24 19:26:52.170090 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.170024    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 19:26:52.170724 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.170710    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-84.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 19:26:52.170803 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.170737    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-84.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 19:26:52.170803 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.170751    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-84.ec2.internal" event="NodeHasSufficientPID"
Jul 24 19:26:52.198134 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:52.198115    2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-84.ec2.internal\" not found" node="ip-10-0-133-84.ec2.internal"
Jul 24 19:26:52.202544 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:52.202527    2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-84.ec2.internal\" not found" node="ip-10-0-133-84.ec2.internal"
Jul 24 19:26:52.254765 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:52.254741    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-84.ec2.internal\" not found"
Jul 24 19:26:52.266175 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.266154    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8560c43657f7ea2f80765f41474cfd07-config\") pod \"kube-apiserver-proxy-ip-10-0-133-84.ec2.internal\" (UID: \"8560c43657f7ea2f80765f41474cfd07\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-84.ec2.internal"
Jul 24 19:26:52.266225 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.266182    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6fe5cd5134e56726bcd7ca2df5720e0f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-84.ec2.internal\" (UID: \"6fe5cd5134e56726bcd7ca2df5720e0f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-84.ec2.internal"
Jul 24 19:26:52.266225 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.266201    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6fe5cd5134e56726bcd7ca2df5720e0f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-84.ec2.internal\" (UID: \"6fe5cd5134e56726bcd7ca2df5720e0f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-84.ec2.internal"
Jul 24 19:26:52.355610 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:52.355538    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-84.ec2.internal\" not found"
Jul 24 19:26:52.366925 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.366903    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8560c43657f7ea2f80765f41474cfd07-config\") pod \"kube-apiserver-proxy-ip-10-0-133-84.ec2.internal\" (UID: \"8560c43657f7ea2f80765f41474cfd07\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-84.ec2.internal"
Jul 24 19:26:52.366980 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.366870    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8560c43657f7ea2f80765f41474cfd07-config\") pod \"kube-apiserver-proxy-ip-10-0-133-84.ec2.internal\" (UID: \"8560c43657f7ea2f80765f41474cfd07\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-84.ec2.internal"
Jul 24 19:26:52.366980 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.366972    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6fe5cd5134e56726bcd7ca2df5720e0f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-84.ec2.internal\" (UID: \"6fe5cd5134e56726bcd7ca2df5720e0f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-84.ec2.internal"
Jul 24 19:26:52.367040 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.366991    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6fe5cd5134e56726bcd7ca2df5720e0f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-84.ec2.internal\" (UID: \"6fe5cd5134e56726bcd7ca2df5720e0f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-84.ec2.internal"
Jul 24 19:26:52.367040 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.367016    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6fe5cd5134e56726bcd7ca2df5720e0f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-84.ec2.internal\" (UID: \"6fe5cd5134e56726bcd7ca2df5720e0f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-84.ec2.internal"
Jul 24 19:26:52.367098 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.367047    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6fe5cd5134e56726bcd7ca2df5720e0f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-84.ec2.internal\" (UID: \"6fe5cd5134e56726bcd7ca2df5720e0f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-84.ec2.internal"
Jul 24 19:26:52.456075 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:52.456034    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-84.ec2.internal\" not found"
Jul 24 19:26:52.500585 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.500564    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-84.ec2.internal"
Jul 24 19:26:52.506173 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.506154    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-84.ec2.internal"
Jul 24 19:26:52.556553 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:52.556521    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-84.ec2.internal\" not found"
Jul 24 19:26:52.657064 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:52.656989    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-84.ec2.internal\" not found"
Jul 24 19:26:52.758555 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:52.758518    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-84.ec2.internal\" not found"
Jul 24 19:26:52.806415 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.806390    2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 24 19:26:52.806838 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.806559    2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 24 19:26:52.806838 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.806559    2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 24 19:26:52.858728 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:52.858697    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-84.ec2.internal\" not found"
Jul 24 19:26:52.865227 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.865192    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 19:21:52 +0000 UTC" deadline="2028-01-03 16:11:13.610368216 +0000 UTC"
Jul 24 19:26:52.865284 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.865228    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12668h44m20.745143547s"
Jul 24 19:26:52.931043 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.931022    2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 19:26:52.965174 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.965127    2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-84.ec2.internal"
Jul 24 19:26:52.976821 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.976793    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 19:26:52.978928 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.978910    2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-84.ec2.internal"
Jul 24 19:26:52.992194 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:52.992177    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 19:26:53.019847 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:53.019819    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fe5cd5134e56726bcd7ca2df5720e0f.slice/crio-71c0a98ef2f00b3d3cd2591b507b3257eb23213c92ae4d9caac607fa91e72d9c WatchSource:0}: Error finding container 71c0a98ef2f00b3d3cd2591b507b3257eb23213c92ae4d9caac607fa91e72d9c: Status 404 returned error can't find the container with id 71c0a98ef2f00b3d3cd2591b507b3257eb23213c92ae4d9caac607fa91e72d9c
Jul 24 19:26:53.020417 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:53.020387    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8560c43657f7ea2f80765f41474cfd07.slice/crio-667e336495769967c555433d9701a5b4488c809fb6f9c58d80d343bf901b4f64 WatchSource:0}: Error finding container 667e336495769967c555433d9701a5b4488c809fb6f9c58d80d343bf901b4f64: Status 404 returned error can't find the container with id 667e336495769967c555433d9701a5b4488c809fb6f9c58d80d343bf901b4f64
Jul 24 19:26:53.025401 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.025387    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 19:26:53.064065 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.064045    2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 19:26:53.068374 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.068335    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-84.ec2.internal" event={"ID":"6fe5cd5134e56726bcd7ca2df5720e0f","Type":"ContainerStarted","Data":"71c0a98ef2f00b3d3cd2591b507b3257eb23213c92ae4d9caac607fa91e72d9c"}
Jul 24 19:26:53.069441 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.069405    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-84.ec2.internal" event={"ID":"8560c43657f7ea2f80765f41474cfd07","Type":"ContainerStarted","Data":"667e336495769967c555433d9701a5b4488c809fb6f9c58d80d343bf901b4f64"}
Jul 24 19:26:53.844392 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.844356    2567 apiserver.go:52] "Watching apiserver"
Jul 24 19:26:53.861757 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.861718    2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 24 19:26:53.863920 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.863889    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9f2q","openshift-dns/node-resolver-swjv4","openshift-image-registry/node-ca-2586j","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-84.ec2.internal","openshift-multus/multus-additional-cni-plugins-wvbtg","openshift-network-diagnostics/network-check-target-tv7vs","openshift-network-operator/iptables-alerter-qqf8p","kube-system/konnectivity-agent-v2l9c","kube-system/kube-apiserver-proxy-ip-10-0-133-84.ec2.internal","openshift-cluster-node-tuning-operator/tuned-bzptt","openshift-multus/multus-77d9q","openshift-multus/network-metrics-daemon-nqt4p","openshift-ovn-kubernetes/ovnkube-node-d87bq","kube-system/global-pull-secret-syncer-gvbbc"]
Jul 24 19:26:53.865185 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.864407    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 24 19:26:53.865580 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.865536    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bzptt"
Jul 24 19:26:53.868082 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.866929    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:53.868225 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.868202    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2586j"
Jul 24 19:26:53.869054 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.869032    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 24 19:26:53.869154 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.869084    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 24 19:26:53.869230 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.869039    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lfk6v\""
Jul 24 19:26:53.869457 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.869436    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 24 19:26:53.869670 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.869647    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gvbbc"
Jul 24 19:26:53.869786 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:53.869725    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gvbbc" podUID="94868cfc-85a8-4310-a339-2c4b44da043b"
Jul 24 19:26:53.870067 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.870040    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 24 19:26:53.870367 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.870350    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 24 19:26:53.870765 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.870746    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4z9h8\""
Jul 24 19:26:53.871325 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.871308    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wvbtg"
Jul 24 19:26:53.872808 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.872787    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 24 19:26:53.873059 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.873040    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 24 19:26:53.873294 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.873274    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 24 19:26:53.873367 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.873353    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 24 19:26:53.875132 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.873506    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 24 19:26:53.875132 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.873611    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9rp86\""
Jul 24 19:26:53.875132 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.873723    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 24 19:26:53.875132 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.873920    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 24 19:26:53.875132 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.874109    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tv7vs"
Jul 24 19:26:53.875132 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:53.874186    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tv7vs" podUID="9e802511-bdaa-463d-9572-22349bfbcd49"
Jul 24 19:26:53.875132 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.874243    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-v2l9c"
Jul 24 19:26:53.875132 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.874246    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 24 19:26:53.875132 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.874596    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 24 19:26:53.875132 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.874806    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 24 19:26:53.875132 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.874812    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 24 19:26:53.875132 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.875066    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-sv8pt\""
Jul 24 19:26:53.875967 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.875563    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qqf8p"
Jul 24 19:26:53.876646 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.876539    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 24 19:26:53.876908 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.876884    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 24 19:26:53.877147 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.877124    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wm7w2\""
Jul 24 19:26:53.877229 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.877191    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8d148fa4-bff9-4286-a162-a0d07bb9c2a9-etc-modprobe-d\") pod \"tuned-bzptt\" (UID: \"8d148fa4-bff9-4286-a162-a0d07bb9c2a9\") " pod="openshift-cluster-node-tuning-operator/tuned-bzptt"
Jul 24 19:26:53.877229 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.877225    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8d148fa4-bff9-4286-a162-a0d07bb9c2a9-etc-sysctl-d\") pod \"tuned-bzptt\" (UID: \"8d148fa4-bff9-4286-a162-a0d07bb9c2a9\") " pod="openshift-cluster-node-tuning-operator/tuned-bzptt"
Jul 24 19:26:53.877341 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.877251    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8d148fa4-bff9-4286-a162-a0d07bb9c2a9-etc-sysctl-conf\") pod \"tuned-bzptt\" (UID: \"8d148fa4-bff9-4286-a162-a0d07bb9c2a9\") " pod="openshift-cluster-node-tuning-operator/tuned-bzptt"
Jul 24 19:26:53.877341 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.877293    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d148fa4-bff9-4286-a162-a0d07bb9c2a9-var-lib-kubelet\") pod \"tuned-bzptt\" (UID: \"8d148fa4-bff9-4286-a162-a0d07bb9c2a9\") " pod="openshift-cluster-node-tuning-operator/tuned-bzptt"
Jul 24 19:26:53.877341 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.877320    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8d148fa4-bff9-4286-a162-a0d07bb9c2a9-etc-sysconfig\") pod \"tuned-bzptt\" (UID: \"8d148fa4-bff9-4286-a162-a0d07bb9c2a9\") " pod="openshift-cluster-node-tuning-operator/tuned-bzptt"
Jul 24 19:26:53.877341 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.877340    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d148fa4-bff9-4286-a162-a0d07bb9c2a9-etc-kubernetes\") pod \"tuned-bzptt\" (UID: \"8d148fa4-bff9-4286-a162-a0d07bb9c2a9\") " pod="openshift-cluster-node-tuning-operator/tuned-bzptt"
Jul 24 19:26:53.877574 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.877359    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8d148fa4-bff9-4286-a162-a0d07bb9c2a9-etc-systemd\") pod \"tuned-bzptt\" (UID: \"8d148fa4-bff9-4286-a162-a0d07bb9c2a9\") " pod="openshift-cluster-node-tuning-operator/tuned-bzptt"
Jul 24 19:26:53.877574 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.877383    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8d148fa4-bff9-4286-a162-a0d07bb9c2a9-host\") pod \"tuned-bzptt\" (UID: \"8d148fa4-bff9-4286-a162-a0d07bb9c2a9\") " pod="openshift-cluster-node-tuning-operator/tuned-bzptt"
Jul 24 19:26:53.877574 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.877407    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8d148fa4-bff9-4286-a162-a0d07bb9c2a9-etc-tuned\") pod \"tuned-bzptt\" (UID: \"8d148fa4-bff9-4286-a162-a0d07bb9c2a9\") " pod="openshift-cluster-node-tuning-operator/tuned-bzptt"
Jul 24 19:26:53.877574 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.877431    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d148fa4-bff9-4286-a162-a0d07bb9c2a9-tmp\") pod \"tuned-bzptt\" (UID: \"8d148fa4-bff9-4286-a162-a0d07bb9c2a9\") " pod="openshift-cluster-node-tuning-operator/tuned-bzptt"
Jul 24 19:26:53.877574 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.877524    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8d148fa4-bff9-4286-a162-a0d07bb9c2a9-run\") pod \"tuned-bzptt\" (UID: \"8d148fa4-bff9-4286-a162-a0d07bb9c2a9\") " pod="openshift-cluster-node-tuning-operator/tuned-bzptt"
Jul 24 19:26:53.877881 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.877554    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8d148fa4-bff9-4286-a162-a0d07bb9c2a9-sys\") pod \"tuned-bzptt\" (UID: \"8d148fa4-bff9-4286-a162-a0d07bb9c2a9\") " pod="openshift-cluster-node-tuning-operator/tuned-bzptt"
Jul 24 19:26:53.877881 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.877689    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8d148fa4-bff9-4286-a162-a0d07bb9c2a9-lib-modules\") pod \"tuned-bzptt\" (UID: \"8d148fa4-bff9-4286-a162-a0d07bb9c2a9\") " pod="openshift-cluster-node-tuning-operator/tuned-bzptt"
Jul 24 19:26:53.877881 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.877708    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7x2vz\" (UniqueName: \"kubernetes.io/projected/8d148fa4-bff9-4286-a162-a0d07bb9c2a9-kube-api-access-7x2vz\") pod \"tuned-bzptt\" (UID: \"8d148fa4-bff9-4286-a162-a0d07bb9c2a9\") " pod="openshift-cluster-node-tuning-operator/tuned-bzptt"
Jul 24 19:26:53.878023 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.878003    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jjdz6\""
Jul 24 19:26:53.878235 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.878218    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 24 19:26:53.878310 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.878230    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 24 19:26:53.878559 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.878537    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-swjv4"
Jul 24 19:26:53.879298 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.879278    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 24 19:26:53.879422 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.879301    2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 19:26:53.881989 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.881389    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 24 19:26:53.881989 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.881394    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9wfvq\""
Jul 24 19:26:53.881989 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.881473    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 24 19:26:53.881989 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.881668    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9f2q"
Jul 24 19:26:53.884324 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.883229    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-77d9q"
Jul 24 19:26:53.884324 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.884046    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 24 19:26:53.884324 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.884106    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-l4bwj\""
Jul 24 19:26:53.884496 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.884372    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 24 19:26:53.884496 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.884379    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 24 19:26:53.885435 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.885416    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nqt4p"
Jul 24 19:26:53.885587 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:53.885555    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nqt4p" podUID="5b53e2ac-1a53-4df0-a395-2718093476b6"
Jul 24 19:26:53.885865 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.885844    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 24 19:26:53.886707 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.886675    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6k9tg\""
Jul 24 19:26:53.903675 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.903647    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-htfwf"
Jul 24 19:26:53.905552 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.905490    2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 19:26:53.909758 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.909736    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-htfwf"
Jul 24 19:26:53.965504 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.965485    2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 24 19:26:53.978001 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.977973    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/93f02579-75e7-459b-baae-032a5b2a46dc-device-dir\") pod \"aws-ebs-csi-driver-node-t9f2q\" (UID: \"93f02579-75e7-459b-baae-032a5b2a46dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9f2q"
Jul 24 19:26:53.978109 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.978012    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fb85497d-d7d8-484b-aef8-ad70ac0db182-system-cni-dir\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:53.978109 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.978042    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fb85497d-d7d8-484b-aef8-ad70ac0db182-multus-conf-dir\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:53.978268 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.978099    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb85497d-d7d8-484b-aef8-ad70ac0db182-etc-kubernetes\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:53.978268 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.978141    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8d148fa4-bff9-4286-a162-a0d07bb9c2a9-sys\") pod \"tuned-bzptt\" (UID: \"8d148fa4-bff9-4286-a162-a0d07bb9c2a9\") " pod="openshift-cluster-node-tuning-operator/tuned-bzptt"
Jul 24 19:26:53.978268 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.978168    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/72c2265c-f7f6-462a-bf46-eda3f35de953-run-systemd\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:53.978268 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.978193    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/72c2265c-f7f6-462a-bf46-eda3f35de953-ovnkube-config\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:53.978268 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.978219    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh5nt\" (UniqueName: \"kubernetes.io/projected/9e802511-bdaa-463d-9572-22349bfbcd49-kube-api-access-qh5nt\") pod \"network-check-target-tv7vs\" (UID: \"9e802511-bdaa-463d-9572-22349bfbcd49\") " pod="openshift-network-diagnostics/network-check-target-tv7vs"
Jul 24 19:26:53.978268 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.978253    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d38eaa42-116b-4a94-92e2-a9806f4c0cb9-hosts-file\") pod \"node-resolver-swjv4\" (UID: \"d38eaa42-116b-4a94-92e2-a9806f4c0cb9\") " pod="openshift-dns/node-resolver-swjv4"
Jul 24 19:26:53.978523 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.978282    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/72c2265c-f7f6-462a-bf46-eda3f35de953-systemd-units\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:53.978523 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.978307    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8d148fa4-bff9-4286-a162-a0d07bb9c2a9-sys\") pod \"tuned-bzptt\" (UID: \"8d148fa4-bff9-4286-a162-a0d07bb9c2a9\") " pod="openshift-cluster-node-tuning-operator/tuned-bzptt"
Jul 24 19:26:53.978523 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.978308    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/72c2265c-f7f6-462a-bf46-eda3f35de953-run-ovn\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:53.978523 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.978350    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/72c2265c-f7f6-462a-bf46-eda3f35de953-host-cni-netd\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:53.978523 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.978373    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3b49150d-39c5-4429-90e4-5f7a092b1619-host-slash\") pod \"iptables-alerter-qqf8p\" (UID: \"3b49150d-39c5-4429-90e4-5f7a092b1619\") " pod="openshift-network-operator/iptables-alerter-qqf8p"
Jul 24 19:26:53.978523 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.978395    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fb85497d-d7d8-484b-aef8-ad70ac0db182-multus-cni-dir\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:53.978523 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.978429    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8d148fa4-bff9-4286-a162-a0d07bb9c2a9-etc-sysctl-d\") pod \"tuned-bzptt\" (UID: \"8d148fa4-bff9-4286-a162-a0d07bb9c2a9\") " pod="openshift-cluster-node-tuning-operator/tuned-bzptt"
Jul 24 19:26:53.978878 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.978554    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8d148fa4-bff9-4286-a162-a0d07bb9c2a9-etc-sysctl-conf\") pod \"tuned-bzptt\" (UID: \"8d148fa4-bff9-4286-a162-a0d07bb9c2a9\") " pod="openshift-cluster-node-tuning-operator/tuned-bzptt"
Jul 24 19:26:53.978878 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.978587    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/72c2265c-f7f6-462a-bf46-eda3f35de953-host-slash\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:53.978878 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.978599    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8d148fa4-bff9-4286-a162-a0d07bb9c2a9-etc-sysctl-d\") pod \"tuned-bzptt\" (UID: \"8d148fa4-bff9-4286-a162-a0d07bb9c2a9\") " pod="openshift-cluster-node-tuning-operator/tuned-bzptt"
Jul 24 19:26:53.978878 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.978611    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/72c2265c-f7f6-462a-bf46-eda3f35de953-node-log\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:53.978878 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.978657    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/72c2265c-f7f6-462a-bf46-eda3f35de953-ovn-node-metrics-cert\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:53.978878 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.978685    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7ba5baab-dd60-4a1f-bece-25c178dbe520-cni-binary-copy\") pod \"multus-additional-cni-plugins-wvbtg\" (UID: \"7ba5baab-dd60-4a1f-bece-25c178dbe520\") " pod="openshift-multus/multus-additional-cni-plugins-wvbtg"
Jul 24 19:26:53.978878 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.978709    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/93f02579-75e7-459b-baae-032a5b2a46dc-registration-dir\") pod \"aws-ebs-csi-driver-node-t9f2q\" (UID: \"93f02579-75e7-459b-baae-032a5b2a46dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9f2q"
Jul 24 19:26:53.978878 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.978767    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8d148fa4-bff9-4286-a162-a0d07bb9c2a9-etc-sysctl-conf\") pod \"tuned-bzptt\" (UID: \"8d148fa4-bff9-4286-a162-a0d07bb9c2a9\") " pod="openshift-cluster-node-tuning-operator/tuned-bzptt"
Jul 24 19:26:53.978878 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.978805    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9pq7\" (UniqueName: \"kubernetes.io/projected/5b53e2ac-1a53-4df0-a395-2718093476b6-kube-api-access-g9pq7\") pod \"network-metrics-daemon-nqt4p\" (UID: \"5b53e2ac-1a53-4df0-a395-2718093476b6\") " pod="openshift-multus/network-metrics-daemon-nqt4p"
Jul 24 19:26:53.978878 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.978835    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8d148fa4-bff9-4286-a162-a0d07bb9c2a9-etc-systemd\") pod \"tuned-bzptt\" (UID: \"8d148fa4-bff9-4286-a162-a0d07bb9c2a9\") " pod="openshift-cluster-node-tuning-operator/tuned-bzptt"
Jul 24 19:26:53.978878 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.978873    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94868cfc-85a8-4310-a339-2c4b44da043b-original-pull-secret\") pod \"global-pull-secret-syncer-gvbbc\" (UID: \"94868cfc-85a8-4310-a339-2c4b44da043b\") " pod="kube-system/global-pull-secret-syncer-gvbbc"
Jul 24 19:26:53.979377 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.978900    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8d148fa4-bff9-4286-a162-a0d07bb9c2a9-etc-systemd\") pod \"tuned-bzptt\" (UID: \"8d148fa4-bff9-4286-a162-a0d07bb9c2a9\") " pod="openshift-cluster-node-tuning-operator/tuned-bzptt"
Jul 24 19:26:53.979377 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.978907    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3b49150d-39c5-4429-90e4-5f7a092b1619-iptables-alerter-script\") pod \"iptables-alerter-qqf8p\" (UID: \"3b49150d-39c5-4429-90e4-5f7a092b1619\") " pod="openshift-network-operator/iptables-alerter-qqf8p"
Jul 24 19:26:53.979377 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.978951    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0b4c1d88-b127-4f5a-985b-1eda0f9470fa-host\") pod \"node-ca-2586j\" (UID: \"0b4c1d88-b127-4f5a-985b-1eda0f9470fa\") " pod="openshift-image-registry/node-ca-2586j"
Jul 24 19:26:53.979377 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.978991    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d38eaa42-116b-4a94-92e2-a9806f4c0cb9-tmp-dir\") pod \"node-resolver-swjv4\" (UID: \"d38eaa42-116b-4a94-92e2-a9806f4c0cb9\") " pod="openshift-dns/node-resolver-swjv4"
Jul 24 19:26:53.979377 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.979031    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fb85497d-d7d8-484b-aef8-ad70ac0db182-cnibin\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:53.979377 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.979060    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8d148fa4-bff9-4286-a162-a0d07bb9c2a9-lib-modules\") pod \"tuned-bzptt\" (UID: \"8d148fa4-bff9-4286-a162-a0d07bb9c2a9\") " pod="openshift-cluster-node-tuning-operator/tuned-bzptt"
Jul 24 19:26:53.979377 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.979136    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/72c2265c-f7f6-462a-bf46-eda3f35de953-host-kubelet\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:53.979377 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.979162    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8d148fa4-bff9-4286-a162-a0d07bb9c2a9-lib-modules\") pod \"tuned-bzptt\" (UID: \"8d148fa4-bff9-4286-a162-a0d07bb9c2a9\") " pod="openshift-cluster-node-tuning-operator/tuned-bzptt"
Jul 24 19:26:53.979377 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.979161    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r225v\" (UniqueName: \"kubernetes.io/projected/72c2265c-f7f6-462a-bf46-eda3f35de953-kube-api-access-r225v\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:53.979377 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.979194    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8d148fa4-bff9-4286-a162-a0d07bb9c2a9-etc-modprobe-d\") pod \"tuned-bzptt\" (UID: \"8d148fa4-bff9-4286-a162-a0d07bb9c2a9\") " pod="openshift-cluster-node-tuning-operator/tuned-bzptt"
Jul 24 19:26:53.979377 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.979223    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7ba5baab-dd60-4a1f-bece-25c178dbe520-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wvbtg\" (UID: \"7ba5baab-dd60-4a1f-bece-25c178dbe520\") " pod="openshift-multus/multus-additional-cni-plugins-wvbtg"
Jul 24 19:26:53.979377 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.979248    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fb85497d-d7d8-484b-aef8-ad70ac0db182-cni-binary-copy\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:53.979377 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.979333    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d148fa4-bff9-4286-a162-a0d07bb9c2a9-tmp\") pod \"tuned-bzptt\" (UID: \"8d148fa4-bff9-4286-a162-a0d07bb9c2a9\") " pod="openshift-cluster-node-tuning-operator/tuned-bzptt"
Jul 24 19:26:53.979377 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.979342    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8d148fa4-bff9-4286-a162-a0d07bb9c2a9-etc-modprobe-d\") pod \"tuned-bzptt\" (UID: \"8d148fa4-bff9-4286-a162-a0d07bb9c2a9\") " pod="openshift-cluster-node-tuning-operator/tuned-bzptt"
Jul 24 19:26:53.979377 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.979358    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72c2265c-f7f6-462a-bf46-eda3f35de953-host-run-ovn-kubernetes\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:53.979377 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.979383    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k64ld\" (UniqueName: \"kubernetes.io/projected/0b4c1d88-b127-4f5a-985b-1eda0f9470fa-kube-api-access-k64ld\") pod \"node-ca-2586j\" (UID: \"0b4c1d88-b127-4f5a-985b-1eda0f9470fa\") " pod="openshift-image-registry/node-ca-2586j"
Jul 24 19:26:53.980114 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.979421    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5l49\" (UniqueName: \"kubernetes.io/projected/d38eaa42-116b-4a94-92e2-a9806f4c0cb9-kube-api-access-g5l49\") pod \"node-resolver-swjv4\" (UID: \"d38eaa42-116b-4a94-92e2-a9806f4c0cb9\") " pod="openshift-dns/node-resolver-swjv4"
Jul 24 19:26:53.980114 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.979447    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/93f02579-75e7-459b-baae-032a5b2a46dc-etc-selinux\") pod \"aws-ebs-csi-driver-node-t9f2q\" (UID: \"93f02579-75e7-459b-baae-032a5b2a46dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9f2q"
Jul 24 19:26:53.980114 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.979471    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72c2265c-f7f6-462a-bf46-eda3f35de953-var-lib-openvswitch\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:53.980114 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.979509    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72c2265c-f7f6-462a-bf46-eda3f35de953-run-openvswitch\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:53.980114 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.979530    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fb85497d-d7d8-484b-aef8-ad70ac0db182-os-release\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:53.980114 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.979550    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fb85497d-d7d8-484b-aef8-ad70ac0db182-hostroot\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:53.980114 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.979595    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0b4c1d88-b127-4f5a-985b-1eda0f9470fa-serviceca\") pod \"node-ca-2586j\" (UID: \"0b4c1d88-b127-4f5a-985b-1eda0f9470fa\") " pod="openshift-image-registry/node-ca-2586j"
Jul 24 19:26:53.980114 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.979632    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fb85497d-d7d8-484b-aef8-ad70ac0db182-multus-socket-dir-parent\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:53.980114 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.979698    2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 24 19:26:53.980114 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.979746    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fb85497d-d7d8-484b-aef8-ad70ac0db182-host-run-k8s-cni-cncf-io\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:53.980114 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.979775    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/72c2265c-f7f6-462a-bf46-eda3f35de953-log-socket\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:53.980114 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.979790    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/94868cfc-85a8-4310-a339-2c4b44da043b-dbus\") pod \"global-pull-secret-syncer-gvbbc\" (UID: \"94868cfc-85a8-4310-a339-2c4b44da043b\") " pod="kube-system/global-pull-secret-syncer-gvbbc"
Jul 24 19:26:53.980114 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.979831    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ba5baab-dd60-4a1f-bece-25c178dbe520-system-cni-dir\") pod \"multus-additional-cni-plugins-wvbtg\" (UID: \"7ba5baab-dd60-4a1f-bece-25c178dbe520\") " pod="openshift-multus/multus-additional-cni-plugins-wvbtg"
Jul 24 19:26:53.980114 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.979862    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/75378781-af5d-4b0c-a6a5-3176b16700c7-konnectivity-ca\") pod \"konnectivity-agent-v2l9c\" (UID: \"75378781-af5d-4b0c-a6a5-3176b16700c7\") " pod="kube-system/konnectivity-agent-v2l9c"
Jul 24 19:26:53.980114 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.979902    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fb85497d-d7d8-484b-aef8-ad70ac0db182-host-var-lib-cni-multus\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:53.980114 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.979928    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fb85497d-d7d8-484b-aef8-ad70ac0db182-multus-daemon-config\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:53.980114 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.979948    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8d148fa4-bff9-4286-a162-a0d07bb9c2a9-etc-sysconfig\") pod \"tuned-bzptt\" (UID: \"8d148fa4-bff9-4286-a162-a0d07bb9c2a9\") " pod="openshift-cluster-node-tuning-operator/tuned-bzptt"
Jul 24 19:26:53.980778 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.979978    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d148fa4-bff9-4286-a162-a0d07bb9c2a9-etc-kubernetes\") pod \"tuned-bzptt\" (UID: \"8d148fa4-bff9-4286-a162-a0d07bb9c2a9\") " pod="openshift-cluster-node-tuning-operator/tuned-bzptt"
Jul 24 19:26:53.980778 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.980004    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8d148fa4-bff9-4286-a162-a0d07bb9c2a9-host\") pod \"tuned-bzptt\" (UID: \"8d148fa4-bff9-4286-a162-a0d07bb9c2a9\") " pod="openshift-cluster-node-tuning-operator/tuned-bzptt"
Jul 24 19:26:53.980778 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.980029    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/72c2265c-f7f6-462a-bf46-eda3f35de953-env-overrides\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:53.980778 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.980059    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d148fa4-bff9-4286-a162-a0d07bb9c2a9-etc-kubernetes\") pod \"tuned-bzptt\" (UID: \"8d148fa4-bff9-4286-a162-a0d07bb9c2a9\") " pod="openshift-cluster-node-tuning-operator/tuned-bzptt"
Jul 24 19:26:53.980778 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.980082    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8d148fa4-bff9-4286-a162-a0d07bb9c2a9-host\") pod \"tuned-bzptt\" (UID: \"8d148fa4-bff9-4286-a162-a0d07bb9c2a9\") " pod="openshift-cluster-node-tuning-operator/tuned-bzptt"
Jul 24 19:26:53.980778 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.980089    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7ba5baab-dd60-4a1f-bece-25c178dbe520-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wvbtg\" (UID: \"7ba5baab-dd60-4a1f-bece-25c178dbe520\") " pod="openshift-multus/multus-additional-cni-plugins-wvbtg"
Jul 24 19:26:53.980778 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.980106    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8d148fa4-bff9-4286-a162-a0d07bb9c2a9-etc-sysconfig\") pod \"tuned-bzptt\" (UID: \"8d148fa4-bff9-4286-a162-a0d07bb9c2a9\") " pod="openshift-cluster-node-tuning-operator/tuned-bzptt"
Jul 24 19:26:53.980778 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.980124    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/93f02579-75e7-459b-baae-032a5b2a46dc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t9f2q\" (UID: \"93f02579-75e7-459b-baae-032a5b2a46dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9f2q"
Jul 24 19:26:53.980778 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.980151    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/93f02579-75e7-459b-baae-032a5b2a46dc-sys-fs\") pod \"aws-ebs-csi-driver-node-t9f2q\" (UID: \"93f02579-75e7-459b-baae-032a5b2a46dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9f2q"
Jul 24 19:26:53.980778 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.980175    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fb85497d-d7d8-484b-aef8-ad70ac0db182-host-var-lib-cni-bin\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:53.980778 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.980202    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8d148fa4-bff9-4286-a162-a0d07bb9c2a9-run\") pod \"tuned-bzptt\" (UID: \"8d148fa4-bff9-4286-a162-a0d07bb9c2a9\") " pod="openshift-cluster-node-tuning-operator/tuned-bzptt"
Jul 24 19:26:53.980778 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.980231    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/94868cfc-85a8-4310-a339-2c4b44da043b-kubelet-config\") pod \"global-pull-secret-syncer-gvbbc\" (UID: \"94868cfc-85a8-4310-a339-2c4b44da043b\") " pod="kube-system/global-pull-secret-syncer-gvbbc"
Jul 24 19:26:53.980778 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.980256    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqnwk\" (UniqueName: \"kubernetes.io/projected/3b49150d-39c5-4429-90e4-5f7a092b1619-kube-api-access-cqnwk\") pod \"iptables-alerter-qqf8p\" (UID: \"3b49150d-39c5-4429-90e4-5f7a092b1619\") " pod="openshift-network-operator/iptables-alerter-qqf8p"
Jul 24 19:26:53.980778 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.980264    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8d148fa4-bff9-4286-a162-a0d07bb9c2a9-run\") pod \"tuned-bzptt\" (UID: \"8d148fa4-bff9-4286-a162-a0d07bb9c2a9\") " pod="openshift-cluster-node-tuning-operator/tuned-bzptt"
Jul 24 19:26:53.980778 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.980282    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/93f02579-75e7-459b-baae-032a5b2a46dc-socket-dir\") pod \"aws-ebs-csi-driver-node-t9f2q\" (UID: \"93f02579-75e7-459b-baae-032a5b2a46dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9f2q"
Jul 24 19:26:53.980778 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.980305    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb85497d-d7d8-484b-aef8-ad70ac0db182-host-var-lib-kubelet\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:53.980778 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.980319    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fb85497d-d7d8-484b-aef8-ad70ac0db182-host-run-multus-certs\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:53.981371 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.980334    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bl46q\" (UniqueName: \"kubernetes.io/projected/fb85497d-d7d8-484b-aef8-ad70ac0db182-kube-api-access-bl46q\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:53.981371 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.980359    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7x2vz\" (UniqueName: \"kubernetes.io/projected/8d148fa4-bff9-4286-a162-a0d07bb9c2a9-kube-api-access-7x2vz\") pod \"tuned-bzptt\" (UID: \"8d148fa4-bff9-4286-a162-a0d07bb9c2a9\") " pod="openshift-cluster-node-tuning-operator/tuned-bzptt"
Jul 24 19:26:53.981371 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.980398    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/72c2265c-f7f6-462a-bf46-eda3f35de953-host-run-netns\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:53.981371 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.980427    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/72c2265c-f7f6-462a-bf46-eda3f35de953-host-cni-bin\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:53.981371 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.980466    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7ba5baab-dd60-4a1f-bece-25c178dbe520-cnibin\") pod \"multus-additional-cni-plugins-wvbtg\" (UID: \"7ba5baab-dd60-4a1f-bece-25c178dbe520\") " pod="openshift-multus/multus-additional-cni-plugins-wvbtg"
Jul 24 19:26:53.981371 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.980506    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7ba5baab-dd60-4a1f-bece-25c178dbe520-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wvbtg\" (UID: \"7ba5baab-dd60-4a1f-bece-25c178dbe520\") " pod="openshift-multus/multus-additional-cni-plugins-wvbtg"
Jul 24 19:26:53.981371 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.980533    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx77d\" (UniqueName: \"kubernetes.io/projected/7ba5baab-dd60-4a1f-bece-25c178dbe520-kube-api-access-qx77d\") pod \"multus-additional-cni-plugins-wvbtg\" (UID: \"7ba5baab-dd60-4a1f-bece-25c178dbe520\") " pod="openshift-multus/multus-additional-cni-plugins-wvbtg"
Jul 24 19:26:53.981371 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.980568    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9ptz\" (UniqueName: \"kubernetes.io/projected/93f02579-75e7-459b-baae-032a5b2a46dc-kube-api-access-p9ptz\") pod \"aws-ebs-csi-driver-node-t9f2q\" (UID: \"93f02579-75e7-459b-baae-032a5b2a46dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9f2q"
Jul 24 19:26:53.981371 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.980593    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fb85497d-d7d8-484b-aef8-ad70ac0db182-host-run-netns\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:53.981371 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.980626    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d148fa4-bff9-4286-a162-a0d07bb9c2a9-var-lib-kubelet\") pod \"tuned-bzptt\" (UID: \"8d148fa4-bff9-4286-a162-a0d07bb9c2a9\") " pod="openshift-cluster-node-tuning-operator/tuned-bzptt"
Jul 24 19:26:53.981371 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.980649    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72c2265c-f7f6-462a-bf46-eda3f35de953-etc-openvswitch\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:53.981371 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.980705    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d148fa4-bff9-4286-a162-a0d07bb9c2a9-var-lib-kubelet\") pod \"tuned-bzptt\" (UID: \"8d148fa4-bff9-4286-a162-a0d07bb9c2a9\") " pod="openshift-cluster-node-tuning-operator/tuned-bzptt"
Jul 24 19:26:53.981371 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.980747    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/72c2265c-f7f6-462a-bf46-eda3f35de953-ovnkube-script-lib\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:53.981371 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.980772    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/75378781-af5d-4b0c-a6a5-3176b16700c7-agent-certs\") pod \"konnectivity-agent-v2l9c\" (UID: \"75378781-af5d-4b0c-a6a5-3176b16700c7\") " pod="kube-system/konnectivity-agent-v2l9c"
Jul 24 19:26:53.981371 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.980797    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b53e2ac-1a53-4df0-a395-2718093476b6-metrics-certs\") pod \"network-metrics-daemon-nqt4p\" (UID: \"5b53e2ac-1a53-4df0-a395-2718093476b6\") " pod="openshift-multus/network-metrics-daemon-nqt4p"
Jul 24 19:26:53.981371 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.980843    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8d148fa4-bff9-4286-a162-a0d07bb9c2a9-etc-tuned\") pod \"tuned-bzptt\" (UID: \"8d148fa4-bff9-4286-a162-a0d07bb9c2a9\") " pod="openshift-cluster-node-tuning-operator/tuned-bzptt"
Jul 24 19:26:53.982186 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.980874    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72c2265c-f7f6-462a-bf46-eda3f35de953-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:53.982186 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.980900    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7ba5baab-dd60-4a1f-bece-25c178dbe520-os-release\") pod \"multus-additional-cni-plugins-wvbtg\" (UID: \"7ba5baab-dd60-4a1f-bece-25c178dbe520\") " pod="openshift-multus/multus-additional-cni-plugins-wvbtg"
Jul 24 19:26:53.984268 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.984247    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d148fa4-bff9-4286-a162-a0d07bb9c2a9-tmp\") pod \"tuned-bzptt\" (UID: \"8d148fa4-bff9-4286-a162-a0d07bb9c2a9\") " pod="openshift-cluster-node-tuning-operator/tuned-bzptt"
Jul 24 19:26:53.984369 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.984320    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8d148fa4-bff9-4286-a162-a0d07bb9c2a9-etc-tuned\") pod \"tuned-bzptt\" (UID: \"8d148fa4-bff9-4286-a162-a0d07bb9c2a9\") " pod="openshift-cluster-node-tuning-operator/tuned-bzptt"
Jul 24 19:26:53.989528 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:53.989505    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7x2vz\" (UniqueName: \"kubernetes.io/projected/8d148fa4-bff9-4286-a162-a0d07bb9c2a9-kube-api-access-7x2vz\") pod \"tuned-bzptt\" (UID: \"8d148fa4-bff9-4286-a162-a0d07bb9c2a9\") " pod="openshift-cluster-node-tuning-operator/tuned-bzptt"
Jul 24 19:26:54.081281 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.081243    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0b4c1d88-b127-4f5a-985b-1eda0f9470fa-serviceca\") pod \"node-ca-2586j\" (UID: \"0b4c1d88-b127-4f5a-985b-1eda0f9470fa\") " pod="openshift-image-registry/node-ca-2586j"
Jul 24 19:26:54.081454 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.081298    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fb85497d-d7d8-484b-aef8-ad70ac0db182-multus-socket-dir-parent\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:54.081454 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.081327    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fb85497d-d7d8-484b-aef8-ad70ac0db182-host-run-k8s-cni-cncf-io\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:54.081454 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.081360    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/72c2265c-f7f6-462a-bf46-eda3f35de953-log-socket\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:54.081454 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.081418    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/94868cfc-85a8-4310-a339-2c4b44da043b-dbus\") pod \"global-pull-secret-syncer-gvbbc\" (UID: \"94868cfc-85a8-4310-a339-2c4b44da043b\") " pod="kube-system/global-pull-secret-syncer-gvbbc"
Jul 24 19:26:54.081758 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.081460    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ba5baab-dd60-4a1f-bece-25c178dbe520-system-cni-dir\") pod \"multus-additional-cni-plugins-wvbtg\" (UID: \"7ba5baab-dd60-4a1f-bece-25c178dbe520\") " pod="openshift-multus/multus-additional-cni-plugins-wvbtg"
Jul 24 19:26:54.081758 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.081489    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/75378781-af5d-4b0c-a6a5-3176b16700c7-konnectivity-ca\") pod \"konnectivity-agent-v2l9c\" (UID: \"75378781-af5d-4b0c-a6a5-3176b16700c7\") " pod="kube-system/konnectivity-agent-v2l9c"
Jul 24 19:26:54.081758 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.081538    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fb85497d-d7d8-484b-aef8-ad70ac0db182-host-var-lib-cni-multus\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:54.081758 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.081595    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fb85497d-d7d8-484b-aef8-ad70ac0db182-multus-daemon-config\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:54.081758 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.081641    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/72c2265c-f7f6-462a-bf46-eda3f35de953-env-overrides\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:54.081758 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.081680    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7ba5baab-dd60-4a1f-bece-25c178dbe520-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wvbtg\" (UID: \"7ba5baab-dd60-4a1f-bece-25c178dbe520\") " pod="openshift-multus/multus-additional-cni-plugins-wvbtg"
Jul 24 19:26:54.081758 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.081709    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/93f02579-75e7-459b-baae-032a5b2a46dc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t9f2q\" (UID: \"93f02579-75e7-459b-baae-032a5b2a46dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9f2q"
Jul 24 19:26:54.081758 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.081741    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/93f02579-75e7-459b-baae-032a5b2a46dc-sys-fs\") pod \"aws-ebs-csi-driver-node-t9f2q\" (UID: \"93f02579-75e7-459b-baae-032a5b2a46dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9f2q"
Jul 24 19:26:54.082153 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.081771    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fb85497d-d7d8-484b-aef8-ad70ac0db182-host-var-lib-cni-bin\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:54.082153 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.081804    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/94868cfc-85a8-4310-a339-2c4b44da043b-kubelet-config\") pod \"global-pull-secret-syncer-gvbbc\" (UID: \"94868cfc-85a8-4310-a339-2c4b44da043b\") " pod="kube-system/global-pull-secret-syncer-gvbbc"
Jul 24 19:26:54.082153 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.081835    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqnwk\" (UniqueName: \"kubernetes.io/projected/3b49150d-39c5-4429-90e4-5f7a092b1619-kube-api-access-cqnwk\") pod \"iptables-alerter-qqf8p\" (UID: \"3b49150d-39c5-4429-90e4-5f7a092b1619\") " pod="openshift-network-operator/iptables-alerter-qqf8p"
Jul 24 19:26:54.082153 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.081862    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/93f02579-75e7-459b-baae-032a5b2a46dc-socket-dir\") pod \"aws-ebs-csi-driver-node-t9f2q\" (UID: \"93f02579-75e7-459b-baae-032a5b2a46dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9f2q"
Jul 24 19:26:54.082153 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.082021    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/93f02579-75e7-459b-baae-032a5b2a46dc-socket-dir\") pod \"aws-ebs-csi-driver-node-t9f2q\" (UID: \"93f02579-75e7-459b-baae-032a5b2a46dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9f2q"
Jul 24 19:26:54.082153 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.082095    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fb85497d-d7d8-484b-aef8-ad70ac0db182-host-var-lib-cni-multus\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:54.082476 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.082451    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/75378781-af5d-4b0c-a6a5-3176b16700c7-konnectivity-ca\") pod \"konnectivity-agent-v2l9c\" (UID: \"75378781-af5d-4b0c-a6a5-3176b16700c7\") " pod="kube-system/konnectivity-agent-v2l9c"
Jul 24 19:26:54.083407 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.082570    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/72c2265c-f7f6-462a-bf46-eda3f35de953-log-socket\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:54.083407 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.082613    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0b4c1d88-b127-4f5a-985b-1eda0f9470fa-serviceca\") pod \"node-ca-2586j\" (UID: \"0b4c1d88-b127-4f5a-985b-1eda0f9470fa\") " pod="openshift-image-registry/node-ca-2586j"
Jul 24 19:26:54.083407 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.082665    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fb85497d-d7d8-484b-aef8-ad70ac0db182-multus-socket-dir-parent\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:54.083407 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.082708    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fb85497d-d7d8-484b-aef8-ad70ac0db182-host-run-k8s-cni-cncf-io\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:54.083407 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.082768    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb85497d-d7d8-484b-aef8-ad70ac0db182-host-var-lib-kubelet\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:54.083407 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.082917    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fb85497d-d7d8-484b-aef8-ad70ac0db182-host-run-multus-certs\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:54.083407 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.082959    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bl46q\" (UniqueName: \"kubernetes.io/projected/fb85497d-d7d8-484b-aef8-ad70ac0db182-kube-api-access-bl46q\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:54.083407 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.082993    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/94868cfc-85a8-4310-a339-2c4b44da043b-dbus\") pod \"global-pull-secret-syncer-gvbbc\" (UID: \"94868cfc-85a8-4310-a339-2c4b44da043b\") " pod="kube-system/global-pull-secret-syncer-gvbbc"
Jul 24 19:26:54.083407 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.082994    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/72c2265c-f7f6-462a-bf46-eda3f35de953-host-run-netns\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:54.083407 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.083041    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/72c2265c-f7f6-462a-bf46-eda3f35de953-host-run-netns\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:54.083407 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.083047    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/72c2265c-f7f6-462a-bf46-eda3f35de953-host-cni-bin\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:54.083407 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.083088    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7ba5baab-dd60-4a1f-bece-25c178dbe520-cnibin\") pod \"multus-additional-cni-plugins-wvbtg\" (UID: \"7ba5baab-dd60-4a1f-bece-25c178dbe520\") " pod="openshift-multus/multus-additional-cni-plugins-wvbtg"
Jul 24 19:26:54.083407 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.083106    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ba5baab-dd60-4a1f-bece-25c178dbe520-system-cni-dir\") pod \"multus-additional-cni-plugins-wvbtg\" (UID: \"7ba5baab-dd60-4a1f-bece-25c178dbe520\") " pod="openshift-multus/multus-additional-cni-plugins-wvbtg"
Jul 24 19:26:54.083407 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.083173    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb85497d-d7d8-484b-aef8-ad70ac0db182-host-var-lib-kubelet\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:54.083407 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.083174    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/72c2265c-f7f6-462a-bf46-eda3f35de953-host-cni-bin\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:54.083407 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.083203    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7ba5baab-dd60-4a1f-bece-25c178dbe520-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wvbtg\" (UID: \"7ba5baab-dd60-4a1f-bece-25c178dbe520\") " pod="openshift-multus/multus-additional-cni-plugins-wvbtg"
Jul 24 19:26:54.083407 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.083216    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/72c2265c-f7f6-462a-bf46-eda3f35de953-env-overrides\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:54.083407 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.083246    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7ba5baab-dd60-4a1f-bece-25c178dbe520-cnibin\") pod \"multus-additional-cni-plugins-wvbtg\" (UID: \"7ba5baab-dd60-4a1f-bece-25c178dbe520\") " pod="openshift-multus/multus-additional-cni-plugins-wvbtg"
Jul 24 19:26:54.084312 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.083233    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fb85497d-d7d8-484b-aef8-ad70ac0db182-host-run-multus-certs\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:54.084312 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.083262    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx77d\" (UniqueName: \"kubernetes.io/projected/7ba5baab-dd60-4a1f-bece-25c178dbe520-kube-api-access-qx77d\") pod \"multus-additional-cni-plugins-wvbtg\" (UID: \"7ba5baab-dd60-4a1f-bece-25c178dbe520\") " pod="openshift-multus/multus-additional-cni-plugins-wvbtg"
Jul 24 19:26:54.084312 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.083310    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/93f02579-75e7-459b-baae-032a5b2a46dc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t9f2q\" (UID: \"93f02579-75e7-459b-baae-032a5b2a46dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9f2q"
Jul 24 19:26:54.084312 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.083320    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9ptz\" (UniqueName: \"kubernetes.io/projected/93f02579-75e7-459b-baae-032a5b2a46dc-kube-api-access-p9ptz\") pod \"aws-ebs-csi-driver-node-t9f2q\" (UID: \"93f02579-75e7-459b-baae-032a5b2a46dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9f2q"
Jul 24 19:26:54.084312 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.083365    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fb85497d-d7d8-484b-aef8-ad70ac0db182-host-run-netns\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:54.084312 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.083411    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72c2265c-f7f6-462a-bf46-eda3f35de953-etc-openvswitch\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:54.084312 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.083454    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/72c2265c-f7f6-462a-bf46-eda3f35de953-ovnkube-script-lib\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:54.084312 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.083410    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/94868cfc-85a8-4310-a339-2c4b44da043b-kubelet-config\") pod \"global-pull-secret-syncer-gvbbc\" (UID: \"94868cfc-85a8-4310-a339-2c4b44da043b\") " pod="kube-system/global-pull-secret-syncer-gvbbc"
Jul 24 19:26:54.084312 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.083492    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/75378781-af5d-4b0c-a6a5-3176b16700c7-agent-certs\") pod \"konnectivity-agent-v2l9c\" (UID: \"75378781-af5d-4b0c-a6a5-3176b16700c7\") " pod="kube-system/konnectivity-agent-v2l9c"
Jul 24 19:26:54.084312 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.083584    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b53e2ac-1a53-4df0-a395-2718093476b6-metrics-certs\") pod \"network-metrics-daemon-nqt4p\" (UID: \"5b53e2ac-1a53-4df0-a395-2718093476b6\") " pod="openshift-multus/network-metrics-daemon-nqt4p"
Jul 24 19:26:54.084312 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.083661    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72c2265c-f7f6-462a-bf46-eda3f35de953-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:54.084312 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.083806    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fb85497d-d7d8-484b-aef8-ad70ac0db182-host-run-netns\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:54.084312 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.083812    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/93f02579-75e7-459b-baae-032a5b2a46dc-sys-fs\") pod \"aws-ebs-csi-driver-node-t9f2q\" (UID: \"93f02579-75e7-459b-baae-032a5b2a46dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9f2q"
Jul 24 19:26:54.084312 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.083852    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fb85497d-d7d8-484b-aef8-ad70ac0db182-host-var-lib-cni-bin\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:54.084312 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.083906    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7ba5baab-dd60-4a1f-bece-25c178dbe520-os-release\") pod \"multus-additional-cni-plugins-wvbtg\" (UID: \"7ba5baab-dd60-4a1f-bece-25c178dbe520\") " pod="openshift-multus/multus-additional-cni-plugins-wvbtg"
Jul 24 19:26:54.084312 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.083913    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7ba5baab-dd60-4a1f-bece-25c178dbe520-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wvbtg\" (UID: \"7ba5baab-dd60-4a1f-bece-25c178dbe520\") " pod="openshift-multus/multus-additional-cni-plugins-wvbtg"
Jul 24 19:26:54.084312 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.083945    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7ba5baab-dd60-4a1f-bece-25c178dbe520-os-release\") pod \"multus-additional-cni-plugins-wvbtg\" (UID: \"7ba5baab-dd60-4a1f-bece-25c178dbe520\") " pod="openshift-multus/multus-additional-cni-plugins-wvbtg"
Jul 24 19:26:54.085084 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.083975    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72c2265c-f7f6-462a-bf46-eda3f35de953-etc-openvswitch\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:54.085084 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.083999    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/93f02579-75e7-459b-baae-032a5b2a46dc-device-dir\") pod \"aws-ebs-csi-driver-node-t9f2q\" (UID: \"93f02579-75e7-459b-baae-032a5b2a46dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9f2q"
Jul 24 19:26:54.085084 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.084043    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fb85497d-d7d8-484b-aef8-ad70ac0db182-system-cni-dir\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:54.085084 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:54.084122    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:26:54.085084 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.084131    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fb85497d-d7d8-484b-aef8-ad70ac0db182-system-cni-dir\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:54.085084 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.084130    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/93f02579-75e7-459b-baae-032a5b2a46dc-device-dir\") pod \"aws-ebs-csi-driver-node-t9f2q\" (UID: \"93f02579-75e7-459b-baae-032a5b2a46dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9f2q"
Jul 24 19:26:54.085084 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.084168    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fb85497d-d7d8-484b-aef8-ad70ac0db182-multus-conf-dir\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:54.085084 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.084199    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72c2265c-f7f6-462a-bf46-eda3f35de953-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:54.085084 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:54.084236    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b53e2ac-1a53-4df0-a395-2718093476b6-metrics-certs podName:5b53e2ac-1a53-4df0-a395-2718093476b6 nodeName:}" failed. No retries permitted until 2026-07-24 19:26:54.584186847 +0000 UTC m=+3.102806882 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b53e2ac-1a53-4df0-a395-2718093476b6-metrics-certs") pod "network-metrics-daemon-nqt4p" (UID: "5b53e2ac-1a53-4df0-a395-2718093476b6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:26:54.085084 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.084244    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fb85497d-d7d8-484b-aef8-ad70ac0db182-multus-conf-dir\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:54.085084 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.084268    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb85497d-d7d8-484b-aef8-ad70ac0db182-etc-kubernetes\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:54.085084 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.084312    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/72c2265c-f7f6-462a-bf46-eda3f35de953-run-systemd\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:54.085084 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.084340    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/72c2265c-f7f6-462a-bf46-eda3f35de953-ovnkube-config\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:54.085084 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.084381    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qh5nt\" (UniqueName: \"kubernetes.io/projected/9e802511-bdaa-463d-9572-22349bfbcd49-kube-api-access-qh5nt\") pod \"network-check-target-tv7vs\" (UID: \"9e802511-bdaa-463d-9572-22349bfbcd49\") " pod="openshift-network-diagnostics/network-check-target-tv7vs"
Jul 24 19:26:54.085084 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.084418    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d38eaa42-116b-4a94-92e2-a9806f4c0cb9-hosts-file\") pod \"node-resolver-swjv4\" (UID: \"d38eaa42-116b-4a94-92e2-a9806f4c0cb9\") " pod="openshift-dns/node-resolver-swjv4"
Jul 24 19:26:54.085084 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.084421    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7ba5baab-dd60-4a1f-bece-25c178dbe520-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wvbtg\" (UID: \"7ba5baab-dd60-4a1f-bece-25c178dbe520\") " pod="openshift-multus/multus-additional-cni-plugins-wvbtg"
Jul 24 19:26:54.085084 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.084446    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb85497d-d7d8-484b-aef8-ad70ac0db182-etc-kubernetes\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:54.085924 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.084455    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/72c2265c-f7f6-462a-bf46-eda3f35de953-systemd-units\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:54.085924 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.084522    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/72c2265c-f7f6-462a-bf46-eda3f35de953-run-ovn\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:54.085924 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.084536    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d38eaa42-116b-4a94-92e2-a9806f4c0cb9-hosts-file\") pod \"node-resolver-swjv4\" (UID: \"d38eaa42-116b-4a94-92e2-a9806f4c0cb9\") " pod="openshift-dns/node-resolver-swjv4"
Jul 24 19:26:54.085924 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.084605    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/72c2265c-f7f6-462a-bf46-eda3f35de953-host-cni-netd\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:54.085924 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.084619    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/72c2265c-f7f6-462a-bf46-eda3f35de953-run-ovn\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:54.085924 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.084623    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/72c2265c-f7f6-462a-bf46-eda3f35de953-run-systemd\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:54.085924 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.084645    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3b49150d-39c5-4429-90e4-5f7a092b1619-host-slash\") pod \"iptables-alerter-qqf8p\" (UID: \"3b49150d-39c5-4429-90e4-5f7a092b1619\") " pod="openshift-network-operator/iptables-alerter-qqf8p"
Jul 24 19:26:54.085924 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.084648    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/72c2265c-f7f6-462a-bf46-eda3f35de953-ovnkube-script-lib\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:54.085924 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.084694    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fb85497d-d7d8-484b-aef8-ad70ac0db182-multus-cni-dir\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:54.085924 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.084695    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/72c2265c-f7f6-462a-bf46-eda3f35de953-systemd-units\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:54.085924 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.084728    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/72c2265c-f7f6-462a-bf46-eda3f35de953-host-cni-netd\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:54.085924 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.084786    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/72c2265c-f7f6-462a-bf46-eda3f35de953-host-slash\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:54.085924 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.084821    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fb85497d-d7d8-484b-aef8-ad70ac0db182-multus-cni-dir\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:54.085924 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.084832    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3b49150d-39c5-4429-90e4-5f7a092b1619-host-slash\") pod \"iptables-alerter-qqf8p\" (UID: \"3b49150d-39c5-4429-90e4-5f7a092b1619\") " pod="openshift-network-operator/iptables-alerter-qqf8p"
Jul 24 19:26:54.085924 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.084944    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/72c2265c-f7f6-462a-bf46-eda3f35de953-host-slash\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:54.085924 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.084946    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/72c2265c-f7f6-462a-bf46-eda3f35de953-node-log\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:54.085924 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.084999    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/72c2265c-f7f6-462a-bf46-eda3f35de953-ovn-node-metrics-cert\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:54.085924 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.085035    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7ba5baab-dd60-4a1f-bece-25c178dbe520-cni-binary-copy\") pod \"multus-additional-cni-plugins-wvbtg\" (UID: \"7ba5baab-dd60-4a1f-bece-25c178dbe520\") " pod="openshift-multus/multus-additional-cni-plugins-wvbtg"
Jul 24 19:26:54.086510 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.085063    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/93f02579-75e7-459b-baae-032a5b2a46dc-registration-dir\") pod \"aws-ebs-csi-driver-node-t9f2q\" (UID: \"93f02579-75e7-459b-baae-032a5b2a46dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9f2q"
Jul 24 19:26:54.086510 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.085097    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9pq7\" (UniqueName: \"kubernetes.io/projected/5b53e2ac-1a53-4df0-a395-2718093476b6-kube-api-access-g9pq7\") pod \"network-metrics-daemon-nqt4p\" (UID: \"5b53e2ac-1a53-4df0-a395-2718093476b6\") " pod="openshift-multus/network-metrics-daemon-nqt4p"
Jul 24 19:26:54.086510 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.085176    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94868cfc-85a8-4310-a339-2c4b44da043b-original-pull-secret\") pod \"global-pull-secret-syncer-gvbbc\" (UID: \"94868cfc-85a8-4310-a339-2c4b44da043b\") " pod="kube-system/global-pull-secret-syncer-gvbbc"
Jul 24 19:26:54.086510 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.085222    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/72c2265c-f7f6-462a-bf46-eda3f35de953-ovnkube-config\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:54.086510 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.085209    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3b49150d-39c5-4429-90e4-5f7a092b1619-iptables-alerter-script\") pod \"iptables-alerter-qqf8p\" (UID: \"3b49150d-39c5-4429-90e4-5f7a092b1619\") " pod="openshift-network-operator/iptables-alerter-qqf8p"
Jul 24 19:26:54.086510 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.085299    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0b4c1d88-b127-4f5a-985b-1eda0f9470fa-host\") pod \"node-ca-2586j\" (UID: \"0b4c1d88-b127-4f5a-985b-1eda0f9470fa\") " pod="openshift-image-registry/node-ca-2586j"
Jul 24 19:26:54.086510 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.085383    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fb85497d-d7d8-484b-aef8-ad70ac0db182-multus-daemon-config\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:54.086510 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.085412    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d38eaa42-116b-4a94-92e2-a9806f4c0cb9-tmp-dir\") pod \"node-resolver-swjv4\" (UID: \"d38eaa42-116b-4a94-92e2-a9806f4c0cb9\") " pod="openshift-dns/node-resolver-swjv4"
Jul 24 19:26:54.086510 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.085483    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fb85497d-d7d8-484b-aef8-ad70ac0db182-cnibin\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:54.086510 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.085484    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/93f02579-75e7-459b-baae-032a5b2a46dc-registration-dir\") pod \"aws-ebs-csi-driver-node-t9f2q\" (UID: \"93f02579-75e7-459b-baae-032a5b2a46dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9f2q"
Jul 24 19:26:54.086510 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.085000    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/72c2265c-f7f6-462a-bf46-eda3f35de953-node-log\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:54.086510 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.085520    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/72c2265c-f7f6-462a-bf46-eda3f35de953-host-kubelet\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:54.086510 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.085573    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r225v\" (UniqueName: \"kubernetes.io/projected/72c2265c-f7f6-462a-bf46-eda3f35de953-kube-api-access-r225v\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:54.086510 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.085748    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7ba5baab-dd60-4a1f-bece-25c178dbe520-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wvbtg\" (UID: \"7ba5baab-dd60-4a1f-bece-25c178dbe520\") " pod="openshift-multus/multus-additional-cni-plugins-wvbtg"
Jul 24 19:26:54.086510 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.085781    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fb85497d-d7d8-484b-aef8-ad70ac0db182-cni-binary-copy\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:54.086510 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.085847    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72c2265c-f7f6-462a-bf46-eda3f35de953-host-run-ovn-kubernetes\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:54.086510 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.085887    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k64ld\" (UniqueName: \"kubernetes.io/projected/0b4c1d88-b127-4f5a-985b-1eda0f9470fa-kube-api-access-k64ld\") pod \"node-ca-2586j\" (UID: \"0b4c1d88-b127-4f5a-985b-1eda0f9470fa\") " pod="openshift-image-registry/node-ca-2586j"
Jul 24 19:26:54.087106 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.085919    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5l49\" (UniqueName: \"kubernetes.io/projected/d38eaa42-116b-4a94-92e2-a9806f4c0cb9-kube-api-access-g5l49\") pod \"node-resolver-swjv4\" (UID: \"d38eaa42-116b-4a94-92e2-a9806f4c0cb9\") " pod="openshift-dns/node-resolver-swjv4"
Jul 24 19:26:54.087106 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.085962    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3b49150d-39c5-4429-90e4-5f7a092b1619-iptables-alerter-script\") pod \"iptables-alerter-qqf8p\" (UID: \"3b49150d-39c5-4429-90e4-5f7a092b1619\") " pod="openshift-network-operator/iptables-alerter-qqf8p"
Jul 24 19:26:54.087106 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.086072    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/93f02579-75e7-459b-baae-032a5b2a46dc-etc-selinux\") pod \"aws-ebs-csi-driver-node-t9f2q\" (UID: \"93f02579-75e7-459b-baae-032a5b2a46dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9f2q"
Jul 24 19:26:54.087106 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.086084    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7ba5baab-dd60-4a1f-bece-25c178dbe520-cni-binary-copy\") pod \"multus-additional-cni-plugins-wvbtg\" (UID: \"7ba5baab-dd60-4a1f-bece-25c178dbe520\") " pod="openshift-multus/multus-additional-cni-plugins-wvbtg"
Jul 24 19:26:54.087106 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.086139    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72c2265c-f7f6-462a-bf46-eda3f35de953-var-lib-openvswitch\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:54.087106 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:54.086161    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 19:26:54.087106 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.086218    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72c2265c-f7f6-462a-bf46-eda3f35de953-var-lib-openvswitch\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:54.087106 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:54.086262    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94868cfc-85a8-4310-a339-2c4b44da043b-original-pull-secret podName:94868cfc-85a8-4310-a339-2c4b44da043b nodeName:}" failed. No retries permitted until 2026-07-24 19:26:54.586240996 +0000 UTC m=+3.104861032 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/94868cfc-85a8-4310-a339-2c4b44da043b-original-pull-secret") pod "global-pull-secret-syncer-gvbbc" (UID: "94868cfc-85a8-4310-a339-2c4b44da043b") : object "kube-system"/"original-pull-secret" not registered
Jul 24 19:26:54.087106 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.086263    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/93f02579-75e7-459b-baae-032a5b2a46dc-etc-selinux\") pod \"aws-ebs-csi-driver-node-t9f2q\" (UID: \"93f02579-75e7-459b-baae-032a5b2a46dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9f2q"
Jul 24 19:26:54.087106 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.086300    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/72c2265c-f7f6-462a-bf46-eda3f35de953-host-kubelet\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:54.087106 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.086357    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0b4c1d88-b127-4f5a-985b-1eda0f9470fa-host\") pod \"node-ca-2586j\" (UID: \"0b4c1d88-b127-4f5a-985b-1eda0f9470fa\") " pod="openshift-image-registry/node-ca-2586j"
Jul 24 19:26:54.087106 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.086436    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72c2265c-f7f6-462a-bf46-eda3f35de953-host-run-ovn-kubernetes\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:54.087106 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.086555    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72c2265c-f7f6-462a-bf46-eda3f35de953-run-openvswitch\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:54.087106 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.086624    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fb85497d-d7d8-484b-aef8-ad70ac0db182-os-release\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:54.087106 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.086623    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7ba5baab-dd60-4a1f-bece-25c178dbe520-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wvbtg\" (UID: \"7ba5baab-dd60-4a1f-bece-25c178dbe520\") " pod="openshift-multus/multus-additional-cni-plugins-wvbtg"
Jul 24 19:26:54.087106 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.086658    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fb85497d-d7d8-484b-aef8-ad70ac0db182-hostroot\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:54.087106 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.086711    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72c2265c-f7f6-462a-bf46-eda3f35de953-run-openvswitch\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:54.087681 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.086791    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fb85497d-d7d8-484b-aef8-ad70ac0db182-os-release\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:54.087681 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.086816    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d38eaa42-116b-4a94-92e2-a9806f4c0cb9-tmp-dir\") pod \"node-resolver-swjv4\" (UID: \"d38eaa42-116b-4a94-92e2-a9806f4c0cb9\") " pod="openshift-dns/node-resolver-swjv4"
Jul 24 19:26:54.087681 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.086965    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fb85497d-d7d8-484b-aef8-ad70ac0db182-cnibin\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:54.087681 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.086965    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fb85497d-d7d8-484b-aef8-ad70ac0db182-hostroot\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:54.087681 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.086980    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fb85497d-d7d8-484b-aef8-ad70ac0db182-cni-binary-copy\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:54.089761 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.089717    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/75378781-af5d-4b0c-a6a5-3176b16700c7-agent-certs\") pod \"konnectivity-agent-v2l9c\" (UID: \"75378781-af5d-4b0c-a6a5-3176b16700c7\") " pod="kube-system/konnectivity-agent-v2l9c"
Jul 24 19:26:54.090002 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.089981    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/72c2265c-f7f6-462a-bf46-eda3f35de953-ovn-node-metrics-cert\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:54.092108 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:54.092075    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 19:26:54.092108 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:54.092102    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 19:26:54.092270 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:54.092118    2567 projected.go:196] Error preparing data for projected volume kube-api-access-qh5nt for pod openshift-network-diagnostics/network-check-target-tv7vs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:26:54.092270 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:54.092184    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e802511-bdaa-463d-9572-22349bfbcd49-kube-api-access-qh5nt podName:9e802511-bdaa-463d-9572-22349bfbcd49 nodeName:}" failed. No retries permitted until 2026-07-24 19:26:54.592167444 +0000 UTC m=+3.110787483 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qh5nt" (UniqueName: "kubernetes.io/projected/9e802511-bdaa-463d-9572-22349bfbcd49-kube-api-access-qh5nt") pod "network-check-target-tv7vs" (UID: "9e802511-bdaa-463d-9572-22349bfbcd49") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:26:54.097555 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.097468    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx77d\" (UniqueName: \"kubernetes.io/projected/7ba5baab-dd60-4a1f-bece-25c178dbe520-kube-api-access-qx77d\") pod \"multus-additional-cni-plugins-wvbtg\" (UID: \"7ba5baab-dd60-4a1f-bece-25c178dbe520\") " pod="openshift-multus/multus-additional-cni-plugins-wvbtg"
Jul 24 19:26:54.097555 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.097474    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqnwk\" (UniqueName: \"kubernetes.io/projected/3b49150d-39c5-4429-90e4-5f7a092b1619-kube-api-access-cqnwk\") pod \"iptables-alerter-qqf8p\" (UID: \"3b49150d-39c5-4429-90e4-5f7a092b1619\") " pod="openshift-network-operator/iptables-alerter-qqf8p"
Jul 24 19:26:54.097819 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.097794    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9pq7\" (UniqueName: \"kubernetes.io/projected/5b53e2ac-1a53-4df0-a395-2718093476b6-kube-api-access-g9pq7\") pod \"network-metrics-daemon-nqt4p\" (UID: \"5b53e2ac-1a53-4df0-a395-2718093476b6\") " pod="openshift-multus/network-metrics-daemon-nqt4p"
Jul 24 19:26:54.098182 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.098136    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k64ld\" (UniqueName: \"kubernetes.io/projected/0b4c1d88-b127-4f5a-985b-1eda0f9470fa-kube-api-access-k64ld\") pod \"node-ca-2586j\" (UID: \"0b4c1d88-b127-4f5a-985b-1eda0f9470fa\") " pod="openshift-image-registry/node-ca-2586j"
Jul 24 19:26:54.099102 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.099078    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9ptz\" (UniqueName: \"kubernetes.io/projected/93f02579-75e7-459b-baae-032a5b2a46dc-kube-api-access-p9ptz\") pod \"aws-ebs-csi-driver-node-t9f2q\" (UID: \"93f02579-75e7-459b-baae-032a5b2a46dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9f2q"
Jul 24 19:26:54.099199 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.099110    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bl46q\" (UniqueName: \"kubernetes.io/projected/fb85497d-d7d8-484b-aef8-ad70ac0db182-kube-api-access-bl46q\") pod \"multus-77d9q\" (UID: \"fb85497d-d7d8-484b-aef8-ad70ac0db182\") " pod="openshift-multus/multus-77d9q"
Jul 24 19:26:54.099983 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.099959    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5l49\" (UniqueName: \"kubernetes.io/projected/d38eaa42-116b-4a94-92e2-a9806f4c0cb9-kube-api-access-g5l49\") pod \"node-resolver-swjv4\" (UID: \"d38eaa42-116b-4a94-92e2-a9806f4c0cb9\") " pod="openshift-dns/node-resolver-swjv4"
Jul 24 19:26:54.102459 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.102441    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r225v\" (UniqueName: \"kubernetes.io/projected/72c2265c-f7f6-462a-bf46-eda3f35de953-kube-api-access-r225v\") pod \"ovnkube-node-d87bq\" (UID: \"72c2265c-f7f6-462a-bf46-eda3f35de953\") " pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:54.182032 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.181995    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bzptt"
Jul 24 19:26:54.197265 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.197237    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:26:54.212501 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.212456    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2586j"
Jul 24 19:26:54.222701 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.222676    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wvbtg"
Jul 24 19:26:54.234807 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.234780    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-v2l9c"
Jul 24 19:26:54.241080 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.241051    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qqf8p"
Jul 24 19:26:54.251372 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.251348    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-swjv4"
Jul 24 19:26:54.258463 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.258445    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9f2q"
Jul 24 19:26:54.264310 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.264289    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-77d9q"
Jul 24 19:26:54.350977 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.350909    2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 19:26:54.590536 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.590485    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b53e2ac-1a53-4df0-a395-2718093476b6-metrics-certs\") pod \"network-metrics-daemon-nqt4p\" (UID: \"5b53e2ac-1a53-4df0-a395-2718093476b6\") " pod="openshift-multus/network-metrics-daemon-nqt4p"
Jul 24 19:26:54.590742 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.590581    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94868cfc-85a8-4310-a339-2c4b44da043b-original-pull-secret\") pod \"global-pull-secret-syncer-gvbbc\" (UID: \"94868cfc-85a8-4310-a339-2c4b44da043b\") " pod="kube-system/global-pull-secret-syncer-gvbbc"
Jul 24 19:26:54.590742 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:54.590671    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:26:54.590742 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:54.590725    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 19:26:54.590895 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:54.590749    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b53e2ac-1a53-4df0-a395-2718093476b6-metrics-certs podName:5b53e2ac-1a53-4df0-a395-2718093476b6 nodeName:}" failed. No retries permitted until 2026-07-24 19:26:55.590725185 +0000 UTC m=+4.109345224 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b53e2ac-1a53-4df0-a395-2718093476b6-metrics-certs") pod "network-metrics-daemon-nqt4p" (UID: "5b53e2ac-1a53-4df0-a395-2718093476b6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:26:54.590895 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:54.590788    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94868cfc-85a8-4310-a339-2c4b44da043b-original-pull-secret podName:94868cfc-85a8-4310-a339-2c4b44da043b nodeName:}" failed. No retries permitted until 2026-07-24 19:26:55.590768694 +0000 UTC m=+4.109388720 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/94868cfc-85a8-4310-a339-2c4b44da043b-original-pull-secret") pod "global-pull-secret-syncer-gvbbc" (UID: "94868cfc-85a8-4310-a339-2c4b44da043b") : object "kube-system"/"original-pull-secret" not registered
Jul 24 19:26:54.691070 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.690989    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qh5nt\" (UniqueName: \"kubernetes.io/projected/9e802511-bdaa-463d-9572-22349bfbcd49-kube-api-access-qh5nt\") pod \"network-check-target-tv7vs\" (UID: \"9e802511-bdaa-463d-9572-22349bfbcd49\") " pod="openshift-network-diagnostics/network-check-target-tv7vs"
Jul 24 19:26:54.691243 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:54.691144    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 19:26:54.691243 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:54.691163    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 19:26:54.691243 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:54.691173    2567 projected.go:196] Error preparing data for projected volume kube-api-access-qh5nt for pod openshift-network-diagnostics/network-check-target-tv7vs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:26:54.691243 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:54.691232    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e802511-bdaa-463d-9572-22349bfbcd49-kube-api-access-qh5nt podName:9e802511-bdaa-463d-9572-22349bfbcd49 nodeName:}" failed. No retries permitted until 2026-07-24 19:26:55.691211145 +0000 UTC m=+4.209831186 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qh5nt" (UniqueName: "kubernetes.io/projected/9e802511-bdaa-463d-9572-22349bfbcd49-kube-api-access-qh5nt") pod "network-check-target-tv7vs" (UID: "9e802511-bdaa-463d-9572-22349bfbcd49") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:26:54.912954 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.912908    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 19:21:54 +0000 UTC" deadline="2028-01-21 01:39:50.829607324 +0000 UTC"
Jul 24 19:26:54.913662 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:54.912984    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13086h12m55.916659695s"
Jul 24 19:26:55.066427 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:55.066337    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gvbbc"
Jul 24 19:26:55.066606 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:55.066493    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gvbbc" podUID="94868cfc-85a8-4310-a339-2c4b44da043b"
Jul 24 19:26:55.142754 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:55.142723    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d148fa4_bff9_4286_a162_a0d07bb9c2a9.slice/crio-6ac70c026343c1b3dc49e78eb10ce5fe7625b54ac9c91c210ac280ec6cf32276 WatchSource:0}: Error finding container 6ac70c026343c1b3dc49e78eb10ce5fe7625b54ac9c91c210ac280ec6cf32276: Status 404 returned error can't find the container with id 6ac70c026343c1b3dc49e78eb10ce5fe7625b54ac9c91c210ac280ec6cf32276
Jul 24 19:26:55.144102 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:55.143977    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b49150d_39c5_4429_90e4_5f7a092b1619.slice/crio-a624c8452d3b54e9a6822b5d71d7cd80b4c081f1647a9ccd3dabe16fae8b2f4b WatchSource:0}: Error finding container a624c8452d3b54e9a6822b5d71d7cd80b4c081f1647a9ccd3dabe16fae8b2f4b: Status 404 returned error can't find the container with id a624c8452d3b54e9a6822b5d71d7cd80b4c081f1647a9ccd3dabe16fae8b2f4b
Jul 24 19:26:55.144911 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:55.144804    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75378781_af5d_4b0c_a6a5_3176b16700c7.slice/crio-d167591d18e5cc3884d7e919748c98875d6688cfd9063ac402326dc8f7df1e3a WatchSource:0}: Error finding container d167591d18e5cc3884d7e919748c98875d6688cfd9063ac402326dc8f7df1e3a: Status 404 returned error can't find the container with id d167591d18e5cc3884d7e919748c98875d6688cfd9063ac402326dc8f7df1e3a
Jul 24 19:26:55.148747 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:55.148703    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72c2265c_f7f6_462a_bf46_eda3f35de953.slice/crio-f01195f2f2d900adea5bb08f22e6ff2b61f46013ba7b044b4a231485a45adee6 WatchSource:0}: Error finding container f01195f2f2d900adea5bb08f22e6ff2b61f46013ba7b044b4a231485a45adee6: Status 404 returned error can't find the container with id f01195f2f2d900adea5bb08f22e6ff2b61f46013ba7b044b4a231485a45adee6
Jul 24 19:26:55.149981 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:55.149958    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ba5baab_dd60_4a1f_bece_25c178dbe520.slice/crio-b76c3bebc7488e77093ede3b9d82e6150fa8da5f54c4318dedf06f415b9b932c WatchSource:0}: Error finding container b76c3bebc7488e77093ede3b9d82e6150fa8da5f54c4318dedf06f415b9b932c: Status 404 returned error can't find the container with id b76c3bebc7488e77093ede3b9d82e6150fa8da5f54c4318dedf06f415b9b932c
Jul 24 19:26:55.150951 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:55.150418    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd38eaa42_116b_4a94_92e2_a9806f4c0cb9.slice/crio-23f6a46098d8e0c6eb00b5c4de10e1ca1e9b57cee1d8aab27b1d964ca93464f9 WatchSource:0}: Error finding container 23f6a46098d8e0c6eb00b5c4de10e1ca1e9b57cee1d8aab27b1d964ca93464f9: Status 404 returned error can't find the container with id 23f6a46098d8e0c6eb00b5c4de10e1ca1e9b57cee1d8aab27b1d964ca93464f9
Jul 24 19:26:55.151438 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:55.151414    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b4c1d88_b127_4f5a_985b_1eda0f9470fa.slice/crio-c897b4af142b91e5e7627e7ccc6c3b1cda68dba6ad8cbf907596c7e667c24c26 WatchSource:0}: Error finding container c897b4af142b91e5e7627e7ccc6c3b1cda68dba6ad8cbf907596c7e667c24c26: Status 404 returned error can't find the container with id c897b4af142b91e5e7627e7ccc6c3b1cda68dba6ad8cbf907596c7e667c24c26
Jul 24 19:26:55.155239 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:55.154673    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb85497d_d7d8_484b_aef8_ad70ac0db182.slice/crio-1f4388cf1dd3203c2972cd3dc7708669ae533fa9b2d31cd376139abc331f1b63 WatchSource:0}: Error finding container 1f4388cf1dd3203c2972cd3dc7708669ae533fa9b2d31cd376139abc331f1b63: Status 404 returned error can't find the container with id 1f4388cf1dd3203c2972cd3dc7708669ae533fa9b2d31cd376139abc331f1b63
Jul 24 19:26:55.155997 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:26:55.155973    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93f02579_75e7_459b_baae_032a5b2a46dc.slice/crio-3dd341611fd2150cf1c24407a744d283c99220b4d18ea63b686bb9e863edb5d4 WatchSource:0}: Error finding container 3dd341611fd2150cf1c24407a744d283c99220b4d18ea63b686bb9e863edb5d4: Status 404 returned error can't find the container with id 3dd341611fd2150cf1c24407a744d283c99220b4d18ea63b686bb9e863edb5d4
Jul 24 19:26:55.598527 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:55.598189    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94868cfc-85a8-4310-a339-2c4b44da043b-original-pull-secret\") pod \"global-pull-secret-syncer-gvbbc\" (UID: \"94868cfc-85a8-4310-a339-2c4b44da043b\") " pod="kube-system/global-pull-secret-syncer-gvbbc"
Jul 24 19:26:55.598675 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:55.598566    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b53e2ac-1a53-4df0-a395-2718093476b6-metrics-certs\") pod \"network-metrics-daemon-nqt4p\" (UID: \"5b53e2ac-1a53-4df0-a395-2718093476b6\") " pod="openshift-multus/network-metrics-daemon-nqt4p"
Jul 24 19:26:55.598723 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:55.598423    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 19:26:55.598776 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:55.598740    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94868cfc-85a8-4310-a339-2c4b44da043b-original-pull-secret podName:94868cfc-85a8-4310-a339-2c4b44da043b nodeName:}" failed. No retries permitted until 2026-07-24 19:26:57.598724418 +0000 UTC m=+6.117344438 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/94868cfc-85a8-4310-a339-2c4b44da043b-original-pull-secret") pod "global-pull-secret-syncer-gvbbc" (UID: "94868cfc-85a8-4310-a339-2c4b44da043b") : object "kube-system"/"original-pull-secret" not registered
Jul 24 19:26:55.599067 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:55.598674    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:26:55.599179 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:55.599090    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b53e2ac-1a53-4df0-a395-2718093476b6-metrics-certs podName:5b53e2ac-1a53-4df0-a395-2718093476b6 nodeName:}" failed. No retries permitted until 2026-07-24 19:26:57.59907753 +0000 UTC m=+6.117697550 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b53e2ac-1a53-4df0-a395-2718093476b6-metrics-certs") pod "network-metrics-daemon-nqt4p" (UID: "5b53e2ac-1a53-4df0-a395-2718093476b6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:26:55.699457 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:55.699415    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qh5nt\" (UniqueName: \"kubernetes.io/projected/9e802511-bdaa-463d-9572-22349bfbcd49-kube-api-access-qh5nt\") pod \"network-check-target-tv7vs\" (UID: \"9e802511-bdaa-463d-9572-22349bfbcd49\") " pod="openshift-network-diagnostics/network-check-target-tv7vs"
Jul 24 19:26:55.699654 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:55.699636    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 19:26:55.699734 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:55.699713    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 19:26:55.699734 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:55.699728    2567 projected.go:196] Error preparing data for projected volume kube-api-access-qh5nt for pod openshift-network-diagnostics/network-check-target-tv7vs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:26:55.699842 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:55.699791    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e802511-bdaa-463d-9572-22349bfbcd49-kube-api-access-qh5nt podName:9e802511-bdaa-463d-9572-22349bfbcd49 nodeName:}" failed. No retries permitted until 2026-07-24 19:26:57.699770933 +0000 UTC m=+6.218390969 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qh5nt" (UniqueName: "kubernetes.io/projected/9e802511-bdaa-463d-9572-22349bfbcd49-kube-api-access-qh5nt") pod "network-check-target-tv7vs" (UID: "9e802511-bdaa-463d-9572-22349bfbcd49") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:26:55.913382 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:55.913287    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 19:21:54 +0000 UTC" deadline="2027-12-29 07:15:35.321211233 +0000 UTC"
Jul 24 19:26:55.913382 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:55.913330    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12539h48m39.40788708s"
Jul 24 19:26:56.066721 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:56.066691    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tv7vs"
Jul 24 19:26:56.066928 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:56.066699    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nqt4p"
Jul 24 19:26:56.066997 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:56.066934    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tv7vs" podUID="9e802511-bdaa-463d-9572-22349bfbcd49"
Jul 24 19:26:56.067097 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:56.067051    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nqt4p" podUID="5b53e2ac-1a53-4df0-a395-2718093476b6"
Jul 24 19:26:56.079815 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:56.079746    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9f2q" event={"ID":"93f02579-75e7-459b-baae-032a5b2a46dc","Type":"ContainerStarted","Data":"3dd341611fd2150cf1c24407a744d283c99220b4d18ea63b686bb9e863edb5d4"}
Jul 24 19:26:56.090503 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:56.090428    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2586j" event={"ID":"0b4c1d88-b127-4f5a-985b-1eda0f9470fa","Type":"ContainerStarted","Data":"c897b4af142b91e5e7627e7ccc6c3b1cda68dba6ad8cbf907596c7e667c24c26"}
Jul 24 19:26:56.108876 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:56.108845    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-77d9q" event={"ID":"fb85497d-d7d8-484b-aef8-ad70ac0db182","Type":"ContainerStarted","Data":"1f4388cf1dd3203c2972cd3dc7708669ae533fa9b2d31cd376139abc331f1b63"}
Jul 24 19:26:56.118482 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:56.118381    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d87bq" event={"ID":"72c2265c-f7f6-462a-bf46-eda3f35de953","Type":"ContainerStarted","Data":"f01195f2f2d900adea5bb08f22e6ff2b61f46013ba7b044b4a231485a45adee6"}
Jul 24 19:26:56.125087 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:56.124389    2567 generic.go:356] "Generic (PLEG): container finished" podID="6fe5cd5134e56726bcd7ca2df5720e0f" containerID="3db9d61805e9f7b8e51232b478294e0f6efb0138afa88977c9f4da1612ad63e2" exitCode=0
Jul 24 19:26:56.125087 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:56.124474    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-84.ec2.internal" event={"ID":"6fe5cd5134e56726bcd7ca2df5720e0f","Type":"ContainerDied","Data":"3db9d61805e9f7b8e51232b478294e0f6efb0138afa88977c9f4da1612ad63e2"}
Jul 24 19:26:56.143383 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:56.143314    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-swjv4" event={"ID":"d38eaa42-116b-4a94-92e2-a9806f4c0cb9","Type":"ContainerStarted","Data":"23f6a46098d8e0c6eb00b5c4de10e1ca1e9b57cee1d8aab27b1d964ca93464f9"}
Jul 24 19:26:56.147249 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:56.147194    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wvbtg" event={"ID":"7ba5baab-dd60-4a1f-bece-25c178dbe520","Type":"ContainerStarted","Data":"b76c3bebc7488e77093ede3b9d82e6150fa8da5f54c4318dedf06f415b9b932c"}
Jul 24 19:26:56.148757 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:56.148723    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-v2l9c" event={"ID":"75378781-af5d-4b0c-a6a5-3176b16700c7","Type":"ContainerStarted","Data":"d167591d18e5cc3884d7e919748c98875d6688cfd9063ac402326dc8f7df1e3a"}
Jul 24 19:26:56.155132 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:56.155107    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qqf8p" event={"ID":"3b49150d-39c5-4429-90e4-5f7a092b1619","Type":"ContainerStarted","Data":"a624c8452d3b54e9a6822b5d71d7cd80b4c081f1647a9ccd3dabe16fae8b2f4b"}
Jul 24 19:26:56.163095 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:56.163069    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bzptt" event={"ID":"8d148fa4-bff9-4286-a162-a0d07bb9c2a9","Type":"ContainerStarted","Data":"6ac70c026343c1b3dc49e78eb10ce5fe7625b54ac9c91c210ac280ec6cf32276"}
Jul 24 19:26:56.170468 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:56.170397    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-84.ec2.internal" event={"ID":"8560c43657f7ea2f80765f41474cfd07","Type":"ContainerStarted","Data":"8d2fe91047496c0ab981a6106e471b4a31c5b810de0066d11e72f7966b133309"}
Jul 24 19:26:57.066616 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:57.066046    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gvbbc"
Jul 24 19:26:57.066616 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:57.066187    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gvbbc" podUID="94868cfc-85a8-4310-a339-2c4b44da043b"
Jul 24 19:26:57.195071 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:57.195032    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-84.ec2.internal" event={"ID":"6fe5cd5134e56726bcd7ca2df5720e0f","Type":"ContainerStarted","Data":"77d63508d27be00417f3f62db9b0576a009b457396a185c08e10d0e0ba06f929"}
Jul 24 19:26:57.212063 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:57.211989    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-84.ec2.internal" podStartSLOduration=4.211946197 podStartE2EDuration="4.211946197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:26:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:26:56.197414291 +0000 UTC m=+4.716034337" watchObservedRunningTime="2026-07-24 19:26:57.211946197 +0000 UTC m=+5.730566242"
Jul 24 19:26:57.619759 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:57.619087    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b53e2ac-1a53-4df0-a395-2718093476b6-metrics-certs\") pod \"network-metrics-daemon-nqt4p\" (UID: \"5b53e2ac-1a53-4df0-a395-2718093476b6\") " pod="openshift-multus/network-metrics-daemon-nqt4p"
Jul 24 19:26:57.619759 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:57.619164    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94868cfc-85a8-4310-a339-2c4b44da043b-original-pull-secret\") pod \"global-pull-secret-syncer-gvbbc\" (UID: \"94868cfc-85a8-4310-a339-2c4b44da043b\") " pod="kube-system/global-pull-secret-syncer-gvbbc"
Jul 24 19:26:57.619759 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:57.619311    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 19:26:57.619759 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:57.619375    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94868cfc-85a8-4310-a339-2c4b44da043b-original-pull-secret podName:94868cfc-85a8-4310-a339-2c4b44da043b nodeName:}" failed. No retries permitted until 2026-07-24 19:27:01.619356835 +0000 UTC m=+10.137976858 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/94868cfc-85a8-4310-a339-2c4b44da043b-original-pull-secret") pod "global-pull-secret-syncer-gvbbc" (UID: "94868cfc-85a8-4310-a339-2c4b44da043b") : object "kube-system"/"original-pull-secret" not registered
Jul 24 19:26:57.619759 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:57.619530    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:26:57.619759 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:57.619597    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b53e2ac-1a53-4df0-a395-2718093476b6-metrics-certs podName:5b53e2ac-1a53-4df0-a395-2718093476b6 nodeName:}" failed. No retries permitted until 2026-07-24 19:27:01.619577795 +0000 UTC m=+10.138197818 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b53e2ac-1a53-4df0-a395-2718093476b6-metrics-certs") pod "network-metrics-daemon-nqt4p" (UID: "5b53e2ac-1a53-4df0-a395-2718093476b6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:26:57.720303 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:57.719579    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qh5nt\" (UniqueName: \"kubernetes.io/projected/9e802511-bdaa-463d-9572-22349bfbcd49-kube-api-access-qh5nt\") pod \"network-check-target-tv7vs\" (UID: \"9e802511-bdaa-463d-9572-22349bfbcd49\") " pod="openshift-network-diagnostics/network-check-target-tv7vs"
Jul 24 19:26:57.720303 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:57.719783    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 19:26:57.720303 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:57.719808    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 19:26:57.720303 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:57.719823    2567 projected.go:196] Error preparing data for projected volume kube-api-access-qh5nt for pod openshift-network-diagnostics/network-check-target-tv7vs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:26:57.720303 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:57.719891    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e802511-bdaa-463d-9572-22349bfbcd49-kube-api-access-qh5nt podName:9e802511-bdaa-463d-9572-22349bfbcd49 nodeName:}" failed. No retries permitted until 2026-07-24 19:27:01.719870131 +0000 UTC m=+10.238490154 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qh5nt" (UniqueName: "kubernetes.io/projected/9e802511-bdaa-463d-9572-22349bfbcd49-kube-api-access-qh5nt") pod "network-check-target-tv7vs" (UID: "9e802511-bdaa-463d-9572-22349bfbcd49") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:26:58.068578 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:58.068481    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nqt4p"
Jul 24 19:26:58.069147 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:58.068650    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nqt4p" podUID="5b53e2ac-1a53-4df0-a395-2718093476b6"
Jul 24 19:26:58.069147 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:58.069047    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tv7vs"
Jul 24 19:26:58.069269 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:58.069148    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tv7vs" podUID="9e802511-bdaa-463d-9572-22349bfbcd49"
Jul 24 19:26:59.066062 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:26:59.066027    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gvbbc"
Jul 24 19:26:59.066257 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:26:59.066159    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gvbbc" podUID="94868cfc-85a8-4310-a339-2c4b44da043b"
Jul 24 19:27:00.068917 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:00.068186    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tv7vs"
Jul 24 19:27:00.068917 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:00.068316    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tv7vs" podUID="9e802511-bdaa-463d-9572-22349bfbcd49"
Jul 24 19:27:00.068917 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:00.068746    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nqt4p"
Jul 24 19:27:00.068917 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:00.068859    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nqt4p" podUID="5b53e2ac-1a53-4df0-a395-2718093476b6"
Jul 24 19:27:01.065381 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:01.065343    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gvbbc"
Jul 24 19:27:01.065579 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:01.065510    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gvbbc" podUID="94868cfc-85a8-4310-a339-2c4b44da043b"
Jul 24 19:27:01.654973 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:01.654941    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b53e2ac-1a53-4df0-a395-2718093476b6-metrics-certs\") pod \"network-metrics-daemon-nqt4p\" (UID: \"5b53e2ac-1a53-4df0-a395-2718093476b6\") " pod="openshift-multus/network-metrics-daemon-nqt4p"
Jul 24 19:27:01.655385 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:01.654996    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94868cfc-85a8-4310-a339-2c4b44da043b-original-pull-secret\") pod \"global-pull-secret-syncer-gvbbc\" (UID: \"94868cfc-85a8-4310-a339-2c4b44da043b\") " pod="kube-system/global-pull-secret-syncer-gvbbc"
Jul 24 19:27:01.655385 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:01.655091    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 19:27:01.655385 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:01.655099    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:27:01.655385 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:01.655141    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94868cfc-85a8-4310-a339-2c4b44da043b-original-pull-secret podName:94868cfc-85a8-4310-a339-2c4b44da043b nodeName:}" failed. No retries permitted until 2026-07-24 19:27:09.65512829 +0000 UTC m=+18.173748309 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/94868cfc-85a8-4310-a339-2c4b44da043b-original-pull-secret") pod "global-pull-secret-syncer-gvbbc" (UID: "94868cfc-85a8-4310-a339-2c4b44da043b") : object "kube-system"/"original-pull-secret" not registered
Jul 24 19:27:01.655385 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:01.655165    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b53e2ac-1a53-4df0-a395-2718093476b6-metrics-certs podName:5b53e2ac-1a53-4df0-a395-2718093476b6 nodeName:}" failed. No retries permitted until 2026-07-24 19:27:09.65514666 +0000 UTC m=+18.173766698 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b53e2ac-1a53-4df0-a395-2718093476b6-metrics-certs") pod "network-metrics-daemon-nqt4p" (UID: "5b53e2ac-1a53-4df0-a395-2718093476b6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:27:01.756032 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:01.755995    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qh5nt\" (UniqueName: \"kubernetes.io/projected/9e802511-bdaa-463d-9572-22349bfbcd49-kube-api-access-qh5nt\") pod \"network-check-target-tv7vs\" (UID: \"9e802511-bdaa-463d-9572-22349bfbcd49\") " pod="openshift-network-diagnostics/network-check-target-tv7vs"
Jul 24 19:27:01.756184 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:01.756154    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 19:27:01.756184 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:01.756176    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 19:27:01.756305 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:01.756189    2567 projected.go:196] Error preparing data for projected volume kube-api-access-qh5nt for pod openshift-network-diagnostics/network-check-target-tv7vs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:27:01.756305 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:01.756239    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e802511-bdaa-463d-9572-22349bfbcd49-kube-api-access-qh5nt podName:9e802511-bdaa-463d-9572-22349bfbcd49 nodeName:}" failed. No retries permitted until 2026-07-24 19:27:09.756225599 +0000 UTC m=+18.274845618 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qh5nt" (UniqueName: "kubernetes.io/projected/9e802511-bdaa-463d-9572-22349bfbcd49-kube-api-access-qh5nt") pod "network-check-target-tv7vs" (UID: "9e802511-bdaa-463d-9572-22349bfbcd49") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:27:02.066820 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:02.066733    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tv7vs"
Jul 24 19:27:02.066979 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:02.066852    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tv7vs" podUID="9e802511-bdaa-463d-9572-22349bfbcd49"
Jul 24 19:27:02.066979 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:02.066922    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nqt4p"
Jul 24 19:27:02.067087 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:02.067048    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nqt4p" podUID="5b53e2ac-1a53-4df0-a395-2718093476b6"
Jul 24 19:27:03.065957 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:03.065508    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gvbbc"
Jul 24 19:27:03.065957 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:03.065652    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gvbbc" podUID="94868cfc-85a8-4310-a339-2c4b44da043b"
Jul 24 19:27:04.067183 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:04.067147    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nqt4p"
Jul 24 19:27:04.067633 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:04.067330    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nqt4p" podUID="5b53e2ac-1a53-4df0-a395-2718093476b6"
Jul 24 19:27:04.067821 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:04.067803    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tv7vs"
Jul 24 19:27:04.067945 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:04.067926    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tv7vs" podUID="9e802511-bdaa-463d-9572-22349bfbcd49"
Jul 24 19:27:05.065421 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:05.065386    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gvbbc"
Jul 24 19:27:05.065623 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:05.065543    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gvbbc" podUID="94868cfc-85a8-4310-a339-2c4b44da043b"
Jul 24 19:27:06.065960 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:06.065874    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nqt4p"
Jul 24 19:27:06.065960 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:06.065931    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tv7vs"
Jul 24 19:27:06.066446 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:06.066030    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nqt4p" podUID="5b53e2ac-1a53-4df0-a395-2718093476b6"
Jul 24 19:27:06.066446 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:06.066154    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tv7vs" podUID="9e802511-bdaa-463d-9572-22349bfbcd49"
Jul 24 19:27:07.065235 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:07.065197    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gvbbc"
Jul 24 19:27:07.065393 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:07.065311    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gvbbc" podUID="94868cfc-85a8-4310-a339-2c4b44da043b"
Jul 24 19:27:08.065834 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:08.065797    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nqt4p"
Jul 24 19:27:08.065834 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:08.065813    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tv7vs"
Jul 24 19:27:08.066330 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:08.065939    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nqt4p" podUID="5b53e2ac-1a53-4df0-a395-2718093476b6"
Jul 24 19:27:08.066330 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:08.066069    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tv7vs" podUID="9e802511-bdaa-463d-9572-22349bfbcd49"
Jul 24 19:27:09.066287 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:09.066235    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gvbbc"
Jul 24 19:27:09.066705 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:09.066368    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gvbbc" podUID="94868cfc-85a8-4310-a339-2c4b44da043b"
Jul 24 19:27:09.713324 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:09.713224    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b53e2ac-1a53-4df0-a395-2718093476b6-metrics-certs\") pod \"network-metrics-daemon-nqt4p\" (UID: \"5b53e2ac-1a53-4df0-a395-2718093476b6\") " pod="openshift-multus/network-metrics-daemon-nqt4p"
Jul 24 19:27:09.713324 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:09.713303    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94868cfc-85a8-4310-a339-2c4b44da043b-original-pull-secret\") pod \"global-pull-secret-syncer-gvbbc\" (UID: \"94868cfc-85a8-4310-a339-2c4b44da043b\") " pod="kube-system/global-pull-secret-syncer-gvbbc"
Jul 24 19:27:09.713553 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:09.713365    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:27:09.713553 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:09.713420    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 19:27:09.713553 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:09.713434    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b53e2ac-1a53-4df0-a395-2718093476b6-metrics-certs podName:5b53e2ac-1a53-4df0-a395-2718093476b6 nodeName:}" failed. No retries permitted until 2026-07-24 19:27:25.71341644 +0000 UTC m=+34.232036485 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b53e2ac-1a53-4df0-a395-2718093476b6-metrics-certs") pod "network-metrics-daemon-nqt4p" (UID: "5b53e2ac-1a53-4df0-a395-2718093476b6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:27:09.713553 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:09.713470    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94868cfc-85a8-4310-a339-2c4b44da043b-original-pull-secret podName:94868cfc-85a8-4310-a339-2c4b44da043b nodeName:}" failed. No retries permitted until 2026-07-24 19:27:25.713454091 +0000 UTC m=+34.232074112 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/94868cfc-85a8-4310-a339-2c4b44da043b-original-pull-secret") pod "global-pull-secret-syncer-gvbbc" (UID: "94868cfc-85a8-4310-a339-2c4b44da043b") : object "kube-system"/"original-pull-secret" not registered
Jul 24 19:27:09.814242 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:09.814206    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qh5nt\" (UniqueName: \"kubernetes.io/projected/9e802511-bdaa-463d-9572-22349bfbcd49-kube-api-access-qh5nt\") pod \"network-check-target-tv7vs\" (UID: \"9e802511-bdaa-463d-9572-22349bfbcd49\") " pod="openshift-network-diagnostics/network-check-target-tv7vs"
Jul 24 19:27:09.814456 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:09.814433    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 19:27:09.814541 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:09.814461    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 19:27:09.814541 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:09.814473    2567 projected.go:196] Error preparing data for projected volume kube-api-access-qh5nt for pod openshift-network-diagnostics/network-check-target-tv7vs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:27:09.814633 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:09.814554    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e802511-bdaa-463d-9572-22349bfbcd49-kube-api-access-qh5nt podName:9e802511-bdaa-463d-9572-22349bfbcd49 nodeName:}" failed. No retries permitted until 2026-07-24 19:27:25.814534958 +0000 UTC m=+34.333154980 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qh5nt" (UniqueName: "kubernetes.io/projected/9e802511-bdaa-463d-9572-22349bfbcd49-kube-api-access-qh5nt") pod "network-check-target-tv7vs" (UID: "9e802511-bdaa-463d-9572-22349bfbcd49") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:27:10.066473 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:10.066383    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nqt4p"
Jul 24 19:27:10.066473 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:10.066429    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tv7vs"
Jul 24 19:27:10.066934 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:10.066561    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nqt4p" podUID="5b53e2ac-1a53-4df0-a395-2718093476b6"
Jul 24 19:27:10.066934 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:10.066677    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tv7vs" podUID="9e802511-bdaa-463d-9572-22349bfbcd49"
Jul 24 19:27:11.065643 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:11.065604    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gvbbc"
Jul 24 19:27:11.065813 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:11.065739    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gvbbc" podUID="94868cfc-85a8-4310-a339-2c4b44da043b"
Jul 24 19:27:12.067066 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:12.067032    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nqt4p"
Jul 24 19:27:12.067615 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:12.067149    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nqt4p" podUID="5b53e2ac-1a53-4df0-a395-2718093476b6"
Jul 24 19:27:12.067615 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:12.067194    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tv7vs"
Jul 24 19:27:12.067615 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:12.067245    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tv7vs" podUID="9e802511-bdaa-463d-9572-22349bfbcd49"
Jul 24 19:27:13.065953 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:13.065925    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gvbbc"
Jul 24 19:27:13.066127 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:13.066059    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gvbbc" podUID="94868cfc-85a8-4310-a339-2c4b44da043b"
Jul 24 19:27:14.066117 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:14.065963    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nqt4p"
Jul 24 19:27:14.066430 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:14.065963    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tv7vs"
Jul 24 19:27:14.066430 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:14.066189    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nqt4p" podUID="5b53e2ac-1a53-4df0-a395-2718093476b6"
Jul 24 19:27:14.066430 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:14.066258    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tv7vs" podUID="9e802511-bdaa-463d-9572-22349bfbcd49"
Jul 24 19:27:14.245071 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:14.245005    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-swjv4" event={"ID":"d38eaa42-116b-4a94-92e2-a9806f4c0cb9","Type":"ContainerStarted","Data":"eaa2a296dd4ee1cb059f135179766a2a811225a1b74b40c6cc311c3d9c938100"}
Jul 24 19:27:14.248215 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:14.248189    2567 generic.go:356] "Generic (PLEG): container finished" podID="7ba5baab-dd60-4a1f-bece-25c178dbe520" containerID="3aae3a3e82f8dedfb331b653f2b2d91a61177e9d82a96a03c4028dab0e61f1dc" exitCode=0
Jul 24 19:27:14.248305 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:14.248264    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wvbtg" event={"ID":"7ba5baab-dd60-4a1f-bece-25c178dbe520","Type":"ContainerDied","Data":"3aae3a3e82f8dedfb331b653f2b2d91a61177e9d82a96a03c4028dab0e61f1dc"}
Jul 24 19:27:14.249729 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:14.249702    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-v2l9c" event={"ID":"75378781-af5d-4b0c-a6a5-3176b16700c7","Type":"ContainerStarted","Data":"61d639f018a7dc1bcb6faf14cfcca492f4c5d1e248df619bc753233d9afca93c"}
Jul 24 19:27:14.251222 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:14.251149    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bzptt" event={"ID":"8d148fa4-bff9-4286-a162-a0d07bb9c2a9","Type":"ContainerStarted","Data":"4a0842db44b2005af4d1cc147159f046dead7063f9fba2b4bbd33057954b26a3"}
Jul 24 19:27:14.252711 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:14.252688    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9f2q" event={"ID":"93f02579-75e7-459b-baae-032a5b2a46dc","Type":"ContainerStarted","Data":"1b9d33da323c1e3e4ae0b4ed45c39897f79a2f2d573839fc742c1a2acb1806d8"}
Jul 24 19:27:14.254100 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:14.254082    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2586j" event={"ID":"0b4c1d88-b127-4f5a-985b-1eda0f9470fa","Type":"ContainerStarted","Data":"28e4c5f750f12362d1547d82766ec822ed9f0c094ced8ebe018ac60322152dcb"}
Jul 24 19:27:14.256179 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:14.256162    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d87bq_72c2265c-f7f6-462a-bf46-eda3f35de953/ovn-acl-logging/0.log"
Jul 24 19:27:14.256602 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:14.256583    2567 generic.go:356] "Generic (PLEG): container finished" podID="72c2265c-f7f6-462a-bf46-eda3f35de953" containerID="ae6fd7d2859b9727f7b7fe23a1e8f6bf9b5f3968f96b7eca8e64bae9db56488a" exitCode=1
Jul 24 19:27:14.256699 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:14.256614    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d87bq" event={"ID":"72c2265c-f7f6-462a-bf46-eda3f35de953","Type":"ContainerStarted","Data":"6784830380cee3e273a6f02360a6fc7024363eef4e1c56ef26391537b56f02dc"}
Jul 24 19:27:14.256699 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:14.256677    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d87bq" event={"ID":"72c2265c-f7f6-462a-bf46-eda3f35de953","Type":"ContainerDied","Data":"ae6fd7d2859b9727f7b7fe23a1e8f6bf9b5f3968f96b7eca8e64bae9db56488a"}
Jul 24 19:27:14.256798 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:14.256728    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d87bq" event={"ID":"72c2265c-f7f6-462a-bf46-eda3f35de953","Type":"ContainerStarted","Data":"a63f9edd51c598134d7fbcca31a587776dec5857943b139708c3a38151c5fbf0"}
Jul 24 19:27:14.259985 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:14.259950    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-swjv4" podStartSLOduration=3.630863381 podStartE2EDuration="22.259940044s" totalImagesPullingTime="18.629076663s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:26:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:27:14.259774935 +0000 UTC m=+22.778394975" watchObservedRunningTime="2026-07-24 19:27:14.259940044 +0000 UTC m=+22.778560084"
Jul 24 19:27:14.260089 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:14.260062    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-84.ec2.internal" podStartSLOduration=21.260055429 podStartE2EDuration="21.260055429s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:26:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:26:57.21175429 +0000 UTC m=+5.730374337" watchObservedRunningTime="2026-07-24 19:27:14.260055429 +0000 UTC m=+22.778675471"
Jul 24 19:27:14.303838 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:14.303781    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2586j" podStartSLOduration=3.676957652 podStartE2EDuration="22.303761564s" totalImagesPullingTime="18.626803912s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:26:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:27:14.303349935 +0000 UTC m=+22.821969988" watchObservedRunningTime="2026-07-24 19:27:14.303761564 +0000 UTC m=+22.822381606"
Jul 24 19:27:14.304252 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:14.304218    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bzptt" podStartSLOduration=3.666046215 podStartE2EDuration="22.304202245s" totalImagesPullingTime="18.63815603s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:26:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:27:14.278236227 +0000 UTC m=+22.796856266" watchObservedRunningTime="2026-07-24 19:27:14.304202245 +0000 UTC m=+22.822822287"
Jul 24 19:27:15.066243 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:15.066015    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gvbbc"
Jul 24 19:27:15.067021 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:15.066347    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gvbbc" podUID="94868cfc-85a8-4310-a339-2c4b44da043b"
Jul 24 19:27:15.260030 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:15.260001    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-77d9q" event={"ID":"fb85497d-d7d8-484b-aef8-ad70ac0db182","Type":"ContainerStarted","Data":"a1bed28587de14e94e268614d70f1089da3345c4872fc123eaa009304c38ebf8"}
Jul 24 19:27:15.264278 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:15.264257    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d87bq_72c2265c-f7f6-462a-bf46-eda3f35de953/ovn-acl-logging/0.log"
Jul 24 19:27:15.264717 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:15.264689    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d87bq" event={"ID":"72c2265c-f7f6-462a-bf46-eda3f35de953","Type":"ContainerStarted","Data":"b6bf71406959410a51e6b8967fbf794a1015584a405c7db5f9e5948ed5aafe9c"}
Jul 24 19:27:15.264834 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:15.264772    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d87bq" event={"ID":"72c2265c-f7f6-462a-bf46-eda3f35de953","Type":"ContainerStarted","Data":"9f0015a061224cd7d334da9d72af0f1cafcc885f8ff5a4778a37f07774c11979"}
Jul 24 19:27:15.264834 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:15.264825    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d87bq" event={"ID":"72c2265c-f7f6-462a-bf46-eda3f35de953","Type":"ContainerStarted","Data":"c844e4985dc5ac523911c967d70c3284060e5de0d9473b93a4853b47ecbd828e"}
Jul 24 19:27:15.266401 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:15.266370    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qqf8p" event={"ID":"3b49150d-39c5-4429-90e4-5f7a092b1619","Type":"ContainerStarted","Data":"d9bfffb5f23e9eb803db01b61c37df5eff279adadd3a8e42e5426e0615ba5fed"}
Jul 24 19:27:15.281397 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:15.281349    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-v2l9c" podStartSLOduration=8.991669261 podStartE2EDuration="23.281331296s" totalImagesPullingTime="14.289662035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:26:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:27:14.382302777 +0000 UTC m=+22.900922818" watchObservedRunningTime="2026-07-24 19:27:15.281331296 +0000 UTC m=+23.799951338"
Jul 24 19:27:15.282003 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:15.281958    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-77d9q" podStartSLOduration=4.290257152 podStartE2EDuration="23.281940708s" totalImagesPullingTime="18.991683556s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:26:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:27:15.281133671 +0000 UTC m=+23.799753712" watchObservedRunningTime="2026-07-24 19:27:15.281940708 +0000 UTC m=+23.800560748"
Jul 24 19:27:15.403118 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:15.403051    2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 24 19:27:15.940794 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:15.940692    2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T19:27:15.403074974Z","UUID":"a95a6aa6-225f-4c65-8f9f-ea4e45ccb429","Handler":null,"Name":"","Endpoint":""}
Jul 24 19:27:15.942357 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:15.942335    2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 24 19:27:15.942527 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:15.942377    2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 24 19:27:16.066455 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:16.066423    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tv7vs"
Jul 24 19:27:16.066905 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:16.066576    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tv7vs" podUID="9e802511-bdaa-463d-9572-22349bfbcd49"
Jul 24 19:27:16.066905 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:16.066634    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nqt4p"
Jul 24 19:27:16.066905 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:16.066755    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nqt4p" podUID="5b53e2ac-1a53-4df0-a395-2718093476b6"
Jul 24 19:27:16.086918 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:16.086890    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-v2l9c"
Jul 24 19:27:16.087587 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:16.087566    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-v2l9c"
Jul 24 19:27:16.121608 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:16.121556    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qqf8p" podStartSLOduration=9.831167735 podStartE2EDuration="24.12153856s" totalImagesPullingTime="14.290370825s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:26:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:27:15.298557912 +0000 UTC m=+23.817177954" watchObservedRunningTime="2026-07-24 19:27:16.12153856 +0000 UTC m=+24.640158603"
Jul 24 19:27:16.271348 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:16.271266    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9f2q" event={"ID":"93f02579-75e7-459b-baae-032a5b2a46dc","Type":"ContainerStarted","Data":"b0f2b22865f8a780b8d441b2713aa5e01d40681f4a7e4c44c8a75cb4d5b030ce"}
Jul 24 19:27:16.271926 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:16.271899    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-v2l9c"
Jul 24 19:27:16.272357 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:16.272337    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-v2l9c"
Jul 24 19:27:17.066019 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:17.065944    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gvbbc"
Jul 24 19:27:17.066168 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:17.066066    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gvbbc" podUID="94868cfc-85a8-4310-a339-2c4b44da043b"
Jul 24 19:27:17.277616 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:17.277584    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d87bq_72c2265c-f7f6-462a-bf46-eda3f35de953/ovn-acl-logging/0.log"
Jul 24 19:27:17.278065 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:17.278032    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d87bq" event={"ID":"72c2265c-f7f6-462a-bf46-eda3f35de953","Type":"ContainerStarted","Data":"f8e4adb7fc4720ccaec6b7643ba76426f78b1444913ca208ce135ac9a6b09c4e"}
Jul 24 19:27:17.280573 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:17.280542    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9f2q" event={"ID":"93f02579-75e7-459b-baae-032a5b2a46dc","Type":"ContainerStarted","Data":"cb3f07f50cc91d3056de756f5613c0f76218db646e1773ba6054780546fb867a"}
Jul 24 19:27:17.302244 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:17.302201    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9f2q" podStartSLOduration=4.464990815 podStartE2EDuration="25.30218729s" totalImagesPullingTime="20.837196475s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:26:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:27:17.302040587 +0000 UTC m=+25.820660624" watchObservedRunningTime="2026-07-24 19:27:17.30218729 +0000 UTC m=+25.820807331"
Jul 24 19:27:18.065681 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:18.065646    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tv7vs"
Jul 24 19:27:18.065871 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:18.065645    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nqt4p"
Jul 24 19:27:18.065871 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:18.065765    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tv7vs" podUID="9e802511-bdaa-463d-9572-22349bfbcd49"
Jul 24 19:27:18.065988 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:18.065866    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nqt4p" podUID="5b53e2ac-1a53-4df0-a395-2718093476b6"
Jul 24 19:27:19.066018 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:19.065802    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gvbbc"
Jul 24 19:27:19.066695 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:19.066044    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gvbbc" podUID="94868cfc-85a8-4310-a339-2c4b44da043b"
Jul 24 19:27:19.287672 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:19.287646    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d87bq_72c2265c-f7f6-462a-bf46-eda3f35de953/ovn-acl-logging/0.log"
Jul 24 19:27:19.288020 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:19.287995    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d87bq" event={"ID":"72c2265c-f7f6-462a-bf46-eda3f35de953","Type":"ContainerStarted","Data":"9c5085ff014d33e48e8110c62a5cff2a405118322cab46d07224f70dacb33644"}
Jul 24 19:27:19.288267 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:19.288239    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:27:19.288419 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:19.288402    2567 scope.go:117] "RemoveContainer" containerID="ae6fd7d2859b9727f7b7fe23a1e8f6bf9b5f3968f96b7eca8e64bae9db56488a"
Jul 24 19:27:19.289900 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:19.289876    2567 generic.go:356] "Generic (PLEG): container finished" podID="7ba5baab-dd60-4a1f-bece-25c178dbe520" containerID="4b176cdfd2da5d3620c2c387a9cdaa455f8ce371e78ca6ef871c2bab647db838" exitCode=0
Jul 24 19:27:19.289990 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:19.289904    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wvbtg" event={"ID":"7ba5baab-dd60-4a1f-bece-25c178dbe520","Type":"ContainerDied","Data":"4b176cdfd2da5d3620c2c387a9cdaa455f8ce371e78ca6ef871c2bab647db838"}
Jul 24 19:27:19.305593 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:19.305444    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:27:20.066430 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:20.066351    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tv7vs"
Jul 24 19:27:20.066430 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:20.066384    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nqt4p"
Jul 24 19:27:20.066883 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:20.066519    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tv7vs" podUID="9e802511-bdaa-463d-9572-22349bfbcd49"
Jul 24 19:27:20.066883 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:20.066598    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nqt4p" podUID="5b53e2ac-1a53-4df0-a395-2718093476b6"
Jul 24 19:27:20.295768 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:20.295744    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d87bq_72c2265c-f7f6-462a-bf46-eda3f35de953/ovn-acl-logging/0.log"
Jul 24 19:27:20.296124 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:20.296100    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d87bq" event={"ID":"72c2265c-f7f6-462a-bf46-eda3f35de953","Type":"ContainerStarted","Data":"cc48d37e3ef530573f908d66a732d69cb7d4256f33b58915fbd9e6f6aad63fc4"}
Jul 24 19:27:20.296283 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:20.296263    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:27:20.296374 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:20.296341    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:27:20.298273 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:20.298251    2567 generic.go:356] "Generic (PLEG): container finished" podID="7ba5baab-dd60-4a1f-bece-25c178dbe520" containerID="55dcfdcdfbfbd6e32ee45272e9cae648e3581be8ca65d36efe4709f88cb50870" exitCode=0
Jul 24 19:27:20.298398 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:20.298293    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wvbtg" event={"ID":"7ba5baab-dd60-4a1f-bece-25c178dbe520","Type":"ContainerDied","Data":"55dcfdcdfbfbd6e32ee45272e9cae648e3581be8ca65d36efe4709f88cb50870"}
Jul 24 19:27:20.312066 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:20.312044    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:27:20.322892 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:20.322795    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-d87bq" podStartSLOduration=9.645586747 podStartE2EDuration="28.322780471s" totalImagesPullingTime="18.677193724s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:26:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:27:20.321765775 +0000 UTC m=+28.840385816" watchObservedRunningTime="2026-07-24 19:27:20.322780471 +0000 UTC m=+28.841400494"
Jul 24 19:27:20.874663 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:20.874628    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gvbbc"]
Jul 24 19:27:20.874838 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:20.874757    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gvbbc"
Jul 24 19:27:20.874886 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:20.874837    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gvbbc" podUID="94868cfc-85a8-4310-a339-2c4b44da043b"
Jul 24 19:27:20.878734 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:20.878701    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nqt4p"]
Jul 24 19:27:20.878860 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:20.878761    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tv7vs"]
Jul 24 19:27:20.878860 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:20.878816    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tv7vs"
Jul 24 19:27:20.878937 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:20.878892    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tv7vs" podUID="9e802511-bdaa-463d-9572-22349bfbcd49"
Jul 24 19:27:20.878977 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:20.878940    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nqt4p"
Jul 24 19:27:20.879006 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:20.878997    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nqt4p" podUID="5b53e2ac-1a53-4df0-a395-2718093476b6"
Jul 24 19:27:21.302722 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:21.302630    2567 generic.go:356] "Generic (PLEG): container finished" podID="7ba5baab-dd60-4a1f-bece-25c178dbe520" containerID="35dd4d77e3d2a5b5515a982c81ed0d5a9232c01d2952304cd71e2f12bdbc8bc5" exitCode=0
Jul 24 19:27:21.303062 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:21.302717    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wvbtg" event={"ID":"7ba5baab-dd60-4a1f-bece-25c178dbe520","Type":"ContainerDied","Data":"35dd4d77e3d2a5b5515a982c81ed0d5a9232c01d2952304cd71e2f12bdbc8bc5"}
Jul 24 19:27:23.065937 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:23.065688    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nqt4p"
Jul 24 19:27:23.066338 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:23.066049    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nqt4p" podUID="5b53e2ac-1a53-4df0-a395-2718093476b6"
Jul 24 19:27:23.066338 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:23.065749    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gvbbc"
Jul 24 19:27:23.066338 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:23.066140    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gvbbc" podUID="94868cfc-85a8-4310-a339-2c4b44da043b"
Jul 24 19:27:23.066338 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:23.065738    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tv7vs"
Jul 24 19:27:23.066338 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:23.066212    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tv7vs" podUID="9e802511-bdaa-463d-9572-22349bfbcd49"
Jul 24 19:27:25.065885 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:25.065847    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gvbbc"
Jul 24 19:27:25.065885 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:25.065875    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nqt4p"
Jul 24 19:27:25.065885 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:25.065887    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tv7vs"
Jul 24 19:27:25.066638 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:25.065996    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gvbbc" podUID="94868cfc-85a8-4310-a339-2c4b44da043b"
Jul 24 19:27:25.066638 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:25.066143    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nqt4p" podUID="5b53e2ac-1a53-4df0-a395-2718093476b6"
Jul 24 19:27:25.066638 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:25.066225    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tv7vs" podUID="9e802511-bdaa-463d-9572-22349bfbcd49"
Jul 24 19:27:25.739704 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:25.739670    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b53e2ac-1a53-4df0-a395-2718093476b6-metrics-certs\") pod \"network-metrics-daemon-nqt4p\" (UID: \"5b53e2ac-1a53-4df0-a395-2718093476b6\") " pod="openshift-multus/network-metrics-daemon-nqt4p"
Jul 24 19:27:25.739919 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:25.739718    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94868cfc-85a8-4310-a339-2c4b44da043b-original-pull-secret\") pod \"global-pull-secret-syncer-gvbbc\" (UID: \"94868cfc-85a8-4310-a339-2c4b44da043b\") " pod="kube-system/global-pull-secret-syncer-gvbbc"
Jul 24 19:27:25.739919 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:25.739802    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 19:27:25.739919 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:25.739805    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:27:25.739919 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:25.739848    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94868cfc-85a8-4310-a339-2c4b44da043b-original-pull-secret podName:94868cfc-85a8-4310-a339-2c4b44da043b nodeName:}" failed. No retries permitted until 2026-07-24 19:27:57.739836402 +0000 UTC m=+66.258456421 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/94868cfc-85a8-4310-a339-2c4b44da043b-original-pull-secret") pod "global-pull-secret-syncer-gvbbc" (UID: "94868cfc-85a8-4310-a339-2c4b44da043b") : object "kube-system"/"original-pull-secret" not registered
Jul 24 19:27:25.739919 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:25.739862    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b53e2ac-1a53-4df0-a395-2718093476b6-metrics-certs podName:5b53e2ac-1a53-4df0-a395-2718093476b6 nodeName:}" failed. No retries permitted until 2026-07-24 19:27:57.739855773 +0000 UTC m=+66.258475792 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b53e2ac-1a53-4df0-a395-2718093476b6-metrics-certs") pod "network-metrics-daemon-nqt4p" (UID: "5b53e2ac-1a53-4df0-a395-2718093476b6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:27:25.840746 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:25.840725    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qh5nt\" (UniqueName: \"kubernetes.io/projected/9e802511-bdaa-463d-9572-22349bfbcd49-kube-api-access-qh5nt\") pod \"network-check-target-tv7vs\" (UID: \"9e802511-bdaa-463d-9572-22349bfbcd49\") " pod="openshift-network-diagnostics/network-check-target-tv7vs"
Jul 24 19:27:25.840870 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:25.840839    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 19:27:25.840870 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:25.840853    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 19:27:25.840870 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:25.840861    2567 projected.go:196] Error preparing data for projected volume kube-api-access-qh5nt for pod openshift-network-diagnostics/network-check-target-tv7vs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:27:25.840967 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:25.840903    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e802511-bdaa-463d-9572-22349bfbcd49-kube-api-access-qh5nt podName:9e802511-bdaa-463d-9572-22349bfbcd49 nodeName:}" failed. No retries permitted until 2026-07-24 19:27:57.84089001 +0000 UTC m=+66.359510029 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qh5nt" (UniqueName: "kubernetes.io/projected/9e802511-bdaa-463d-9572-22349bfbcd49-kube-api-access-qh5nt") pod "network-check-target-tv7vs" (UID: "9e802511-bdaa-463d-9572-22349bfbcd49") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:27:26.317531 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:26.317432    2567 generic.go:356] "Generic (PLEG): container finished" podID="7ba5baab-dd60-4a1f-bece-25c178dbe520" containerID="48b8e34e92a2c874ad5ff4b13663f8729c621323c1b32ab9cb21d1643e95494a" exitCode=0
Jul 24 19:27:26.317531 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:26.317495    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wvbtg" event={"ID":"7ba5baab-dd60-4a1f-bece-25c178dbe520","Type":"ContainerDied","Data":"48b8e34e92a2c874ad5ff4b13663f8729c621323c1b32ab9cb21d1643e95494a"}
Jul 24 19:27:26.852987 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:26.852911    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-84.ec2.internal" event="NodeReady"
Jul 24 19:27:26.853202 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:26.853062    2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 24 19:27:26.902923 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:26.902888    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ztc4c"]
Jul 24 19:27:26.916014 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:26.915986    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-sgb8z"]
Jul 24 19:27:26.916187 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:26.916117    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ztc4c"
Jul 24 19:27:26.919581 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:26.919561    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8tvpg\""
Jul 24 19:27:26.920187 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:26.920171    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 24 19:27:26.920827 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:26.920657    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 24 19:27:26.920827 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:26.920743    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 24 19:27:26.930191 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:26.930170    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ztc4c"]
Jul 24 19:27:26.930310 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:26.930212    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lbpc2"]
Jul 24 19:27:26.930310 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:26.930257    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sgb8z"
Jul 24 19:27:26.933209 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:26.932988    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qvrwm\""
Jul 24 19:27:26.933361 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:26.933338    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 24 19:27:26.933535 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:26.933468    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 24 19:27:26.933867 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:26.933850    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 24 19:27:26.934120 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:26.933895    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 24 19:27:26.946362 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:26.946343    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sgb8z"]
Jul 24 19:27:26.946459 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:26.946427    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lbpc2"
Jul 24 19:27:26.949158 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:26.949137    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 24 19:27:26.949253 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:26.949226    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-75276\""
Jul 24 19:27:26.949316 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:26.949269    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 24 19:27:26.954338 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:26.954316    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lbpc2"]
Jul 24 19:27:27.040915 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.040885    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69759cd94d-84blt"]
Jul 24 19:27:27.047293 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.047272    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f301acb7-aeba-4a68-b491-8d926efaebd8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sgb8z\" (UID: \"f301acb7-aeba-4a68-b491-8d926efaebd8\") " pod="openshift-insights/insights-runtime-extractor-sgb8z"
Jul 24 19:27:27.047382 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.047302    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f301acb7-aeba-4a68-b491-8d926efaebd8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sgb8z\" (UID: \"f301acb7-aeba-4a68-b491-8d926efaebd8\") " pod="openshift-insights/insights-runtime-extractor-sgb8z"
Jul 24 19:27:27.047382 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.047322    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/25c81c8c-dcd3-46b8-a220-9d23d851271e-config-volume\") pod \"dns-default-lbpc2\" (UID: \"25c81c8c-dcd3-46b8-a220-9d23d851271e\") " pod="openshift-dns/dns-default-lbpc2"
Jul 24 19:27:27.047382 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.047336    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqbl9\" (UniqueName: \"kubernetes.io/projected/25c81c8c-dcd3-46b8-a220-9d23d851271e-kube-api-access-gqbl9\") pod \"dns-default-lbpc2\" (UID: \"25c81c8c-dcd3-46b8-a220-9d23d851271e\") " pod="openshift-dns/dns-default-lbpc2"
Jul 24 19:27:27.047519 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.047431    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25c81c8c-dcd3-46b8-a220-9d23d851271e-tmp-dir\") pod \"dns-default-lbpc2\" (UID: \"25c81c8c-dcd3-46b8-a220-9d23d851271e\") " pod="openshift-dns/dns-default-lbpc2"
Jul 24 19:27:27.047519 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.047499    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5skt\" (UniqueName: \"kubernetes.io/projected/f301acb7-aeba-4a68-b491-8d926efaebd8-kube-api-access-t5skt\") pod \"insights-runtime-extractor-sgb8z\" (UID: \"f301acb7-aeba-4a68-b491-8d926efaebd8\") " pod="openshift-insights/insights-runtime-extractor-sgb8z"
Jul 24 19:27:27.047606 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.047531    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e6fd444c-0fa9-4139-9f44-6e389728f05a-cert\") pod \"ingress-canary-ztc4c\" (UID: \"e6fd444c-0fa9-4139-9f44-6e389728f05a\") " pod="openshift-ingress-canary/ingress-canary-ztc4c"
Jul 24 19:27:27.047606 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.047546    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl22h\" (UniqueName: \"kubernetes.io/projected/e6fd444c-0fa9-4139-9f44-6e389728f05a-kube-api-access-pl22h\") pod \"ingress-canary-ztc4c\" (UID: \"e6fd444c-0fa9-4139-9f44-6e389728f05a\") " pod="openshift-ingress-canary/ingress-canary-ztc4c"
Jul 24 19:27:27.047606 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.047561    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f301acb7-aeba-4a68-b491-8d926efaebd8-crio-socket\") pod \"insights-runtime-extractor-sgb8z\" (UID: \"f301acb7-aeba-4a68-b491-8d926efaebd8\") " pod="openshift-insights/insights-runtime-extractor-sgb8z"
Jul 24 19:27:27.047703 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.047625    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f301acb7-aeba-4a68-b491-8d926efaebd8-data-volume\") pod \"insights-runtime-extractor-sgb8z\" (UID: \"f301acb7-aeba-4a68-b491-8d926efaebd8\") " pod="openshift-insights/insights-runtime-extractor-sgb8z"
Jul 24 19:27:27.047703 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.047653    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/25c81c8c-dcd3-46b8-a220-9d23d851271e-metrics-tls\") pod \"dns-default-lbpc2\" (UID: \"25c81c8c-dcd3-46b8-a220-9d23d851271e\") " pod="openshift-dns/dns-default-lbpc2"
Jul 24 19:27:27.057548 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.057530    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69759cd94d-84blt"
Jul 24 19:27:27.062117 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.062096    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69759cd94d-84blt"]
Jul 24 19:27:27.065778 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.065376    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 24 19:27:27.065778 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.065418    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nqt4p"
Jul 24 19:27:27.065778 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.065443    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tv7vs"
Jul 24 19:27:27.065778 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.065558    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gvbbc"
Jul 24 19:27:27.066169 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.066138    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 24 19:27:27.066256 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.066204    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 24 19:27:27.066314 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.066266    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 24 19:27:27.066381 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.066314    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-lbnbp\""
Jul 24 19:27:27.066381 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.066347    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 24 19:27:27.066560 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.066544    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 24 19:27:27.067042 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.067024    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 24 19:27:27.068909 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.068894    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nz88f\""
Jul 24 19:27:27.069002 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.068982    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 19:27:27.069355 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.069339    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 19:27:27.069432 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.069389    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ln4l7\""
Jul 24 19:27:27.069432 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.069415    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 19:27:27.069432 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.069416    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 19:27:27.075102 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.075076    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 24 19:27:27.148166 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.148143    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5skt\" (UniqueName: \"kubernetes.io/projected/f301acb7-aeba-4a68-b491-8d926efaebd8-kube-api-access-t5skt\") pod \"insights-runtime-extractor-sgb8z\" (UID: \"f301acb7-aeba-4a68-b491-8d926efaebd8\") " pod="openshift-insights/insights-runtime-extractor-sgb8z"
Jul 24 19:27:27.148322 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.148179    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b93c35c-ebba-464b-a673-48b5fef660c6-console-config\") pod \"console-69759cd94d-84blt\" (UID: \"2b93c35c-ebba-464b-a673-48b5fef660c6\") " pod="openshift-console/console-69759cd94d-84blt"
Jul 24 19:27:27.148322 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.148203    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b93c35c-ebba-464b-a673-48b5fef660c6-service-ca\") pod \"console-69759cd94d-84blt\" (UID: \"2b93c35c-ebba-464b-a673-48b5fef660c6\") " pod="openshift-console/console-69759cd94d-84blt"
Jul 24 19:27:27.148322 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.148232    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e6fd444c-0fa9-4139-9f44-6e389728f05a-cert\") pod \"ingress-canary-ztc4c\" (UID: \"e6fd444c-0fa9-4139-9f44-6e389728f05a\") " pod="openshift-ingress-canary/ingress-canary-ztc4c"
Jul 24 19:27:27.148322 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.148250    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl22h\" (UniqueName: \"kubernetes.io/projected/e6fd444c-0fa9-4139-9f44-6e389728f05a-kube-api-access-pl22h\") pod \"ingress-canary-ztc4c\" (UID: \"e6fd444c-0fa9-4139-9f44-6e389728f05a\") " pod="openshift-ingress-canary/ingress-canary-ztc4c"
Jul 24 19:27:27.148322 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.148302    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f301acb7-aeba-4a68-b491-8d926efaebd8-crio-socket\") pod \"insights-runtime-extractor-sgb8z\" (UID: \"f301acb7-aeba-4a68-b491-8d926efaebd8\") " pod="openshift-insights/insights-runtime-extractor-sgb8z"
Jul 24 19:27:27.148623 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.148348    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b93c35c-ebba-464b-a673-48b5fef660c6-oauth-serving-cert\") pod \"console-69759cd94d-84blt\" (UID: \"2b93c35c-ebba-464b-a673-48b5fef660c6\") " pod="openshift-console/console-69759cd94d-84blt"
Jul 24 19:27:27.148623 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.148413    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f301acb7-aeba-4a68-b491-8d926efaebd8-data-volume\") pod \"insights-runtime-extractor-sgb8z\" (UID: \"f301acb7-aeba-4a68-b491-8d926efaebd8\") " pod="openshift-insights/insights-runtime-extractor-sgb8z"
Jul 24 19:27:27.148623 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.148441    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/25c81c8c-dcd3-46b8-a220-9d23d851271e-metrics-tls\") pod \"dns-default-lbpc2\" (UID: \"25c81c8c-dcd3-46b8-a220-9d23d851271e\") " pod="openshift-dns/dns-default-lbpc2"
Jul 24 19:27:27.148623 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.148466    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b93c35c-ebba-464b-a673-48b5fef660c6-trusted-ca-bundle\") pod \"console-69759cd94d-84blt\" (UID: \"2b93c35c-ebba-464b-a673-48b5fef660c6\") " pod="openshift-console/console-69759cd94d-84blt"
Jul 24 19:27:27.148623 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.148521    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f301acb7-aeba-4a68-b491-8d926efaebd8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sgb8z\" (UID: \"f301acb7-aeba-4a68-b491-8d926efaebd8\") " pod="openshift-insights/insights-runtime-extractor-sgb8z"
Jul 24 19:27:27.148623 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.148536    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f301acb7-aeba-4a68-b491-8d926efaebd8-crio-socket\") pod \"insights-runtime-extractor-sgb8z\" (UID: \"f301acb7-aeba-4a68-b491-8d926efaebd8\") " pod="openshift-insights/insights-runtime-extractor-sgb8z"
Jul 24 19:27:27.148623 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.148550    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f301acb7-aeba-4a68-b491-8d926efaebd8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sgb8z\" (UID: \"f301acb7-aeba-4a68-b491-8d926efaebd8\") " pod="openshift-insights/insights-runtime-extractor-sgb8z"
Jul 24 19:27:27.148623 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.148593    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/25c81c8c-dcd3-46b8-a220-9d23d851271e-config-volume\") pod \"dns-default-lbpc2\" (UID: \"25c81c8c-dcd3-46b8-a220-9d23d851271e\") " pod="openshift-dns/dns-default-lbpc2"
Jul 24 19:27:27.148623 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.148623    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqbl9\" (UniqueName: \"kubernetes.io/projected/25c81c8c-dcd3-46b8-a220-9d23d851271e-kube-api-access-gqbl9\") pod \"dns-default-lbpc2\" (UID: \"25c81c8c-dcd3-46b8-a220-9d23d851271e\") " pod="openshift-dns/dns-default-lbpc2"
Jul 24 19:27:27.149414 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.148660    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b93c35c-ebba-464b-a673-48b5fef660c6-console-oauth-config\") pod \"console-69759cd94d-84blt\" (UID: \"2b93c35c-ebba-464b-a673-48b5fef660c6\") " pod="openshift-console/console-69759cd94d-84blt"
Jul 24 19:27:27.149414 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.148695    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x42gd\" (UniqueName: \"kubernetes.io/projected/2b93c35c-ebba-464b-a673-48b5fef660c6-kube-api-access-x42gd\") pod \"console-69759cd94d-84blt\" (UID: \"2b93c35c-ebba-464b-a673-48b5fef660c6\") " pod="openshift-console/console-69759cd94d-84blt"
Jul 24 19:27:27.149414 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.148738    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25c81c8c-dcd3-46b8-a220-9d23d851271e-tmp-dir\") pod \"dns-default-lbpc2\" (UID: \"25c81c8c-dcd3-46b8-a220-9d23d851271e\") " pod="openshift-dns/dns-default-lbpc2"
Jul 24 19:27:27.149414 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.148784    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b93c35c-ebba-464b-a673-48b5fef660c6-console-serving-cert\") pod \"console-69759cd94d-84blt\" (UID: \"2b93c35c-ebba-464b-a673-48b5fef660c6\") " pod="openshift-console/console-69759cd94d-84blt"
Jul 24 19:27:27.149414 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.149144    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f301acb7-aeba-4a68-b491-8d926efaebd8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sgb8z\" (UID: \"f301acb7-aeba-4a68-b491-8d926efaebd8\") " pod="openshift-insights/insights-runtime-extractor-sgb8z"
Jul 24 19:27:27.149414 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.149183    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f301acb7-aeba-4a68-b491-8d926efaebd8-data-volume\") pod \"insights-runtime-extractor-sgb8z\" (UID: \"f301acb7-aeba-4a68-b491-8d926efaebd8\") " pod="openshift-insights/insights-runtime-extractor-sgb8z"
Jul 24 19:27:27.149414 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.149186    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25c81c8c-dcd3-46b8-a220-9d23d851271e-tmp-dir\") pod \"dns-default-lbpc2\" (UID: \"25c81c8c-dcd3-46b8-a220-9d23d851271e\") " pod="openshift-dns/dns-default-lbpc2"
Jul 24 19:27:27.149414 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.149220    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/25c81c8c-dcd3-46b8-a220-9d23d851271e-config-volume\") pod \"dns-default-lbpc2\" (UID: \"25c81c8c-dcd3-46b8-a220-9d23d851271e\") " pod="openshift-dns/dns-default-lbpc2"
Jul 24 19:27:27.152433 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.152407    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f301acb7-aeba-4a68-b491-8d926efaebd8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sgb8z\" (UID: \"f301acb7-aeba-4a68-b491-8d926efaebd8\") " pod="openshift-insights/insights-runtime-extractor-sgb8z"
Jul 24 19:27:27.152547 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.152436    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/25c81c8c-dcd3-46b8-a220-9d23d851271e-metrics-tls\") pod \"dns-default-lbpc2\" (UID: \"25c81c8c-dcd3-46b8-a220-9d23d851271e\") " pod="openshift-dns/dns-default-lbpc2"
Jul 24 19:27:27.152624 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.152606    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e6fd444c-0fa9-4139-9f44-6e389728f05a-cert\") pod \"ingress-canary-ztc4c\" (UID: \"e6fd444c-0fa9-4139-9f44-6e389728f05a\") " pod="openshift-ingress-canary/ingress-canary-ztc4c"
Jul 24 19:27:27.157569 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.157537    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqbl9\" (UniqueName: \"kubernetes.io/projected/25c81c8c-dcd3-46b8-a220-9d23d851271e-kube-api-access-gqbl9\") pod \"dns-default-lbpc2\" (UID: \"25c81c8c-dcd3-46b8-a220-9d23d851271e\") " pod="openshift-dns/dns-default-lbpc2"
Jul 24 19:27:27.158048 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.158015    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5skt\" (UniqueName: \"kubernetes.io/projected/f301acb7-aeba-4a68-b491-8d926efaebd8-kube-api-access-t5skt\") pod \"insights-runtime-extractor-sgb8z\" (UID: \"f301acb7-aeba-4a68-b491-8d926efaebd8\") " pod="openshift-insights/insights-runtime-extractor-sgb8z"
Jul 24 19:27:27.158186 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.158170    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl22h\" (UniqueName: \"kubernetes.io/projected/e6fd444c-0fa9-4139-9f44-6e389728f05a-kube-api-access-pl22h\") pod \"ingress-canary-ztc4c\" (UID: \"e6fd444c-0fa9-4139-9f44-6e389728f05a\") " pod="openshift-ingress-canary/ingress-canary-ztc4c"
Jul 24 19:27:27.226025 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.225992    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ztc4c"
Jul 24 19:27:27.239203 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.239176    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sgb8z"
Jul 24 19:27:27.249441 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.249411    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b93c35c-ebba-464b-a673-48b5fef660c6-console-serving-cert\") pod \"console-69759cd94d-84blt\" (UID: \"2b93c35c-ebba-464b-a673-48b5fef660c6\") " pod="openshift-console/console-69759cd94d-84blt"
Jul 24 19:27:27.249576 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.249475    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b93c35c-ebba-464b-a673-48b5fef660c6-console-config\") pod \"console-69759cd94d-84blt\" (UID: \"2b93c35c-ebba-464b-a673-48b5fef660c6\") " pod="openshift-console/console-69759cd94d-84blt"
Jul 24 19:27:27.249576 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.249524    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b93c35c-ebba-464b-a673-48b5fef660c6-service-ca\") pod \"console-69759cd94d-84blt\" (UID: \"2b93c35c-ebba-464b-a673-48b5fef660c6\") " pod="openshift-console/console-69759cd94d-84blt"
Jul 24 19:27:27.249675 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.249575    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b93c35c-ebba-464b-a673-48b5fef660c6-oauth-serving-cert\") pod \"console-69759cd94d-84blt\" (UID: \"2b93c35c-ebba-464b-a673-48b5fef660c6\") " pod="openshift-console/console-69759cd94d-84blt"
Jul 24 19:27:27.249675 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.249618    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b93c35c-ebba-464b-a673-48b5fef660c6-trusted-ca-bundle\") pod \"console-69759cd94d-84blt\" (UID: \"2b93c35c-ebba-464b-a673-48b5fef660c6\") " pod="openshift-console/console-69759cd94d-84blt"
Jul 24 19:27:27.249675 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.249660    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b93c35c-ebba-464b-a673-48b5fef660c6-console-oauth-config\") pod \"console-69759cd94d-84blt\" (UID: \"2b93c35c-ebba-464b-a673-48b5fef660c6\") " pod="openshift-console/console-69759cd94d-84blt"
Jul 24 19:27:27.249812 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.249690    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x42gd\" (UniqueName: \"kubernetes.io/projected/2b93c35c-ebba-464b-a673-48b5fef660c6-kube-api-access-x42gd\") pod \"console-69759cd94d-84blt\" (UID: \"2b93c35c-ebba-464b-a673-48b5fef660c6\") " pod="openshift-console/console-69759cd94d-84blt"
Jul 24 19:27:27.250336 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.250288    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b93c35c-ebba-464b-a673-48b5fef660c6-console-config\") pod \"console-69759cd94d-84blt\" (UID: \"2b93c35c-ebba-464b-a673-48b5fef660c6\") " pod="openshift-console/console-69759cd94d-84blt"
Jul 24 19:27:27.250336 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.250293    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b93c35c-ebba-464b-a673-48b5fef660c6-oauth-serving-cert\") pod \"console-69759cd94d-84blt\" (UID: \"2b93c35c-ebba-464b-a673-48b5fef660c6\") " pod="openshift-console/console-69759cd94d-84blt"
Jul 24 19:27:27.250471 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.250382    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b93c35c-ebba-464b-a673-48b5fef660c6-service-ca\") pod \"console-69759cd94d-84blt\" (UID: \"2b93c35c-ebba-464b-a673-48b5fef660c6\") " pod="openshift-console/console-69759cd94d-84blt"
Jul 24 19:27:27.250653 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.250636    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b93c35c-ebba-464b-a673-48b5fef660c6-trusted-ca-bundle\") pod \"console-69759cd94d-84blt\" (UID: \"2b93c35c-ebba-464b-a673-48b5fef660c6\") " pod="openshift-console/console-69759cd94d-84blt"
Jul 24 19:27:27.251919 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.251885    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b93c35c-ebba-464b-a673-48b5fef660c6-console-serving-cert\") pod \"console-69759cd94d-84blt\" (UID: \"2b93c35c-ebba-464b-a673-48b5fef660c6\") " pod="openshift-console/console-69759cd94d-84blt"
Jul 24 19:27:27.252195 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.252174    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b93c35c-ebba-464b-a673-48b5fef660c6-console-oauth-config\") pod \"console-69759cd94d-84blt\" (UID: \"2b93c35c-ebba-464b-a673-48b5fef660c6\") " pod="openshift-console/console-69759cd94d-84blt"
Jul 24 19:27:27.255175 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.255157    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lbpc2"
Jul 24 19:27:27.261177 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.261160    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x42gd\" (UniqueName: \"kubernetes.io/projected/2b93c35c-ebba-464b-a673-48b5fef660c6-kube-api-access-x42gd\") pod \"console-69759cd94d-84blt\" (UID: \"2b93c35c-ebba-464b-a673-48b5fef660c6\") " pod="openshift-console/console-69759cd94d-84blt"
Jul 24 19:27:27.323873 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.323699    2567 generic.go:356] "Generic (PLEG): container finished" podID="7ba5baab-dd60-4a1f-bece-25c178dbe520" containerID="dbdfde84eab83b05d5cfddb0e3027a78c2a0cbea3faab6b9882183be29beb1c1" exitCode=0
Jul 24 19:27:27.324315 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.323872    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wvbtg" event={"ID":"7ba5baab-dd60-4a1f-bece-25c178dbe520","Type":"ContainerDied","Data":"dbdfde84eab83b05d5cfddb0e3027a78c2a0cbea3faab6b9882183be29beb1c1"}
Jul 24 19:27:27.370842 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.370592    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69759cd94d-84blt"
Jul 24 19:27:27.455596 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.455532    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ztc4c"]
Jul 24 19:27:27.464898 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.464875    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sgb8z"]
Jul 24 19:27:27.466463 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.466438    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lbpc2"]
Jul 24 19:27:27.466901 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:27:27.466858    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6fd444c_0fa9_4139_9f44_6e389728f05a.slice/crio-4904becc5e4e29506512eaa5dc03faa887378aa5b9d5da7450107797104f7da3 WatchSource:0}: Error finding container 4904becc5e4e29506512eaa5dc03faa887378aa5b9d5da7450107797104f7da3: Status 404 returned error can't find the container with id 4904becc5e4e29506512eaa5dc03faa887378aa5b9d5da7450107797104f7da3
Jul 24 19:27:27.469313 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:27:27.469221    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf301acb7_aeba_4a68_b491_8d926efaebd8.slice/crio-e83bcba74b26c4522d5933712e617da16151454fdad5a06ddadb8a15c3aa6ae5 WatchSource:0}: Error finding container e83bcba74b26c4522d5933712e617da16151454fdad5a06ddadb8a15c3aa6ae5: Status 404 returned error can't find the container with id e83bcba74b26c4522d5933712e617da16151454fdad5a06ddadb8a15c3aa6ae5
Jul 24 19:27:27.470866 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:27:27.470847    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25c81c8c_dcd3_46b8_a220_9d23d851271e.slice/crio-0f5723007e0fa5db89bcdf6ae83d2df63a6a6a1c183b909342583ef653ee8f1c WatchSource:0}: Error finding container 0f5723007e0fa5db89bcdf6ae83d2df63a6a6a1c183b909342583ef653ee8f1c: Status 404 returned error can't find the container with id 0f5723007e0fa5db89bcdf6ae83d2df63a6a6a1c183b909342583ef653ee8f1c
Jul 24 19:27:27.542523 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:27.542474    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69759cd94d-84blt"]
Jul 24 19:27:27.547707 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:27:27.547680    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b93c35c_ebba_464b_a673_48b5fef660c6.slice/crio-e262d70d1636f20b503b4bbfc5ffc2612b2c89f34e8eac2cebeb97d8b704785b WatchSource:0}: Error finding container e262d70d1636f20b503b4bbfc5ffc2612b2c89f34e8eac2cebeb97d8b704785b: Status 404 returned error can't find the container with id e262d70d1636f20b503b4bbfc5ffc2612b2c89f34e8eac2cebeb97d8b704785b
Jul 24 19:27:28.334661 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:28.334622    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wvbtg" event={"ID":"7ba5baab-dd60-4a1f-bece-25c178dbe520","Type":"ContainerStarted","Data":"e0c6b02c2cf9dd8e6c66d3f7539bae9cbf0a87b46c6d486dfb50b888c5bd8633"}
Jul 24 19:27:28.337428 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:28.337372    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69759cd94d-84blt" event={"ID":"2b93c35c-ebba-464b-a673-48b5fef660c6","Type":"ContainerStarted","Data":"e262d70d1636f20b503b4bbfc5ffc2612b2c89f34e8eac2cebeb97d8b704785b"}
Jul 24 19:27:28.339886 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:28.339860    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ztc4c" event={"ID":"e6fd444c-0fa9-4139-9f44-6e389728f05a","Type":"ContainerStarted","Data":"4904becc5e4e29506512eaa5dc03faa887378aa5b9d5da7450107797104f7da3"}
Jul 24 19:27:28.341837 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:28.341765    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lbpc2" event={"ID":"25c81c8c-dcd3-46b8-a220-9d23d851271e","Type":"ContainerStarted","Data":"0f5723007e0fa5db89bcdf6ae83d2df63a6a6a1c183b909342583ef653ee8f1c"}
Jul 24 19:27:28.343828 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:28.343762    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sgb8z" event={"ID":"f301acb7-aeba-4a68-b491-8d926efaebd8","Type":"ContainerStarted","Data":"e83bcba74b26c4522d5933712e617da16151454fdad5a06ddadb8a15c3aa6ae5"}
Jul 24 19:27:28.358322 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:28.357166    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wvbtg" podStartSLOduration=7.409470858 podStartE2EDuration="36.357147432s" totalImagesPullingTime="28.947676574s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:26:52 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:27:28.355790861 +0000 UTC m=+36.874410906" watchObservedRunningTime="2026-07-24 19:27:28.357147432 +0000 UTC m=+36.875767471"
Jul 24 19:27:36.367613 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:36.367339    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69759cd94d-84blt" event={"ID":"2b93c35c-ebba-464b-a673-48b5fef660c6","Type":"ContainerStarted","Data":"99523e5573b43b78d59ec6ef17c8f13cd6185e3621ef52016f5115d85eadd33a"}
Jul 24 19:27:36.368862 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:36.368838    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ztc4c" event={"ID":"e6fd444c-0fa9-4139-9f44-6e389728f05a","Type":"ContainerStarted","Data":"30c21912c37591e56153a3f74418208df40892a7a0e93358e2a98c7c9c202cb3"}
Jul 24 19:27:36.370470 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:36.370442    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lbpc2" event={"ID":"25c81c8c-dcd3-46b8-a220-9d23d851271e","Type":"ContainerStarted","Data":"409c3358287dfa2ad4481b69931d552e098d11bd8fa09afc8a4e77399282bf63"}
Jul 24 19:27:36.370572 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:36.370507    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lbpc2" event={"ID":"25c81c8c-dcd3-46b8-a220-9d23d851271e","Type":"ContainerStarted","Data":"5689fd4666d4e4060cd7ae5897d36ecfb950eeb3279af5715b427e4290561631"}
Jul 24 19:27:36.370572 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:36.370533    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lbpc2"
Jul 24 19:27:36.371788 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:36.371768    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sgb8z" event={"ID":"f301acb7-aeba-4a68-b491-8d926efaebd8","Type":"ContainerStarted","Data":"ff69d1b4cffeb054aea317eba40da7fdfc34e796f7da92fdac83ab87d1ecdc2f"}
Jul 24 19:27:36.386211 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:36.386162    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69759cd94d-84blt" podStartSLOduration=1.284947246 podStartE2EDuration="9.386145358s" totalImagesPullingTime="8.101198112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:27:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:27:36.385882093 +0000 UTC m=+44.904502133" watchObservedRunningTime="2026-07-24 19:27:36.386145358 +0000 UTC m=+44.904765395"
Jul 24 19:27:36.401500 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:36.401433    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ztc4c" podStartSLOduration=2.219410886 podStartE2EDuration="10.401422244s" totalImagesPullingTime="8.182011358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:27:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:27:36.400855364 +0000 UTC m=+44.919475405" watchObservedRunningTime="2026-07-24 19:27:36.401422244 +0000 UTC m=+44.920042287"
Jul 24 19:27:36.418077 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:36.418034    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-lbpc2" podStartSLOduration=2.241900437 podStartE2EDuration="10.418019085s" totalImagesPullingTime="8.176118648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:27:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:27:36.417321393 +0000 UTC m=+44.935941437" watchObservedRunningTime="2026-07-24 19:27:36.418019085 +0000 UTC m=+44.936639126"
Jul 24 19:27:37.371581 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:37.371413    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69759cd94d-84blt"
Jul 24 19:27:37.371581 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:37.371547    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69759cd94d-84blt"
Jul 24 19:27:37.372862 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:37.372827    2567 patch_prober.go:28] interesting pod/console-69759cd94d-84blt container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.9:8443/health\": dial tcp 10.134.0.9:8443: connect: connection refused" start-of-body=
Jul 24 19:27:37.372990 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:37.372882    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-69759cd94d-84blt" podUID="2b93c35c-ebba-464b-a673-48b5fef660c6" containerName="console" probeResult="failure" output="Get \"https://10.134.0.9:8443/health\": dial tcp 10.134.0.9:8443: connect: connection refused"
Jul 24 19:27:41.389400 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:41.389366    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sgb8z" event={"ID":"f301acb7-aeba-4a68-b491-8d926efaebd8","Type":"ContainerStarted","Data":"26da96b83432127011aafa12bf0942fec4c79a065b11762e0a1fa6ec64044735"}
Jul 24 19:27:42.241602 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:42.241565    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-h44dq"]
Jul 24 19:27:42.259180 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:42.259142    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-h44dq"]
Jul 24 19:27:42.259357 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:42.259266    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-h44dq"
Jul 24 19:27:42.261746 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:42.261718    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 24 19:27:42.262060 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:42.261843    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-wgvhw\""
Jul 24 19:27:42.383867 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:42.383828    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/29aa9285-1752-42ab-8e2e-b65ba53abdb9-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-h44dq\" (UID: \"29aa9285-1752-42ab-8e2e-b65ba53abdb9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-h44dq"
Jul 24 19:27:42.484447 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:42.484338    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/29aa9285-1752-42ab-8e2e-b65ba53abdb9-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-h44dq\" (UID: \"29aa9285-1752-42ab-8e2e-b65ba53abdb9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-h44dq"
Jul 24 19:27:42.488963 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:42.488929    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/29aa9285-1752-42ab-8e2e-b65ba53abdb9-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-h44dq\" (UID: \"29aa9285-1752-42ab-8e2e-b65ba53abdb9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-h44dq"
Jul 24 19:27:42.570772 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:42.570691    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-h44dq"
Jul 24 19:27:42.725082 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:42.725008    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-h44dq"]
Jul 24 19:27:42.727519 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:27:42.727474    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29aa9285_1752_42ab_8e2e_b65ba53abdb9.slice/crio-c60d6cfb64c4d71726656d39b20230394ff4609e57498786f2e105da9a9f5ba4 WatchSource:0}: Error finding container c60d6cfb64c4d71726656d39b20230394ff4609e57498786f2e105da9a9f5ba4: Status 404 returned error can't find the container with id c60d6cfb64c4d71726656d39b20230394ff4609e57498786f2e105da9a9f5ba4
Jul 24 19:27:43.397188 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:43.397152    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-h44dq" event={"ID":"29aa9285-1752-42ab-8e2e-b65ba53abdb9","Type":"ContainerStarted","Data":"c60d6cfb64c4d71726656d39b20230394ff4609e57498786f2e105da9a9f5ba4"}
Jul 24 19:27:45.405119 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:45.405019    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-h44dq" event={"ID":"29aa9285-1752-42ab-8e2e-b65ba53abdb9","Type":"ContainerStarted","Data":"d305c121ffe4bed5dfaec61d7a8ab487331b120041f05d270f6f8641a5eede24"}
Jul 24 19:27:45.405554 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:45.405141    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-h44dq"
Jul 24 19:27:45.407752 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:45.407721    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sgb8z" event={"ID":"f301acb7-aeba-4a68-b491-8d926efaebd8","Type":"ContainerStarted","Data":"985970763ddc09480a199919fd45e385980e5c5df573049634549f07f4f670d5"}
Jul 24 19:27:45.410236 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:45.410217    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-h44dq"
Jul 24 19:27:45.420665 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:45.420627    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-h44dq" podStartSLOduration=1.036787516 podStartE2EDuration="3.420613859s" totalImagesPullingTime="2.383826343s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:27:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:27:45.419657536 +0000 UTC m=+53.938277577" watchObservedRunningTime="2026-07-24 19:27:45.420613859 +0000 UTC m=+53.939233899"
Jul 24 19:27:45.436528 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:45.436468    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-sgb8z" podStartSLOduration=2.600655319 podStartE2EDuration="19.436455588s" totalImagesPullingTime="16.835800269s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:27:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:27:45.435779649 +0000 UTC m=+53.954399687" watchObservedRunningTime="2026-07-24 19:27:45.436455588 +0000 UTC m=+53.955075628"
Jul 24 19:27:46.306404 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:46.306360    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-m2z6d"]
Jul 24 19:27:46.308496 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:46.308456    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-m2z6d"
Jul 24 19:27:46.310836 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:46.310810    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 24 19:27:46.310943 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:46.310910    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 24 19:27:46.311919 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:46.311895    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 24 19:27:46.312006 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:46.311906    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 24 19:27:46.312006 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:46.311906    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 24 19:27:46.312101 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:46.312012    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-2vwt7\""
Jul 24 19:27:46.318710 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:46.318686    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq5vb\" (UniqueName: \"kubernetes.io/projected/6a45f826-8752-4af6-892d-7377b8a979af-kube-api-access-qq5vb\") pod \"prometheus-operator-84d69f794d-m2z6d\" (UID: \"6a45f826-8752-4af6-892d-7377b8a979af\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-m2z6d"
Jul 24 19:27:46.318829 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:46.318727    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a45f826-8752-4af6-892d-7377b8a979af-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-m2z6d\" (UID: \"6a45f826-8752-4af6-892d-7377b8a979af\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-m2z6d"
Jul 24 19:27:46.318829 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:46.318767    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6a45f826-8752-4af6-892d-7377b8a979af-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-m2z6d\" (UID: \"6a45f826-8752-4af6-892d-7377b8a979af\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-m2z6d"
Jul 24 19:27:46.318939 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:46.318908    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a45f826-8752-4af6-892d-7377b8a979af-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-m2z6d\" (UID: \"6a45f826-8752-4af6-892d-7377b8a979af\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-m2z6d"
Jul 24 19:27:46.320005 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:46.319986    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-m2z6d"]
Jul 24 19:27:46.378526 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:46.378499    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lbpc2"
Jul 24 19:27:46.420018 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:46.419989    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6a45f826-8752-4af6-892d-7377b8a979af-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-m2z6d\" (UID: \"6a45f826-8752-4af6-892d-7377b8a979af\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-m2z6d"
Jul 24 19:27:46.420465 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:46.420062    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a45f826-8752-4af6-892d-7377b8a979af-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-m2z6d\" (UID: \"6a45f826-8752-4af6-892d-7377b8a979af\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-m2z6d"
Jul 24 19:27:46.420465 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:46.420118    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq5vb\" (UniqueName: \"kubernetes.io/projected/6a45f826-8752-4af6-892d-7377b8a979af-kube-api-access-qq5vb\") pod \"prometheus-operator-84d69f794d-m2z6d\" (UID: \"6a45f826-8752-4af6-892d-7377b8a979af\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-m2z6d"
Jul 24 19:27:46.420465 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:46.420168    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a45f826-8752-4af6-892d-7377b8a979af-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-m2z6d\" (UID: \"6a45f826-8752-4af6-892d-7377b8a979af\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-m2z6d"
Jul 24 19:27:46.420465 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:46.420254    2567 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 24 19:27:46.420465 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:27:46.420324    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a45f826-8752-4af6-892d-7377b8a979af-prometheus-operator-tls podName:6a45f826-8752-4af6-892d-7377b8a979af nodeName:}" failed. No retries permitted until 2026-07-24 19:27:46.92030605 +0000 UTC m=+55.438926069 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/6a45f826-8752-4af6-892d-7377b8a979af-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-m2z6d" (UID: "6a45f826-8752-4af6-892d-7377b8a979af") : secret "prometheus-operator-tls" not found
Jul 24 19:27:46.420977 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:46.420956    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a45f826-8752-4af6-892d-7377b8a979af-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-m2z6d\" (UID: \"6a45f826-8752-4af6-892d-7377b8a979af\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-m2z6d"
Jul 24 19:27:46.423243 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:46.423220    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6a45f826-8752-4af6-892d-7377b8a979af-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-m2z6d\" (UID: \"6a45f826-8752-4af6-892d-7377b8a979af\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-m2z6d"
Jul 24 19:27:46.431719 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:46.431699    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq5vb\" (UniqueName: \"kubernetes.io/projected/6a45f826-8752-4af6-892d-7377b8a979af-kube-api-access-qq5vb\") pod \"prometheus-operator-84d69f794d-m2z6d\" (UID: \"6a45f826-8752-4af6-892d-7377b8a979af\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-m2z6d"
Jul 24 19:27:46.924121 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:46.924088    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a45f826-8752-4af6-892d-7377b8a979af-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-m2z6d\" (UID: \"6a45f826-8752-4af6-892d-7377b8a979af\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-m2z6d"
Jul 24 19:27:46.926580 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:46.926556    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a45f826-8752-4af6-892d-7377b8a979af-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-m2z6d\" (UID: \"6a45f826-8752-4af6-892d-7377b8a979af\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-m2z6d"
Jul 24 19:27:47.217017 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:47.216922    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-m2z6d"
Jul 24 19:27:47.340473 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:47.340436    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-m2z6d"]
Jul 24 19:27:47.343444 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:27:47.343422    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a45f826_8752_4af6_892d_7377b8a979af.slice/crio-68cae5a4822b33d3016085a86168e41f7eb985176e64f19ca41b316953a3cc16 WatchSource:0}: Error finding container 68cae5a4822b33d3016085a86168e41f7eb985176e64f19ca41b316953a3cc16: Status 404 returned error can't find the container with id 68cae5a4822b33d3016085a86168e41f7eb985176e64f19ca41b316953a3cc16
Jul 24 19:27:47.375097 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:47.375073    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69759cd94d-84blt"
Jul 24 19:27:47.378980 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:47.378959    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69759cd94d-84blt"
Jul 24 19:27:47.417130 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:47.417092    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-m2z6d" event={"ID":"6a45f826-8752-4af6-892d-7377b8a979af","Type":"ContainerStarted","Data":"68cae5a4822b33d3016085a86168e41f7eb985176e64f19ca41b316953a3cc16"}
Jul 24 19:27:49.425349 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:49.425314    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-m2z6d" event={"ID":"6a45f826-8752-4af6-892d-7377b8a979af","Type":"ContainerStarted","Data":"6488c2b0205653ae42b14577e20b5ad341addcefbb3a8b6fd20c3c5e85e167a3"}
Jul 24 19:27:49.425759 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:49.425406    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-m2z6d" event={"ID":"6a45f826-8752-4af6-892d-7377b8a979af","Type":"ContainerStarted","Data":"44806fe2ddd7c13558e7be48cad2c6454fe714a989426efd36b439b7d46d97ed"}
Jul 24 19:27:49.442890 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:49.442829    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-m2z6d" podStartSLOduration=2.319609219 podStartE2EDuration="3.442808549s" totalImagesPullingTime="1.12319933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:27:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:27:49.442178482 +0000 UTC m=+57.960798524" watchObservedRunningTime="2026-07-24 19:27:49.442808549 +0000 UTC m=+57.961428589"
Jul 24 19:27:51.788073 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.788036    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-qxvdt"]
Jul 24 19:27:51.790887 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.790871    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qxvdt"
Jul 24 19:27:51.795152 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.795125    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 24 19:27:51.795152 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.795137    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 24 19:27:51.795288 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.795134    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-gmd4k\""
Jul 24 19:27:51.795288 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.795132    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 24 19:27:51.813730 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.813708    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fm6w8"]
Jul 24 19:27:51.815686 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.815672    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fm6w8"
Jul 24 19:27:51.819959 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.819942    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 24 19:27:51.820130 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.820116    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 24 19:27:51.820274 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.820254    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 24 19:27:51.820393 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.820339    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tdkbv\""
Jul 24 19:27:51.864533 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.864089    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6svnv\" (UniqueName: \"kubernetes.io/projected/5ed1b7c2-570b-4919-a766-c7c87e46aeb9-kube-api-access-6svnv\") pod \"node-exporter-fm6w8\" (UID: \"5ed1b7c2-570b-4919-a766-c7c87e46aeb9\") " pod="openshift-monitoring/node-exporter-fm6w8"
Jul 24 19:27:51.864533 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.864128    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5ed1b7c2-570b-4919-a766-c7c87e46aeb9-root\") pod \"node-exporter-fm6w8\" (UID: \"5ed1b7c2-570b-4919-a766-c7c87e46aeb9\") " pod="openshift-monitoring/node-exporter-fm6w8"
Jul 24 19:27:51.864533 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.864159    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d54290e4-ffa8-4f6a-a15b-a811e3ea2259-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-qxvdt\" (UID: \"d54290e4-ffa8-4f6a-a15b-a811e3ea2259\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qxvdt"
Jul 24 19:27:51.864533 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.864196    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5ed1b7c2-570b-4919-a766-c7c87e46aeb9-node-exporter-tls\") pod \"node-exporter-fm6w8\" (UID: \"5ed1b7c2-570b-4919-a766-c7c87e46aeb9\") " pod="openshift-monitoring/node-exporter-fm6w8"
Jul 24 19:27:51.864533 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.864221    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hghgl\" (UniqueName: \"kubernetes.io/projected/d54290e4-ffa8-4f6a-a15b-a811e3ea2259-kube-api-access-hghgl\") pod \"kube-state-metrics-56d9f944b4-qxvdt\" (UID: \"d54290e4-ffa8-4f6a-a15b-a811e3ea2259\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qxvdt"
Jul 24 19:27:51.864533 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.864247    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ed1b7c2-570b-4919-a766-c7c87e46aeb9-metrics-client-ca\") pod \"node-exporter-fm6w8\" (UID: \"5ed1b7c2-570b-4919-a766-c7c87e46aeb9\") " pod="openshift-monitoring/node-exporter-fm6w8"
Jul 24 19:27:51.864533 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.864274    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5ed1b7c2-570b-4919-a766-c7c87e46aeb9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fm6w8\" (UID: \"5ed1b7c2-570b-4919-a766-c7c87e46aeb9\") " pod="openshift-monitoring/node-exporter-fm6w8"
Jul 24 19:27:51.864533 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.864303    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5ed1b7c2-570b-4919-a766-c7c87e46aeb9-node-exporter-wtmp\") pod \"node-exporter-fm6w8\" (UID: \"5ed1b7c2-570b-4919-a766-c7c87e46aeb9\") " pod="openshift-monitoring/node-exporter-fm6w8"
Jul 24 19:27:51.864533 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.864329    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ed1b7c2-570b-4919-a766-c7c87e46aeb9-sys\") pod \"node-exporter-fm6w8\" (UID: \"5ed1b7c2-570b-4919-a766-c7c87e46aeb9\") " pod="openshift-monitoring/node-exporter-fm6w8"
Jul 24 19:27:51.864533 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.864357    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5ed1b7c2-570b-4919-a766-c7c87e46aeb9-node-exporter-textfile\") pod \"node-exporter-fm6w8\" (UID: \"5ed1b7c2-570b-4919-a766-c7c87e46aeb9\") " pod="openshift-monitoring/node-exporter-fm6w8"
Jul 24 19:27:51.864533 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.864383    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5ed1b7c2-570b-4919-a766-c7c87e46aeb9-node-exporter-accelerators-collector-config\") pod \"node-exporter-fm6w8\" (UID: \"5ed1b7c2-570b-4919-a766-c7c87e46aeb9\") " pod="openshift-monitoring/node-exporter-fm6w8"
Jul 24 19:27:51.864533 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.864436    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d54290e4-ffa8-4f6a-a15b-a811e3ea2259-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-qxvdt\" (UID: \"d54290e4-ffa8-4f6a-a15b-a811e3ea2259\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qxvdt"
Jul 24 19:27:51.865071 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.864596    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d54290e4-ffa8-4f6a-a15b-a811e3ea2259-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-qxvdt\" (UID: \"d54290e4-ffa8-4f6a-a15b-a811e3ea2259\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qxvdt"
Jul 24 19:27:51.865071 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.864631    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d54290e4-ffa8-4f6a-a15b-a811e3ea2259-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-qxvdt\" (UID: \"d54290e4-ffa8-4f6a-a15b-a811e3ea2259\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qxvdt"
Jul 24 19:27:51.865071 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.864685    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d54290e4-ffa8-4f6a-a15b-a811e3ea2259-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-qxvdt\" (UID: \"d54290e4-ffa8-4f6a-a15b-a811e3ea2259\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qxvdt"
Jul 24 19:27:51.896047 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.896022    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-qxvdt"]
Jul 24 19:27:51.964993 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.964965    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d54290e4-ffa8-4f6a-a15b-a811e3ea2259-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-qxvdt\" (UID: \"d54290e4-ffa8-4f6a-a15b-a811e3ea2259\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qxvdt"
Jul 24 19:27:51.965155 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.965005    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5ed1b7c2-570b-4919-a766-c7c87e46aeb9-node-exporter-tls\") pod \"node-exporter-fm6w8\" (UID: \"5ed1b7c2-570b-4919-a766-c7c87e46aeb9\") " pod="openshift-monitoring/node-exporter-fm6w8"
Jul 24 19:27:51.965155 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.965024    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hghgl\" (UniqueName: \"kubernetes.io/projected/d54290e4-ffa8-4f6a-a15b-a811e3ea2259-kube-api-access-hghgl\") pod \"kube-state-metrics-56d9f944b4-qxvdt\" (UID: \"d54290e4-ffa8-4f6a-a15b-a811e3ea2259\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qxvdt"
Jul 24 19:27:51.965155 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.965042    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ed1b7c2-570b-4919-a766-c7c87e46aeb9-metrics-client-ca\") pod \"node-exporter-fm6w8\" (UID: \"5ed1b7c2-570b-4919-a766-c7c87e46aeb9\") " pod="openshift-monitoring/node-exporter-fm6w8"
Jul 24 19:27:51.965155 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.965058    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5ed1b7c2-570b-4919-a766-c7c87e46aeb9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fm6w8\" (UID: \"5ed1b7c2-570b-4919-a766-c7c87e46aeb9\") " pod="openshift-monitoring/node-exporter-fm6w8"
Jul 24 19:27:51.965155 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.965080    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5ed1b7c2-570b-4919-a766-c7c87e46aeb9-node-exporter-wtmp\") pod \"node-exporter-fm6w8\" (UID: \"5ed1b7c2-570b-4919-a766-c7c87e46aeb9\") " pod="openshift-monitoring/node-exporter-fm6w8"
Jul 24 19:27:51.965410 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.965206    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5ed1b7c2-570b-4919-a766-c7c87e46aeb9-node-exporter-wtmp\") pod \"node-exporter-fm6w8\" (UID: \"5ed1b7c2-570b-4919-a766-c7c87e46aeb9\") " pod="openshift-monitoring/node-exporter-fm6w8"
Jul 24 19:27:51.965410 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.965291    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ed1b7c2-570b-4919-a766-c7c87e46aeb9-sys\") pod \"node-exporter-fm6w8\" (UID: \"5ed1b7c2-570b-4919-a766-c7c87e46aeb9\") " pod="openshift-monitoring/node-exporter-fm6w8"
Jul 24 19:27:51.965410 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.965311    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ed1b7c2-570b-4919-a766-c7c87e46aeb9-sys\") pod \"node-exporter-fm6w8\" (UID: \"5ed1b7c2-570b-4919-a766-c7c87e46aeb9\") " pod="openshift-monitoring/node-exporter-fm6w8"
Jul 24 19:27:51.965410 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.965360    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5ed1b7c2-570b-4919-a766-c7c87e46aeb9-node-exporter-textfile\") pod \"node-exporter-fm6w8\" (UID: \"5ed1b7c2-570b-4919-a766-c7c87e46aeb9\") " pod="openshift-monitoring/node-exporter-fm6w8"
Jul 24 19:27:51.965410 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.965389    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5ed1b7c2-570b-4919-a766-c7c87e46aeb9-node-exporter-accelerators-collector-config\") pod \"node-exporter-fm6w8\" (UID: \"5ed1b7c2-570b-4919-a766-c7c87e46aeb9\") " pod="openshift-monitoring/node-exporter-fm6w8"
Jul 24 19:27:51.965682 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.965449    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d54290e4-ffa8-4f6a-a15b-a811e3ea2259-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-qxvdt\" (UID: \"d54290e4-ffa8-4f6a-a15b-a811e3ea2259\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qxvdt"
Jul 24 19:27:51.965682 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.965525    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d54290e4-ffa8-4f6a-a15b-a811e3ea2259-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-qxvdt\" (UID: \"d54290e4-ffa8-4f6a-a15b-a811e3ea2259\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qxvdt"
Jul 24 19:27:51.965682 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.965553    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d54290e4-ffa8-4f6a-a15b-a811e3ea2259-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-qxvdt\" (UID: \"d54290e4-ffa8-4f6a-a15b-a811e3ea2259\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qxvdt"
Jul 24 19:27:51.965682 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.965583    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d54290e4-ffa8-4f6a-a15b-a811e3ea2259-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-qxvdt\" (UID: \"d54290e4-ffa8-4f6a-a15b-a811e3ea2259\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qxvdt"
Jul 24 19:27:51.965682 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.965646    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6svnv\" (UniqueName: \"kubernetes.io/projected/5ed1b7c2-570b-4919-a766-c7c87e46aeb9-kube-api-access-6svnv\") pod \"node-exporter-fm6w8\" (UID: \"5ed1b7c2-570b-4919-a766-c7c87e46aeb9\") " pod="openshift-monitoring/node-exporter-fm6w8"
Jul 24 19:27:51.965682 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.965653    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5ed1b7c2-570b-4919-a766-c7c87e46aeb9-node-exporter-textfile\") pod \"node-exporter-fm6w8\" (UID: \"5ed1b7c2-570b-4919-a766-c7c87e46aeb9\") " pod="openshift-monitoring/node-exporter-fm6w8"
Jul 24 19:27:51.965682 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.965674    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5ed1b7c2-570b-4919-a766-c7c87e46aeb9-root\") pod \"node-exporter-fm6w8\" (UID: \"5ed1b7c2-570b-4919-a766-c7c87e46aeb9\") " pod="openshift-monitoring/node-exporter-fm6w8"
Jul 24 19:27:51.965976 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.965710    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ed1b7c2-570b-4919-a766-c7c87e46aeb9-metrics-client-ca\") pod \"node-exporter-fm6w8\" (UID: \"5ed1b7c2-570b-4919-a766-c7c87e46aeb9\") " pod="openshift-monitoring/node-exporter-fm6w8"
Jul 24 19:27:51.965976 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.965752    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5ed1b7c2-570b-4919-a766-c7c87e46aeb9-root\") pod \"node-exporter-fm6w8\" (UID: \"5ed1b7c2-570b-4919-a766-c7c87e46aeb9\") " pod="openshift-monitoring/node-exporter-fm6w8"
Jul 24 19:27:51.965976 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.965769    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d54290e4-ffa8-4f6a-a15b-a811e3ea2259-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-qxvdt\" (UID: \"d54290e4-ffa8-4f6a-a15b-a811e3ea2259\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qxvdt"
Jul 24 19:27:51.965976 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.965833    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d54290e4-ffa8-4f6a-a15b-a811e3ea2259-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-qxvdt\" (UID: \"d54290e4-ffa8-4f6a-a15b-a811e3ea2259\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qxvdt"
Jul 24 19:27:51.968829 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.968813    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 24 19:27:51.968907 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.968834    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 24 19:27:51.968907 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.968813    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 24 19:27:51.969064 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.969048    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 24 19:27:51.969127 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.969079    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 24 19:27:51.970733 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.970715    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 24 19:27:51.976279 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.976256    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5ed1b7c2-570b-4919-a766-c7c87e46aeb9-node-exporter-accelerators-collector-config\") pod \"node-exporter-fm6w8\" (UID: \"5ed1b7c2-570b-4919-a766-c7c87e46aeb9\") " pod="openshift-monitoring/node-exporter-fm6w8"
Jul 24 19:27:51.976563 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.976303    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d54290e4-ffa8-4f6a-a15b-a811e3ea2259-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-qxvdt\" (UID: \"d54290e4-ffa8-4f6a-a15b-a811e3ea2259\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qxvdt"
Jul 24 19:27:51.978146 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.978124    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d54290e4-ffa8-4f6a-a15b-a811e3ea2259-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-qxvdt\" (UID: \"d54290e4-ffa8-4f6a-a15b-a811e3ea2259\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qxvdt"
Jul 24 19:27:51.978340 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.978318    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5ed1b7c2-570b-4919-a766-c7c87e46aeb9-node-exporter-tls\") pod \"node-exporter-fm6w8\" (UID: \"5ed1b7c2-570b-4919-a766-c7c87e46aeb9\") " pod="openshift-monitoring/node-exporter-fm6w8"
Jul 24 19:27:51.978542 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.978526    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5ed1b7c2-570b-4919-a766-c7c87e46aeb9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fm6w8\" (UID: \"5ed1b7c2-570b-4919-a766-c7c87e46aeb9\") " pod="openshift-monitoring/node-exporter-fm6w8"
Jul 24 19:27:51.978710 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.978691    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d54290e4-ffa8-4f6a-a15b-a811e3ea2259-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-qxvdt\" (UID: \"d54290e4-ffa8-4f6a-a15b-a811e3ea2259\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qxvdt"
Jul 24 19:27:51.979015 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.978998    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6svnv\" (UniqueName: \"kubernetes.io/projected/5ed1b7c2-570b-4919-a766-c7c87e46aeb9-kube-api-access-6svnv\") pod \"node-exporter-fm6w8\" (UID: \"5ed1b7c2-570b-4919-a766-c7c87e46aeb9\") " pod="openshift-monitoring/node-exporter-fm6w8"
Jul 24 19:27:51.979325 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:51.979307    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hghgl\" (UniqueName: \"kubernetes.io/projected/d54290e4-ffa8-4f6a-a15b-a811e3ea2259-kube-api-access-hghgl\") pod \"kube-state-metrics-56d9f944b4-qxvdt\" (UID: \"d54290e4-ffa8-4f6a-a15b-a811e3ea2259\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qxvdt"
Jul 24 19:27:52.102661 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.102598    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-gmd4k\""
Jul 24 19:27:52.110737 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.110714    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qxvdt"
Jul 24 19:27:52.126356 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.126331    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tdkbv\""
Jul 24 19:27:52.134351 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.134328    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fm6w8"
Jul 24 19:27:52.144725 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:27:52.144694    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ed1b7c2_570b_4919_a766_c7c87e46aeb9.slice/crio-568d071d723599a6c4409089622c69944e3ecaeed5585a009d905c8d16bec3fd WatchSource:0}: Error finding container 568d071d723599a6c4409089622c69944e3ecaeed5585a009d905c8d16bec3fd: Status 404 returned error can't find the container with id 568d071d723599a6c4409089622c69944e3ecaeed5585a009d905c8d16bec3fd
Jul 24 19:27:52.257354 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.257311    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-qxvdt"]
Jul 24 19:27:52.259536 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:27:52.259503    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd54290e4_ffa8_4f6a_a15b_a811e3ea2259.slice/crio-7e05b70b7e57be75269ef3ac8119a77cec426d3908d97b2af2e485508965cb45 WatchSource:0}: Error finding container 7e05b70b7e57be75269ef3ac8119a77cec426d3908d97b2af2e485508965cb45: Status 404 returned error can't find the container with id 7e05b70b7e57be75269ef3ac8119a77cec426d3908d97b2af2e485508965cb45
Jul 24 19:27:52.316367 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.316344    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d87bq"
Jul 24 19:27:52.435073 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.435035    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qxvdt" event={"ID":"d54290e4-ffa8-4f6a-a15b-a811e3ea2259","Type":"ContainerStarted","Data":"7e05b70b7e57be75269ef3ac8119a77cec426d3908d97b2af2e485508965cb45"}
Jul 24 19:27:52.436084 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.436061    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fm6w8" event={"ID":"5ed1b7c2-570b-4919-a766-c7c87e46aeb9","Type":"ContainerStarted","Data":"568d071d723599a6c4409089622c69944e3ecaeed5585a009d905c8d16bec3fd"}
Jul 24 19:27:52.788631 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.788544    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 19:27:52.793110 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.793083    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:27:52.796643 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.796613    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 24 19:27:52.796783 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.796666    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 24 19:27:52.796783 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.796625    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 24 19:27:52.796893 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.796616    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 24 19:27:52.797176 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.797156    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 24 19:27:52.797288 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.797196    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 24 19:27:52.797288 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.797198    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-22x94\""
Jul 24 19:27:52.797288 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.797268    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 24 19:27:52.797418 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.797165    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 24 19:27:52.797667 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.797648    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 24 19:27:52.812082 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.812058    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 19:27:52.872604 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.872573    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3376df31-f289-4905-85b5-0fb505b04806-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3376df31-f289-4905-85b5-0fb505b04806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:27:52.873038 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.872629    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3376df31-f289-4905-85b5-0fb505b04806-config-out\") pod \"alertmanager-main-0\" (UID: \"3376df31-f289-4905-85b5-0fb505b04806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:27:52.873038 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.872662    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3376df31-f289-4905-85b5-0fb505b04806-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3376df31-f289-4905-85b5-0fb505b04806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:27:52.873038 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.872686    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3376df31-f289-4905-85b5-0fb505b04806-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3376df31-f289-4905-85b5-0fb505b04806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:27:52.873038 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.872716    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3376df31-f289-4905-85b5-0fb505b04806-web-config\") pod \"alertmanager-main-0\" (UID: \"3376df31-f289-4905-85b5-0fb505b04806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:27:52.873038 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.872824    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3376df31-f289-4905-85b5-0fb505b04806-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3376df31-f289-4905-85b5-0fb505b04806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:27:52.873038 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.872867    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3376df31-f289-4905-85b5-0fb505b04806-config-volume\") pod \"alertmanager-main-0\" (UID: \"3376df31-f289-4905-85b5-0fb505b04806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:27:52.873038 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.872899    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3376df31-f289-4905-85b5-0fb505b04806-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3376df31-f289-4905-85b5-0fb505b04806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:27:52.873038 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.872926    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3376df31-f289-4905-85b5-0fb505b04806-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3376df31-f289-4905-85b5-0fb505b04806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:27:52.873038 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.872954    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3376df31-f289-4905-85b5-0fb505b04806-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3376df31-f289-4905-85b5-0fb505b04806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:27:52.873038 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.873005    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3376df31-f289-4905-85b5-0fb505b04806-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3376df31-f289-4905-85b5-0fb505b04806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:27:52.873038 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.873038    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqg9j\" (UniqueName: \"kubernetes.io/projected/3376df31-f289-4905-85b5-0fb505b04806-kube-api-access-mqg9j\") pod \"alertmanager-main-0\" (UID: \"3376df31-f289-4905-85b5-0fb505b04806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:27:52.873389 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.873066    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3376df31-f289-4905-85b5-0fb505b04806-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3376df31-f289-4905-85b5-0fb505b04806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:27:52.973600 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.973561    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3376df31-f289-4905-85b5-0fb505b04806-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3376df31-f289-4905-85b5-0fb505b04806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:27:52.973600 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.973604    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3376df31-f289-4905-85b5-0fb505b04806-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3376df31-f289-4905-85b5-0fb505b04806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:27:52.973839 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.973630    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3376df31-f289-4905-85b5-0fb505b04806-web-config\") pod \"alertmanager-main-0\" (UID: \"3376df31-f289-4905-85b5-0fb505b04806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:27:52.973839 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.973687    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3376df31-f289-4905-85b5-0fb505b04806-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3376df31-f289-4905-85b5-0fb505b04806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:27:52.973839 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.973715    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3376df31-f289-4905-85b5-0fb505b04806-config-volume\") pod \"alertmanager-main-0\" (UID: \"3376df31-f289-4905-85b5-0fb505b04806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:27:52.973839 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.973741    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3376df31-f289-4905-85b5-0fb505b04806-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3376df31-f289-4905-85b5-0fb505b04806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:27:52.973985 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.973885    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3376df31-f289-4905-85b5-0fb505b04806-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3376df31-f289-4905-85b5-0fb505b04806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:27:52.973985 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.973929    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3376df31-f289-4905-85b5-0fb505b04806-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3376df31-f289-4905-85b5-0fb505b04806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:27:52.973985 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.973965    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3376df31-f289-4905-85b5-0fb505b04806-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3376df31-f289-4905-85b5-0fb505b04806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:27:52.974127 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.974001    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqg9j\" (UniqueName: \"kubernetes.io/projected/3376df31-f289-4905-85b5-0fb505b04806-kube-api-access-mqg9j\") pod \"alertmanager-main-0\" (UID: \"3376df31-f289-4905-85b5-0fb505b04806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:27:52.974127 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.974054    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3376df31-f289-4905-85b5-0fb505b04806-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3376df31-f289-4905-85b5-0fb505b04806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:27:52.974127 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.974097    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3376df31-f289-4905-85b5-0fb505b04806-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3376df31-f289-4905-85b5-0fb505b04806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:27:52.974282 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.974140    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3376df31-f289-4905-85b5-0fb505b04806-config-out\") pod \"alertmanager-main-0\" (UID: \"3376df31-f289-4905-85b5-0fb505b04806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:27:52.977108 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.976962    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3376df31-f289-4905-85b5-0fb505b04806-web-config\") pod \"alertmanager-main-0\" (UID: \"3376df31-f289-4905-85b5-0fb505b04806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:27:52.977108 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.977031    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3376df31-f289-4905-85b5-0fb505b04806-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3376df31-f289-4905-85b5-0fb505b04806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:27:52.977336 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.977110    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3376df31-f289-4905-85b5-0fb505b04806-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3376df31-f289-4905-85b5-0fb505b04806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:27:52.977381 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.977344    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3376df31-f289-4905-85b5-0fb505b04806-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3376df31-f289-4905-85b5-0fb505b04806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:27:52.977504 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.977457    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3376df31-f289-4905-85b5-0fb505b04806-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3376df31-f289-4905-85b5-0fb505b04806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:27:52.977576 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.977503    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3376df31-f289-4905-85b5-0fb505b04806-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3376df31-f289-4905-85b5-0fb505b04806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:27:52.978065 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.978029    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3376df31-f289-4905-85b5-0fb505b04806-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3376df31-f289-4905-85b5-0fb505b04806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:27:52.978233 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.978210    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3376df31-f289-4905-85b5-0fb505b04806-config-out\") pod \"alertmanager-main-0\" (UID: \"3376df31-f289-4905-85b5-0fb505b04806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:27:52.978318 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.978241    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3376df31-f289-4905-85b5-0fb505b04806-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3376df31-f289-4905-85b5-0fb505b04806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:27:52.978976 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.978897    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3376df31-f289-4905-85b5-0fb505b04806-config-volume\") pod \"alertmanager-main-0\" (UID: \"3376df31-f289-4905-85b5-0fb505b04806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:27:52.981600 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.980258    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3376df31-f289-4905-85b5-0fb505b04806-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3376df31-f289-4905-85b5-0fb505b04806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:27:52.981600 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.981181    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3376df31-f289-4905-85b5-0fb505b04806-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3376df31-f289-4905-85b5-0fb505b04806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:27:52.996004 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:52.995980    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqg9j\" (UniqueName: \"kubernetes.io/projected/3376df31-f289-4905-85b5-0fb505b04806-kube-api-access-mqg9j\") pod \"alertmanager-main-0\" (UID: \"3376df31-f289-4905-85b5-0fb505b04806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:27:53.104641 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:53.104541    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:27:53.278569 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:53.278535    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 19:27:53.442430 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:53.442346    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fm6w8" event={"ID":"5ed1b7c2-570b-4919-a766-c7c87e46aeb9","Type":"ContainerStarted","Data":"9989b9485fee25c2b646fa3bdbb3c6ff645470c6b121853eb8086b35d319bcb5"}
Jul 24 19:27:53.527180 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:27:53.527144    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3376df31_f289_4905_85b5_0fb505b04806.slice/crio-ba15ebc171fb3acf00998954c93534525ea32514c0d82298f8edc16991beddbe WatchSource:0}: Error finding container ba15ebc171fb3acf00998954c93534525ea32514c0d82298f8edc16991beddbe: Status 404 returned error can't find the container with id ba15ebc171fb3acf00998954c93534525ea32514c0d82298f8edc16991beddbe
Jul 24 19:27:54.446779 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:54.446746    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3376df31-f289-4905-85b5-0fb505b04806","Type":"ContainerStarted","Data":"ba15ebc171fb3acf00998954c93534525ea32514c0d82298f8edc16991beddbe"}
Jul 24 19:27:54.448324 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:54.448295    2567 generic.go:356] "Generic (PLEG): container finished" podID="5ed1b7c2-570b-4919-a766-c7c87e46aeb9" containerID="9989b9485fee25c2b646fa3bdbb3c6ff645470c6b121853eb8086b35d319bcb5" exitCode=0
Jul 24 19:27:54.448452 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:54.448326    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fm6w8" event={"ID":"5ed1b7c2-570b-4919-a766-c7c87e46aeb9","Type":"ContainerDied","Data":"9989b9485fee25c2b646fa3bdbb3c6ff645470c6b121853eb8086b35d319bcb5"}
Jul 24 19:27:54.450516 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:54.450468    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qxvdt" event={"ID":"d54290e4-ffa8-4f6a-a15b-a811e3ea2259","Type":"ContainerStarted","Data":"962fa5be591a827aa8320240110245b3454a5bb166fbfae278bce4fb21ab8d6e"}
Jul 24 19:27:54.450600 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:54.450543    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qxvdt" event={"ID":"d54290e4-ffa8-4f6a-a15b-a811e3ea2259","Type":"ContainerStarted","Data":"b8ce3b2e163ecf78e55d6bfaaa0caaedad6b025e5ab5e1fe1bb3df2e5b5efa8b"}
Jul 24 19:27:54.450600 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:54.450572    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qxvdt" event={"ID":"d54290e4-ffa8-4f6a-a15b-a811e3ea2259","Type":"ContainerStarted","Data":"7f36bada7893c410d577bace46aaee4a62b2f2a3764a92755d4edb6a91fd97a5"}
Jul 24 19:27:54.492616 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:54.492566    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-qxvdt" podStartSLOduration=2.202765367 podStartE2EDuration="3.492549145s" totalImagesPullingTime="1.289783778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:27:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:27:54.491606347 +0000 UTC m=+63.010226388" watchObservedRunningTime="2026-07-24 19:27:54.492549145 +0000 UTC m=+63.011169187"
Jul 24 19:27:55.455217 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:55.455178    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fm6w8" event={"ID":"5ed1b7c2-570b-4919-a766-c7c87e46aeb9","Type":"ContainerStarted","Data":"b3c9c0027aecf8be4366273400f789efbbfbc3802495e4ce6d0a90f98a798c0c"}
Jul 24 19:27:55.455647 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:55.455234    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fm6w8" event={"ID":"5ed1b7c2-570b-4919-a766-c7c87e46aeb9","Type":"ContainerStarted","Data":"79ae2d8aedee56fcb1a0c104f1269f099c57ead9a44b89cc52b40674cf32e834"}
Jul 24 19:27:55.457288 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:55.457248    2567 generic.go:356] "Generic (PLEG): container finished" podID="3376df31-f289-4905-85b5-0fb505b04806" containerID="07b1816cd0d68dadbc425feeb784b1b7f359a3ae80b3b5bc64cfc032ed75f013" exitCode=0
Jul 24 19:27:55.458268 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:55.458231    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3376df31-f289-4905-85b5-0fb505b04806","Type":"ContainerDied","Data":"07b1816cd0d68dadbc425feeb784b1b7f359a3ae80b3b5bc64cfc032ed75f013"}
Jul 24 19:27:55.478290 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:55.478246    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fm6w8" podStartSLOduration=3.405357491 podStartE2EDuration="4.478233415s" totalImagesPullingTime="991.229655ms" totalInitContainerRuntime="81.646269ms" isStatefulPod=true podCreationTimestamp="2026-07-24 19:27:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:27:55.476340249 +0000 UTC m=+63.994960290" watchObservedRunningTime="2026-07-24 19:27:55.478233415 +0000 UTC m=+63.996853486"
Jul 24 19:27:56.497750 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:56.497713    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-678b77cf48-6wcc5"]
Jul 24 19:27:56.502825 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:56.502803    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-678b77cf48-6wcc5"
Jul 24 19:27:56.517155 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:56.517128    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-678b77cf48-6wcc5"]
Jul 24 19:27:56.607287 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:56.607253    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9fca712e-11dd-4783-8fab-7ae83d33c611-oauth-serving-cert\") pod \"console-678b77cf48-6wcc5\" (UID: \"9fca712e-11dd-4783-8fab-7ae83d33c611\") " pod="openshift-console/console-678b77cf48-6wcc5"
Jul 24 19:27:56.607468 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:56.607338    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9fca712e-11dd-4783-8fab-7ae83d33c611-service-ca\") pod \"console-678b77cf48-6wcc5\" (UID: \"9fca712e-11dd-4783-8fab-7ae83d33c611\") " pod="openshift-console/console-678b77cf48-6wcc5"
Jul 24 19:27:56.607468 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:56.607366    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvn6p\" (UniqueName: \"kubernetes.io/projected/9fca712e-11dd-4783-8fab-7ae83d33c611-kube-api-access-pvn6p\") pod \"console-678b77cf48-6wcc5\" (UID: \"9fca712e-11dd-4783-8fab-7ae83d33c611\") " pod="openshift-console/console-678b77cf48-6wcc5"
Jul 24 19:27:56.607468 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:56.607444    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9fca712e-11dd-4783-8fab-7ae83d33c611-console-serving-cert\") pod \"console-678b77cf48-6wcc5\" (UID: \"9fca712e-11dd-4783-8fab-7ae83d33c611\") " pod="openshift-console/console-678b77cf48-6wcc5"
Jul 24 19:27:56.607626 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:56.607475    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9fca712e-11dd-4783-8fab-7ae83d33c611-console-config\") pod \"console-678b77cf48-6wcc5\" (UID: \"9fca712e-11dd-4783-8fab-7ae83d33c611\") " pod="openshift-console/console-678b77cf48-6wcc5"
Jul 24 19:27:56.607626 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:56.607526    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fca712e-11dd-4783-8fab-7ae83d33c611-trusted-ca-bundle\") pod \"console-678b77cf48-6wcc5\" (UID: \"9fca712e-11dd-4783-8fab-7ae83d33c611\") " pod="openshift-console/console-678b77cf48-6wcc5"
Jul 24 19:27:56.607626 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:56.607545    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9fca712e-11dd-4783-8fab-7ae83d33c611-console-oauth-config\") pod \"console-678b77cf48-6wcc5\" (UID: \"9fca712e-11dd-4783-8fab-7ae83d33c611\") " pod="openshift-console/console-678b77cf48-6wcc5"
Jul 24 19:27:56.708638 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:56.708604    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9fca712e-11dd-4783-8fab-7ae83d33c611-oauth-serving-cert\") pod \"console-678b77cf48-6wcc5\" (UID: \"9fca712e-11dd-4783-8fab-7ae83d33c611\") " pod="openshift-console/console-678b77cf48-6wcc5"
Jul 24 19:27:56.708799 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:56.708657    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9fca712e-11dd-4783-8fab-7ae83d33c611-service-ca\") pod \"console-678b77cf48-6wcc5\" (UID: \"9fca712e-11dd-4783-8fab-7ae83d33c611\") " pod="openshift-console/console-678b77cf48-6wcc5"
Jul 24 19:27:56.708799 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:56.708682    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvn6p\" (UniqueName: \"kubernetes.io/projected/9fca712e-11dd-4783-8fab-7ae83d33c611-kube-api-access-pvn6p\") pod \"console-678b77cf48-6wcc5\" (UID: \"9fca712e-11dd-4783-8fab-7ae83d33c611\") " pod="openshift-console/console-678b77cf48-6wcc5"
Jul 24 19:27:56.708906 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:56.708805    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9fca712e-11dd-4783-8fab-7ae83d33c611-console-serving-cert\") pod \"console-678b77cf48-6wcc5\" (UID: \"9fca712e-11dd-4783-8fab-7ae83d33c611\") " pod="openshift-console/console-678b77cf48-6wcc5"
Jul 24 19:27:56.708906 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:56.708837    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9fca712e-11dd-4783-8fab-7ae83d33c611-console-config\") pod \"console-678b77cf48-6wcc5\" (UID: \"9fca712e-11dd-4783-8fab-7ae83d33c611\") " pod="openshift-console/console-678b77cf48-6wcc5"
Jul 24 19:27:56.708906 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:56.708867    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fca712e-11dd-4783-8fab-7ae83d33c611-trusted-ca-bundle\") pod \"console-678b77cf48-6wcc5\" (UID: \"9fca712e-11dd-4783-8fab-7ae83d33c611\") " pod="openshift-console/console-678b77cf48-6wcc5"
Jul 24 19:27:56.708906 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:56.708892    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9fca712e-11dd-4783-8fab-7ae83d33c611-console-oauth-config\") pod \"console-678b77cf48-6wcc5\" (UID: \"9fca712e-11dd-4783-8fab-7ae83d33c611\") " pod="openshift-console/console-678b77cf48-6wcc5"
Jul 24 19:27:56.709506 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:56.709438    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9fca712e-11dd-4783-8fab-7ae83d33c611-service-ca\") pod \"console-678b77cf48-6wcc5\" (UID: \"9fca712e-11dd-4783-8fab-7ae83d33c611\") " pod="openshift-console/console-678b77cf48-6wcc5"
Jul 24 19:27:56.709506 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:56.709458    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9fca712e-11dd-4783-8fab-7ae83d33c611-oauth-serving-cert\") pod \"console-678b77cf48-6wcc5\" (UID: \"9fca712e-11dd-4783-8fab-7ae83d33c611\") " pod="openshift-console/console-678b77cf48-6wcc5"
Jul 24 19:27:56.709759 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:56.709661    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9fca712e-11dd-4783-8fab-7ae83d33c611-console-config\") pod \"console-678b77cf48-6wcc5\" (UID: \"9fca712e-11dd-4783-8fab-7ae83d33c611\") " pod="openshift-console/console-678b77cf48-6wcc5"
Jul 24 19:27:56.710080 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:56.710057    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fca712e-11dd-4783-8fab-7ae83d33c611-trusted-ca-bundle\") pod \"console-678b77cf48-6wcc5\" (UID: \"9fca712e-11dd-4783-8fab-7ae83d33c611\") " pod="openshift-console/console-678b77cf48-6wcc5"
Jul 24 19:27:56.712367 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:56.712345    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9fca712e-11dd-4783-8fab-7ae83d33c611-console-serving-cert\") pod \"console-678b77cf48-6wcc5\" (UID: \"9fca712e-11dd-4783-8fab-7ae83d33c611\") " pod="openshift-console/console-678b77cf48-6wcc5"
Jul 24 19:27:56.712585 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:56.712559    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9fca712e-11dd-4783-8fab-7ae83d33c611-console-oauth-config\") pod \"console-678b77cf48-6wcc5\" (UID: \"9fca712e-11dd-4783-8fab-7ae83d33c611\") " pod="openshift-console/console-678b77cf48-6wcc5"
Jul 24 19:27:56.721208 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:56.721159    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvn6p\" (UniqueName: \"kubernetes.io/projected/9fca712e-11dd-4783-8fab-7ae83d33c611-kube-api-access-pvn6p\") pod \"console-678b77cf48-6wcc5\" (UID: \"9fca712e-11dd-4783-8fab-7ae83d33c611\") " pod="openshift-console/console-678b77cf48-6wcc5"
Jul 24 19:27:56.817759 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:56.817688    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-678b77cf48-6wcc5"
Jul 24 19:27:56.975235 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:56.975205    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-678b77cf48-6wcc5"]
Jul 24 19:27:57.002162 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.002129    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-79d5bdb8f7-stmxp"]
Jul 24 19:27:57.016453 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.016427    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-79d5bdb8f7-stmxp"
Jul 24 19:27:57.019810 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.019784    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 24 19:27:57.019941 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.019882    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-t5j9n\""
Jul 24 19:27:57.019941 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.019894    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 24 19:27:57.020347 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.020325    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 24 19:27:57.020443 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.020383    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 24 19:27:57.020562 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.020527    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 24 19:27:57.021151 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.021132    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-79d5bdb8f7-stmxp"]
Jul 24 19:27:57.026622 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.026603    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 24 19:27:57.084972 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:27:57.084910    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fca712e_11dd_4783_8fab_7ae83d33c611.slice/crio-dcd1acc6b9d2a8dc00e82bc42f59c7a891c6d57bb97f05b67e3b644554d8d5df WatchSource:0}: Error finding container dcd1acc6b9d2a8dc00e82bc42f59c7a891c6d57bb97f05b67e3b644554d8d5df: Status 404 returned error can't find the container with id dcd1acc6b9d2a8dc00e82bc42f59c7a891c6d57bb97f05b67e3b644554d8d5df
Jul 24 19:27:57.112402 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.112380    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c34ea396-859c-4f2d-b878-897380961784-telemeter-trusted-ca-bundle\") pod \"telemeter-client-79d5bdb8f7-stmxp\" (UID: \"c34ea396-859c-4f2d-b878-897380961784\") " pod="openshift-monitoring/telemeter-client-79d5bdb8f7-stmxp"
Jul 24 19:27:57.112505 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.112412    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfglb\" (UniqueName: \"kubernetes.io/projected/c34ea396-859c-4f2d-b878-897380961784-kube-api-access-rfglb\") pod \"telemeter-client-79d5bdb8f7-stmxp\" (UID: \"c34ea396-859c-4f2d-b878-897380961784\") " pod="openshift-monitoring/telemeter-client-79d5bdb8f7-stmxp"
Jul 24 19:27:57.112505 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.112433    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c34ea396-859c-4f2d-b878-897380961784-secret-telemeter-client\") pod \"telemeter-client-79d5bdb8f7-stmxp\" (UID: \"c34ea396-859c-4f2d-b878-897380961784\") " pod="openshift-monitoring/telemeter-client-79d5bdb8f7-stmxp"
Jul 24 19:27:57.112505 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.112454    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c34ea396-859c-4f2d-b878-897380961784-serving-certs-ca-bundle\") pod \"telemeter-client-79d5bdb8f7-stmxp\" (UID: \"c34ea396-859c-4f2d-b878-897380961784\") " pod="openshift-monitoring/telemeter-client-79d5bdb8f7-stmxp"
Jul 24 19:27:57.112622 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.112532    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c34ea396-859c-4f2d-b878-897380961784-metrics-client-ca\") pod \"telemeter-client-79d5bdb8f7-stmxp\" (UID: \"c34ea396-859c-4f2d-b878-897380961784\") " pod="openshift-monitoring/telemeter-client-79d5bdb8f7-stmxp"
Jul 24 19:27:57.112622 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.112573    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c34ea396-859c-4f2d-b878-897380961784-telemeter-client-tls\") pod \"telemeter-client-79d5bdb8f7-stmxp\" (UID: \"c34ea396-859c-4f2d-b878-897380961784\") " pod="openshift-monitoring/telemeter-client-79d5bdb8f7-stmxp"
Jul 24 19:27:57.112622 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.112589    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c34ea396-859c-4f2d-b878-897380961784-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-79d5bdb8f7-stmxp\" (UID: \"c34ea396-859c-4f2d-b878-897380961784\") " pod="openshift-monitoring/telemeter-client-79d5bdb8f7-stmxp"
Jul 24 19:27:57.112733 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.112635    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c34ea396-859c-4f2d-b878-897380961784-federate-client-tls\") pod \"telemeter-client-79d5bdb8f7-stmxp\" (UID: \"c34ea396-859c-4f2d-b878-897380961784\") " pod="openshift-monitoring/telemeter-client-79d5bdb8f7-stmxp"
Jul 24 19:27:57.213669 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.213646    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c34ea396-859c-4f2d-b878-897380961784-telemeter-client-tls\") pod \"telemeter-client-79d5bdb8f7-stmxp\" (UID: \"c34ea396-859c-4f2d-b878-897380961784\") " pod="openshift-monitoring/telemeter-client-79d5bdb8f7-stmxp"
Jul 24 19:27:57.213830 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.213682    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c34ea396-859c-4f2d-b878-897380961784-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-79d5bdb8f7-stmxp\" (UID: \"c34ea396-859c-4f2d-b878-897380961784\") " pod="openshift-monitoring/telemeter-client-79d5bdb8f7-stmxp"
Jul 24 19:27:57.213830 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.213757    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c34ea396-859c-4f2d-b878-897380961784-federate-client-tls\") pod \"telemeter-client-79d5bdb8f7-stmxp\" (UID: \"c34ea396-859c-4f2d-b878-897380961784\") " pod="openshift-monitoring/telemeter-client-79d5bdb8f7-stmxp"
Jul 24 19:27:57.213937 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.213831    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c34ea396-859c-4f2d-b878-897380961784-telemeter-trusted-ca-bundle\") pod \"telemeter-client-79d5bdb8f7-stmxp\" (UID: \"c34ea396-859c-4f2d-b878-897380961784\") " pod="openshift-monitoring/telemeter-client-79d5bdb8f7-stmxp"
Jul 24 19:27:57.213937 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.213864    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfglb\" (UniqueName: \"kubernetes.io/projected/c34ea396-859c-4f2d-b878-897380961784-kube-api-access-rfglb\") pod \"telemeter-client-79d5bdb8f7-stmxp\" (UID: \"c34ea396-859c-4f2d-b878-897380961784\") " pod="openshift-monitoring/telemeter-client-79d5bdb8f7-stmxp"
Jul 24 19:27:57.213937 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.213898    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c34ea396-859c-4f2d-b878-897380961784-secret-telemeter-client\") pod \"telemeter-client-79d5bdb8f7-stmxp\" (UID: \"c34ea396-859c-4f2d-b878-897380961784\") " pod="openshift-monitoring/telemeter-client-79d5bdb8f7-stmxp"
Jul 24 19:27:57.214087 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.213935    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c34ea396-859c-4f2d-b878-897380961784-serving-certs-ca-bundle\") pod \"telemeter-client-79d5bdb8f7-stmxp\" (UID: \"c34ea396-859c-4f2d-b878-897380961784\") " pod="openshift-monitoring/telemeter-client-79d5bdb8f7-stmxp"
Jul 24 19:27:57.214087 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.213963    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c34ea396-859c-4f2d-b878-897380961784-metrics-client-ca\") pod \"telemeter-client-79d5bdb8f7-stmxp\" (UID: \"c34ea396-859c-4f2d-b878-897380961784\") " pod="openshift-monitoring/telemeter-client-79d5bdb8f7-stmxp"
Jul 24 19:27:57.214886 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.214858    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c34ea396-859c-4f2d-b878-897380961784-metrics-client-ca\") pod \"telemeter-client-79d5bdb8f7-stmxp\" (UID: \"c34ea396-859c-4f2d-b878-897380961784\") " pod="openshift-monitoring/telemeter-client-79d5bdb8f7-stmxp"
Jul 24 19:27:57.215008 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.214889    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c34ea396-859c-4f2d-b878-897380961784-telemeter-trusted-ca-bundle\") pod \"telemeter-client-79d5bdb8f7-stmxp\" (UID: \"c34ea396-859c-4f2d-b878-897380961784\") " pod="openshift-monitoring/telemeter-client-79d5bdb8f7-stmxp"
Jul 24 19:27:57.215250 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.215220    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c34ea396-859c-4f2d-b878-897380961784-serving-certs-ca-bundle\") pod \"telemeter-client-79d5bdb8f7-stmxp\" (UID: \"c34ea396-859c-4f2d-b878-897380961784\") " pod="openshift-monitoring/telemeter-client-79d5bdb8f7-stmxp"
Jul 24 19:27:57.216714 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.216687    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c34ea396-859c-4f2d-b878-897380961784-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-79d5bdb8f7-stmxp\" (UID: \"c34ea396-859c-4f2d-b878-897380961784\") " pod="openshift-monitoring/telemeter-client-79d5bdb8f7-stmxp"
Jul 24 19:27:57.217029 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.216976    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c34ea396-859c-4f2d-b878-897380961784-federate-client-tls\") pod \"telemeter-client-79d5bdb8f7-stmxp\" (UID: \"c34ea396-859c-4f2d-b878-897380961784\") " pod="openshift-monitoring/telemeter-client-79d5bdb8f7-stmxp"
Jul 24 19:27:57.217116 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.217031    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c34ea396-859c-4f2d-b878-897380961784-telemeter-client-tls\") pod \"telemeter-client-79d5bdb8f7-stmxp\" (UID: \"c34ea396-859c-4f2d-b878-897380961784\") " pod="openshift-monitoring/telemeter-client-79d5bdb8f7-stmxp"
Jul 24 19:27:57.217239 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.217221    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c34ea396-859c-4f2d-b878-897380961784-secret-telemeter-client\") pod \"telemeter-client-79d5bdb8f7-stmxp\" (UID: \"c34ea396-859c-4f2d-b878-897380961784\") " pod="openshift-monitoring/telemeter-client-79d5bdb8f7-stmxp"
Jul 24 19:27:57.222631 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.222584    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfglb\" (UniqueName: \"kubernetes.io/projected/c34ea396-859c-4f2d-b878-897380961784-kube-api-access-rfglb\") pod \"telemeter-client-79d5bdb8f7-stmxp\" (UID: \"c34ea396-859c-4f2d-b878-897380961784\") " pod="openshift-monitoring/telemeter-client-79d5bdb8f7-stmxp"
Jul 24 19:27:57.327601 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.327572    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-79d5bdb8f7-stmxp"
Jul 24 19:27:57.466147 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.466115    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-678b77cf48-6wcc5" event={"ID":"9fca712e-11dd-4783-8fab-7ae83d33c611","Type":"ContainerStarted","Data":"e1a9311f3f5ca00154f330a2db96692a572da2d00caef718582582eed43ce765"}
Jul 24 19:27:57.466324 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.466203    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-678b77cf48-6wcc5" event={"ID":"9fca712e-11dd-4783-8fab-7ae83d33c611","Type":"ContainerStarted","Data":"dcd1acc6b9d2a8dc00e82bc42f59c7a891c6d57bb97f05b67e3b644554d8d5df"}
Jul 24 19:27:57.468697 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.468668    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3376df31-f289-4905-85b5-0fb505b04806","Type":"ContainerStarted","Data":"194959bd63d5929d943dfb7bc5354539cd4b41a914168c92de57581b7c8b90dd"}
Jul 24 19:27:57.468829 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.468729    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3376df31-f289-4905-85b5-0fb505b04806","Type":"ContainerStarted","Data":"36e6b5549c79baaf2a235ed9708f83f9748beacb51b8615dc583c2bdb1d24499"}
Jul 24 19:27:57.468829 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.468769    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3376df31-f289-4905-85b5-0fb505b04806","Type":"ContainerStarted","Data":"6cee07b69f6e09f69dace96add984c0ce7c086129e8f877c2cec01798c80c5c5"}
Jul 24 19:27:57.484515 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.484449    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-678b77cf48-6wcc5" podStartSLOduration=1.484432537 podStartE2EDuration="1.484432537s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:27:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:27:57.483290162 +0000 UTC m=+66.001910204" watchObservedRunningTime="2026-07-24 19:27:57.484432537 +0000 UTC m=+66.003052577"
Jul 24 19:27:57.488427 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.488231    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-79d5bdb8f7-stmxp"]
Jul 24 19:27:57.819295 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.819255    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94868cfc-85a8-4310-a339-2c4b44da043b-original-pull-secret\") pod \"global-pull-secret-syncer-gvbbc\" (UID: \"94868cfc-85a8-4310-a339-2c4b44da043b\") " pod="kube-system/global-pull-secret-syncer-gvbbc"
Jul 24 19:27:57.819800 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.819334    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b53e2ac-1a53-4df0-a395-2718093476b6-metrics-certs\") pod \"network-metrics-daemon-nqt4p\" (UID: \"5b53e2ac-1a53-4df0-a395-2718093476b6\") " pod="openshift-multus/network-metrics-daemon-nqt4p"
Jul 24 19:27:57.821929 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.821909    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 19:27:57.822056 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.821909    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 19:27:57.832701 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.832643    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94868cfc-85a8-4310-a339-2c4b44da043b-original-pull-secret\") pod \"global-pull-secret-syncer-gvbbc\" (UID: \"94868cfc-85a8-4310-a339-2c4b44da043b\") " pod="kube-system/global-pull-secret-syncer-gvbbc"
Jul 24 19:27:57.832701 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.832664    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b53e2ac-1a53-4df0-a395-2718093476b6-metrics-certs\") pod \"network-metrics-daemon-nqt4p\" (UID: \"5b53e2ac-1a53-4df0-a395-2718093476b6\") " pod="openshift-multus/network-metrics-daemon-nqt4p"
Jul 24 19:27:57.920542 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.920473    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qh5nt\" (UniqueName: \"kubernetes.io/projected/9e802511-bdaa-463d-9572-22349bfbcd49-kube-api-access-qh5nt\") pod \"network-check-target-tv7vs\" (UID: \"9e802511-bdaa-463d-9572-22349bfbcd49\") " pod="openshift-network-diagnostics/network-check-target-tv7vs"
Jul 24 19:27:57.923048 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.923027    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 19:27:57.933429 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.933405    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 19:27:57.943871 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.943844    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh5nt\" (UniqueName: \"kubernetes.io/projected/9e802511-bdaa-463d-9572-22349bfbcd49-kube-api-access-qh5nt\") pod \"network-check-target-tv7vs\" (UID: \"9e802511-bdaa-463d-9572-22349bfbcd49\") " pod="openshift-network-diagnostics/network-check-target-tv7vs"
Jul 24 19:27:57.980389 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.980361    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ln4l7\""
Jul 24 19:27:57.984597 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.984572    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nz88f\""
Jul 24 19:27:57.987451 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.987430    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gvbbc"
Jul 24 19:27:57.988526 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.988505    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nqt4p"
Jul 24 19:27:57.992763 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:57.992736    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tv7vs"
Jul 24 19:27:58.024924 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.022942    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 19:27:58.058505 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.057577    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 19:27:58.058505 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.057751    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.069015 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.061114    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rfgqb\""
Jul 24 19:27:58.069015 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.061337    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 24 19:27:58.069015 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.061954    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 24 19:27:58.069015 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.061984    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 24 19:27:58.071697 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.071524    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 24 19:27:58.072164 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.072112    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 24 19:27:58.072554 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.072521    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3iln871k6nji\""
Jul 24 19:27:58.072972 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.072931    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 24 19:27:58.073835 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.073306    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 24 19:27:58.074823 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.074467    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 24 19:27:58.074823 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.074464    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 24 19:27:58.074823 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.074537    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 24 19:27:58.074823 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.074791    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 24 19:27:58.074823 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.074835    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 24 19:27:58.076914 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.075199    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 24 19:27:58.076914 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.075758    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 24 19:27:58.076914 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.076804    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 24 19:27:58.122611 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.122572    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86a1e9a2-e57f-4061-afee-f5718c31069c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.122777 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.122628    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86a1e9a2-e57f-4061-afee-f5718c31069c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.122777 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.122665    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/86a1e9a2-e57f-4061-afee-f5718c31069c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.122777 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.122708    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/86a1e9a2-e57f-4061-afee-f5718c31069c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.122777 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.122733    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/86a1e9a2-e57f-4061-afee-f5718c31069c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.122777 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.122767    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/86a1e9a2-e57f-4061-afee-f5718c31069c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.123044 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.122807    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/86a1e9a2-e57f-4061-afee-f5718c31069c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.123044 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.122829    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/86a1e9a2-e57f-4061-afee-f5718c31069c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.123044 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.122858    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/86a1e9a2-e57f-4061-afee-f5718c31069c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.123044 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.122890    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/86a1e9a2-e57f-4061-afee-f5718c31069c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.123044 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.122915    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/86a1e9a2-e57f-4061-afee-f5718c31069c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.123044 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.122952    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/86a1e9a2-e57f-4061-afee-f5718c31069c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.123044 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.122978    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/86a1e9a2-e57f-4061-afee-f5718c31069c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.123044 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.123002    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86a1e9a2-e57f-4061-afee-f5718c31069c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.123044 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.123029    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86a1e9a2-e57f-4061-afee-f5718c31069c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.123608 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.123052    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/86a1e9a2-e57f-4061-afee-f5718c31069c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.123608 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.123081    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/86a1e9a2-e57f-4061-afee-f5718c31069c-config-out\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.123608 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.123103    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh77v\" (UniqueName: \"kubernetes.io/projected/86a1e9a2-e57f-4061-afee-f5718c31069c-kube-api-access-kh77v\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.123608 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.123142    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/86a1e9a2-e57f-4061-afee-f5718c31069c-web-config\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.123608 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.123170    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/86a1e9a2-e57f-4061-afee-f5718c31069c-config\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.223967 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.223930    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86a1e9a2-e57f-4061-afee-f5718c31069c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.225175 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.225068    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86a1e9a2-e57f-4061-afee-f5718c31069c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.225345 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.225143    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86a1e9a2-e57f-4061-afee-f5718c31069c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.226261 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.226159    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86a1e9a2-e57f-4061-afee-f5718c31069c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.226399 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.226233    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/86a1e9a2-e57f-4061-afee-f5718c31069c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.227015 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.226918    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/86a1e9a2-e57f-4061-afee-f5718c31069c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.227150 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.227134    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/86a1e9a2-e57f-4061-afee-f5718c31069c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.227686 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.227671    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/86a1e9a2-e57f-4061-afee-f5718c31069c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.228172 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.228155    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/86a1e9a2-e57f-4061-afee-f5718c31069c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.228311 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.228298    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/86a1e9a2-e57f-4061-afee-f5718c31069c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.228406 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.228394    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/86a1e9a2-e57f-4061-afee-f5718c31069c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.228514 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.228501    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/86a1e9a2-e57f-4061-afee-f5718c31069c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.228622 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.228610    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/86a1e9a2-e57f-4061-afee-f5718c31069c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.228720 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.228708    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/86a1e9a2-e57f-4061-afee-f5718c31069c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.228822 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.228811    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/86a1e9a2-e57f-4061-afee-f5718c31069c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.228910 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.228899    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/86a1e9a2-e57f-4061-afee-f5718c31069c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.228995 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.228984    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86a1e9a2-e57f-4061-afee-f5718c31069c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.229082 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.229069    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86a1e9a2-e57f-4061-afee-f5718c31069c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.229169 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.229157    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/86a1e9a2-e57f-4061-afee-f5718c31069c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.229273 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.229237    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/86a1e9a2-e57f-4061-afee-f5718c31069c-config-out\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.229346 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.229336    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kh77v\" (UniqueName: \"kubernetes.io/projected/86a1e9a2-e57f-4061-afee-f5718c31069c-kube-api-access-kh77v\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.229441 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.229428    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/86a1e9a2-e57f-4061-afee-f5718c31069c-web-config\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.229537 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.229527    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/86a1e9a2-e57f-4061-afee-f5718c31069c-config\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.230239 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.230019    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/86a1e9a2-e57f-4061-afee-f5718c31069c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.231616 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.230847    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/86a1e9a2-e57f-4061-afee-f5718c31069c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.231616 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.231324    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/86a1e9a2-e57f-4061-afee-f5718c31069c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.233590 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.233126    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/86a1e9a2-e57f-4061-afee-f5718c31069c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.235063 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.235033    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86a1e9a2-e57f-4061-afee-f5718c31069c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.236988 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.236914    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/86a1e9a2-e57f-4061-afee-f5718c31069c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.237309 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.237204    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/86a1e9a2-e57f-4061-afee-f5718c31069c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.237549 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.237532    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86a1e9a2-e57f-4061-afee-f5718c31069c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.238597 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.238547    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/86a1e9a2-e57f-4061-afee-f5718c31069c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.239827 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.239699    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/86a1e9a2-e57f-4061-afee-f5718c31069c-config-out\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.240179 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.240095    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nqt4p"]
Jul 24 19:27:58.241460 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.241438    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/86a1e9a2-e57f-4061-afee-f5718c31069c-web-config\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.241678 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.241540    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/86a1e9a2-e57f-4061-afee-f5718c31069c-config\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.247991 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.246252    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gvbbc"]
Jul 24 19:27:58.250472 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:27:58.250233    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94868cfc_85a8_4310_a339_2c4b44da043b.slice/crio-e09fcba112ecad709c6e52f47aa2f9f0de8108860afa902d4e793cb8bcf4a17c WatchSource:0}: Error finding container e09fcba112ecad709c6e52f47aa2f9f0de8108860afa902d4e793cb8bcf4a17c: Status 404 returned error can't find the container with id e09fcba112ecad709c6e52f47aa2f9f0de8108860afa902d4e793cb8bcf4a17c
Jul 24 19:27:58.252222 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.252197    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh77v\" (UniqueName: \"kubernetes.io/projected/86a1e9a2-e57f-4061-afee-f5718c31069c-kube-api-access-kh77v\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.252399 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.252376    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/86a1e9a2-e57f-4061-afee-f5718c31069c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.252712 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.252470    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/86a1e9a2-e57f-4061-afee-f5718c31069c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.253043 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.253015    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/86a1e9a2-e57f-4061-afee-f5718c31069c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.254866 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.254778    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/86a1e9a2-e57f-4061-afee-f5718c31069c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"86a1e9a2-e57f-4061-afee-f5718c31069c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.286458 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.286433    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tv7vs"]
Jul 24 19:27:58.289970 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:27:58.289942    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e802511_bdaa_463d_9572_22349bfbcd49.slice/crio-c6b1638feb8cf1779960719982e40835db1fcd347ba31b28b2be3f72b675d6f8 WatchSource:0}: Error finding container c6b1638feb8cf1779960719982e40835db1fcd347ba31b28b2be3f72b675d6f8: Status 404 returned error can't find the container with id c6b1638feb8cf1779960719982e40835db1fcd347ba31b28b2be3f72b675d6f8
Jul 24 19:27:58.406080 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.406042    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:27:58.476418 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.476347    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tv7vs" event={"ID":"9e802511-bdaa-463d-9572-22349bfbcd49","Type":"ContainerStarted","Data":"c6b1638feb8cf1779960719982e40835db1fcd347ba31b28b2be3f72b675d6f8"}
Jul 24 19:27:58.480168 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.480136    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3376df31-f289-4905-85b5-0fb505b04806","Type":"ContainerStarted","Data":"be507609fc377d45cc2276dc0e1d218ee0c11baf19757f0b7fa7daa6137ca92c"}
Jul 24 19:27:58.480313 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.480202    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3376df31-f289-4905-85b5-0fb505b04806","Type":"ContainerStarted","Data":"7aaa418f303c910fd0d7e624c719b8c51f4852a29298606d3e3feb410bc70561"}
Jul 24 19:27:58.481980 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.481905    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-79d5bdb8f7-stmxp" event={"ID":"c34ea396-859c-4f2d-b878-897380961784","Type":"ContainerStarted","Data":"772a9d4e502c7026530a7a103453cce0bdceadffbde140d6a8fb7a60dc654aff"}
Jul 24 19:27:58.484062 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.484032    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nqt4p" event={"ID":"5b53e2ac-1a53-4df0-a395-2718093476b6","Type":"ContainerStarted","Data":"309d57e084ac1ed3160cef2f88a1d595fd67d4abf0ac5de790717da232877592"}
Jul 24 19:27:58.485231 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.485206    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gvbbc" event={"ID":"94868cfc-85a8-4310-a339-2c4b44da043b","Type":"ContainerStarted","Data":"e09fcba112ecad709c6e52f47aa2f9f0de8108860afa902d4e793cb8bcf4a17c"}
Jul 24 19:27:58.719086 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:58.719051    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 19:27:58.723915 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:27:58.723886    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86a1e9a2_e57f_4061_afee_f5718c31069c.slice/crio-22aebddcd923fa6ea39b90083239bfc0d801c44af89be45d972e886c1a0fa312 WatchSource:0}: Error finding container 22aebddcd923fa6ea39b90083239bfc0d801c44af89be45d972e886c1a0fa312: Status 404 returned error can't find the container with id 22aebddcd923fa6ea39b90083239bfc0d801c44af89be45d972e886c1a0fa312
Jul 24 19:27:59.495064 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:59.495023    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3376df31-f289-4905-85b5-0fb505b04806","Type":"ContainerStarted","Data":"a8f624ffe12c688f1ee2e785a04a11ed8352fb88ce92cdbfaeebe4446b7123a4"}
Jul 24 19:27:59.499667 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:59.497894    2567 generic.go:356] "Generic (PLEG): container finished" podID="86a1e9a2-e57f-4061-afee-f5718c31069c" containerID="64e0d6e7ad343a814e2852a3563c11a50a248d5463a550ab99a6fcfe51c1f56e" exitCode=0
Jul 24 19:27:59.499667 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:59.497955    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"86a1e9a2-e57f-4061-afee-f5718c31069c","Type":"ContainerDied","Data":"64e0d6e7ad343a814e2852a3563c11a50a248d5463a550ab99a6fcfe51c1f56e"}
Jul 24 19:27:59.499667 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:59.498029    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"86a1e9a2-e57f-4061-afee-f5718c31069c","Type":"ContainerStarted","Data":"22aebddcd923fa6ea39b90083239bfc0d801c44af89be45d972e886c1a0fa312"}
Jul 24 19:27:59.528904 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:27:59.527769    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.67625869 podStartE2EDuration="7.527743734s" totalImagesPullingTime="3.829692798s" totalInitContainerRuntime="21.792246ms" isStatefulPod=false podCreationTimestamp="2026-07-24 19:27:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:27:59.525458896 +0000 UTC m=+68.044078939" watchObservedRunningTime="2026-07-24 19:27:59.527743734 +0000 UTC m=+68.046363776"
Jul 24 19:28:00.508919 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:00.508878    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-79d5bdb8f7-stmxp" event={"ID":"c34ea396-859c-4f2d-b878-897380961784","Type":"ContainerStarted","Data":"2505600dbffe24c43aac61223fcf2ac489713f4ce51fbf0ef81c024dd56c6356"}
Jul 24 19:28:00.509356 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:00.508991    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-79d5bdb8f7-stmxp" event={"ID":"c34ea396-859c-4f2d-b878-897380961784","Type":"ContainerStarted","Data":"68a0e54c2423e79bd40f046dfc96243f39722e1a2282f3d4bf5b46bff6649cb2"}
Jul 24 19:28:00.509356 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:00.509021    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-79d5bdb8f7-stmxp" event={"ID":"c34ea396-859c-4f2d-b878-897380961784","Type":"ContainerStarted","Data":"c15e19435639849c016f2a02e3d4814f27736d8b6f78c87c734c282a9751ba9f"}
Jul 24 19:28:00.513795 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:00.513723    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nqt4p" event={"ID":"5b53e2ac-1a53-4df0-a395-2718093476b6","Type":"ContainerStarted","Data":"6f8707e34b255904be70e50cbad08bcc78782b9dafb613529e85f857603294df"}
Jul 24 19:28:00.513795 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:00.513758    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nqt4p" event={"ID":"5b53e2ac-1a53-4df0-a395-2718093476b6","Type":"ContainerStarted","Data":"40529053dd65005489a022bb1381d60bc863a9b237fbb68c899ea615fdc5989e"}
Jul 24 19:28:00.537071 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:00.537014    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-79d5bdb8f7-stmxp" podStartSLOduration=1.899199321 podStartE2EDuration="4.536993158s" totalImagesPullingTime="2.637793837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:27:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:28:00.533888449 +0000 UTC m=+69.052508492" watchObservedRunningTime="2026-07-24 19:28:00.536993158 +0000 UTC m=+69.055613201"
Jul 24 19:28:00.556142 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:00.556094    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nqt4p" podStartSLOduration=66.670915378 podStartE2EDuration="1m8.556074916s" totalImagesPullingTime="1.885159538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:26:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:28:00.553587153 +0000 UTC m=+69.072207195" watchObservedRunningTime="2026-07-24 19:28:00.556074916 +0000 UTC m=+69.074694959"
Jul 24 19:28:01.280277 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:01.280239    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-678b77cf48-6wcc5"]
Jul 24 19:28:01.316100 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:01.316067    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6845cb4754-4nt8h"]
Jul 24 19:28:01.321351 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:01.321327    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6845cb4754-4nt8h"
Jul 24 19:28:01.329848 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:01.329826    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6845cb4754-4nt8h"]
Jul 24 19:28:01.364614 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:01.364580    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbn7n\" (UniqueName: \"kubernetes.io/projected/8f418fa8-2164-4247-91b6-4554f35d9ec8-kube-api-access-tbn7n\") pod \"console-6845cb4754-4nt8h\" (UID: \"8f418fa8-2164-4247-91b6-4554f35d9ec8\") " pod="openshift-console/console-6845cb4754-4nt8h"
Jul 24 19:28:01.364796 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:01.364625    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8f418fa8-2164-4247-91b6-4554f35d9ec8-console-config\") pod \"console-6845cb4754-4nt8h\" (UID: \"8f418fa8-2164-4247-91b6-4554f35d9ec8\") " pod="openshift-console/console-6845cb4754-4nt8h"
Jul 24 19:28:01.364796 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:01.364676    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8f418fa8-2164-4247-91b6-4554f35d9ec8-oauth-serving-cert\") pod \"console-6845cb4754-4nt8h\" (UID: \"8f418fa8-2164-4247-91b6-4554f35d9ec8\") " pod="openshift-console/console-6845cb4754-4nt8h"
Jul 24 19:28:01.364796 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:01.364713    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f418fa8-2164-4247-91b6-4554f35d9ec8-trusted-ca-bundle\") pod \"console-6845cb4754-4nt8h\" (UID: \"8f418fa8-2164-4247-91b6-4554f35d9ec8\") " pod="openshift-console/console-6845cb4754-4nt8h"
Jul 24 19:28:01.364796 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:01.364767    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8f418fa8-2164-4247-91b6-4554f35d9ec8-service-ca\") pod \"console-6845cb4754-4nt8h\" (UID: \"8f418fa8-2164-4247-91b6-4554f35d9ec8\") " pod="openshift-console/console-6845cb4754-4nt8h"
Jul 24 19:28:01.364988 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:01.364799    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8f418fa8-2164-4247-91b6-4554f35d9ec8-console-oauth-config\") pod \"console-6845cb4754-4nt8h\" (UID: \"8f418fa8-2164-4247-91b6-4554f35d9ec8\") " pod="openshift-console/console-6845cb4754-4nt8h"
Jul 24 19:28:01.364988 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:01.364827    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f418fa8-2164-4247-91b6-4554f35d9ec8-console-serving-cert\") pod \"console-6845cb4754-4nt8h\" (UID: \"8f418fa8-2164-4247-91b6-4554f35d9ec8\") " pod="openshift-console/console-6845cb4754-4nt8h"
Jul 24 19:28:01.465558 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:01.465517    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8f418fa8-2164-4247-91b6-4554f35d9ec8-oauth-serving-cert\") pod \"console-6845cb4754-4nt8h\" (UID: \"8f418fa8-2164-4247-91b6-4554f35d9ec8\") " pod="openshift-console/console-6845cb4754-4nt8h"
Jul 24 19:28:01.465708 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:01.465563    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f418fa8-2164-4247-91b6-4554f35d9ec8-trusted-ca-bundle\") pod \"console-6845cb4754-4nt8h\" (UID: \"8f418fa8-2164-4247-91b6-4554f35d9ec8\") " pod="openshift-console/console-6845cb4754-4nt8h"
Jul 24 19:28:01.465708 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:01.465605    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8f418fa8-2164-4247-91b6-4554f35d9ec8-service-ca\") pod \"console-6845cb4754-4nt8h\" (UID: \"8f418fa8-2164-4247-91b6-4554f35d9ec8\") " pod="openshift-console/console-6845cb4754-4nt8h"
Jul 24 19:28:01.465708 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:01.465630    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8f418fa8-2164-4247-91b6-4554f35d9ec8-console-oauth-config\") pod \"console-6845cb4754-4nt8h\" (UID: \"8f418fa8-2164-4247-91b6-4554f35d9ec8\") " pod="openshift-console/console-6845cb4754-4nt8h"
Jul 24 19:28:01.465708 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:01.465652    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f418fa8-2164-4247-91b6-4554f35d9ec8-console-serving-cert\") pod \"console-6845cb4754-4nt8h\" (UID: \"8f418fa8-2164-4247-91b6-4554f35d9ec8\") " pod="openshift-console/console-6845cb4754-4nt8h"
Jul 24 19:28:01.465708 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:01.465707    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbn7n\" (UniqueName: \"kubernetes.io/projected/8f418fa8-2164-4247-91b6-4554f35d9ec8-kube-api-access-tbn7n\") pod \"console-6845cb4754-4nt8h\" (UID: \"8f418fa8-2164-4247-91b6-4554f35d9ec8\") " pod="openshift-console/console-6845cb4754-4nt8h"
Jul 24 19:28:01.465869 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:01.465723    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8f418fa8-2164-4247-91b6-4554f35d9ec8-console-config\") pod \"console-6845cb4754-4nt8h\" (UID: \"8f418fa8-2164-4247-91b6-4554f35d9ec8\") " pod="openshift-console/console-6845cb4754-4nt8h"
Jul 24 19:28:01.466499 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:01.466441    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8f418fa8-2164-4247-91b6-4554f35d9ec8-console-config\") pod \"console-6845cb4754-4nt8h\" (UID: \"8f418fa8-2164-4247-91b6-4554f35d9ec8\") " pod="openshift-console/console-6845cb4754-4nt8h"
Jul 24 19:28:01.467820 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:01.467773    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8f418fa8-2164-4247-91b6-4554f35d9ec8-service-ca\") pod \"console-6845cb4754-4nt8h\" (UID: \"8f418fa8-2164-4247-91b6-4554f35d9ec8\") " pod="openshift-console/console-6845cb4754-4nt8h"
Jul 24 19:28:01.467934 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:01.467910    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f418fa8-2164-4247-91b6-4554f35d9ec8-trusted-ca-bundle\") pod \"console-6845cb4754-4nt8h\" (UID: \"8f418fa8-2164-4247-91b6-4554f35d9ec8\") " pod="openshift-console/console-6845cb4754-4nt8h"
Jul 24 19:28:01.468528 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:01.468446    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8f418fa8-2164-4247-91b6-4554f35d9ec8-oauth-serving-cert\") pod \"console-6845cb4754-4nt8h\" (UID: \"8f418fa8-2164-4247-91b6-4554f35d9ec8\") " pod="openshift-console/console-6845cb4754-4nt8h"
Jul 24 19:28:01.470435 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:01.470390    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8f418fa8-2164-4247-91b6-4554f35d9ec8-console-oauth-config\") pod \"console-6845cb4754-4nt8h\" (UID: \"8f418fa8-2164-4247-91b6-4554f35d9ec8\") " pod="openshift-console/console-6845cb4754-4nt8h"
Jul 24 19:28:01.471800 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:01.471759    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f418fa8-2164-4247-91b6-4554f35d9ec8-console-serving-cert\") pod \"console-6845cb4754-4nt8h\" (UID: \"8f418fa8-2164-4247-91b6-4554f35d9ec8\") " pod="openshift-console/console-6845cb4754-4nt8h"
Jul 24 19:28:01.474931 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:01.474890    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbn7n\" (UniqueName: \"kubernetes.io/projected/8f418fa8-2164-4247-91b6-4554f35d9ec8-kube-api-access-tbn7n\") pod \"console-6845cb4754-4nt8h\" (UID: \"8f418fa8-2164-4247-91b6-4554f35d9ec8\") " pod="openshift-console/console-6845cb4754-4nt8h"
Jul 24 19:28:01.640524 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:01.640459    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6845cb4754-4nt8h"
Jul 24 19:28:05.755965 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:05.755940    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6845cb4754-4nt8h"]
Jul 24 19:28:05.757554 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:28:05.757528    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f418fa8_2164_4247_91b6_4554f35d9ec8.slice/crio-2af791dbce49851c1c88b8c7b890e2032fd32d11152a8257a6279fc8cdff2be6 WatchSource:0}: Error finding container 2af791dbce49851c1c88b8c7b890e2032fd32d11152a8257a6279fc8cdff2be6: Status 404 returned error can't find the container with id 2af791dbce49851c1c88b8c7b890e2032fd32d11152a8257a6279fc8cdff2be6
Jul 24 19:28:06.547508 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:06.547414    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gvbbc" event={"ID":"94868cfc-85a8-4310-a339-2c4b44da043b","Type":"ContainerStarted","Data":"edca2cf455bf58598d8645bca2950a056677313db2969c2a5b1de01fa4684c50"}
Jul 24 19:28:06.549561 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:06.549448    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6845cb4754-4nt8h" event={"ID":"8f418fa8-2164-4247-91b6-4554f35d9ec8","Type":"ContainerStarted","Data":"f0871331de4f1dce05791364466e82bf8fd121aa1a13141eadbc86b9cc52d234"}
Jul 24 19:28:06.549561 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:06.549523    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6845cb4754-4nt8h" event={"ID":"8f418fa8-2164-4247-91b6-4554f35d9ec8","Type":"ContainerStarted","Data":"2af791dbce49851c1c88b8c7b890e2032fd32d11152a8257a6279fc8cdff2be6"}
Jul 24 19:28:06.552224 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:06.552195    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"86a1e9a2-e57f-4061-afee-f5718c31069c","Type":"ContainerStarted","Data":"bf84e4d85b399447d0b58baf6c003a3689ebded3ebf9d379d720c820fc61ad86"}
Jul 24 19:28:06.552349 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:06.552268    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"86a1e9a2-e57f-4061-afee-f5718c31069c","Type":"ContainerStarted","Data":"5068f4a7326711883314bb33dfc1f0ac6b1c598fbeb11cf79e5d9dc8648d407f"}
Jul 24 19:28:06.555457 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:06.553802    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tv7vs" event={"ID":"9e802511-bdaa-463d-9572-22349bfbcd49","Type":"ContainerStarted","Data":"66bba8c690d5f05a42a98747a7f937b27f7fcc976c98958fec34d3a49fc4af66"}
Jul 24 19:28:06.555457 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:06.553862    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tv7vs"
Jul 24 19:28:06.562162 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:06.562118    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-gvbbc" podStartSLOduration=67.202169245 podStartE2EDuration="1m14.562101904s" totalImagesPullingTime="7.359932659s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:26:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:28:06.561445252 +0000 UTC m=+75.080065295" watchObservedRunningTime="2026-07-24 19:28:06.562101904 +0000 UTC m=+75.080721948"
Jul 24 19:28:06.593620 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:06.593570    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tv7vs" podStartSLOduration=67.27272547 podStartE2EDuration="1m14.593551203s" totalImagesPullingTime="7.320825733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:26:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:28:06.576651024 +0000 UTC m=+75.095271065" watchObservedRunningTime="2026-07-24 19:28:06.593551203 +0000 UTC m=+75.112171247"
Jul 24 19:28:06.594123 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:06.594087    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6845cb4754-4nt8h" podStartSLOduration=5.59407603 podStartE2EDuration="5.59407603s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:28:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:28:06.592782018 +0000 UTC m=+75.111402063" watchObservedRunningTime="2026-07-24 19:28:06.59407603 +0000 UTC m=+75.112696073"
Jul 24 19:28:06.818638 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:06.818556    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-678b77cf48-6wcc5"
Jul 24 19:28:08.565540 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:08.565509    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"86a1e9a2-e57f-4061-afee-f5718c31069c","Type":"ContainerStarted","Data":"9d9c3c60dbcdacbc403798060ca6a2c55070f771ffc13fe8803dc6d7349e7156"}
Jul 24 19:28:08.565974 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:08.565571    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"86a1e9a2-e57f-4061-afee-f5718c31069c","Type":"ContainerStarted","Data":"7977212f9d523806b4f8990fc1f202206825e318c601157c3c321268435aa844"}
Jul 24 19:28:08.565974 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:08.565596    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"86a1e9a2-e57f-4061-afee-f5718c31069c","Type":"ContainerStarted","Data":"014ffafe84d70f013de6780af92226cc5509b9de60ddb57465ef988d42729f76"}
Jul 24 19:28:09.573202 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:09.573169    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"86a1e9a2-e57f-4061-afee-f5718c31069c","Type":"ContainerStarted","Data":"6162f31bcb645233948af6bb8f32026e953b7e32efad9366af49689b662f08f5"}
Jul 24 19:28:09.606240 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:09.604402    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.141484187 podStartE2EDuration="12.604381671s" totalImagesPullingTime="8.434873999s" totalInitContainerRuntime="28.023485ms" isStatefulPod=false podCreationTimestamp="2026-07-24 19:27:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:28:09.602320985 +0000 UTC m=+78.120941027" watchObservedRunningTime="2026-07-24 19:28:09.604381671 +0000 UTC m=+78.123001715"
Jul 24 19:28:11.640964 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:11.640926    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6845cb4754-4nt8h"
Jul 24 19:28:11.641344 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:11.641083    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6845cb4754-4nt8h"
Jul 24 19:28:11.645987 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:11.645969    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6845cb4754-4nt8h"
Jul 24 19:28:12.589123 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:12.589097    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6845cb4754-4nt8h"
Jul 24 19:28:12.638536 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:12.638505    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69759cd94d-84blt"]
Jul 24 19:28:13.407025 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:13.406997    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:28:26.311537 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:26.311454    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-678b77cf48-6wcc5" podUID="9fca712e-11dd-4783-8fab-7ae83d33c611" containerName="console" containerID="cri-o://e1a9311f3f5ca00154f330a2db96692a572da2d00caef718582582eed43ce765" gracePeriod=15
Jul 24 19:28:26.556928 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:26.556907    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-678b77cf48-6wcc5"
Jul 24 19:28:26.604715 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:26.604640    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9fca712e-11dd-4783-8fab-7ae83d33c611-console-config\") pod \"9fca712e-11dd-4783-8fab-7ae83d33c611\" (UID: \"9fca712e-11dd-4783-8fab-7ae83d33c611\") "
Jul 24 19:28:26.604715 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:26.604683    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9fca712e-11dd-4783-8fab-7ae83d33c611-console-serving-cert\") pod \"9fca712e-11dd-4783-8fab-7ae83d33c611\" (UID: \"9fca712e-11dd-4783-8fab-7ae83d33c611\") "
Jul 24 19:28:26.604921 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:26.604731    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9fca712e-11dd-4783-8fab-7ae83d33c611-service-ca\") pod \"9fca712e-11dd-4783-8fab-7ae83d33c611\" (UID: \"9fca712e-11dd-4783-8fab-7ae83d33c611\") "
Jul 24 19:28:26.604921 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:26.604746    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fca712e-11dd-4783-8fab-7ae83d33c611-trusted-ca-bundle\") pod \"9fca712e-11dd-4783-8fab-7ae83d33c611\" (UID: \"9fca712e-11dd-4783-8fab-7ae83d33c611\") "
Jul 24 19:28:26.604921 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:26.604777    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9fca712e-11dd-4783-8fab-7ae83d33c611-oauth-serving-cert\") pod \"9fca712e-11dd-4783-8fab-7ae83d33c611\" (UID: \"9fca712e-11dd-4783-8fab-7ae83d33c611\") "
Jul 24 19:28:26.605143 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:26.605027    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fca712e-11dd-4783-8fab-7ae83d33c611-console-config" (OuterVolumeSpecName: "console-config") pod "9fca712e-11dd-4783-8fab-7ae83d33c611" (UID: "9fca712e-11dd-4783-8fab-7ae83d33c611"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:28:26.605225 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:26.605156    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fca712e-11dd-4783-8fab-7ae83d33c611-service-ca" (OuterVolumeSpecName: "service-ca") pod "9fca712e-11dd-4783-8fab-7ae83d33c611" (UID: "9fca712e-11dd-4783-8fab-7ae83d33c611"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:28:26.605225 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:26.605194    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fca712e-11dd-4783-8fab-7ae83d33c611-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9fca712e-11dd-4783-8fab-7ae83d33c611" (UID: "9fca712e-11dd-4783-8fab-7ae83d33c611"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:28:26.605225 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:26.605207    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fca712e-11dd-4783-8fab-7ae83d33c611-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9fca712e-11dd-4783-8fab-7ae83d33c611" (UID: "9fca712e-11dd-4783-8fab-7ae83d33c611"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:28:26.607146 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:26.607128    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fca712e-11dd-4783-8fab-7ae83d33c611-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9fca712e-11dd-4783-8fab-7ae83d33c611" (UID: "9fca712e-11dd-4783-8fab-7ae83d33c611"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:28:26.652398 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:26.652365    2567 generic.go:356] "Generic (PLEG): container finished" podID="9fca712e-11dd-4783-8fab-7ae83d33c611" containerID="e1a9311f3f5ca00154f330a2db96692a572da2d00caef718582582eed43ce765" exitCode=0
Jul 24 19:28:26.652543 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:26.652412    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-678b77cf48-6wcc5"
Jul 24 19:28:26.652543 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:26.652436    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-678b77cf48-6wcc5" event={"ID":"9fca712e-11dd-4783-8fab-7ae83d33c611","Type":"ContainerDied","Data":"e1a9311f3f5ca00154f330a2db96692a572da2d00caef718582582eed43ce765"}
Jul 24 19:28:26.652543 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:26.652508    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-678b77cf48-6wcc5" event={"ID":"9fca712e-11dd-4783-8fab-7ae83d33c611","Type":"ContainerDied","Data":"dcd1acc6b9d2a8dc00e82bc42f59c7a891c6d57bb97f05b67e3b644554d8d5df"}
Jul 24 19:28:26.652543 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:26.652535    2567 scope.go:117] "RemoveContainer" containerID="e1a9311f3f5ca00154f330a2db96692a572da2d00caef718582582eed43ce765"
Jul 24 19:28:26.660605 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:26.660592    2567 scope.go:117] "RemoveContainer" containerID="e1a9311f3f5ca00154f330a2db96692a572da2d00caef718582582eed43ce765"
Jul 24 19:28:26.660863 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:28:26.660846    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1a9311f3f5ca00154f330a2db96692a572da2d00caef718582582eed43ce765\": container with ID starting with e1a9311f3f5ca00154f330a2db96692a572da2d00caef718582582eed43ce765 not found: ID does not exist" containerID="e1a9311f3f5ca00154f330a2db96692a572da2d00caef718582582eed43ce765"
Jul 24 19:28:26.660905 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:26.660873    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1a9311f3f5ca00154f330a2db96692a572da2d00caef718582582eed43ce765"} err="failed to get container status \"e1a9311f3f5ca00154f330a2db96692a572da2d00caef718582582eed43ce765\": rpc error: code = NotFound desc = could not find container \"e1a9311f3f5ca00154f330a2db96692a572da2d00caef718582582eed43ce765\": container with ID starting with e1a9311f3f5ca00154f330a2db96692a572da2d00caef718582582eed43ce765 not found: ID does not exist"
Jul 24 19:28:26.705733 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:26.705705    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pvn6p\" (UniqueName: \"kubernetes.io/projected/9fca712e-11dd-4783-8fab-7ae83d33c611-kube-api-access-pvn6p\") pod \"9fca712e-11dd-4783-8fab-7ae83d33c611\" (UID: \"9fca712e-11dd-4783-8fab-7ae83d33c611\") "
Jul 24 19:28:26.705733 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:26.705738    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9fca712e-11dd-4783-8fab-7ae83d33c611-console-oauth-config\") pod \"9fca712e-11dd-4783-8fab-7ae83d33c611\" (UID: \"9fca712e-11dd-4783-8fab-7ae83d33c611\") "
Jul 24 19:28:26.705937 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:26.705917    2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9fca712e-11dd-4783-8fab-7ae83d33c611-service-ca\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:28:26.705937 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:26.705937    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fca712e-11dd-4783-8fab-7ae83d33c611-trusted-ca-bundle\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:28:26.706073 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:26.705953    2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9fca712e-11dd-4783-8fab-7ae83d33c611-oauth-serving-cert\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:28:26.706073 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:26.705965    2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9fca712e-11dd-4783-8fab-7ae83d33c611-console-config\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:28:26.706073 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:26.705977    2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9fca712e-11dd-4783-8fab-7ae83d33c611-console-serving-cert\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:28:26.707882 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:26.707854    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fca712e-11dd-4783-8fab-7ae83d33c611-kube-api-access-pvn6p" (OuterVolumeSpecName: "kube-api-access-pvn6p") pod "9fca712e-11dd-4783-8fab-7ae83d33c611" (UID: "9fca712e-11dd-4783-8fab-7ae83d33c611"). InnerVolumeSpecName "kube-api-access-pvn6p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:28:26.707961 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:26.707917    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fca712e-11dd-4783-8fab-7ae83d33c611-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9fca712e-11dd-4783-8fab-7ae83d33c611" (UID: "9fca712e-11dd-4783-8fab-7ae83d33c611"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:28:26.806592 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:26.806558    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pvn6p\" (UniqueName: \"kubernetes.io/projected/9fca712e-11dd-4783-8fab-7ae83d33c611-kube-api-access-pvn6p\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:28:26.806592 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:26.806587    2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9fca712e-11dd-4783-8fab-7ae83d33c611-console-oauth-config\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:28:26.973122 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:26.973087    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-678b77cf48-6wcc5"]
Jul 24 19:28:26.976933 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:26.976910    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-678b77cf48-6wcc5"]
Jul 24 19:28:28.073701 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:28.073658    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fca712e-11dd-4783-8fab-7ae83d33c611" path="/var/lib/kubelet/pods/9fca712e-11dd-4783-8fab-7ae83d33c611/volumes"
Jul 24 19:28:37.561190 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:37.561159    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tv7vs"
Jul 24 19:28:37.661842 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:37.661781    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-69759cd94d-84blt" podUID="2b93c35c-ebba-464b-a673-48b5fef660c6" containerName="console" containerID="cri-o://99523e5573b43b78d59ec6ef17c8f13cd6185e3621ef52016f5115d85eadd33a" gracePeriod=15
Jul 24 19:28:37.925273 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:37.925236    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69759cd94d-84blt"
Jul 24 19:28:37.994712 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:37.994684    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b93c35c-ebba-464b-a673-48b5fef660c6-console-config\") pod \"2b93c35c-ebba-464b-a673-48b5fef660c6\" (UID: \"2b93c35c-ebba-464b-a673-48b5fef660c6\") "
Jul 24 19:28:37.994886 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:37.994719    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b93c35c-ebba-464b-a673-48b5fef660c6-console-oauth-config\") pod \"2b93c35c-ebba-464b-a673-48b5fef660c6\" (UID: \"2b93c35c-ebba-464b-a673-48b5fef660c6\") "
Jul 24 19:28:37.994886 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:37.994742    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x42gd\" (UniqueName: \"kubernetes.io/projected/2b93c35c-ebba-464b-a673-48b5fef660c6-kube-api-access-x42gd\") pod \"2b93c35c-ebba-464b-a673-48b5fef660c6\" (UID: \"2b93c35c-ebba-464b-a673-48b5fef660c6\") "
Jul 24 19:28:37.994886 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:37.994811    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b93c35c-ebba-464b-a673-48b5fef660c6-console-serving-cert\") pod \"2b93c35c-ebba-464b-a673-48b5fef660c6\" (UID: \"2b93c35c-ebba-464b-a673-48b5fef660c6\") "
Jul 24 19:28:37.994886 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:37.994854    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b93c35c-ebba-464b-a673-48b5fef660c6-service-ca\") pod \"2b93c35c-ebba-464b-a673-48b5fef660c6\" (UID: \"2b93c35c-ebba-464b-a673-48b5fef660c6\") "
Jul 24 19:28:37.994886 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:37.994887    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b93c35c-ebba-464b-a673-48b5fef660c6-oauth-serving-cert\") pod \"2b93c35c-ebba-464b-a673-48b5fef660c6\" (UID: \"2b93c35c-ebba-464b-a673-48b5fef660c6\") "
Jul 24 19:28:37.995145 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:37.994913    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b93c35c-ebba-464b-a673-48b5fef660c6-trusted-ca-bundle\") pod \"2b93c35c-ebba-464b-a673-48b5fef660c6\" (UID: \"2b93c35c-ebba-464b-a673-48b5fef660c6\") "
Jul 24 19:28:37.995283 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:37.995245    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b93c35c-ebba-464b-a673-48b5fef660c6-console-config" (OuterVolumeSpecName: "console-config") pod "2b93c35c-ebba-464b-a673-48b5fef660c6" (UID: "2b93c35c-ebba-464b-a673-48b5fef660c6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:28:37.995283 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:37.995260    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b93c35c-ebba-464b-a673-48b5fef660c6-service-ca" (OuterVolumeSpecName: "service-ca") pod "2b93c35c-ebba-464b-a673-48b5fef660c6" (UID: "2b93c35c-ebba-464b-a673-48b5fef660c6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:28:37.995426 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:37.995356    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b93c35c-ebba-464b-a673-48b5fef660c6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2b93c35c-ebba-464b-a673-48b5fef660c6" (UID: "2b93c35c-ebba-464b-a673-48b5fef660c6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:28:37.995426 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:37.995405    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b93c35c-ebba-464b-a673-48b5fef660c6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2b93c35c-ebba-464b-a673-48b5fef660c6" (UID: "2b93c35c-ebba-464b-a673-48b5fef660c6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:28:37.995798 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:37.995779    2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b93c35c-ebba-464b-a673-48b5fef660c6-service-ca\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:28:37.995852 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:37.995804    2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b93c35c-ebba-464b-a673-48b5fef660c6-oauth-serving-cert\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:28:37.995852 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:37.995819    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b93c35c-ebba-464b-a673-48b5fef660c6-trusted-ca-bundle\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:28:37.995852 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:37.995833    2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b93c35c-ebba-464b-a673-48b5fef660c6-console-config\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:28:37.997034 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:37.997002    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b93c35c-ebba-464b-a673-48b5fef660c6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2b93c35c-ebba-464b-a673-48b5fef660c6" (UID: "2b93c35c-ebba-464b-a673-48b5fef660c6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:28:37.997186 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:37.997151    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b93c35c-ebba-464b-a673-48b5fef660c6-kube-api-access-x42gd" (OuterVolumeSpecName: "kube-api-access-x42gd") pod "2b93c35c-ebba-464b-a673-48b5fef660c6" (UID: "2b93c35c-ebba-464b-a673-48b5fef660c6"). InnerVolumeSpecName "kube-api-access-x42gd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:28:37.997253 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:37.997201    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b93c35c-ebba-464b-a673-48b5fef660c6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2b93c35c-ebba-464b-a673-48b5fef660c6" (UID: "2b93c35c-ebba-464b-a673-48b5fef660c6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:28:38.097208 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:38.097151    2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b93c35c-ebba-464b-a673-48b5fef660c6-console-serving-cert\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:28:38.097208 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:38.097174    2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b93c35c-ebba-464b-a673-48b5fef660c6-console-oauth-config\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:28:38.097208 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:38.097189    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x42gd\" (UniqueName: \"kubernetes.io/projected/2b93c35c-ebba-464b-a673-48b5fef660c6-kube-api-access-x42gd\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:28:38.699642 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:38.699604    2567 generic.go:356] "Generic (PLEG): container finished" podID="2b93c35c-ebba-464b-a673-48b5fef660c6" containerID="99523e5573b43b78d59ec6ef17c8f13cd6185e3621ef52016f5115d85eadd33a" exitCode=0
Jul 24 19:28:38.700038 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:38.699653    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69759cd94d-84blt"
Jul 24 19:28:38.700038 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:38.699690    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69759cd94d-84blt" event={"ID":"2b93c35c-ebba-464b-a673-48b5fef660c6","Type":"ContainerDied","Data":"99523e5573b43b78d59ec6ef17c8f13cd6185e3621ef52016f5115d85eadd33a"}
Jul 24 19:28:38.700038 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:38.699737    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69759cd94d-84blt" event={"ID":"2b93c35c-ebba-464b-a673-48b5fef660c6","Type":"ContainerDied","Data":"e262d70d1636f20b503b4bbfc5ffc2612b2c89f34e8eac2cebeb97d8b704785b"}
Jul 24 19:28:38.700038 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:38.699758    2567 scope.go:117] "RemoveContainer" containerID="99523e5573b43b78d59ec6ef17c8f13cd6185e3621ef52016f5115d85eadd33a"
Jul 24 19:28:38.707805 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:38.707792    2567 scope.go:117] "RemoveContainer" containerID="99523e5573b43b78d59ec6ef17c8f13cd6185e3621ef52016f5115d85eadd33a"
Jul 24 19:28:38.708058 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:28:38.708043    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99523e5573b43b78d59ec6ef17c8f13cd6185e3621ef52016f5115d85eadd33a\": container with ID starting with 99523e5573b43b78d59ec6ef17c8f13cd6185e3621ef52016f5115d85eadd33a not found: ID does not exist" containerID="99523e5573b43b78d59ec6ef17c8f13cd6185e3621ef52016f5115d85eadd33a"
Jul 24 19:28:38.708106 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:38.708066    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99523e5573b43b78d59ec6ef17c8f13cd6185e3621ef52016f5115d85eadd33a"} err="failed to get container status \"99523e5573b43b78d59ec6ef17c8f13cd6185e3621ef52016f5115d85eadd33a\": rpc error: code = NotFound desc = could not find container \"99523e5573b43b78d59ec6ef17c8f13cd6185e3621ef52016f5115d85eadd33a\": container with ID starting with 99523e5573b43b78d59ec6ef17c8f13cd6185e3621ef52016f5115d85eadd33a not found: ID does not exist"
Jul 24 19:28:38.715183 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:38.715161    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69759cd94d-84blt"]
Jul 24 19:28:38.719110 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:38.719092    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69759cd94d-84blt"]
Jul 24 19:28:40.070172 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:40.070131    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b93c35c-ebba-464b-a673-48b5fef660c6" path="/var/lib/kubelet/pods/2b93c35c-ebba-464b-a673-48b5fef660c6/volumes"
Jul 24 19:28:58.407408 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:58.407371    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:28:58.426951 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:58.426926    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:28:58.796087 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:28:58.796015    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:29:11.330658 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:11.330624    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-58f5b4b598-qpb6g"]
Jul 24 19:29:11.331226 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:11.331101    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b93c35c-ebba-464b-a673-48b5fef660c6" containerName="console"
Jul 24 19:29:11.331226 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:11.331120    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b93c35c-ebba-464b-a673-48b5fef660c6" containerName="console"
Jul 24 19:29:11.331226 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:11.331138    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fca712e-11dd-4783-8fab-7ae83d33c611" containerName="console"
Jul 24 19:29:11.331226 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:11.331148    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fca712e-11dd-4783-8fab-7ae83d33c611" containerName="console"
Jul 24 19:29:11.331226 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:11.331226    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fca712e-11dd-4783-8fab-7ae83d33c611" containerName="console"
Jul 24 19:29:11.331475 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:11.331237    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b93c35c-ebba-464b-a673-48b5fef660c6" containerName="console"
Jul 24 19:29:11.333287 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:11.333268    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58f5b4b598-qpb6g"
Jul 24 19:29:11.376636 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:11.376607    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58f5b4b598-qpb6g"]
Jul 24 19:29:11.392269 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:11.392242    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/623a0c9d-99f2-47b8-ae39-638b5f2d7315-service-ca\") pod \"console-58f5b4b598-qpb6g\" (UID: \"623a0c9d-99f2-47b8-ae39-638b5f2d7315\") " pod="openshift-console/console-58f5b4b598-qpb6g"
Jul 24 19:29:11.392388 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:11.392273    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/623a0c9d-99f2-47b8-ae39-638b5f2d7315-console-serving-cert\") pod \"console-58f5b4b598-qpb6g\" (UID: \"623a0c9d-99f2-47b8-ae39-638b5f2d7315\") " pod="openshift-console/console-58f5b4b598-qpb6g"
Jul 24 19:29:11.392388 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:11.392312    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/623a0c9d-99f2-47b8-ae39-638b5f2d7315-console-config\") pod \"console-58f5b4b598-qpb6g\" (UID: \"623a0c9d-99f2-47b8-ae39-638b5f2d7315\") " pod="openshift-console/console-58f5b4b598-qpb6g"
Jul 24 19:29:11.392649 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:11.392387    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/623a0c9d-99f2-47b8-ae39-638b5f2d7315-console-oauth-config\") pod \"console-58f5b4b598-qpb6g\" (UID: \"623a0c9d-99f2-47b8-ae39-638b5f2d7315\") " pod="openshift-console/console-58f5b4b598-qpb6g"
Jul 24 19:29:11.392649 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:11.392416    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj4rc\" (UniqueName: \"kubernetes.io/projected/623a0c9d-99f2-47b8-ae39-638b5f2d7315-kube-api-access-hj4rc\") pod \"console-58f5b4b598-qpb6g\" (UID: \"623a0c9d-99f2-47b8-ae39-638b5f2d7315\") " pod="openshift-console/console-58f5b4b598-qpb6g"
Jul 24 19:29:11.392649 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:11.392440    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/623a0c9d-99f2-47b8-ae39-638b5f2d7315-oauth-serving-cert\") pod \"console-58f5b4b598-qpb6g\" (UID: \"623a0c9d-99f2-47b8-ae39-638b5f2d7315\") " pod="openshift-console/console-58f5b4b598-qpb6g"
Jul 24 19:29:11.392649 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:11.392525    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/623a0c9d-99f2-47b8-ae39-638b5f2d7315-trusted-ca-bundle\") pod \"console-58f5b4b598-qpb6g\" (UID: \"623a0c9d-99f2-47b8-ae39-638b5f2d7315\") " pod="openshift-console/console-58f5b4b598-qpb6g"
Jul 24 19:29:11.493098 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:11.493063    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/623a0c9d-99f2-47b8-ae39-638b5f2d7315-service-ca\") pod \"console-58f5b4b598-qpb6g\" (UID: \"623a0c9d-99f2-47b8-ae39-638b5f2d7315\") " pod="openshift-console/console-58f5b4b598-qpb6g"
Jul 24 19:29:11.493261 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:11.493104    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/623a0c9d-99f2-47b8-ae39-638b5f2d7315-console-serving-cert\") pod \"console-58f5b4b598-qpb6g\" (UID: \"623a0c9d-99f2-47b8-ae39-638b5f2d7315\") " pod="openshift-console/console-58f5b4b598-qpb6g"
Jul 24 19:29:11.493261 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:11.493160    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/623a0c9d-99f2-47b8-ae39-638b5f2d7315-console-config\") pod \"console-58f5b4b598-qpb6g\" (UID: \"623a0c9d-99f2-47b8-ae39-638b5f2d7315\") " pod="openshift-console/console-58f5b4b598-qpb6g"
Jul 24 19:29:11.493261 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:11.493204    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/623a0c9d-99f2-47b8-ae39-638b5f2d7315-console-oauth-config\") pod \"console-58f5b4b598-qpb6g\" (UID: \"623a0c9d-99f2-47b8-ae39-638b5f2d7315\") " pod="openshift-console/console-58f5b4b598-qpb6g"
Jul 24 19:29:11.493261 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:11.493227    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hj4rc\" (UniqueName: \"kubernetes.io/projected/623a0c9d-99f2-47b8-ae39-638b5f2d7315-kube-api-access-hj4rc\") pod \"console-58f5b4b598-qpb6g\" (UID: \"623a0c9d-99f2-47b8-ae39-638b5f2d7315\") " pod="openshift-console/console-58f5b4b598-qpb6g"
Jul 24 19:29:11.493261 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:11.493246    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/623a0c9d-99f2-47b8-ae39-638b5f2d7315-oauth-serving-cert\") pod \"console-58f5b4b598-qpb6g\" (UID: \"623a0c9d-99f2-47b8-ae39-638b5f2d7315\") " pod="openshift-console/console-58f5b4b598-qpb6g"
Jul 24 19:29:11.493526 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:11.493282    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/623a0c9d-99f2-47b8-ae39-638b5f2d7315-trusted-ca-bundle\") pod \"console-58f5b4b598-qpb6g\" (UID: \"623a0c9d-99f2-47b8-ae39-638b5f2d7315\") " pod="openshift-console/console-58f5b4b598-qpb6g"
Jul 24 19:29:11.493939 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:11.493909    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/623a0c9d-99f2-47b8-ae39-638b5f2d7315-console-config\") pod \"console-58f5b4b598-qpb6g\" (UID: \"623a0c9d-99f2-47b8-ae39-638b5f2d7315\") " pod="openshift-console/console-58f5b4b598-qpb6g"
Jul 24 19:29:11.494073 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:11.493909    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/623a0c9d-99f2-47b8-ae39-638b5f2d7315-service-ca\") pod \"console-58f5b4b598-qpb6g\" (UID: \"623a0c9d-99f2-47b8-ae39-638b5f2d7315\") " pod="openshift-console/console-58f5b4b598-qpb6g"
Jul 24 19:29:11.494073 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:11.493917    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/623a0c9d-99f2-47b8-ae39-638b5f2d7315-oauth-serving-cert\") pod \"console-58f5b4b598-qpb6g\" (UID: \"623a0c9d-99f2-47b8-ae39-638b5f2d7315\") " pod="openshift-console/console-58f5b4b598-qpb6g"
Jul 24 19:29:11.494216 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:11.494196    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/623a0c9d-99f2-47b8-ae39-638b5f2d7315-trusted-ca-bundle\") pod \"console-58f5b4b598-qpb6g\" (UID: \"623a0c9d-99f2-47b8-ae39-638b5f2d7315\") " pod="openshift-console/console-58f5b4b598-qpb6g"
Jul 24 19:29:11.496386 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:11.496369    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/623a0c9d-99f2-47b8-ae39-638b5f2d7315-console-serving-cert\") pod \"console-58f5b4b598-qpb6g\" (UID: \"623a0c9d-99f2-47b8-ae39-638b5f2d7315\") " pod="openshift-console/console-58f5b4b598-qpb6g"
Jul 24 19:29:11.496518 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:11.496470    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/623a0c9d-99f2-47b8-ae39-638b5f2d7315-console-oauth-config\") pod \"console-58f5b4b598-qpb6g\" (UID: \"623a0c9d-99f2-47b8-ae39-638b5f2d7315\") " pod="openshift-console/console-58f5b4b598-qpb6g"
Jul 24 19:29:11.502466 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:11.502443    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj4rc\" (UniqueName: \"kubernetes.io/projected/623a0c9d-99f2-47b8-ae39-638b5f2d7315-kube-api-access-hj4rc\") pod \"console-58f5b4b598-qpb6g\" (UID: \"623a0c9d-99f2-47b8-ae39-638b5f2d7315\") " pod="openshift-console/console-58f5b4b598-qpb6g"
Jul 24 19:29:11.641560 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:11.641531    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58f5b4b598-qpb6g"
Jul 24 19:29:11.771181 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:11.771149    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58f5b4b598-qpb6g"]
Jul 24 19:29:11.774129 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:29:11.774103    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod623a0c9d_99f2_47b8_ae39_638b5f2d7315.slice/crio-e15f0ff046ffe0f7ca2114e897847d6616f7706e8ac8e5d7d8b9af81c2613bea WatchSource:0}: Error finding container e15f0ff046ffe0f7ca2114e897847d6616f7706e8ac8e5d7d8b9af81c2613bea: Status 404 returned error can't find the container with id e15f0ff046ffe0f7ca2114e897847d6616f7706e8ac8e5d7d8b9af81c2613bea
Jul 24 19:29:11.826729 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:11.826697    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58f5b4b598-qpb6g" event={"ID":"623a0c9d-99f2-47b8-ae39-638b5f2d7315","Type":"ContainerStarted","Data":"e15f0ff046ffe0f7ca2114e897847d6616f7706e8ac8e5d7d8b9af81c2613bea"}
Jul 24 19:29:11.847807 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:11.847758    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-58f5b4b598-qpb6g" podStartSLOduration=0.847741559 podStartE2EDuration="847.741559ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:29:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:29:11.845213533 +0000 UTC m=+140.363833573" watchObservedRunningTime="2026-07-24 19:29:11.847741559 +0000 UTC m=+140.366361600"
Jul 24 19:29:12.832220 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:12.832187    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58f5b4b598-qpb6g" event={"ID":"623a0c9d-99f2-47b8-ae39-638b5f2d7315","Type":"ContainerStarted","Data":"6a83a17886daf45f6d8436fd0c9bc77bc6fe5091a4992c62a1333ad7799cf25a"}
Jul 24 19:29:21.641686 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:21.641653    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-58f5b4b598-qpb6g"
Jul 24 19:29:21.642143 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:21.641924    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-58f5b4b598-qpb6g"
Jul 24 19:29:21.647107 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:21.647089    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-58f5b4b598-qpb6g"
Jul 24 19:29:21.870317 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:21.870294    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-58f5b4b598-qpb6g"
Jul 24 19:29:21.915250 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:21.915153    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6845cb4754-4nt8h"]
Jul 24 19:29:46.934542 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:46.934431    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6845cb4754-4nt8h" podUID="8f418fa8-2164-4247-91b6-4554f35d9ec8" containerName="console" containerID="cri-o://f0871331de4f1dce05791364466e82bf8fd121aa1a13141eadbc86b9cc52d234" gracePeriod=15
Jul 24 19:29:47.213158 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:47.213133    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6845cb4754-4nt8h"
Jul 24 19:29:47.406903 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:47.406871    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8f418fa8-2164-4247-91b6-4554f35d9ec8-console-config\") pod \"8f418fa8-2164-4247-91b6-4554f35d9ec8\" (UID: \"8f418fa8-2164-4247-91b6-4554f35d9ec8\") "
Jul 24 19:29:47.407071 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:47.406910    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8f418fa8-2164-4247-91b6-4554f35d9ec8-console-oauth-config\") pod \"8f418fa8-2164-4247-91b6-4554f35d9ec8\" (UID: \"8f418fa8-2164-4247-91b6-4554f35d9ec8\") "
Jul 24 19:29:47.407071 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:47.406941    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbn7n\" (UniqueName: \"kubernetes.io/projected/8f418fa8-2164-4247-91b6-4554f35d9ec8-kube-api-access-tbn7n\") pod \"8f418fa8-2164-4247-91b6-4554f35d9ec8\" (UID: \"8f418fa8-2164-4247-91b6-4554f35d9ec8\") "
Jul 24 19:29:47.407071 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:47.406989    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8f418fa8-2164-4247-91b6-4554f35d9ec8-oauth-serving-cert\") pod \"8f418fa8-2164-4247-91b6-4554f35d9ec8\" (UID: \"8f418fa8-2164-4247-91b6-4554f35d9ec8\") "
Jul 24 19:29:47.407071 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:47.407051    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f418fa8-2164-4247-91b6-4554f35d9ec8-console-serving-cert\") pod \"8f418fa8-2164-4247-91b6-4554f35d9ec8\" (UID: \"8f418fa8-2164-4247-91b6-4554f35d9ec8\") "
Jul 24 19:29:47.407261 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:47.407079    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f418fa8-2164-4247-91b6-4554f35d9ec8-trusted-ca-bundle\") pod \"8f418fa8-2164-4247-91b6-4554f35d9ec8\" (UID: \"8f418fa8-2164-4247-91b6-4554f35d9ec8\") "
Jul 24 19:29:47.407261 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:47.407108    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8f418fa8-2164-4247-91b6-4554f35d9ec8-service-ca\") pod \"8f418fa8-2164-4247-91b6-4554f35d9ec8\" (UID: \"8f418fa8-2164-4247-91b6-4554f35d9ec8\") "
Jul 24 19:29:47.407362 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:47.407315    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f418fa8-2164-4247-91b6-4554f35d9ec8-console-config" (OuterVolumeSpecName: "console-config") pod "8f418fa8-2164-4247-91b6-4554f35d9ec8" (UID: "8f418fa8-2164-4247-91b6-4554f35d9ec8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:29:47.407518 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:47.407456    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f418fa8-2164-4247-91b6-4554f35d9ec8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8f418fa8-2164-4247-91b6-4554f35d9ec8" (UID: "8f418fa8-2164-4247-91b6-4554f35d9ec8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:29:47.407819 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:47.407580    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f418fa8-2164-4247-91b6-4554f35d9ec8-service-ca" (OuterVolumeSpecName: "service-ca") pod "8f418fa8-2164-4247-91b6-4554f35d9ec8" (UID: "8f418fa8-2164-4247-91b6-4554f35d9ec8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:29:47.407819 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:47.407512    2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8f418fa8-2164-4247-91b6-4554f35d9ec8-console-config\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:29:47.408019 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:47.407887    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f418fa8-2164-4247-91b6-4554f35d9ec8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8f418fa8-2164-4247-91b6-4554f35d9ec8" (UID: "8f418fa8-2164-4247-91b6-4554f35d9ec8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:29:47.409366 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:47.409335    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f418fa8-2164-4247-91b6-4554f35d9ec8-kube-api-access-tbn7n" (OuterVolumeSpecName: "kube-api-access-tbn7n") pod "8f418fa8-2164-4247-91b6-4554f35d9ec8" (UID: "8f418fa8-2164-4247-91b6-4554f35d9ec8"). InnerVolumeSpecName "kube-api-access-tbn7n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:29:47.409366 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:47.409340    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f418fa8-2164-4247-91b6-4554f35d9ec8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8f418fa8-2164-4247-91b6-4554f35d9ec8" (UID: "8f418fa8-2164-4247-91b6-4554f35d9ec8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:29:47.409518 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:47.409417    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f418fa8-2164-4247-91b6-4554f35d9ec8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8f418fa8-2164-4247-91b6-4554f35d9ec8" (UID: "8f418fa8-2164-4247-91b6-4554f35d9ec8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:29:47.508762 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:47.508678    2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8f418fa8-2164-4247-91b6-4554f35d9ec8-oauth-serving-cert\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:29:47.508762 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:47.508706    2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f418fa8-2164-4247-91b6-4554f35d9ec8-console-serving-cert\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:29:47.508762 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:47.508715    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f418fa8-2164-4247-91b6-4554f35d9ec8-trusted-ca-bundle\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:29:47.508762 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:47.508724    2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8f418fa8-2164-4247-91b6-4554f35d9ec8-service-ca\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:29:47.508762 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:47.508733    2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8f418fa8-2164-4247-91b6-4554f35d9ec8-console-oauth-config\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:29:47.508762 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:47.508741    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbn7n\" (UniqueName: \"kubernetes.io/projected/8f418fa8-2164-4247-91b6-4554f35d9ec8-kube-api-access-tbn7n\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:29:47.962875 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:47.962843    2567 generic.go:356] "Generic (PLEG): container finished" podID="8f418fa8-2164-4247-91b6-4554f35d9ec8" containerID="f0871331de4f1dce05791364466e82bf8fd121aa1a13141eadbc86b9cc52d234" exitCode=0
Jul 24 19:29:47.963313 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:47.962884    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6845cb4754-4nt8h" event={"ID":"8f418fa8-2164-4247-91b6-4554f35d9ec8","Type":"ContainerDied","Data":"f0871331de4f1dce05791364466e82bf8fd121aa1a13141eadbc86b9cc52d234"}
Jul 24 19:29:47.963313 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:47.962906    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6845cb4754-4nt8h"
Jul 24 19:29:47.963313 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:47.962950    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6845cb4754-4nt8h" event={"ID":"8f418fa8-2164-4247-91b6-4554f35d9ec8","Type":"ContainerDied","Data":"2af791dbce49851c1c88b8c7b890e2032fd32d11152a8257a6279fc8cdff2be6"}
Jul 24 19:29:47.963313 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:47.962971    2567 scope.go:117] "RemoveContainer" containerID="f0871331de4f1dce05791364466e82bf8fd121aa1a13141eadbc86b9cc52d234"
Jul 24 19:29:47.972013 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:47.971998    2567 scope.go:117] "RemoveContainer" containerID="f0871331de4f1dce05791364466e82bf8fd121aa1a13141eadbc86b9cc52d234"
Jul 24 19:29:47.972258 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:29:47.972238    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0871331de4f1dce05791364466e82bf8fd121aa1a13141eadbc86b9cc52d234\": container with ID starting with f0871331de4f1dce05791364466e82bf8fd121aa1a13141eadbc86b9cc52d234 not found: ID does not exist" containerID="f0871331de4f1dce05791364466e82bf8fd121aa1a13141eadbc86b9cc52d234"
Jul 24 19:29:47.972319 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:47.972265    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0871331de4f1dce05791364466e82bf8fd121aa1a13141eadbc86b9cc52d234"} err="failed to get container status \"f0871331de4f1dce05791364466e82bf8fd121aa1a13141eadbc86b9cc52d234\": rpc error: code = NotFound desc = could not find container \"f0871331de4f1dce05791364466e82bf8fd121aa1a13141eadbc86b9cc52d234\": container with ID starting with f0871331de4f1dce05791364466e82bf8fd121aa1a13141eadbc86b9cc52d234 not found: ID does not exist"
Jul 24 19:29:47.983588 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:47.983563    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6845cb4754-4nt8h"]
Jul 24 19:29:47.987296 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:47.987278    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6845cb4754-4nt8h"]
Jul 24 19:29:48.070207 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:29:48.070179    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f418fa8-2164-4247-91b6-4554f35d9ec8" path="/var/lib/kubelet/pods/8f418fa8-2164-4247-91b6-4554f35d9ec8/volumes"
Jul 24 19:30:40.144422 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:40.144392    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-j2h6q"]
Jul 24 19:30:40.144869 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:40.144684    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f418fa8-2164-4247-91b6-4554f35d9ec8" containerName="console"
Jul 24 19:30:40.144869 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:40.144695    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f418fa8-2164-4247-91b6-4554f35d9ec8" containerName="console"
Jul 24 19:30:40.144869 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:40.144752    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f418fa8-2164-4247-91b6-4554f35d9ec8" containerName="console"
Jul 24 19:30:40.146445 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:40.146431    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-j2h6q"
Jul 24 19:30:40.148872 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:40.148850    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-frfn7\""
Jul 24 19:30:40.149001 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:40.148879    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 24 19:30:40.149683 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:40.149666    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 24 19:30:40.156505 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:40.156466    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-j2h6q"]
Jul 24 19:30:40.246923 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:40.246890    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ww6px\" (UniqueName: \"kubernetes.io/projected/c1165435-9d71-4f7e-be5d-4a934979b046-kube-api-access-ww6px\") pod \"cert-manager-55b4d954d5-j2h6q\" (UID: \"c1165435-9d71-4f7e-be5d-4a934979b046\") " pod="cert-manager/cert-manager-55b4d954d5-j2h6q"
Jul 24 19:30:40.247092 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:40.246957    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1165435-9d71-4f7e-be5d-4a934979b046-bound-sa-token\") pod \"cert-manager-55b4d954d5-j2h6q\" (UID: \"c1165435-9d71-4f7e-be5d-4a934979b046\") " pod="cert-manager/cert-manager-55b4d954d5-j2h6q"
Jul 24 19:30:40.347552 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:40.347507    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ww6px\" (UniqueName: \"kubernetes.io/projected/c1165435-9d71-4f7e-be5d-4a934979b046-kube-api-access-ww6px\") pod \"cert-manager-55b4d954d5-j2h6q\" (UID: \"c1165435-9d71-4f7e-be5d-4a934979b046\") " pod="cert-manager/cert-manager-55b4d954d5-j2h6q"
Jul 24 19:30:40.347725 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:40.347604    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1165435-9d71-4f7e-be5d-4a934979b046-bound-sa-token\") pod \"cert-manager-55b4d954d5-j2h6q\" (UID: \"c1165435-9d71-4f7e-be5d-4a934979b046\") " pod="cert-manager/cert-manager-55b4d954d5-j2h6q"
Jul 24 19:30:40.355146 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:40.355124    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1165435-9d71-4f7e-be5d-4a934979b046-bound-sa-token\") pod \"cert-manager-55b4d954d5-j2h6q\" (UID: \"c1165435-9d71-4f7e-be5d-4a934979b046\") " pod="cert-manager/cert-manager-55b4d954d5-j2h6q"
Jul 24 19:30:40.355266 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:40.355250    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ww6px\" (UniqueName: \"kubernetes.io/projected/c1165435-9d71-4f7e-be5d-4a934979b046-kube-api-access-ww6px\") pod \"cert-manager-55b4d954d5-j2h6q\" (UID: \"c1165435-9d71-4f7e-be5d-4a934979b046\") " pod="cert-manager/cert-manager-55b4d954d5-j2h6q"
Jul 24 19:30:40.470011 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:40.469936    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-j2h6q"
Jul 24 19:30:40.595273 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:40.595245    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-j2h6q"]
Jul 24 19:30:40.598437 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:30:40.598406    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc1165435_9d71_4f7e_be5d_4a934979b046.slice/crio-e00135091398ef4a5989841b0623939207381cc5140deb5f0181bb5999907f37 WatchSource:0}: Error finding container e00135091398ef4a5989841b0623939207381cc5140deb5f0181bb5999907f37: Status 404 returned error can't find the container with id e00135091398ef4a5989841b0623939207381cc5140deb5f0181bb5999907f37
Jul 24 19:30:41.156583 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:41.156552    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-j2h6q" event={"ID":"c1165435-9d71-4f7e-be5d-4a934979b046","Type":"ContainerStarted","Data":"e00135091398ef4a5989841b0623939207381cc5140deb5f0181bb5999907f37"}
Jul 24 19:30:44.177245 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:44.177205    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-j2h6q" event={"ID":"c1165435-9d71-4f7e-be5d-4a934979b046","Type":"ContainerStarted","Data":"4357273fefbf26f11ad7bfcf0dd1eca20dce7947376313a27cc405987da2c767"}
Jul 24 19:30:44.192949 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:44.192898    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-j2h6q" podStartSLOduration=0.71648636 podStartE2EDuration="4.192879105s" totalImagesPullingTime="3.476392745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:30:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:30:44.192615676 +0000 UTC m=+232.711235716" watchObservedRunningTime="2026-07-24 19:30:44.192879105 +0000 UTC m=+232.711499148"
Jul 24 19:30:47.640100 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:47.640056    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-9ccbf6686-77llk"]
Jul 24 19:30:47.643258 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:47.643240    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-9ccbf6686-77llk"
Jul 24 19:30:47.646984 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:47.646947    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 24 19:30:47.646984 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:47.646966    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 24 19:30:47.647151 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:47.647040    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 24 19:30:47.647151 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:47.647042    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 24 19:30:47.647151 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:47.647091    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-trhxb\""
Jul 24 19:30:47.647151 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:47.647109    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 24 19:30:47.656098 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:47.656079    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-9ccbf6686-77llk"]
Jul 24 19:30:47.715989 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:47.715951    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/df4e9b78-80c9-463c-a20d-f017025b7187-manager-config\") pod \"lws-controller-manager-9ccbf6686-77llk\" (UID: \"df4e9b78-80c9-463c-a20d-f017025b7187\") " pod="openshift-lws-operator/lws-controller-manager-9ccbf6686-77llk"
Jul 24 19:30:47.716178 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:47.716035    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df4e9b78-80c9-463c-a20d-f017025b7187-cert\") pod \"lws-controller-manager-9ccbf6686-77llk\" (UID: \"df4e9b78-80c9-463c-a20d-f017025b7187\") " pod="openshift-lws-operator/lws-controller-manager-9ccbf6686-77llk"
Jul 24 19:30:47.716178 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:47.716080    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5g8l\" (UniqueName: \"kubernetes.io/projected/df4e9b78-80c9-463c-a20d-f017025b7187-kube-api-access-j5g8l\") pod \"lws-controller-manager-9ccbf6686-77llk\" (UID: \"df4e9b78-80c9-463c-a20d-f017025b7187\") " pod="openshift-lws-operator/lws-controller-manager-9ccbf6686-77llk"
Jul 24 19:30:47.716178 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:47.716128    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/df4e9b78-80c9-463c-a20d-f017025b7187-metrics-cert\") pod \"lws-controller-manager-9ccbf6686-77llk\" (UID: \"df4e9b78-80c9-463c-a20d-f017025b7187\") " pod="openshift-lws-operator/lws-controller-manager-9ccbf6686-77llk"
Jul 24 19:30:47.817464 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:47.817406    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/df4e9b78-80c9-463c-a20d-f017025b7187-metrics-cert\") pod \"lws-controller-manager-9ccbf6686-77llk\" (UID: \"df4e9b78-80c9-463c-a20d-f017025b7187\") " pod="openshift-lws-operator/lws-controller-manager-9ccbf6686-77llk"
Jul 24 19:30:47.817644 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:47.817547    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/df4e9b78-80c9-463c-a20d-f017025b7187-manager-config\") pod \"lws-controller-manager-9ccbf6686-77llk\" (UID: \"df4e9b78-80c9-463c-a20d-f017025b7187\") " pod="openshift-lws-operator/lws-controller-manager-9ccbf6686-77llk"
Jul 24 19:30:47.817714 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:47.817651    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df4e9b78-80c9-463c-a20d-f017025b7187-cert\") pod \"lws-controller-manager-9ccbf6686-77llk\" (UID: \"df4e9b78-80c9-463c-a20d-f017025b7187\") " pod="openshift-lws-operator/lws-controller-manager-9ccbf6686-77llk"
Jul 24 19:30:47.817714 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:47.817678    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5g8l\" (UniqueName: \"kubernetes.io/projected/df4e9b78-80c9-463c-a20d-f017025b7187-kube-api-access-j5g8l\") pod \"lws-controller-manager-9ccbf6686-77llk\" (UID: \"df4e9b78-80c9-463c-a20d-f017025b7187\") " pod="openshift-lws-operator/lws-controller-manager-9ccbf6686-77llk"
Jul 24 19:30:47.818389 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:47.818362    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/df4e9b78-80c9-463c-a20d-f017025b7187-manager-config\") pod \"lws-controller-manager-9ccbf6686-77llk\" (UID: \"df4e9b78-80c9-463c-a20d-f017025b7187\") " pod="openshift-lws-operator/lws-controller-manager-9ccbf6686-77llk"
Jul 24 19:30:47.821934 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:47.821900    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/df4e9b78-80c9-463c-a20d-f017025b7187-metrics-cert\") pod \"lws-controller-manager-9ccbf6686-77llk\" (UID: \"df4e9b78-80c9-463c-a20d-f017025b7187\") " pod="openshift-lws-operator/lws-controller-manager-9ccbf6686-77llk"
Jul 24 19:30:47.822466 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:47.822444    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df4e9b78-80c9-463c-a20d-f017025b7187-cert\") pod \"lws-controller-manager-9ccbf6686-77llk\" (UID: \"df4e9b78-80c9-463c-a20d-f017025b7187\") " pod="openshift-lws-operator/lws-controller-manager-9ccbf6686-77llk"
Jul 24 19:30:47.827249 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:47.827227    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5g8l\" (UniqueName: \"kubernetes.io/projected/df4e9b78-80c9-463c-a20d-f017025b7187-kube-api-access-j5g8l\") pod \"lws-controller-manager-9ccbf6686-77llk\" (UID: \"df4e9b78-80c9-463c-a20d-f017025b7187\") " pod="openshift-lws-operator/lws-controller-manager-9ccbf6686-77llk"
Jul 24 19:30:47.952472 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:47.952390    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-9ccbf6686-77llk"
Jul 24 19:30:48.079132 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:48.079103    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-9ccbf6686-77llk"]
Jul 24 19:30:48.081971 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:30:48.081941    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf4e9b78_80c9_463c_a20d_f017025b7187.slice/crio-734d1f77ab10b25f71bf77946795352bc2ef24f5a95110c0600cb8add4aa900f WatchSource:0}: Error finding container 734d1f77ab10b25f71bf77946795352bc2ef24f5a95110c0600cb8add4aa900f: Status 404 returned error can't find the container with id 734d1f77ab10b25f71bf77946795352bc2ef24f5a95110c0600cb8add4aa900f
Jul 24 19:30:48.192212 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:48.192187    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-9ccbf6686-77llk" event={"ID":"df4e9b78-80c9-463c-a20d-f017025b7187","Type":"ContainerStarted","Data":"734d1f77ab10b25f71bf77946795352bc2ef24f5a95110c0600cb8add4aa900f"}
Jul 24 19:30:51.209591 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:51.209553    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-9ccbf6686-77llk" event={"ID":"df4e9b78-80c9-463c-a20d-f017025b7187","Type":"ContainerStarted","Data":"54464bf4c7dd9712fbc1d1e6ba82ddcc21dc686c1c6641742756c73fc1a80ad9"}
Jul 24 19:30:51.209981 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:51.209665    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-9ccbf6686-77llk"
Jul 24 19:30:51.228369 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:51.228316    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-9ccbf6686-77llk" podStartSLOduration=1.5323757009999999 podStartE2EDuration="4.228300988s" totalImagesPullingTime="2.695925287s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:30:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:30:51.226917978 +0000 UTC m=+239.745538018" watchObservedRunningTime="2026-07-24 19:30:51.228300988 +0000 UTC m=+239.746921029"
Jul 24 19:30:56.061616 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:56.061581    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69f558d7f4-9c94j"]
Jul 24 19:30:56.065066 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:56.065041    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69f558d7f4-9c94j"
Jul 24 19:30:56.068079 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:56.068058    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 24 19:30:56.068079 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:56.068072    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-k4bkj\""
Jul 24 19:30:56.068358 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:56.068340    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 24 19:30:56.068427 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:56.068409    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 24 19:30:56.068690 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:56.068673    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 24 19:30:56.089450 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:56.089430    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69f558d7f4-9c94j"]
Jul 24 19:30:56.190912 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:56.190876    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be899b57-ba59-4869-bb22-d0f199b3446c-tmp\") pod \"opendatahub-operator-controller-manager-69f558d7f4-9c94j\" (UID: \"be899b57-ba59-4869-bb22-d0f199b3446c\") " pod="opendatahub/opendatahub-operator-controller-manager-69f558d7f4-9c94j"
Jul 24 19:30:56.191075 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:56.190920    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/be899b57-ba59-4869-bb22-d0f199b3446c-webhook-cert\") pod \"opendatahub-operator-controller-manager-69f558d7f4-9c94j\" (UID: \"be899b57-ba59-4869-bb22-d0f199b3446c\") " pod="opendatahub/opendatahub-operator-controller-manager-69f558d7f4-9c94j"
Jul 24 19:30:56.191075 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:56.190947    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbpwb\" (UniqueName: \"kubernetes.io/projected/be899b57-ba59-4869-bb22-d0f199b3446c-kube-api-access-fbpwb\") pod \"opendatahub-operator-controller-manager-69f558d7f4-9c94j\" (UID: \"be899b57-ba59-4869-bb22-d0f199b3446c\") " pod="opendatahub/opendatahub-operator-controller-manager-69f558d7f4-9c94j"
Jul 24 19:30:56.191075 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:56.191021    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/be899b57-ba59-4869-bb22-d0f199b3446c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69f558d7f4-9c94j\" (UID: \"be899b57-ba59-4869-bb22-d0f199b3446c\") " pod="opendatahub/opendatahub-operator-controller-manager-69f558d7f4-9c94j"
Jul 24 19:30:56.191075 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:56.191065    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/be899b57-ba59-4869-bb22-d0f199b3446c-manifests\") pod \"opendatahub-operator-controller-manager-69f558d7f4-9c94j\" (UID: \"be899b57-ba59-4869-bb22-d0f199b3446c\") " pod="opendatahub/opendatahub-operator-controller-manager-69f558d7f4-9c94j"
Jul 24 19:30:56.291925 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:56.291887    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/be899b57-ba59-4869-bb22-d0f199b3446c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69f558d7f4-9c94j\" (UID: \"be899b57-ba59-4869-bb22-d0f199b3446c\") " pod="opendatahub/opendatahub-operator-controller-manager-69f558d7f4-9c94j"
Jul 24 19:30:56.292088 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:56.291935    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/be899b57-ba59-4869-bb22-d0f199b3446c-manifests\") pod \"opendatahub-operator-controller-manager-69f558d7f4-9c94j\" (UID: \"be899b57-ba59-4869-bb22-d0f199b3446c\") " pod="opendatahub/opendatahub-operator-controller-manager-69f558d7f4-9c94j"
Jul 24 19:30:56.292088 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:56.292045    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be899b57-ba59-4869-bb22-d0f199b3446c-tmp\") pod \"opendatahub-operator-controller-manager-69f558d7f4-9c94j\" (UID: \"be899b57-ba59-4869-bb22-d0f199b3446c\") " pod="opendatahub/opendatahub-operator-controller-manager-69f558d7f4-9c94j"
Jul 24 19:30:56.292159 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:56.292089    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/be899b57-ba59-4869-bb22-d0f199b3446c-webhook-cert\") pod \"opendatahub-operator-controller-manager-69f558d7f4-9c94j\" (UID: \"be899b57-ba59-4869-bb22-d0f199b3446c\") " pod="opendatahub/opendatahub-operator-controller-manager-69f558d7f4-9c94j"
Jul 24 19:30:56.292159 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:56.292131    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbpwb\" (UniqueName: \"kubernetes.io/projected/be899b57-ba59-4869-bb22-d0f199b3446c-kube-api-access-fbpwb\") pod \"opendatahub-operator-controller-manager-69f558d7f4-9c94j\" (UID: \"be899b57-ba59-4869-bb22-d0f199b3446c\") " pod="opendatahub/opendatahub-operator-controller-manager-69f558d7f4-9c94j"
Jul 24 19:30:56.292310 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:56.292278    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/be899b57-ba59-4869-bb22-d0f199b3446c-manifests\") pod \"opendatahub-operator-controller-manager-69f558d7f4-9c94j\" (UID: \"be899b57-ba59-4869-bb22-d0f199b3446c\") " pod="opendatahub/opendatahub-operator-controller-manager-69f558d7f4-9c94j"
Jul 24 19:30:56.294470 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:56.294437    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be899b57-ba59-4869-bb22-d0f199b3446c-tmp\") pod \"opendatahub-operator-controller-manager-69f558d7f4-9c94j\" (UID: \"be899b57-ba59-4869-bb22-d0f199b3446c\") " pod="opendatahub/opendatahub-operator-controller-manager-69f558d7f4-9c94j"
Jul 24 19:30:56.294470 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:56.294455    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/be899b57-ba59-4869-bb22-d0f199b3446c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69f558d7f4-9c94j\" (UID: \"be899b57-ba59-4869-bb22-d0f199b3446c\") " pod="opendatahub/opendatahub-operator-controller-manager-69f558d7f4-9c94j"
Jul 24 19:30:56.294684 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:56.294597    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/be899b57-ba59-4869-bb22-d0f199b3446c-webhook-cert\") pod \"opendatahub-operator-controller-manager-69f558d7f4-9c94j\" (UID: \"be899b57-ba59-4869-bb22-d0f199b3446c\") " pod="opendatahub/opendatahub-operator-controller-manager-69f558d7f4-9c94j"
Jul 24 19:30:56.300669 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:56.300643    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbpwb\" (UniqueName: \"kubernetes.io/projected/be899b57-ba59-4869-bb22-d0f199b3446c-kube-api-access-fbpwb\") pod \"opendatahub-operator-controller-manager-69f558d7f4-9c94j\" (UID: \"be899b57-ba59-4869-bb22-d0f199b3446c\") " pod="opendatahub/opendatahub-operator-controller-manager-69f558d7f4-9c94j"
Jul 24 19:30:56.377051 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:56.377023    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69f558d7f4-9c94j"
Jul 24 19:30:56.511530 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:56.511472    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69f558d7f4-9c94j"]
Jul 24 19:30:56.515094 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:30:56.515054    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe899b57_ba59_4869_bb22_d0f199b3446c.slice/crio-ba9006d03f0cc991ac69c7939e73b6c2e609e5c5c2d99feba6175f70cad443e8 WatchSource:0}: Error finding container ba9006d03f0cc991ac69c7939e73b6c2e609e5c5c2d99feba6175f70cad443e8: Status 404 returned error can't find the container with id ba9006d03f0cc991ac69c7939e73b6c2e609e5c5c2d99feba6175f70cad443e8
Jul 24 19:30:57.236461 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:30:57.236420    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69f558d7f4-9c94j" event={"ID":"be899b57-ba59-4869-bb22-d0f199b3446c","Type":"ContainerStarted","Data":"ba9006d03f0cc991ac69c7939e73b6c2e609e5c5c2d99feba6175f70cad443e8"}
Jul 24 19:31:00.250792 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:31:00.250761    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69f558d7f4-9c94j" event={"ID":"be899b57-ba59-4869-bb22-d0f199b3446c","Type":"ContainerStarted","Data":"5b1866e390e2a9ff9652c2808aecd09a2843924225b7f830c08b244ed8a3a670"}
Jul 24 19:31:01.255740 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:31:01.255705    2567 generic.go:356] "Generic (PLEG): container finished" podID="be899b57-ba59-4869-bb22-d0f199b3446c" containerID="5b1866e390e2a9ff9652c2808aecd09a2843924225b7f830c08b244ed8a3a670" exitCode=0
Jul 24 19:31:01.256252 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:31:01.255784    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69f558d7f4-9c94j" event={"ID":"be899b57-ba59-4869-bb22-d0f199b3446c","Type":"ContainerDied","Data":"5b1866e390e2a9ff9652c2808aecd09a2843924225b7f830c08b244ed8a3a670"}
Jul 24 19:31:02.220166 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:31:02.220132    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-9ccbf6686-77llk"
Jul 24 19:31:02.262890 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:31:02.262863    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69f558d7f4-9c94j" event={"ID":"be899b57-ba59-4869-bb22-d0f199b3446c","Type":"ContainerStarted","Data":"e3977ee653ead99e89c2d96b47c5ea4d982b4736dcbff8a5f1507e983a599c2e"}
Jul 24 19:31:02.263326 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:31:02.263042    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-69f558d7f4-9c94j"
Jul 24 19:31:13.269347 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:31:13.269269    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-69f558d7f4-9c94j"
Jul 24 19:31:13.291678 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:31:13.291633    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-69f558d7f4-9c94j" podStartSLOduration=12.890648048 podStartE2EDuration="17.291618697s" totalImagesPullingTime="3.339419857s" totalInitContainerRuntime="1.061550792s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:30:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:31:02.289991161 +0000 UTC m=+250.808611202" watchObservedRunningTime="2026-07-24 19:31:13.291618697 +0000 UTC m=+261.810238752"
Jul 24 19:31:26.418540 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:31:26.418502    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-cff79d5b6-fmmmp"]
Jul 24 19:31:26.430866 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:31:26.430832    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-cff79d5b6-fmmmp"
Jul 24 19:31:26.433694 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:31:26.433666    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 24 19:31:26.435066 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:31:26.435046    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 24 19:31:26.435186 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:31:26.435082    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 24 19:31:26.435186 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:31:26.435059    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 24 19:31:26.435564 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:31:26.435544    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-pgspr\""
Jul 24 19:31:26.435658 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:31:26.435562    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-cff79d5b6-fmmmp"]
Jul 24 19:31:26.548131 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:31:26.548102    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5bb50866-390d-4d57-9eaa-592e1e9e11fa-tmp\") pod \"kube-auth-proxy-cff79d5b6-fmmmp\" (UID: \"5bb50866-390d-4d57-9eaa-592e1e9e11fa\") " pod="openshift-ingress/kube-auth-proxy-cff79d5b6-fmmmp"
Jul 24 19:31:26.548288 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:31:26.548141    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g92g\" (UniqueName: \"kubernetes.io/projected/5bb50866-390d-4d57-9eaa-592e1e9e11fa-kube-api-access-8g92g\") pod \"kube-auth-proxy-cff79d5b6-fmmmp\" (UID: \"5bb50866-390d-4d57-9eaa-592e1e9e11fa\") " pod="openshift-ingress/kube-auth-proxy-cff79d5b6-fmmmp"
Jul 24 19:31:26.548288 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:31:26.548161    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bb50866-390d-4d57-9eaa-592e1e9e11fa-tls-certs\") pod \"kube-auth-proxy-cff79d5b6-fmmmp\" (UID: \"5bb50866-390d-4d57-9eaa-592e1e9e11fa\") " pod="openshift-ingress/kube-auth-proxy-cff79d5b6-fmmmp"
Jul 24 19:31:26.648867 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:31:26.648820    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5bb50866-390d-4d57-9eaa-592e1e9e11fa-tmp\") pod \"kube-auth-proxy-cff79d5b6-fmmmp\" (UID: \"5bb50866-390d-4d57-9eaa-592e1e9e11fa\") " pod="openshift-ingress/kube-auth-proxy-cff79d5b6-fmmmp"
Jul 24 19:31:26.649043 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:31:26.648887    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g92g\" (UniqueName: \"kubernetes.io/projected/5bb50866-390d-4d57-9eaa-592e1e9e11fa-kube-api-access-8g92g\") pod \"kube-auth-proxy-cff79d5b6-fmmmp\" (UID: \"5bb50866-390d-4d57-9eaa-592e1e9e11fa\") " pod="openshift-ingress/kube-auth-proxy-cff79d5b6-fmmmp"
Jul 24 19:31:26.649043 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:31:26.648913    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bb50866-390d-4d57-9eaa-592e1e9e11fa-tls-certs\") pod \"kube-auth-proxy-cff79d5b6-fmmmp\" (UID: \"5bb50866-390d-4d57-9eaa-592e1e9e11fa\") " pod="openshift-ingress/kube-auth-proxy-cff79d5b6-fmmmp"
Jul 24 19:31:26.649160 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:31:26.649057    2567 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 24 19:31:26.649160 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:31:26.649132    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bb50866-390d-4d57-9eaa-592e1e9e11fa-tls-certs podName:5bb50866-390d-4d57-9eaa-592e1e9e11fa nodeName:}" failed. No retries permitted until 2026-07-24 19:31:27.149109726 +0000 UTC m=+275.667729748 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/5bb50866-390d-4d57-9eaa-592e1e9e11fa-tls-certs") pod "kube-auth-proxy-cff79d5b6-fmmmp" (UID: "5bb50866-390d-4d57-9eaa-592e1e9e11fa") : secret "kube-auth-proxy-tls" not found
Jul 24 19:31:26.651094 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:31:26.651077    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5bb50866-390d-4d57-9eaa-592e1e9e11fa-tmp\") pod \"kube-auth-proxy-cff79d5b6-fmmmp\" (UID: \"5bb50866-390d-4d57-9eaa-592e1e9e11fa\") " pod="openshift-ingress/kube-auth-proxy-cff79d5b6-fmmmp"
Jul 24 19:31:26.687476 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:31:26.687419    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g92g\" (UniqueName: \"kubernetes.io/projected/5bb50866-390d-4d57-9eaa-592e1e9e11fa-kube-api-access-8g92g\") pod \"kube-auth-proxy-cff79d5b6-fmmmp\" (UID: \"5bb50866-390d-4d57-9eaa-592e1e9e11fa\") " pod="openshift-ingress/kube-auth-proxy-cff79d5b6-fmmmp"
Jul 24 19:31:27.154383 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:31:27.154353    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bb50866-390d-4d57-9eaa-592e1e9e11fa-tls-certs\") pod \"kube-auth-proxy-cff79d5b6-fmmmp\" (UID: \"5bb50866-390d-4d57-9eaa-592e1e9e11fa\") " pod="openshift-ingress/kube-auth-proxy-cff79d5b6-fmmmp"
Jul 24 19:31:27.156991 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:31:27.156961    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bb50866-390d-4d57-9eaa-592e1e9e11fa-tls-certs\") pod \"kube-auth-proxy-cff79d5b6-fmmmp\" (UID: \"5bb50866-390d-4d57-9eaa-592e1e9e11fa\") " pod="openshift-ingress/kube-auth-proxy-cff79d5b6-fmmmp"
Jul 24 19:31:27.341829 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:31:27.341799    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-cff79d5b6-fmmmp"
Jul 24 19:31:27.468830 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:31:27.468799    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-cff79d5b6-fmmmp"]
Jul 24 19:31:27.471642 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:31:27.471620    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bb50866_390d_4d57_9eaa_592e1e9e11fa.slice/crio-b62f3307177a08c43eafc10b3ec86ce64bb60d4bc51f108685d2e14582562db0 WatchSource:0}: Error finding container b62f3307177a08c43eafc10b3ec86ce64bb60d4bc51f108685d2e14582562db0: Status 404 returned error can't find the container with id b62f3307177a08c43eafc10b3ec86ce64bb60d4bc51f108685d2e14582562db0
Jul 24 19:31:28.371497 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:31:28.371436    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-cff79d5b6-fmmmp" event={"ID":"5bb50866-390d-4d57-9eaa-592e1e9e11fa","Type":"ContainerStarted","Data":"b62f3307177a08c43eafc10b3ec86ce64bb60d4bc51f108685d2e14582562db0"}
Jul 24 19:31:31.386136 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:31:31.386098    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-cff79d5b6-fmmmp" event={"ID":"5bb50866-390d-4d57-9eaa-592e1e9e11fa","Type":"ContainerStarted","Data":"49b6dd4b974cdec206add97520e56f0d9aa1d3860ce8a6100c4bac8e901f6cf2"}
Jul 24 19:31:31.402679 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:31:31.402622    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-cff79d5b6-fmmmp" podStartSLOduration=2.466501651 podStartE2EDuration="5.402608173s" totalImagesPullingTime="2.936106522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:31:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:31:31.401701336 +0000 UTC m=+279.920321377" watchObservedRunningTime="2026-07-24 19:31:31.402608173 +0000 UTC m=+279.921228208"
Jul 24 19:31:51.885050 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:31:51.885020    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d87bq_72c2265c-f7f6-462a-bf46-eda3f35de953/ovn-acl-logging/0.log"
Jul 24 19:31:51.888882 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:31:51.888861    2567 kubelet.go:1648] "Image garbage collection succeeded"
Jul 24 19:31:51.889815 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:31:51.889798    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d87bq_72c2265c-f7f6-462a-bf46-eda3f35de953/ovn-acl-logging/0.log"
Jul 24 19:32:48.254497 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:32:48.254400    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-jcgkt"]
Jul 24 19:32:48.257676 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:32:48.257657    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jcgkt"
Jul 24 19:32:48.260224 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:32:48.260207    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 24 19:32:48.260302 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:32:48.260234    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 24 19:32:48.261289 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:32:48.261274    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-dgnj4\""
Jul 24 19:32:48.269155 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:32:48.269132    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-jcgkt"]
Jul 24 19:32:48.358184 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:32:48.358151    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmt5m\" (UniqueName: \"kubernetes.io/projected/b684bea0-d4e2-41ba-8654-b2aae209171d-kube-api-access-kmt5m\") pod \"authorino-operator-75cc8d5cb7-jcgkt\" (UID: \"b684bea0-d4e2-41ba-8654-b2aae209171d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-jcgkt"
Jul 24 19:32:48.459525 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:32:48.459494    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmt5m\" (UniqueName: \"kubernetes.io/projected/b684bea0-d4e2-41ba-8654-b2aae209171d-kube-api-access-kmt5m\") pod \"authorino-operator-75cc8d5cb7-jcgkt\" (UID: \"b684bea0-d4e2-41ba-8654-b2aae209171d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-jcgkt"
Jul 24 19:32:48.468315 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:32:48.468292    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmt5m\" (UniqueName: \"kubernetes.io/projected/b684bea0-d4e2-41ba-8654-b2aae209171d-kube-api-access-kmt5m\") pod \"authorino-operator-75cc8d5cb7-jcgkt\" (UID: \"b684bea0-d4e2-41ba-8654-b2aae209171d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-jcgkt"
Jul 24 19:32:48.570298 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:32:48.570221    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jcgkt"
Jul 24 19:32:48.705998 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:32:48.705975    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-jcgkt"]
Jul 24 19:32:48.708527 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:32:48.708504    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb684bea0_d4e2_41ba_8654_b2aae209171d.slice/crio-a665d424cd99eb47261ddac70a8ce8837ee799efa4b5bbbcffead546792f816d WatchSource:0}: Error finding container a665d424cd99eb47261ddac70a8ce8837ee799efa4b5bbbcffead546792f816d: Status 404 returned error can't find the container with id a665d424cd99eb47261ddac70a8ce8837ee799efa4b5bbbcffead546792f816d
Jul 24 19:32:48.710527 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:32:48.710508    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 19:32:49.719255 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:32:49.719212    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jcgkt" event={"ID":"b684bea0-d4e2-41ba-8654-b2aae209171d","Type":"ContainerStarted","Data":"a665d424cd99eb47261ddac70a8ce8837ee799efa4b5bbbcffead546792f816d"}
Jul 24 19:32:51.730761 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:32:51.730721    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jcgkt" event={"ID":"b684bea0-d4e2-41ba-8654-b2aae209171d","Type":"ContainerStarted","Data":"24a52af739113162de5398d65d4cf16199258da5823c0097b5b9e8965928a73e"}
Jul 24 19:32:51.731167 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:32:51.730857    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jcgkt"
Jul 24 19:32:51.749432 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:32:51.749389    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jcgkt" podStartSLOduration=1.485735566 podStartE2EDuration="3.749376089s" totalImagesPullingTime="2.263640523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:32:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:32:51.748597003 +0000 UTC m=+360.267217045" watchObservedRunningTime="2026-07-24 19:32:51.749376089 +0000 UTC m=+360.267996130"
Jul 24 19:33:02.737571 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:02.737544    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jcgkt"
Jul 24 19:33:05.781560 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:05.781524    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ptlqt"]
Jul 24 19:33:05.784921 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:05.784902    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ptlqt"
Jul 24 19:33:05.787577 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:05.787551    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-twmhj\""
Jul 24 19:33:05.802763 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:05.802738    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ptlqt"]
Jul 24 19:33:05.908233 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:05.908195    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9fbb6335-e1ac-4233-8767-b65d429b1d8b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ptlqt\" (UID: \"9fbb6335-e1ac-4233-8767-b65d429b1d8b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ptlqt"
Jul 24 19:33:05.908233 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:05.908235    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgdrb\" (UniqueName: \"kubernetes.io/projected/9fbb6335-e1ac-4233-8767-b65d429b1d8b-kube-api-access-lgdrb\") pod \"kuadrant-operator-controller-manager-86878c769f-ptlqt\" (UID: \"9fbb6335-e1ac-4233-8767-b65d429b1d8b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ptlqt"
Jul 24 19:33:06.008885 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:06.008855    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9fbb6335-e1ac-4233-8767-b65d429b1d8b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ptlqt\" (UID: \"9fbb6335-e1ac-4233-8767-b65d429b1d8b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ptlqt"
Jul 24 19:33:06.009029 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:06.008895    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgdrb\" (UniqueName: \"kubernetes.io/projected/9fbb6335-e1ac-4233-8767-b65d429b1d8b-kube-api-access-lgdrb\") pod \"kuadrant-operator-controller-manager-86878c769f-ptlqt\" (UID: \"9fbb6335-e1ac-4233-8767-b65d429b1d8b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ptlqt"
Jul 24 19:33:06.009239 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:06.009216    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9fbb6335-e1ac-4233-8767-b65d429b1d8b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ptlqt\" (UID: \"9fbb6335-e1ac-4233-8767-b65d429b1d8b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ptlqt"
Jul 24 19:33:06.023384 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:06.023359    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgdrb\" (UniqueName: \"kubernetes.io/projected/9fbb6335-e1ac-4233-8767-b65d429b1d8b-kube-api-access-lgdrb\") pod \"kuadrant-operator-controller-manager-86878c769f-ptlqt\" (UID: \"9fbb6335-e1ac-4233-8767-b65d429b1d8b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ptlqt"
Jul 24 19:33:06.094474 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:06.094397    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ptlqt"
Jul 24 19:33:06.234315 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:06.234283    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ptlqt"]
Jul 24 19:33:06.238108 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:33:06.238077    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fbb6335_e1ac_4233_8767_b65d429b1d8b.slice/crio-56fadaa6429eb4c4b08b7b1db7754d367ed6b785376119ff836d560ec996a539 WatchSource:0}: Error finding container 56fadaa6429eb4c4b08b7b1db7754d367ed6b785376119ff836d560ec996a539: Status 404 returned error can't find the container with id 56fadaa6429eb4c4b08b7b1db7754d367ed6b785376119ff836d560ec996a539
Jul 24 19:33:06.794956 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:06.794922    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ptlqt" event={"ID":"9fbb6335-e1ac-4233-8767-b65d429b1d8b","Type":"ContainerStarted","Data":"56fadaa6429eb4c4b08b7b1db7754d367ed6b785376119ff836d560ec996a539"}
Jul 24 19:33:11.819912 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:11.819876    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ptlqt" event={"ID":"9fbb6335-e1ac-4233-8767-b65d429b1d8b","Type":"ContainerStarted","Data":"8f561051e5e5338f27bc7a2f873abad21c899d472927f5637c39d90bc255f64a"}
Jul 24 19:33:11.820284 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:11.819988    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ptlqt"
Jul 24 19:33:11.840772 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:11.840718    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ptlqt" podStartSLOduration=2.291940903 podStartE2EDuration="6.840703727s" totalImagesPullingTime="4.548762824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:33:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:33:11.838945308 +0000 UTC m=+380.357565350" watchObservedRunningTime="2026-07-24 19:33:11.840703727 +0000 UTC m=+380.359323770"
Jul 24 19:33:22.826709 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:22.826681    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ptlqt"
Jul 24 19:33:22.929420 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:22.929384    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58f5b4b598-qpb6g"]
Jul 24 19:33:41.786800 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:41.786762    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-86b57"]
Jul 24 19:33:41.793120 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:41.793092    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-86b57"
Jul 24 19:33:41.795471 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:41.795445    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-mzpmw\""
Jul 24 19:33:41.799866 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:41.799842    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-86b57"]
Jul 24 19:33:41.811923 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:41.811899    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2w22\" (UniqueName: \"kubernetes.io/projected/706b7f99-a372-4673-9f94-93d6a7a42595-kube-api-access-t2w22\") pod \"authorino-58cd955675-86b57\" (UID: \"706b7f99-a372-4673-9f94-93d6a7a42595\") " pod="kuadrant-system/authorino-58cd955675-86b57"
Jul 24 19:33:41.904752 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:41.904723    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-p8hbh"]
Jul 24 19:33:41.907086 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:41.907066    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-p8hbh"
Jul 24 19:33:41.912532 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:41.912502    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpgt6\" (UniqueName: \"kubernetes.io/projected/80bbcdeb-8d68-462a-af38-48069d4acf30-kube-api-access-vpgt6\") pod \"authorino-75d556bd77-p8hbh\" (UID: \"80bbcdeb-8d68-462a-af38-48069d4acf30\") " pod="kuadrant-system/authorino-75d556bd77-p8hbh"
Jul 24 19:33:41.912666 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:41.912559    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2w22\" (UniqueName: \"kubernetes.io/projected/706b7f99-a372-4673-9f94-93d6a7a42595-kube-api-access-t2w22\") pod \"authorino-58cd955675-86b57\" (UID: \"706b7f99-a372-4673-9f94-93d6a7a42595\") " pod="kuadrant-system/authorino-58cd955675-86b57"
Jul 24 19:33:41.912666 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:41.912650    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-p8hbh"]
Jul 24 19:33:41.924164 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:41.924136    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2w22\" (UniqueName: \"kubernetes.io/projected/706b7f99-a372-4673-9f94-93d6a7a42595-kube-api-access-t2w22\") pod \"authorino-58cd955675-86b57\" (UID: \"706b7f99-a372-4673-9f94-93d6a7a42595\") " pod="kuadrant-system/authorino-58cd955675-86b57"
Jul 24 19:33:42.013519 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:42.013466    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpgt6\" (UniqueName: \"kubernetes.io/projected/80bbcdeb-8d68-462a-af38-48069d4acf30-kube-api-access-vpgt6\") pod \"authorino-75d556bd77-p8hbh\" (UID: \"80bbcdeb-8d68-462a-af38-48069d4acf30\") " pod="kuadrant-system/authorino-75d556bd77-p8hbh"
Jul 24 19:33:42.026010 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:42.025990    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpgt6\" (UniqueName: \"kubernetes.io/projected/80bbcdeb-8d68-462a-af38-48069d4acf30-kube-api-access-vpgt6\") pod \"authorino-75d556bd77-p8hbh\" (UID: \"80bbcdeb-8d68-462a-af38-48069d4acf30\") " pod="kuadrant-system/authorino-75d556bd77-p8hbh"
Jul 24 19:33:42.103708 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:42.103640    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-86b57"
Jul 24 19:33:42.216428 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:42.216393    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-p8hbh"
Jul 24 19:33:42.235282 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:42.235257    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-86b57"]
Jul 24 19:33:42.238236 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:33:42.238212    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod706b7f99_a372_4673_9f94_93d6a7a42595.slice/crio-ba682c96c04e3ada6fb2565b130a81965cae235db74baf46f6e63ef015e53f96 WatchSource:0}: Error finding container ba682c96c04e3ada6fb2565b130a81965cae235db74baf46f6e63ef015e53f96: Status 404 returned error can't find the container with id ba682c96c04e3ada6fb2565b130a81965cae235db74baf46f6e63ef015e53f96
Jul 24 19:33:42.344784 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:42.344759    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-p8hbh"]
Jul 24 19:33:42.346902 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:33:42.346868    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod80bbcdeb_8d68_462a_af38_48069d4acf30.slice/crio-20af9b19733b352a4d33e2414fdfbcb8ff6677c1a0cdbe9a932f57bf09fd9af7 WatchSource:0}: Error finding container 20af9b19733b352a4d33e2414fdfbcb8ff6677c1a0cdbe9a932f57bf09fd9af7: Status 404 returned error can't find the container with id 20af9b19733b352a4d33e2414fdfbcb8ff6677c1a0cdbe9a932f57bf09fd9af7
Jul 24 19:33:42.957771 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:42.957735    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-p8hbh" event={"ID":"80bbcdeb-8d68-462a-af38-48069d4acf30","Type":"ContainerStarted","Data":"20af9b19733b352a4d33e2414fdfbcb8ff6677c1a0cdbe9a932f57bf09fd9af7"}
Jul 24 19:33:42.959217 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:42.959188    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-86b57" event={"ID":"706b7f99-a372-4673-9f94-93d6a7a42595","Type":"ContainerStarted","Data":"ba682c96c04e3ada6fb2565b130a81965cae235db74baf46f6e63ef015e53f96"}
Jul 24 19:33:45.976541 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:45.976499    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-p8hbh" event={"ID":"80bbcdeb-8d68-462a-af38-48069d4acf30","Type":"ContainerStarted","Data":"dcd72407f4da0124ae56918e9f5c92f4f2bf99b6ac95f19b39dd782cbd72b7be"}
Jul 24 19:33:45.978073 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:45.978050    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-86b57" event={"ID":"706b7f99-a372-4673-9f94-93d6a7a42595","Type":"ContainerStarted","Data":"aa31c82707d82b066a3880755948eebe3de60d4a045e938d22d94a41da52880a"}
Jul 24 19:33:45.991324 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:45.991272    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-p8hbh" podStartSLOduration=1.587357047 podStartE2EDuration="4.991256452s" totalImagesPullingTime="3.403899405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:33:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:33:45.989946586 +0000 UTC m=+414.508566628" watchObservedRunningTime="2026-07-24 19:33:45.991256452 +0000 UTC m=+414.509876502"
Jul 24 19:33:46.030688 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:46.030569    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-86b57" podStartSLOduration=1.503149474 podStartE2EDuration="5.030542383s" totalImagesPullingTime="3.527392909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:33:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:33:46.008423537 +0000 UTC m=+414.527043580" watchObservedRunningTime="2026-07-24 19:33:46.030542383 +0000 UTC m=+414.549162425"
Jul 24 19:33:46.031559 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:46.031535    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-86b57"]
Jul 24 19:33:47.948498 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:47.948442    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-58f5b4b598-qpb6g" podUID="623a0c9d-99f2-47b8-ae39-638b5f2d7315" containerName="console" containerID="cri-o://6a83a17886daf45f6d8436fd0c9bc77bc6fe5091a4992c62a1333ad7799cf25a" gracePeriod=15
Jul 24 19:33:47.986955 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:47.986916    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-86b57" podUID="706b7f99-a372-4673-9f94-93d6a7a42595" containerName="authorino" containerID="cri-o://aa31c82707d82b066a3880755948eebe3de60d4a045e938d22d94a41da52880a" gracePeriod=30
Jul 24 19:33:48.239837 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:48.239818    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58f5b4b598-qpb6g"
Jul 24 19:33:48.242444 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:48.242429    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-86b57"
Jul 24 19:33:48.268766 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:48.268743    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hj4rc\" (UniqueName: \"kubernetes.io/projected/623a0c9d-99f2-47b8-ae39-638b5f2d7315-kube-api-access-hj4rc\") pod \"623a0c9d-99f2-47b8-ae39-638b5f2d7315\" (UID: \"623a0c9d-99f2-47b8-ae39-638b5f2d7315\") "
Jul 24 19:33:48.268907 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:48.268784    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/623a0c9d-99f2-47b8-ae39-638b5f2d7315-trusted-ca-bundle\") pod \"623a0c9d-99f2-47b8-ae39-638b5f2d7315\" (UID: \"623a0c9d-99f2-47b8-ae39-638b5f2d7315\") "
Jul 24 19:33:48.268907 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:48.268831    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/623a0c9d-99f2-47b8-ae39-638b5f2d7315-console-serving-cert\") pod \"623a0c9d-99f2-47b8-ae39-638b5f2d7315\" (UID: \"623a0c9d-99f2-47b8-ae39-638b5f2d7315\") "
Jul 24 19:33:48.268907 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:48.268862    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/623a0c9d-99f2-47b8-ae39-638b5f2d7315-oauth-serving-cert\") pod \"623a0c9d-99f2-47b8-ae39-638b5f2d7315\" (UID: \"623a0c9d-99f2-47b8-ae39-638b5f2d7315\") "
Jul 24 19:33:48.269064 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:48.268933    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/623a0c9d-99f2-47b8-ae39-638b5f2d7315-console-oauth-config\") pod \"623a0c9d-99f2-47b8-ae39-638b5f2d7315\" (UID: \"623a0c9d-99f2-47b8-ae39-638b5f2d7315\") "
Jul 24 19:33:48.269064 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:48.268995    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/623a0c9d-99f2-47b8-ae39-638b5f2d7315-service-ca\") pod \"623a0c9d-99f2-47b8-ae39-638b5f2d7315\" (UID: \"623a0c9d-99f2-47b8-ae39-638b5f2d7315\") "
Jul 24 19:33:48.269064 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:48.269032    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2w22\" (UniqueName: \"kubernetes.io/projected/706b7f99-a372-4673-9f94-93d6a7a42595-kube-api-access-t2w22\") pod \"706b7f99-a372-4673-9f94-93d6a7a42595\" (UID: \"706b7f99-a372-4673-9f94-93d6a7a42595\") "
Jul 24 19:33:48.269249 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:48.269069    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/623a0c9d-99f2-47b8-ae39-638b5f2d7315-console-config\") pod \"623a0c9d-99f2-47b8-ae39-638b5f2d7315\" (UID: \"623a0c9d-99f2-47b8-ae39-638b5f2d7315\") "
Jul 24 19:33:48.269297 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:48.269267    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/623a0c9d-99f2-47b8-ae39-638b5f2d7315-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "623a0c9d-99f2-47b8-ae39-638b5f2d7315" (UID: "623a0c9d-99f2-47b8-ae39-638b5f2d7315"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:33:48.269297 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:48.269279    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/623a0c9d-99f2-47b8-ae39-638b5f2d7315-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "623a0c9d-99f2-47b8-ae39-638b5f2d7315" (UID: "623a0c9d-99f2-47b8-ae39-638b5f2d7315"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:33:48.269520 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:48.269454    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/623a0c9d-99f2-47b8-ae39-638b5f2d7315-trusted-ca-bundle\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:33:48.269520 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:48.269497    2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/623a0c9d-99f2-47b8-ae39-638b5f2d7315-oauth-serving-cert\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:33:48.269654 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:48.269595    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/623a0c9d-99f2-47b8-ae39-638b5f2d7315-console-config" (OuterVolumeSpecName: "console-config") pod "623a0c9d-99f2-47b8-ae39-638b5f2d7315" (UID: "623a0c9d-99f2-47b8-ae39-638b5f2d7315"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:33:48.269727 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:48.269674    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/623a0c9d-99f2-47b8-ae39-638b5f2d7315-service-ca" (OuterVolumeSpecName: "service-ca") pod "623a0c9d-99f2-47b8-ae39-638b5f2d7315" (UID: "623a0c9d-99f2-47b8-ae39-638b5f2d7315"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:33:48.271457 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:48.271434    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/623a0c9d-99f2-47b8-ae39-638b5f2d7315-kube-api-access-hj4rc" (OuterVolumeSpecName: "kube-api-access-hj4rc") pod "623a0c9d-99f2-47b8-ae39-638b5f2d7315" (UID: "623a0c9d-99f2-47b8-ae39-638b5f2d7315"). InnerVolumeSpecName "kube-api-access-hj4rc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:33:48.271457 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:48.271439    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/623a0c9d-99f2-47b8-ae39-638b5f2d7315-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "623a0c9d-99f2-47b8-ae39-638b5f2d7315" (UID: "623a0c9d-99f2-47b8-ae39-638b5f2d7315"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:33:48.272043 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:48.272013    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/623a0c9d-99f2-47b8-ae39-638b5f2d7315-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "623a0c9d-99f2-47b8-ae39-638b5f2d7315" (UID: "623a0c9d-99f2-47b8-ae39-638b5f2d7315"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:33:48.272304 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:48.272277    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/706b7f99-a372-4673-9f94-93d6a7a42595-kube-api-access-t2w22" (OuterVolumeSpecName: "kube-api-access-t2w22") pod "706b7f99-a372-4673-9f94-93d6a7a42595" (UID: "706b7f99-a372-4673-9f94-93d6a7a42595"). InnerVolumeSpecName "kube-api-access-t2w22". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:33:48.370174 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:48.370148    2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/623a0c9d-99f2-47b8-ae39-638b5f2d7315-console-config\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:33:48.370174 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:48.370172    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hj4rc\" (UniqueName: \"kubernetes.io/projected/623a0c9d-99f2-47b8-ae39-638b5f2d7315-kube-api-access-hj4rc\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:33:48.370174 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:48.370183    2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/623a0c9d-99f2-47b8-ae39-638b5f2d7315-console-serving-cert\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:33:48.370398 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:48.370191    2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/623a0c9d-99f2-47b8-ae39-638b5f2d7315-console-oauth-config\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:33:48.370398 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:48.370200    2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/623a0c9d-99f2-47b8-ae39-638b5f2d7315-service-ca\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:33:48.370398 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:48.370207    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2w22\" (UniqueName: \"kubernetes.io/projected/706b7f99-a372-4673-9f94-93d6a7a42595-kube-api-access-t2w22\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:33:48.991940 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:48.991910    2567 generic.go:356] "Generic (PLEG): container finished" podID="623a0c9d-99f2-47b8-ae39-638b5f2d7315" containerID="6a83a17886daf45f6d8436fd0c9bc77bc6fe5091a4992c62a1333ad7799cf25a" exitCode=0
Jul 24 19:33:48.992349 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:48.991963    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58f5b4b598-qpb6g"
Jul 24 19:33:48.992349 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:48.992002    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58f5b4b598-qpb6g" event={"ID":"623a0c9d-99f2-47b8-ae39-638b5f2d7315","Type":"ContainerDied","Data":"6a83a17886daf45f6d8436fd0c9bc77bc6fe5091a4992c62a1333ad7799cf25a"}
Jul 24 19:33:48.992349 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:48.992070    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58f5b4b598-qpb6g" event={"ID":"623a0c9d-99f2-47b8-ae39-638b5f2d7315","Type":"ContainerDied","Data":"e15f0ff046ffe0f7ca2114e897847d6616f7706e8ac8e5d7d8b9af81c2613bea"}
Jul 24 19:33:48.992349 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:48.992099    2567 scope.go:117] "RemoveContainer" containerID="6a83a17886daf45f6d8436fd0c9bc77bc6fe5091a4992c62a1333ad7799cf25a"
Jul 24 19:33:48.993420 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:48.993346    2567 generic.go:356] "Generic (PLEG): container finished" podID="706b7f99-a372-4673-9f94-93d6a7a42595" containerID="aa31c82707d82b066a3880755948eebe3de60d4a045e938d22d94a41da52880a" exitCode=0
Jul 24 19:33:48.993420 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:48.993376    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-86b57" event={"ID":"706b7f99-a372-4673-9f94-93d6a7a42595","Type":"ContainerDied","Data":"aa31c82707d82b066a3880755948eebe3de60d4a045e938d22d94a41da52880a"}
Jul 24 19:33:48.993420 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:48.993402    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-86b57"
Jul 24 19:33:48.993420 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:48.993415    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-86b57" event={"ID":"706b7f99-a372-4673-9f94-93d6a7a42595","Type":"ContainerDied","Data":"ba682c96c04e3ada6fb2565b130a81965cae235db74baf46f6e63ef015e53f96"}
Jul 24 19:33:49.000760 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:49.000741    2567 scope.go:117] "RemoveContainer" containerID="6a83a17886daf45f6d8436fd0c9bc77bc6fe5091a4992c62a1333ad7799cf25a"
Jul 24 19:33:49.001026 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:33:49.001008    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a83a17886daf45f6d8436fd0c9bc77bc6fe5091a4992c62a1333ad7799cf25a\": container with ID starting with 6a83a17886daf45f6d8436fd0c9bc77bc6fe5091a4992c62a1333ad7799cf25a not found: ID does not exist" containerID="6a83a17886daf45f6d8436fd0c9bc77bc6fe5091a4992c62a1333ad7799cf25a"
Jul 24 19:33:49.001090 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:49.001034    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a83a17886daf45f6d8436fd0c9bc77bc6fe5091a4992c62a1333ad7799cf25a"} err="failed to get container status \"6a83a17886daf45f6d8436fd0c9bc77bc6fe5091a4992c62a1333ad7799cf25a\": rpc error: code = NotFound desc = could not find container \"6a83a17886daf45f6d8436fd0c9bc77bc6fe5091a4992c62a1333ad7799cf25a\": container with ID starting with 6a83a17886daf45f6d8436fd0c9bc77bc6fe5091a4992c62a1333ad7799cf25a not found: ID does not exist"
Jul 24 19:33:49.001090 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:49.001052    2567 scope.go:117] "RemoveContainer" containerID="aa31c82707d82b066a3880755948eebe3de60d4a045e938d22d94a41da52880a"
Jul 24 19:33:49.008537 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:49.008521    2567 scope.go:117] "RemoveContainer" containerID="aa31c82707d82b066a3880755948eebe3de60d4a045e938d22d94a41da52880a"
Jul 24 19:33:49.008785 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:33:49.008769    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa31c82707d82b066a3880755948eebe3de60d4a045e938d22d94a41da52880a\": container with ID starting with aa31c82707d82b066a3880755948eebe3de60d4a045e938d22d94a41da52880a not found: ID does not exist" containerID="aa31c82707d82b066a3880755948eebe3de60d4a045e938d22d94a41da52880a"
Jul 24 19:33:49.008830 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:49.008792    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa31c82707d82b066a3880755948eebe3de60d4a045e938d22d94a41da52880a"} err="failed to get container status \"aa31c82707d82b066a3880755948eebe3de60d4a045e938d22d94a41da52880a\": rpc error: code = NotFound desc = could not find container \"aa31c82707d82b066a3880755948eebe3de60d4a045e938d22d94a41da52880a\": container with ID starting with aa31c82707d82b066a3880755948eebe3de60d4a045e938d22d94a41da52880a not found: ID does not exist"
Jul 24 19:33:49.016231 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:49.016211    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58f5b4b598-qpb6g"]
Jul 24 19:33:49.020020 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:49.020000    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-58f5b4b598-qpb6g"]
Jul 24 19:33:49.029510 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:49.029475    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-86b57"]
Jul 24 19:33:49.038187 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:49.038166    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-86b57"]
Jul 24 19:33:50.071439 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:50.071401    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="623a0c9d-99f2-47b8-ae39-638b5f2d7315" path="/var/lib/kubelet/pods/623a0c9d-99f2-47b8-ae39-638b5f2d7315/volumes"
Jul 24 19:33:50.071944 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:33:50.071882    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="706b7f99-a372-4673-9f94-93d6a7a42595" path="/var/lib/kubelet/pods/706b7f99-a372-4673-9f94-93d6a7a42595/volumes"
Jul 24 19:34:10.660955 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:10.660911    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-s8nn7"]
Jul 24 19:34:10.661404 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:10.661392    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="706b7f99-a372-4673-9f94-93d6a7a42595" containerName="authorino"
Jul 24 19:34:10.661468 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:10.661411    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="706b7f99-a372-4673-9f94-93d6a7a42595" containerName="authorino"
Jul 24 19:34:10.661468 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:10.661427    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="623a0c9d-99f2-47b8-ae39-638b5f2d7315" containerName="console"
Jul 24 19:34:10.661468 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:10.661436    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="623a0c9d-99f2-47b8-ae39-638b5f2d7315" containerName="console"
Jul 24 19:34:10.661656 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:10.661559    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="623a0c9d-99f2-47b8-ae39-638b5f2d7315" containerName="console"
Jul 24 19:34:10.661656 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:10.661576    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="706b7f99-a372-4673-9f94-93d6a7a42595" containerName="authorino"
Jul 24 19:34:10.665800 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:10.665780    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-s8nn7"
Jul 24 19:34:10.671386 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:10.671363    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-s8nn7"]
Jul 24 19:34:10.756937 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:10.756900    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xr87w\" (UniqueName: \"kubernetes.io/projected/ab8ba3a9-178b-4934-8e11-9bd364d831e9-kube-api-access-xr87w\") pod \"authorino-5d4b67c446-s8nn7\" (UID: \"ab8ba3a9-178b-4934-8e11-9bd364d831e9\") " pod="kuadrant-system/authorino-5d4b67c446-s8nn7"
Jul 24 19:34:10.858124 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:10.858090    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr87w\" (UniqueName: \"kubernetes.io/projected/ab8ba3a9-178b-4934-8e11-9bd364d831e9-kube-api-access-xr87w\") pod \"authorino-5d4b67c446-s8nn7\" (UID: \"ab8ba3a9-178b-4934-8e11-9bd364d831e9\") " pod="kuadrant-system/authorino-5d4b67c446-s8nn7"
Jul 24 19:34:10.865979 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:10.865950    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xr87w\" (UniqueName: \"kubernetes.io/projected/ab8ba3a9-178b-4934-8e11-9bd364d831e9-kube-api-access-xr87w\") pod \"authorino-5d4b67c446-s8nn7\" (UID: \"ab8ba3a9-178b-4934-8e11-9bd364d831e9\") " pod="kuadrant-system/authorino-5d4b67c446-s8nn7"
Jul 24 19:34:10.893839 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:10.893814    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-s8nn7"]
Jul 24 19:34:10.894055 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:10.894043    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-s8nn7"
Jul 24 19:34:10.919853 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:10.919798    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8576cf6ff6-99g9v"]
Jul 24 19:34:10.923238 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:10.923219    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8576cf6ff6-99g9v"
Jul 24 19:34:10.928539 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:10.928512    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8576cf6ff6-99g9v"]
Jul 24 19:34:11.002321 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:11.002286    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8576cf6ff6-99g9v"]
Jul 24 19:34:11.002663 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:34:11.002638    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-pkx8z], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-8576cf6ff6-99g9v" podUID="bd4512ec-de6f-4ef1-9267-44a1f7313641"
Jul 24 19:34:11.025274 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:11.025247    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-89f54dbd4-kwccn"]
Jul 24 19:34:11.028609 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:11.028589    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-89f54dbd4-kwccn"
Jul 24 19:34:11.031064 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:11.031040    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 24 19:34:11.032083 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:11.031988    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-s8nn7"]
Jul 24 19:34:11.035268 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:34:11.035241    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podab8ba3a9_178b_4934_8e11_9bd364d831e9.slice/crio-ea49da2554620956560967a986423670363edb471eeecd7d4260581eeeff5bcd WatchSource:0}: Error finding container ea49da2554620956560967a986423670363edb471eeecd7d4260581eeeff5bcd: Status 404 returned error can't find the container with id ea49da2554620956560967a986423670363edb471eeecd7d4260581eeeff5bcd
Jul 24 19:34:11.035603 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:11.035585    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-89f54dbd4-kwccn"]
Jul 24 19:34:11.059842 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:11.059821    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkx8z\" (UniqueName: \"kubernetes.io/projected/bd4512ec-de6f-4ef1-9267-44a1f7313641-kube-api-access-pkx8z\") pod \"authorino-8576cf6ff6-99g9v\" (UID: \"bd4512ec-de6f-4ef1-9267-44a1f7313641\") " pod="kuadrant-system/authorino-8576cf6ff6-99g9v"
Jul 24 19:34:11.085962 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:11.085943    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8576cf6ff6-99g9v"
Jul 24 19:34:11.086066 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:11.085936    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-s8nn7" event={"ID":"ab8ba3a9-178b-4934-8e11-9bd364d831e9","Type":"ContainerStarted","Data":"ea49da2554620956560967a986423670363edb471eeecd7d4260581eeeff5bcd"}
Jul 24 19:34:11.092274 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:11.092256    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8576cf6ff6-99g9v"
Jul 24 19:34:11.160964 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:11.160937    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5a2e9855-b9b7-4102-a0c7-517c24b0c631-tls-cert\") pod \"authorino-89f54dbd4-kwccn\" (UID: \"5a2e9855-b9b7-4102-a0c7-517c24b0c631\") " pod="kuadrant-system/authorino-89f54dbd4-kwccn"
Jul 24 19:34:11.161084 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:11.160979    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc4ds\" (UniqueName: \"kubernetes.io/projected/5a2e9855-b9b7-4102-a0c7-517c24b0c631-kube-api-access-wc4ds\") pod \"authorino-89f54dbd4-kwccn\" (UID: \"5a2e9855-b9b7-4102-a0c7-517c24b0c631\") " pod="kuadrant-system/authorino-89f54dbd4-kwccn"
Jul 24 19:34:11.161084 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:11.161011    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkx8z\" (UniqueName: \"kubernetes.io/projected/bd4512ec-de6f-4ef1-9267-44a1f7313641-kube-api-access-pkx8z\") pod \"authorino-8576cf6ff6-99g9v\" (UID: \"bd4512ec-de6f-4ef1-9267-44a1f7313641\") " pod="kuadrant-system/authorino-8576cf6ff6-99g9v"
Jul 24 19:34:11.168446 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:11.168422    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkx8z\" (UniqueName: \"kubernetes.io/projected/bd4512ec-de6f-4ef1-9267-44a1f7313641-kube-api-access-pkx8z\") pod \"authorino-8576cf6ff6-99g9v\" (UID: \"bd4512ec-de6f-4ef1-9267-44a1f7313641\") " pod="kuadrant-system/authorino-8576cf6ff6-99g9v"
Jul 24 19:34:11.262467 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:11.262398    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkx8z\" (UniqueName: \"kubernetes.io/projected/bd4512ec-de6f-4ef1-9267-44a1f7313641-kube-api-access-pkx8z\") pod \"bd4512ec-de6f-4ef1-9267-44a1f7313641\" (UID: \"bd4512ec-de6f-4ef1-9267-44a1f7313641\") "
Jul 24 19:34:11.262624 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:11.262517    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc4ds\" (UniqueName: \"kubernetes.io/projected/5a2e9855-b9b7-4102-a0c7-517c24b0c631-kube-api-access-wc4ds\") pod \"authorino-89f54dbd4-kwccn\" (UID: \"5a2e9855-b9b7-4102-a0c7-517c24b0c631\") " pod="kuadrant-system/authorino-89f54dbd4-kwccn"
Jul 24 19:34:11.262624 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:11.262606    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5a2e9855-b9b7-4102-a0c7-517c24b0c631-tls-cert\") pod \"authorino-89f54dbd4-kwccn\" (UID: \"5a2e9855-b9b7-4102-a0c7-517c24b0c631\") " pod="kuadrant-system/authorino-89f54dbd4-kwccn"
Jul 24 19:34:11.264668 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:11.264636    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd4512ec-de6f-4ef1-9267-44a1f7313641-kube-api-access-pkx8z" (OuterVolumeSpecName: "kube-api-access-pkx8z") pod "bd4512ec-de6f-4ef1-9267-44a1f7313641" (UID: "bd4512ec-de6f-4ef1-9267-44a1f7313641"). InnerVolumeSpecName "kube-api-access-pkx8z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:34:11.264981 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:11.264965    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5a2e9855-b9b7-4102-a0c7-517c24b0c631-tls-cert\") pod \"authorino-89f54dbd4-kwccn\" (UID: \"5a2e9855-b9b7-4102-a0c7-517c24b0c631\") " pod="kuadrant-system/authorino-89f54dbd4-kwccn"
Jul 24 19:34:11.269969 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:11.269948    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc4ds\" (UniqueName: \"kubernetes.io/projected/5a2e9855-b9b7-4102-a0c7-517c24b0c631-kube-api-access-wc4ds\") pod \"authorino-89f54dbd4-kwccn\" (UID: \"5a2e9855-b9b7-4102-a0c7-517c24b0c631\") " pod="kuadrant-system/authorino-89f54dbd4-kwccn"
Jul 24 19:34:11.347161 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:11.347135    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-89f54dbd4-kwccn"
Jul 24 19:34:11.363306 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:11.363277    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkx8z\" (UniqueName: \"kubernetes.io/projected/bd4512ec-de6f-4ef1-9267-44a1f7313641-kube-api-access-pkx8z\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:34:11.476272 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:11.476240    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-89f54dbd4-kwccn"]
Jul 24 19:34:11.479886 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:34:11.479858    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a2e9855_b9b7_4102_a0c7_517c24b0c631.slice/crio-166bd3785a732590527792de9512654f37e3cb954eaeeca9bd4036fb369ac754 WatchSource:0}: Error finding container 166bd3785a732590527792de9512654f37e3cb954eaeeca9bd4036fb369ac754: Status 404 returned error can't find the container with id 166bd3785a732590527792de9512654f37e3cb954eaeeca9bd4036fb369ac754
Jul 24 19:34:12.091755 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:12.091724    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-89f54dbd4-kwccn" event={"ID":"5a2e9855-b9b7-4102-a0c7-517c24b0c631","Type":"ContainerStarted","Data":"dfd5632067216c4f102a3027e507de814af54d2dcb3333d0ae085be904b35994"}
Jul 24 19:34:12.092130 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:12.091761    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-89f54dbd4-kwccn" event={"ID":"5a2e9855-b9b7-4102-a0c7-517c24b0c631","Type":"ContainerStarted","Data":"166bd3785a732590527792de9512654f37e3cb954eaeeca9bd4036fb369ac754"}
Jul 24 19:34:12.093164 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:12.093139    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-s8nn7" event={"ID":"ab8ba3a9-178b-4934-8e11-9bd364d831e9","Type":"ContainerStarted","Data":"13109794567f36a6b100f6d14113415b126254a5833980d9b3acd521aa00bf4e"}
Jul 24 19:34:12.093164 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:12.093162    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8576cf6ff6-99g9v"
Jul 24 19:34:12.093300 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:12.093211    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-s8nn7" podUID="ab8ba3a9-178b-4934-8e11-9bd364d831e9" containerName="authorino" containerID="cri-o://13109794567f36a6b100f6d14113415b126254a5833980d9b3acd521aa00bf4e" gracePeriod=30
Jul 24 19:34:12.106721 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:12.106678    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-89f54dbd4-kwccn" podStartSLOduration=0.805701497 podStartE2EDuration="1.106663712s" totalImagesPullingTime="300.962215ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:34:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:34:12.105528963 +0000 UTC m=+440.624149004" watchObservedRunningTime="2026-07-24 19:34:12.106663712 +0000 UTC m=+440.625283803"
Jul 24 19:34:12.133769 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:12.133741    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-p8hbh"]
Jul 24 19:34:12.133935 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:12.133913    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-p8hbh" podUID="80bbcdeb-8d68-462a-af38-48069d4acf30" containerName="authorino" containerID="cri-o://dcd72407f4da0124ae56918e9f5c92f4f2bf99b6ac95f19b39dd782cbd72b7be" gracePeriod=30
Jul 24 19:34:12.136033 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:12.136010    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8576cf6ff6-99g9v"]
Jul 24 19:34:12.138122 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:12.138098    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8576cf6ff6-99g9v"]
Jul 24 19:34:12.151990 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:12.151939    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-s8nn7" podStartSLOduration=1.803065489 podStartE2EDuration="2.151922032s" totalImagesPullingTime="348.856543ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:34:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:34:12.151637556 +0000 UTC m=+440.670257597" watchObservedRunningTime="2026-07-24 19:34:12.151922032 +0000 UTC m=+440.670542073"
Jul 24 19:34:12.396151 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:12.396128    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-s8nn7"
Jul 24 19:34:12.402174 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:12.402154    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-p8hbh"
Jul 24 19:34:12.475603 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:12.475571    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vpgt6\" (UniqueName: \"kubernetes.io/projected/80bbcdeb-8d68-462a-af38-48069d4acf30-kube-api-access-vpgt6\") pod \"80bbcdeb-8d68-462a-af38-48069d4acf30\" (UID: \"80bbcdeb-8d68-462a-af38-48069d4acf30\") "
Jul 24 19:34:12.475782 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:12.475644    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xr87w\" (UniqueName: \"kubernetes.io/projected/ab8ba3a9-178b-4934-8e11-9bd364d831e9-kube-api-access-xr87w\") pod \"ab8ba3a9-178b-4934-8e11-9bd364d831e9\" (UID: \"ab8ba3a9-178b-4934-8e11-9bd364d831e9\") "
Jul 24 19:34:12.477711 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:12.477683    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80bbcdeb-8d68-462a-af38-48069d4acf30-kube-api-access-vpgt6" (OuterVolumeSpecName: "kube-api-access-vpgt6") pod "80bbcdeb-8d68-462a-af38-48069d4acf30" (UID: "80bbcdeb-8d68-462a-af38-48069d4acf30"). InnerVolumeSpecName "kube-api-access-vpgt6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:34:12.477839 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:12.477816    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab8ba3a9-178b-4934-8e11-9bd364d831e9-kube-api-access-xr87w" (OuterVolumeSpecName: "kube-api-access-xr87w") pod "ab8ba3a9-178b-4934-8e11-9bd364d831e9" (UID: "ab8ba3a9-178b-4934-8e11-9bd364d831e9"). InnerVolumeSpecName "kube-api-access-xr87w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:34:12.577018 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:12.576989    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vpgt6\" (UniqueName: \"kubernetes.io/projected/80bbcdeb-8d68-462a-af38-48069d4acf30-kube-api-access-vpgt6\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:34:12.577018 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:12.577012    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xr87w\" (UniqueName: \"kubernetes.io/projected/ab8ba3a9-178b-4934-8e11-9bd364d831e9-kube-api-access-xr87w\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:34:13.098895 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:13.098860    2567 generic.go:356] "Generic (PLEG): container finished" podID="ab8ba3a9-178b-4934-8e11-9bd364d831e9" containerID="13109794567f36a6b100f6d14113415b126254a5833980d9b3acd521aa00bf4e" exitCode=0
Jul 24 19:34:13.099385 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:13.098902    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-s8nn7"
Jul 24 19:34:13.099385 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:13.098949    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-s8nn7" event={"ID":"ab8ba3a9-178b-4934-8e11-9bd364d831e9","Type":"ContainerDied","Data":"13109794567f36a6b100f6d14113415b126254a5833980d9b3acd521aa00bf4e"}
Jul 24 19:34:13.099385 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:13.098987    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-s8nn7" event={"ID":"ab8ba3a9-178b-4934-8e11-9bd364d831e9","Type":"ContainerDied","Data":"ea49da2554620956560967a986423670363edb471eeecd7d4260581eeeff5bcd"}
Jul 24 19:34:13.099385 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:13.099005    2567 scope.go:117] "RemoveContainer" containerID="13109794567f36a6b100f6d14113415b126254a5833980d9b3acd521aa00bf4e"
Jul 24 19:34:13.100290 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:13.100154    2567 generic.go:356] "Generic (PLEG): container finished" podID="80bbcdeb-8d68-462a-af38-48069d4acf30" containerID="dcd72407f4da0124ae56918e9f5c92f4f2bf99b6ac95f19b39dd782cbd72b7be" exitCode=0
Jul 24 19:34:13.100290 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:13.100206    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-p8hbh"
Jul 24 19:34:13.100290 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:13.100251    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-p8hbh" event={"ID":"80bbcdeb-8d68-462a-af38-48069d4acf30","Type":"ContainerDied","Data":"dcd72407f4da0124ae56918e9f5c92f4f2bf99b6ac95f19b39dd782cbd72b7be"}
Jul 24 19:34:13.100290 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:13.100279    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-p8hbh" event={"ID":"80bbcdeb-8d68-462a-af38-48069d4acf30","Type":"ContainerDied","Data":"20af9b19733b352a4d33e2414fdfbcb8ff6677c1a0cdbe9a932f57bf09fd9af7"}
Jul 24 19:34:13.109760 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:13.109740    2567 scope.go:117] "RemoveContainer" containerID="13109794567f36a6b100f6d14113415b126254a5833980d9b3acd521aa00bf4e"
Jul 24 19:34:13.110039 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:34:13.110021    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13109794567f36a6b100f6d14113415b126254a5833980d9b3acd521aa00bf4e\": container with ID starting with 13109794567f36a6b100f6d14113415b126254a5833980d9b3acd521aa00bf4e not found: ID does not exist" containerID="13109794567f36a6b100f6d14113415b126254a5833980d9b3acd521aa00bf4e"
Jul 24 19:34:13.110128 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:13.110052    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13109794567f36a6b100f6d14113415b126254a5833980d9b3acd521aa00bf4e"} err="failed to get container status \"13109794567f36a6b100f6d14113415b126254a5833980d9b3acd521aa00bf4e\": rpc error: code = NotFound desc = could not find container \"13109794567f36a6b100f6d14113415b126254a5833980d9b3acd521aa00bf4e\": container with ID starting with 13109794567f36a6b100f6d14113415b126254a5833980d9b3acd521aa00bf4e not found: ID does not exist"
Jul 24 19:34:13.110128 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:13.110074    2567 scope.go:117] "RemoveContainer" containerID="dcd72407f4da0124ae56918e9f5c92f4f2bf99b6ac95f19b39dd782cbd72b7be"
Jul 24 19:34:13.117343 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:13.117328    2567 scope.go:117] "RemoveContainer" containerID="dcd72407f4da0124ae56918e9f5c92f4f2bf99b6ac95f19b39dd782cbd72b7be"
Jul 24 19:34:13.117604 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:34:13.117584    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcd72407f4da0124ae56918e9f5c92f4f2bf99b6ac95f19b39dd782cbd72b7be\": container with ID starting with dcd72407f4da0124ae56918e9f5c92f4f2bf99b6ac95f19b39dd782cbd72b7be not found: ID does not exist" containerID="dcd72407f4da0124ae56918e9f5c92f4f2bf99b6ac95f19b39dd782cbd72b7be"
Jul 24 19:34:13.117667 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:13.117614    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcd72407f4da0124ae56918e9f5c92f4f2bf99b6ac95f19b39dd782cbd72b7be"} err="failed to get container status \"dcd72407f4da0124ae56918e9f5c92f4f2bf99b6ac95f19b39dd782cbd72b7be\": rpc error: code = NotFound desc = could not find container \"dcd72407f4da0124ae56918e9f5c92f4f2bf99b6ac95f19b39dd782cbd72b7be\": container with ID starting with dcd72407f4da0124ae56918e9f5c92f4f2bf99b6ac95f19b39dd782cbd72b7be not found: ID does not exist"
Jul 24 19:34:13.119659 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:13.119639    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-s8nn7"]
Jul 24 19:34:13.123929 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:13.123889    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-s8nn7"]
Jul 24 19:34:13.133884 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:13.133866    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-p8hbh"]
Jul 24 19:34:13.137328 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:13.137310    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-p8hbh"]
Jul 24 19:34:14.071950 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:14.071919    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80bbcdeb-8d68-462a-af38-48069d4acf30" path="/var/lib/kubelet/pods/80bbcdeb-8d68-462a-af38-48069d4acf30/volumes"
Jul 24 19:34:14.072236 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:14.072224    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab8ba3a9-178b-4934-8e11-9bd364d831e9" path="/var/lib/kubelet/pods/ab8ba3a9-178b-4934-8e11-9bd364d831e9/volumes"
Jul 24 19:34:14.072515 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:34:14.072502    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd4512ec-de6f-4ef1-9267-44a1f7313641" path="/var/lib/kubelet/pods/bd4512ec-de6f-4ef1-9267-44a1f7313641/volumes"
Jul 24 19:36:06.367217 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:06.367139    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5f48t"]
Jul 24 19:36:06.367709 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:06.367452    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80bbcdeb-8d68-462a-af38-48069d4acf30" containerName="authorino"
Jul 24 19:36:06.367709 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:06.367462    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="80bbcdeb-8d68-462a-af38-48069d4acf30" containerName="authorino"
Jul 24 19:36:06.367709 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:06.367499    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab8ba3a9-178b-4934-8e11-9bd364d831e9" containerName="authorino"
Jul 24 19:36:06.367709 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:06.367508    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab8ba3a9-178b-4934-8e11-9bd364d831e9" containerName="authorino"
Jul 24 19:36:06.367709 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:06.367576    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="80bbcdeb-8d68-462a-af38-48069d4acf30" containerName="authorino"
Jul 24 19:36:06.367709 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:06.367586    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab8ba3a9-178b-4934-8e11-9bd364d831e9" containerName="authorino"
Jul 24 19:36:06.370443 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:06.370428    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5f48t"
Jul 24 19:36:06.377235 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:06.377217    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 24 19:36:06.377987 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:06.377966    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 24 19:36:06.378122 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:06.377995    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mdztr\""
Jul 24 19:36:06.378122 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:06.377999    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 24 19:36:06.403561 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:06.403534    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5f48t"]
Jul 24 19:36:06.444614 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:06.444584    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e636b6f8-a0ff-4c30-90ca-43f6d32bf501-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5f48t\" (UID: \"e636b6f8-a0ff-4c30-90ca-43f6d32bf501\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5f48t"
Jul 24 19:36:06.444829 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:06.444626    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e636b6f8-a0ff-4c30-90ca-43f6d32bf501-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5f48t\" (UID: \"e636b6f8-a0ff-4c30-90ca-43f6d32bf501\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5f48t"
Jul 24 19:36:06.444829 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:06.444657    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e636b6f8-a0ff-4c30-90ca-43f6d32bf501-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5f48t\" (UID: \"e636b6f8-a0ff-4c30-90ca-43f6d32bf501\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5f48t"
Jul 24 19:36:06.444829 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:06.444723    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e636b6f8-a0ff-4c30-90ca-43f6d32bf501-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5f48t\" (UID: \"e636b6f8-a0ff-4c30-90ca-43f6d32bf501\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5f48t"
Jul 24 19:36:06.444829 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:06.444769    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e636b6f8-a0ff-4c30-90ca-43f6d32bf501-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5f48t\" (UID: \"e636b6f8-a0ff-4c30-90ca-43f6d32bf501\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5f48t"
Jul 24 19:36:06.444829 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:06.444794    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dnvv\" (UniqueName: \"kubernetes.io/projected/e636b6f8-a0ff-4c30-90ca-43f6d32bf501-kube-api-access-8dnvv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5f48t\" (UID: \"e636b6f8-a0ff-4c30-90ca-43f6d32bf501\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5f48t"
Jul 24 19:36:06.545280 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:06.545236    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e636b6f8-a0ff-4c30-90ca-43f6d32bf501-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5f48t\" (UID: \"e636b6f8-a0ff-4c30-90ca-43f6d32bf501\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5f48t"
Jul 24 19:36:06.545515 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:06.545289    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e636b6f8-a0ff-4c30-90ca-43f6d32bf501-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5f48t\" (UID: \"e636b6f8-a0ff-4c30-90ca-43f6d32bf501\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5f48t"
Jul 24 19:36:06.545515 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:06.545320    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e636b6f8-a0ff-4c30-90ca-43f6d32bf501-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5f48t\" (UID: \"e636b6f8-a0ff-4c30-90ca-43f6d32bf501\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5f48t"
Jul 24 19:36:06.545515 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:06.545343    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dnvv\" (UniqueName: \"kubernetes.io/projected/e636b6f8-a0ff-4c30-90ca-43f6d32bf501-kube-api-access-8dnvv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5f48t\" (UID: \"e636b6f8-a0ff-4c30-90ca-43f6d32bf501\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5f48t"
Jul 24 19:36:06.545515 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:06.545405    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e636b6f8-a0ff-4c30-90ca-43f6d32bf501-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5f48t\" (UID: \"e636b6f8-a0ff-4c30-90ca-43f6d32bf501\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5f48t"
Jul 24 19:36:06.545515 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:06.545442    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e636b6f8-a0ff-4c30-90ca-43f6d32bf501-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5f48t\" (UID: \"e636b6f8-a0ff-4c30-90ca-43f6d32bf501\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5f48t"
Jul 24 19:36:06.545821 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:06.545797    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e636b6f8-a0ff-4c30-90ca-43f6d32bf501-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5f48t\" (UID: \"e636b6f8-a0ff-4c30-90ca-43f6d32bf501\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5f48t"
Jul 24 19:36:06.545879 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:06.545837    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e636b6f8-a0ff-4c30-90ca-43f6d32bf501-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5f48t\" (UID: \"e636b6f8-a0ff-4c30-90ca-43f6d32bf501\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5f48t"
Jul 24 19:36:06.545921 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:06.545885    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e636b6f8-a0ff-4c30-90ca-43f6d32bf501-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5f48t\" (UID: \"e636b6f8-a0ff-4c30-90ca-43f6d32bf501\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5f48t"
Jul 24 19:36:06.547759 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:06.547740    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e636b6f8-a0ff-4c30-90ca-43f6d32bf501-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5f48t\" (UID: \"e636b6f8-a0ff-4c30-90ca-43f6d32bf501\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5f48t"
Jul 24 19:36:06.547849 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:06.547833    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e636b6f8-a0ff-4c30-90ca-43f6d32bf501-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5f48t\" (UID: \"e636b6f8-a0ff-4c30-90ca-43f6d32bf501\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5f48t"
Jul 24 19:36:06.555953 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:06.555930    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dnvv\" (UniqueName: \"kubernetes.io/projected/e636b6f8-a0ff-4c30-90ca-43f6d32bf501-kube-api-access-8dnvv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5f48t\" (UID: \"e636b6f8-a0ff-4c30-90ca-43f6d32bf501\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5f48t"
Jul 24 19:36:06.680931 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:06.680833    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5f48t"
Jul 24 19:36:06.815195 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:06.815124    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5f48t"]
Jul 24 19:36:06.817368 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:36:06.817344    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode636b6f8_a0ff_4c30_90ca_43f6d32bf501.slice/crio-273807ac56721a2d9176810c3240d6d7f005ad970bb42947910642c5b38c3eae WatchSource:0}: Error finding container 273807ac56721a2d9176810c3240d6d7f005ad970bb42947910642c5b38c3eae: Status 404 returned error can't find the container with id 273807ac56721a2d9176810c3240d6d7f005ad970bb42947910642c5b38c3eae
Jul 24 19:36:07.605357 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:07.605320    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5f48t" event={"ID":"e636b6f8-a0ff-4c30-90ca-43f6d32bf501","Type":"ContainerStarted","Data":"273807ac56721a2d9176810c3240d6d7f005ad970bb42947910642c5b38c3eae"}
Jul 24 19:36:08.617854 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:08.617807    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5f48t" event={"ID":"e636b6f8-a0ff-4c30-90ca-43f6d32bf501","Type":"ContainerStarted","Data":"1006227fcf8e4655d2d4463620f48816310cb302683099f2977613253ed5ed58"}
Jul 24 19:36:08.660982 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:08.660924    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5f48t" podStartSLOduration=1.6214190290000001 podStartE2EDuration="2.660906721s" totalImagesPullingTime="1.039487692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:36:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:36:08.660261124 +0000 UTC m=+557.178881167" watchObservedRunningTime="2026-07-24 19:36:08.660906721 +0000 UTC m=+557.179526762"
Jul 24 19:36:16.681862 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:16.681823    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5f48t"
Jul 24 19:36:16.682289 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:16.681910    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5f48t"
Jul 24 19:36:16.694271 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:16.694241    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5f48t"
Jul 24 19:36:17.668109 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:17.668082    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5f48t"
Jul 24 19:36:34.899716 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:34.899680    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-68pmw"]
Jul 24 19:36:34.906457 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:34.906432    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-68pmw"
Jul 24 19:36:34.909870 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:34.909853    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 24 19:36:34.915992 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:34.915973    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-68pmw"]
Jul 24 19:36:34.993906 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:34.993876    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a46ed62a-7ba9-4e14-9cd0-b1c93b56d18c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-68pmw\" (UID: \"a46ed62a-7ba9-4e14-9cd0-b1c93b56d18c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-68pmw"
Jul 24 19:36:34.994072 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:34.993925    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a46ed62a-7ba9-4e14-9cd0-b1c93b56d18c-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-68pmw\" (UID: \"a46ed62a-7ba9-4e14-9cd0-b1c93b56d18c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-68pmw"
Jul 24 19:36:34.994072 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:34.993955    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjpt2\" (UniqueName: \"kubernetes.io/projected/a46ed62a-7ba9-4e14-9cd0-b1c93b56d18c-kube-api-access-bjpt2\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-68pmw\" (UID: \"a46ed62a-7ba9-4e14-9cd0-b1c93b56d18c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-68pmw"
Jul 24 19:36:34.994072 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:34.994002    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a46ed62a-7ba9-4e14-9cd0-b1c93b56d18c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-68pmw\" (UID: \"a46ed62a-7ba9-4e14-9cd0-b1c93b56d18c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-68pmw"
Jul 24 19:36:34.994181 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:34.994076    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a46ed62a-7ba9-4e14-9cd0-b1c93b56d18c-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-68pmw\" (UID: \"a46ed62a-7ba9-4e14-9cd0-b1c93b56d18c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-68pmw"
Jul 24 19:36:34.994181 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:34.994102    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a46ed62a-7ba9-4e14-9cd0-b1c93b56d18c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-68pmw\" (UID: \"a46ed62a-7ba9-4e14-9cd0-b1c93b56d18c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-68pmw"
Jul 24 19:36:35.095467 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:35.095435    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a46ed62a-7ba9-4e14-9cd0-b1c93b56d18c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-68pmw\" (UID: \"a46ed62a-7ba9-4e14-9cd0-b1c93b56d18c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-68pmw"
Jul 24 19:36:35.095658 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:35.095515    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a46ed62a-7ba9-4e14-9cd0-b1c93b56d18c-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-68pmw\" (UID: \"a46ed62a-7ba9-4e14-9cd0-b1c93b56d18c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-68pmw"
Jul 24 19:36:35.095658 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:35.095534    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a46ed62a-7ba9-4e14-9cd0-b1c93b56d18c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-68pmw\" (UID: \"a46ed62a-7ba9-4e14-9cd0-b1c93b56d18c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-68pmw"
Jul 24 19:36:35.095658 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:35.095569    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a46ed62a-7ba9-4e14-9cd0-b1c93b56d18c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-68pmw\" (UID: \"a46ed62a-7ba9-4e14-9cd0-b1c93b56d18c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-68pmw"
Jul 24 19:36:35.095658 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:35.095605    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a46ed62a-7ba9-4e14-9cd0-b1c93b56d18c-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-68pmw\" (UID: \"a46ed62a-7ba9-4e14-9cd0-b1c93b56d18c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-68pmw"
Jul 24 19:36:35.095829 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:35.095746    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjpt2\" (UniqueName: \"kubernetes.io/projected/a46ed62a-7ba9-4e14-9cd0-b1c93b56d18c-kube-api-access-bjpt2\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-68pmw\" (UID: \"a46ed62a-7ba9-4e14-9cd0-b1c93b56d18c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-68pmw"
Jul 24 19:36:35.096002 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:35.095971    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a46ed62a-7ba9-4e14-9cd0-b1c93b56d18c-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-68pmw\" (UID: \"a46ed62a-7ba9-4e14-9cd0-b1c93b56d18c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-68pmw"
Jul 24 19:36:35.096002 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:35.095993    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a46ed62a-7ba9-4e14-9cd0-b1c93b56d18c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-68pmw\" (UID: \"a46ed62a-7ba9-4e14-9cd0-b1c93b56d18c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-68pmw"
Jul 24 19:36:35.096160 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:35.096035    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a46ed62a-7ba9-4e14-9cd0-b1c93b56d18c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-68pmw\" (UID: \"a46ed62a-7ba9-4e14-9cd0-b1c93b56d18c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-68pmw"
Jul 24 19:36:35.098522 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:35.098497    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a46ed62a-7ba9-4e14-9cd0-b1c93b56d18c-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-68pmw\" (UID: \"a46ed62a-7ba9-4e14-9cd0-b1c93b56d18c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-68pmw"
Jul 24 19:36:35.098751 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:35.098736    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a46ed62a-7ba9-4e14-9cd0-b1c93b56d18c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-68pmw\" (UID: \"a46ed62a-7ba9-4e14-9cd0-b1c93b56d18c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-68pmw"
Jul 24 19:36:35.104606 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:35.104590    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjpt2\" (UniqueName: \"kubernetes.io/projected/a46ed62a-7ba9-4e14-9cd0-b1c93b56d18c-kube-api-access-bjpt2\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-68pmw\" (UID: \"a46ed62a-7ba9-4e14-9cd0-b1c93b56d18c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-68pmw"
Jul 24 19:36:35.215467 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:35.215388    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-68pmw"
Jul 24 19:36:35.348222 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:35.348171    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-68pmw"]
Jul 24 19:36:35.350404 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:36:35.350370    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda46ed62a_7ba9_4e14_9cd0_b1c93b56d18c.slice/crio-6b3292dfbd6d8451602cae0e74cea3726861d238409e01269fc565257d0a1f76 WatchSource:0}: Error finding container 6b3292dfbd6d8451602cae0e74cea3726861d238409e01269fc565257d0a1f76: Status 404 returned error can't find the container with id 6b3292dfbd6d8451602cae0e74cea3726861d238409e01269fc565257d0a1f76
Jul 24 19:36:35.737780 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:35.737751    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-68pmw" event={"ID":"a46ed62a-7ba9-4e14-9cd0-b1c93b56d18c","Type":"ContainerStarted","Data":"05f8058c099f79a85faf0926f7125ec7b66b5077e6f879a4aef78a14627c6782"}
Jul 24 19:36:35.737949 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:35.737788    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-68pmw" event={"ID":"a46ed62a-7ba9-4e14-9cd0-b1c93b56d18c","Type":"ContainerStarted","Data":"6b3292dfbd6d8451602cae0e74cea3726861d238409e01269fc565257d0a1f76"}
Jul 24 19:36:35.757291 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:35.757240    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-68pmw" podStartSLOduration=1.560635709 podStartE2EDuration="1.757225552s" totalImagesPullingTime="196.589843ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:36:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:36:35.75694985 +0000 UTC m=+584.275569892" watchObservedRunningTime="2026-07-24 19:36:35.757225552 +0000 UTC m=+584.275845592"
Jul 24 19:36:45.216418 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:45.216377    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-68pmw"
Jul 24 19:36:45.216937 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:45.216436    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-68pmw"
Jul 24 19:36:45.229023 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:45.228996    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-68pmw"
Jul 24 19:36:45.799715 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:45.799684    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-68pmw"
Jul 24 19:36:51.913033 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:51.913001    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d87bq_72c2265c-f7f6-462a-bf46-eda3f35de953/ovn-acl-logging/0.log"
Jul 24 19:36:51.914548 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:36:51.914525    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d87bq_72c2265c-f7f6-462a-bf46-eda3f35de953/ovn-acl-logging/0.log"
Jul 24 19:37:33.521944 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:37:33.521914    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-69fb4b8ffc-l4szx"]
Jul 24 19:37:33.525077 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:37:33.525063    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69fb4b8ffc-l4szx"
Jul 24 19:37:33.533738 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:37:33.533715    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-69fb4b8ffc-l4szx"]
Jul 24 19:37:33.719841 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:37:33.719806    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7799w\" (UniqueName: \"kubernetes.io/projected/fdf08bda-2b38-49ca-8e61-4d48246cdc4d-kube-api-access-7799w\") pod \"authorino-69fb4b8ffc-l4szx\" (UID: \"fdf08bda-2b38-49ca-8e61-4d48246cdc4d\") " pod="kuadrant-system/authorino-69fb4b8ffc-l4szx"
Jul 24 19:37:33.720008 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:37:33.719883    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fdf08bda-2b38-49ca-8e61-4d48246cdc4d-tls-cert\") pod \"authorino-69fb4b8ffc-l4szx\" (UID: \"fdf08bda-2b38-49ca-8e61-4d48246cdc4d\") " pod="kuadrant-system/authorino-69fb4b8ffc-l4szx"
Jul 24 19:37:33.821433 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:37:33.821344    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7799w\" (UniqueName: \"kubernetes.io/projected/fdf08bda-2b38-49ca-8e61-4d48246cdc4d-kube-api-access-7799w\") pod \"authorino-69fb4b8ffc-l4szx\" (UID: \"fdf08bda-2b38-49ca-8e61-4d48246cdc4d\") " pod="kuadrant-system/authorino-69fb4b8ffc-l4szx"
Jul 24 19:37:33.821634 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:37:33.821465    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fdf08bda-2b38-49ca-8e61-4d48246cdc4d-tls-cert\") pod \"authorino-69fb4b8ffc-l4szx\" (UID: \"fdf08bda-2b38-49ca-8e61-4d48246cdc4d\") " pod="kuadrant-system/authorino-69fb4b8ffc-l4szx"
Jul 24 19:37:33.824399 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:37:33.824377    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fdf08bda-2b38-49ca-8e61-4d48246cdc4d-tls-cert\") pod \"authorino-69fb4b8ffc-l4szx\" (UID: \"fdf08bda-2b38-49ca-8e61-4d48246cdc4d\") " pod="kuadrant-system/authorino-69fb4b8ffc-l4szx"
Jul 24 19:37:33.830474 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:37:33.830438    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7799w\" (UniqueName: \"kubernetes.io/projected/fdf08bda-2b38-49ca-8e61-4d48246cdc4d-kube-api-access-7799w\") pod \"authorino-69fb4b8ffc-l4szx\" (UID: \"fdf08bda-2b38-49ca-8e61-4d48246cdc4d\") " pod="kuadrant-system/authorino-69fb4b8ffc-l4szx"
Jul 24 19:37:33.835144 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:37:33.835117    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69fb4b8ffc-l4szx"
Jul 24 19:37:33.965562 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:37:33.965539    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-69fb4b8ffc-l4szx"]
Jul 24 19:37:33.968047 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:37:33.968016    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfdf08bda_2b38_49ca_8e61_4d48246cdc4d.slice/crio-7a443ae88cb173b11c25627639670602324c6fa7bab17398a67e75343a3b5b57 WatchSource:0}: Error finding container 7a443ae88cb173b11c25627639670602324c6fa7bab17398a67e75343a3b5b57: Status 404 returned error can't find the container with id 7a443ae88cb173b11c25627639670602324c6fa7bab17398a67e75343a3b5b57
Jul 24 19:37:33.995921 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:37:33.995896    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69fb4b8ffc-l4szx" event={"ID":"fdf08bda-2b38-49ca-8e61-4d48246cdc4d","Type":"ContainerStarted","Data":"7a443ae88cb173b11c25627639670602324c6fa7bab17398a67e75343a3b5b57"}
Jul 24 19:37:35.003823 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:37:35.003783    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69fb4b8ffc-l4szx" event={"ID":"fdf08bda-2b38-49ca-8e61-4d48246cdc4d","Type":"ContainerStarted","Data":"44b9da1dcd875b4c75e828db9b19ad3daae6ce317445b991ab21f0ef0f7f334f"}
Jul 24 19:37:35.021663 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:37:35.021604    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-69fb4b8ffc-l4szx" podStartSLOduration=1.554371242 podStartE2EDuration="2.021583671s" totalImagesPullingTime="467.212429ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:37:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:37:35.019508637 +0000 UTC m=+643.538128676" watchObservedRunningTime="2026-07-24 19:37:35.021583671 +0000 UTC m=+643.540203713"
Jul 24 19:37:35.062288 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:37:35.062247    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-89f54dbd4-kwccn"]
Jul 24 19:37:35.062475 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:37:35.062453    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-89f54dbd4-kwccn" podUID="5a2e9855-b9b7-4102-a0c7-517c24b0c631" containerName="authorino" containerID="cri-o://dfd5632067216c4f102a3027e507de814af54d2dcb3333d0ae085be904b35994" gracePeriod=30
Jul 24 19:37:35.341170 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:37:35.341136    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-89f54dbd4-kwccn"
Jul 24 19:37:35.435062 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:37:35.435034    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5a2e9855-b9b7-4102-a0c7-517c24b0c631-tls-cert\") pod \"5a2e9855-b9b7-4102-a0c7-517c24b0c631\" (UID: \"5a2e9855-b9b7-4102-a0c7-517c24b0c631\") "
Jul 24 19:37:35.435248 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:37:35.435073    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wc4ds\" (UniqueName: \"kubernetes.io/projected/5a2e9855-b9b7-4102-a0c7-517c24b0c631-kube-api-access-wc4ds\") pod \"5a2e9855-b9b7-4102-a0c7-517c24b0c631\" (UID: \"5a2e9855-b9b7-4102-a0c7-517c24b0c631\") "
Jul 24 19:37:35.437573 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:37:35.437532    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a2e9855-b9b7-4102-a0c7-517c24b0c631-kube-api-access-wc4ds" (OuterVolumeSpecName: "kube-api-access-wc4ds") pod "5a2e9855-b9b7-4102-a0c7-517c24b0c631" (UID: "5a2e9855-b9b7-4102-a0c7-517c24b0c631"). InnerVolumeSpecName "kube-api-access-wc4ds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:37:35.446970 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:37:35.446945    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a2e9855-b9b7-4102-a0c7-517c24b0c631-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "5a2e9855-b9b7-4102-a0c7-517c24b0c631" (UID: "5a2e9855-b9b7-4102-a0c7-517c24b0c631"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:37:35.536451 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:37:35.536405    2567 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5a2e9855-b9b7-4102-a0c7-517c24b0c631-tls-cert\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:37:35.536451 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:37:35.536448    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wc4ds\" (UniqueName: \"kubernetes.io/projected/5a2e9855-b9b7-4102-a0c7-517c24b0c631-kube-api-access-wc4ds\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:37:36.010743 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:37:36.010711    2567 generic.go:356] "Generic (PLEG): container finished" podID="5a2e9855-b9b7-4102-a0c7-517c24b0c631" containerID="dfd5632067216c4f102a3027e507de814af54d2dcb3333d0ae085be904b35994" exitCode=0
Jul 24 19:37:36.011213 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:37:36.010750    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-89f54dbd4-kwccn" event={"ID":"5a2e9855-b9b7-4102-a0c7-517c24b0c631","Type":"ContainerDied","Data":"dfd5632067216c4f102a3027e507de814af54d2dcb3333d0ae085be904b35994"}
Jul 24 19:37:36.011213 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:37:36.010768    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-89f54dbd4-kwccn"
Jul 24 19:37:36.011213 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:37:36.010800    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-89f54dbd4-kwccn" event={"ID":"5a2e9855-b9b7-4102-a0c7-517c24b0c631","Type":"ContainerDied","Data":"166bd3785a732590527792de9512654f37e3cb954eaeeca9bd4036fb369ac754"}
Jul 24 19:37:36.011213 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:37:36.010825    2567 scope.go:117] "RemoveContainer" containerID="dfd5632067216c4f102a3027e507de814af54d2dcb3333d0ae085be904b35994"
Jul 24 19:37:36.021331 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:37:36.021315    2567 scope.go:117] "RemoveContainer" containerID="dfd5632067216c4f102a3027e507de814af54d2dcb3333d0ae085be904b35994"
Jul 24 19:37:36.021652 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:37:36.021631    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfd5632067216c4f102a3027e507de814af54d2dcb3333d0ae085be904b35994\": container with ID starting with dfd5632067216c4f102a3027e507de814af54d2dcb3333d0ae085be904b35994 not found: ID does not exist" containerID="dfd5632067216c4f102a3027e507de814af54d2dcb3333d0ae085be904b35994"
Jul 24 19:37:36.021751 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:37:36.021662    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfd5632067216c4f102a3027e507de814af54d2dcb3333d0ae085be904b35994"} err="failed to get container status \"dfd5632067216c4f102a3027e507de814af54d2dcb3333d0ae085be904b35994\": rpc error: code = NotFound desc = could not find container \"dfd5632067216c4f102a3027e507de814af54d2dcb3333d0ae085be904b35994\": container with ID starting with dfd5632067216c4f102a3027e507de814af54d2dcb3333d0ae085be904b35994 not found: ID does not exist"
Jul 24 19:37:36.031689 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:37:36.031665    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-89f54dbd4-kwccn"]
Jul 24 19:37:36.035553 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:37:36.035530    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-89f54dbd4-kwccn"]
Jul 24 19:37:36.071636 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:37:36.071610    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a2e9855-b9b7-4102-a0c7-517c24b0c631" path="/var/lib/kubelet/pods/5a2e9855-b9b7-4102-a0c7-517c24b0c631/volumes"
Jul 24 19:39:23.281103 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:23.281068    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-58f4c4bc9c-rxsvk"]
Jul 24 19:39:23.281616 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:23.281402    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a2e9855-b9b7-4102-a0c7-517c24b0c631" containerName="authorino"
Jul 24 19:39:23.281616 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:23.281413    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a2e9855-b9b7-4102-a0c7-517c24b0c631" containerName="authorino"
Jul 24 19:39:23.281616 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:23.281474    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a2e9855-b9b7-4102-a0c7-517c24b0c631" containerName="authorino"
Jul 24 19:39:23.284327 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:23.284313    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58f4c4bc9c-rxsvk"
Jul 24 19:39:23.287611 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:23.287587    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-zsz96\""
Jul 24 19:39:23.287740 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:23.287589    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 24 19:39:23.287740 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:23.287596    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 24 19:39:23.292926 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:23.292902    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58f4c4bc9c-rxsvk"]
Jul 24 19:39:23.399353 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:23.399303    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/192e9072-e864-430f-a650-dc42f1f84263-webhook-cert\") pod \"maas-controller-58f4c4bc9c-rxsvk\" (UID: \"192e9072-e864-430f-a650-dc42f1f84263\") " pod="opendatahub/maas-controller-58f4c4bc9c-rxsvk"
Jul 24 19:39:23.399593 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:23.399469    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4cmz\" (UniqueName: \"kubernetes.io/projected/192e9072-e864-430f-a650-dc42f1f84263-kube-api-access-d4cmz\") pod \"maas-controller-58f4c4bc9c-rxsvk\" (UID: \"192e9072-e864-430f-a650-dc42f1f84263\") " pod="opendatahub/maas-controller-58f4c4bc9c-rxsvk"
Jul 24 19:39:23.500225 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:23.500196    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4cmz\" (UniqueName: \"kubernetes.io/projected/192e9072-e864-430f-a650-dc42f1f84263-kube-api-access-d4cmz\") pod \"maas-controller-58f4c4bc9c-rxsvk\" (UID: \"192e9072-e864-430f-a650-dc42f1f84263\") " pod="opendatahub/maas-controller-58f4c4bc9c-rxsvk"
Jul 24 19:39:23.500395 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:23.500245    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/192e9072-e864-430f-a650-dc42f1f84263-webhook-cert\") pod \"maas-controller-58f4c4bc9c-rxsvk\" (UID: \"192e9072-e864-430f-a650-dc42f1f84263\") " pod="opendatahub/maas-controller-58f4c4bc9c-rxsvk"
Jul 24 19:39:23.502800 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:23.502777    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/192e9072-e864-430f-a650-dc42f1f84263-webhook-cert\") pod \"maas-controller-58f4c4bc9c-rxsvk\" (UID: \"192e9072-e864-430f-a650-dc42f1f84263\") " pod="opendatahub/maas-controller-58f4c4bc9c-rxsvk"
Jul 24 19:39:23.517929 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:23.517905    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4cmz\" (UniqueName: \"kubernetes.io/projected/192e9072-e864-430f-a650-dc42f1f84263-kube-api-access-d4cmz\") pod \"maas-controller-58f4c4bc9c-rxsvk\" (UID: \"192e9072-e864-430f-a650-dc42f1f84263\") " pod="opendatahub/maas-controller-58f4c4bc9c-rxsvk"
Jul 24 19:39:23.595024 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:23.594940    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58f4c4bc9c-rxsvk"
Jul 24 19:39:23.730755 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:23.730724    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58f4c4bc9c-rxsvk"]
Jul 24 19:39:23.733805 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:39:23.733777    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod192e9072_e864_430f_a650_dc42f1f84263.slice/crio-8277819f9fb2f4aeeada77c8cf5cb886e330ed3ad30b653c433fc2b43886ef20 WatchSource:0}: Error finding container 8277819f9fb2f4aeeada77c8cf5cb886e330ed3ad30b653c433fc2b43886ef20: Status 404 returned error can't find the container with id 8277819f9fb2f4aeeada77c8cf5cb886e330ed3ad30b653c433fc2b43886ef20
Jul 24 19:39:23.735415 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:23.735396    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 19:39:24.499675 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:24.499635    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58f4c4bc9c-rxsvk" event={"ID":"192e9072-e864-430f-a650-dc42f1f84263","Type":"ContainerStarted","Data":"8277819f9fb2f4aeeada77c8cf5cb886e330ed3ad30b653c433fc2b43886ef20"}
Jul 24 19:39:26.510598 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:26.510568    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58f4c4bc9c-rxsvk" event={"ID":"192e9072-e864-430f-a650-dc42f1f84263","Type":"ContainerStarted","Data":"f27713edb984e535e35250607142f1154b6df80b9c51227263a8a11eabe0e2d2"}
Jul 24 19:39:26.511038 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:26.510636    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-58f4c4bc9c-rxsvk"
Jul 24 19:39:26.528175 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:26.528130    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-58f4c4bc9c-rxsvk" podStartSLOduration=1.287940384 podStartE2EDuration="3.528114928s" totalImagesPullingTime="2.240174544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:39:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:39:26.526262843 +0000 UTC m=+755.044882884" watchObservedRunningTime="2026-07-24 19:39:26.528114928 +0000 UTC m=+755.046734968"
Jul 24 19:39:37.518039 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:37.518003    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-58f4c4bc9c-rxsvk"
Jul 24 19:39:42.189222 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:42.189187    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-58f4c4bc9c-rxsvk"]
Jul 24 19:39:42.189671 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:42.189358    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-58f4c4bc9c-rxsvk" podUID="192e9072-e864-430f-a650-dc42f1f84263" containerName="manager" containerID="cri-o://f27713edb984e535e35250607142f1154b6df80b9c51227263a8a11eabe0e2d2" gracePeriod=30
Jul 24 19:39:42.436309 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:42.436285    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58f4c4bc9c-rxsvk"
Jul 24 19:39:42.570041 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:42.569947    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/192e9072-e864-430f-a650-dc42f1f84263-webhook-cert\") pod \"192e9072-e864-430f-a650-dc42f1f84263\" (UID: \"192e9072-e864-430f-a650-dc42f1f84263\") "
Jul 24 19:39:42.570041 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:42.570004    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4cmz\" (UniqueName: \"kubernetes.io/projected/192e9072-e864-430f-a650-dc42f1f84263-kube-api-access-d4cmz\") pod \"192e9072-e864-430f-a650-dc42f1f84263\" (UID: \"192e9072-e864-430f-a650-dc42f1f84263\") "
Jul 24 19:39:42.572322 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:42.572295    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/192e9072-e864-430f-a650-dc42f1f84263-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "192e9072-e864-430f-a650-dc42f1f84263" (UID: "192e9072-e864-430f-a650-dc42f1f84263"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:39:42.572440 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:42.572338    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/192e9072-e864-430f-a650-dc42f1f84263-kube-api-access-d4cmz" (OuterVolumeSpecName: "kube-api-access-d4cmz") pod "192e9072-e864-430f-a650-dc42f1f84263" (UID: "192e9072-e864-430f-a650-dc42f1f84263"). InnerVolumeSpecName "kube-api-access-d4cmz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:39:42.587160 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:42.587135    2567 generic.go:356] "Generic (PLEG): container finished" podID="192e9072-e864-430f-a650-dc42f1f84263" containerID="f27713edb984e535e35250607142f1154b6df80b9c51227263a8a11eabe0e2d2" exitCode=0
Jul 24 19:39:42.587271 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:42.587173    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58f4c4bc9c-rxsvk"
Jul 24 19:39:42.587271 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:42.587217    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58f4c4bc9c-rxsvk" event={"ID":"192e9072-e864-430f-a650-dc42f1f84263","Type":"ContainerDied","Data":"f27713edb984e535e35250607142f1154b6df80b9c51227263a8a11eabe0e2d2"}
Jul 24 19:39:42.587271 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:42.587269    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58f4c4bc9c-rxsvk" event={"ID":"192e9072-e864-430f-a650-dc42f1f84263","Type":"ContainerDied","Data":"8277819f9fb2f4aeeada77c8cf5cb886e330ed3ad30b653c433fc2b43886ef20"}
Jul 24 19:39:42.587381 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:42.587291    2567 scope.go:117] "RemoveContainer" containerID="f27713edb984e535e35250607142f1154b6df80b9c51227263a8a11eabe0e2d2"
Jul 24 19:39:42.596589 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:42.596574    2567 scope.go:117] "RemoveContainer" containerID="f27713edb984e535e35250607142f1154b6df80b9c51227263a8a11eabe0e2d2"
Jul 24 19:39:42.596838 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:39:42.596821    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f27713edb984e535e35250607142f1154b6df80b9c51227263a8a11eabe0e2d2\": container with ID starting with f27713edb984e535e35250607142f1154b6df80b9c51227263a8a11eabe0e2d2 not found: ID does not exist" containerID="f27713edb984e535e35250607142f1154b6df80b9c51227263a8a11eabe0e2d2"
Jul 24 19:39:42.596893 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:42.596847    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f27713edb984e535e35250607142f1154b6df80b9c51227263a8a11eabe0e2d2"} err="failed to get container status \"f27713edb984e535e35250607142f1154b6df80b9c51227263a8a11eabe0e2d2\": rpc error: code = NotFound desc = could not find container \"f27713edb984e535e35250607142f1154b6df80b9c51227263a8a11eabe0e2d2\": container with ID starting with f27713edb984e535e35250607142f1154b6df80b9c51227263a8a11eabe0e2d2 not found: ID does not exist"
Jul 24 19:39:42.614249 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:42.614217    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-58f4c4bc9c-rxsvk"]
Jul 24 19:39:42.620212 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:42.620185    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-58f4c4bc9c-rxsvk"]
Jul 24 19:39:42.670886 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:42.670857    2567 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/192e9072-e864-430f-a650-dc42f1f84263-webhook-cert\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:39:42.670886 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:42.670883    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4cmz\" (UniqueName: \"kubernetes.io/projected/192e9072-e864-430f-a650-dc42f1f84263-kube-api-access-d4cmz\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:39:43.407839 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:43.407810    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-58f4c4bc9c-rb9qc"]
Jul 24 19:39:43.408176 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:43.408161    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="192e9072-e864-430f-a650-dc42f1f84263" containerName="manager"
Jul 24 19:39:43.408176 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:43.408171    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="192e9072-e864-430f-a650-dc42f1f84263" containerName="manager"
Jul 24 19:39:43.408274 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:43.408238    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="192e9072-e864-430f-a650-dc42f1f84263" containerName="manager"
Jul 24 19:39:43.412463 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:43.412444    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58f4c4bc9c-rb9qc"
Jul 24 19:39:43.415805 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:43.415786    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 24 19:39:43.415928 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:43.415805    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-zsz96\""
Jul 24 19:39:43.415928 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:43.415823    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 24 19:39:43.419161 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:43.419138    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58f4c4bc9c-rb9qc"]
Jul 24 19:39:43.580979 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:43.580937    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-np9qs\" (UniqueName: \"kubernetes.io/projected/4b22da0d-d471-44d6-826d-b1dab6226a54-kube-api-access-np9qs\") pod \"maas-controller-58f4c4bc9c-rb9qc\" (UID: \"4b22da0d-d471-44d6-826d-b1dab6226a54\") " pod="opendatahub/maas-controller-58f4c4bc9c-rb9qc"
Jul 24 19:39:43.580979 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:43.580984    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4b22da0d-d471-44d6-826d-b1dab6226a54-webhook-cert\") pod \"maas-controller-58f4c4bc9c-rb9qc\" (UID: \"4b22da0d-d471-44d6-826d-b1dab6226a54\") " pod="opendatahub/maas-controller-58f4c4bc9c-rb9qc"
Jul 24 19:39:43.681958 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:43.681866    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-np9qs\" (UniqueName: \"kubernetes.io/projected/4b22da0d-d471-44d6-826d-b1dab6226a54-kube-api-access-np9qs\") pod \"maas-controller-58f4c4bc9c-rb9qc\" (UID: \"4b22da0d-d471-44d6-826d-b1dab6226a54\") " pod="opendatahub/maas-controller-58f4c4bc9c-rb9qc"
Jul 24 19:39:43.681958 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:43.681911    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4b22da0d-d471-44d6-826d-b1dab6226a54-webhook-cert\") pod \"maas-controller-58f4c4bc9c-rb9qc\" (UID: \"4b22da0d-d471-44d6-826d-b1dab6226a54\") " pod="opendatahub/maas-controller-58f4c4bc9c-rb9qc"
Jul 24 19:39:43.684407 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:43.684383    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4b22da0d-d471-44d6-826d-b1dab6226a54-webhook-cert\") pod \"maas-controller-58f4c4bc9c-rb9qc\" (UID: \"4b22da0d-d471-44d6-826d-b1dab6226a54\") " pod="opendatahub/maas-controller-58f4c4bc9c-rb9qc"
Jul 24 19:39:43.690509 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:43.690461    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-np9qs\" (UniqueName: \"kubernetes.io/projected/4b22da0d-d471-44d6-826d-b1dab6226a54-kube-api-access-np9qs\") pod \"maas-controller-58f4c4bc9c-rb9qc\" (UID: \"4b22da0d-d471-44d6-826d-b1dab6226a54\") " pod="opendatahub/maas-controller-58f4c4bc9c-rb9qc"
Jul 24 19:39:43.723476 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:43.723432    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58f4c4bc9c-rb9qc"
Jul 24 19:39:43.859847 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:43.859806    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58f4c4bc9c-rb9qc"]
Jul 24 19:39:43.862049 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:39:43.862024    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b22da0d_d471_44d6_826d_b1dab6226a54.slice/crio-59343340e562dc880106d1f47a9b815fa9e2f86962e01711fe2852a3968289e7 WatchSource:0}: Error finding container 59343340e562dc880106d1f47a9b815fa9e2f86962e01711fe2852a3968289e7: Status 404 returned error can't find the container with id 59343340e562dc880106d1f47a9b815fa9e2f86962e01711fe2852a3968289e7
Jul 24 19:39:44.071499 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:44.071411    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="192e9072-e864-430f-a650-dc42f1f84263" path="/var/lib/kubelet/pods/192e9072-e864-430f-a650-dc42f1f84263/volumes"
Jul 24 19:39:44.598241 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:44.598209    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58f4c4bc9c-rb9qc" event={"ID":"4b22da0d-d471-44d6-826d-b1dab6226a54","Type":"ContainerStarted","Data":"5f8cfc922e55b23eefdcdd9d89114d4b9f2900be76a0a79abfd3790e7acc5b25"}
Jul 24 19:39:44.598662 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:44.598259    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58f4c4bc9c-rb9qc" event={"ID":"4b22da0d-d471-44d6-826d-b1dab6226a54","Type":"ContainerStarted","Data":"59343340e562dc880106d1f47a9b815fa9e2f86962e01711fe2852a3968289e7"}
Jul 24 19:39:44.598662 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:44.598319    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-58f4c4bc9c-rb9qc"
Jul 24 19:39:44.617744 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:44.617699    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-58f4c4bc9c-rb9qc" podStartSLOduration=1.216638643 podStartE2EDuration="1.617682583s" totalImagesPullingTime="401.04394ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:39:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:39:44.61590044 +0000 UTC m=+773.134520481" watchObservedRunningTime="2026-07-24 19:39:44.617682583 +0000 UTC m=+773.136302624"
Jul 24 19:39:55.605122 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:39:55.605087    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-58f4c4bc9c-rb9qc"
Jul 24 19:41:51.948160 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:41:51.948071    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d87bq_72c2265c-f7f6-462a-bf46-eda3f35de953/ovn-acl-logging/0.log"
Jul 24 19:41:51.949509 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:41:51.949465    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d87bq_72c2265c-f7f6-462a-bf46-eda3f35de953/ovn-acl-logging/0.log"
Jul 24 19:44:23.072789 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:44:23.072756    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ptlqt"]
Jul 24 19:44:23.075493 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:44:23.072980    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ptlqt" podUID="9fbb6335-e1ac-4233-8767-b65d429b1d8b" containerName="manager" containerID="cri-o://8f561051e5e5338f27bc7a2f873abad21c899d472927f5637c39d90bc255f64a" gracePeriod=10
Jul 24 19:44:24.880897 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:44:24.880865    2567 generic.go:356] "Generic (PLEG): container finished" podID="9fbb6335-e1ac-4233-8767-b65d429b1d8b" containerID="8f561051e5e5338f27bc7a2f873abad21c899d472927f5637c39d90bc255f64a" exitCode=0
Jul 24 19:44:24.881253 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:44:24.880918    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ptlqt" event={"ID":"9fbb6335-e1ac-4233-8767-b65d429b1d8b","Type":"ContainerDied","Data":"8f561051e5e5338f27bc7a2f873abad21c899d472927f5637c39d90bc255f64a"}
Jul 24 19:44:25.244155 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:44:25.244134    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ptlqt"
Jul 24 19:44:25.325540 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:44:25.325508    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lgdrb\" (UniqueName: \"kubernetes.io/projected/9fbb6335-e1ac-4233-8767-b65d429b1d8b-kube-api-access-lgdrb\") pod \"9fbb6335-e1ac-4233-8767-b65d429b1d8b\" (UID: \"9fbb6335-e1ac-4233-8767-b65d429b1d8b\") "
Jul 24 19:44:25.325685 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:44:25.325567    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9fbb6335-e1ac-4233-8767-b65d429b1d8b-extensions-socket-volume\") pod \"9fbb6335-e1ac-4233-8767-b65d429b1d8b\" (UID: \"9fbb6335-e1ac-4233-8767-b65d429b1d8b\") "
Jul 24 19:44:25.325847 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:44:25.325826    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fbb6335-e1ac-4233-8767-b65d429b1d8b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9fbb6335-e1ac-4233-8767-b65d429b1d8b" (UID: "9fbb6335-e1ac-4233-8767-b65d429b1d8b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:44:25.327634 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:44:25.327608    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fbb6335-e1ac-4233-8767-b65d429b1d8b-kube-api-access-lgdrb" (OuterVolumeSpecName: "kube-api-access-lgdrb") pod "9fbb6335-e1ac-4233-8767-b65d429b1d8b" (UID: "9fbb6335-e1ac-4233-8767-b65d429b1d8b"). InnerVolumeSpecName "kube-api-access-lgdrb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:44:25.426270 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:44:25.426197    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lgdrb\" (UniqueName: \"kubernetes.io/projected/9fbb6335-e1ac-4233-8767-b65d429b1d8b-kube-api-access-lgdrb\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:44:25.426270 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:44:25.426222    2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9fbb6335-e1ac-4233-8767-b65d429b1d8b-extensions-socket-volume\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:44:25.887461 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:44:25.887436    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ptlqt"
Jul 24 19:44:25.887908 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:44:25.887475    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ptlqt" event={"ID":"9fbb6335-e1ac-4233-8767-b65d429b1d8b","Type":"ContainerDied","Data":"56fadaa6429eb4c4b08b7b1db7754d367ed6b785376119ff836d560ec996a539"}
Jul 24 19:44:25.887908 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:44:25.887562    2567 scope.go:117] "RemoveContainer" containerID="8f561051e5e5338f27bc7a2f873abad21c899d472927f5637c39d90bc255f64a"
Jul 24 19:44:25.908159 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:44:25.908137    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ptlqt"]
Jul 24 19:44:25.914428 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:44:25.914406    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ptlqt"]
Jul 24 19:44:26.071542 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:44:26.071454    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fbb6335-e1ac-4233-8767-b65d429b1d8b" path="/var/lib/kubelet/pods/9fbb6335-e1ac-4233-8767-b65d429b1d8b/volumes"
Jul 24 19:45:00.144940 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:45:00.144906    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748705-8tjvb"]
Jul 24 19:45:00.145394 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:45:00.145241    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fbb6335-e1ac-4233-8767-b65d429b1d8b" containerName="manager"
Jul 24 19:45:00.145394 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:45:00.145253    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fbb6335-e1ac-4233-8767-b65d429b1d8b" containerName="manager"
Jul 24 19:45:00.145394 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:45:00.145312    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fbb6335-e1ac-4233-8767-b65d429b1d8b" containerName="manager"
Jul 24 19:45:00.149306 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:45:00.149291    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748705-8tjvb"
Jul 24 19:45:00.151733 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:45:00.151715    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gqw4p\""
Jul 24 19:45:00.154975 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:45:00.154952    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748705-8tjvb"]
Jul 24 19:45:00.159980 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:45:00.159964    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748705-8tjvb"
Jul 24 19:45:00.289504 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:45:00.289465    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748705-8tjvb"]
Jul 24 19:45:00.292043 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:45:00.292011    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddeaafe47_87fb_44d6_ae9f_fa267668ebb3.slice/crio-087f5ab306887e06452fc785f98ce2a5659f4ce9eba6ca645859b943fe5552ea WatchSource:0}: Error finding container 087f5ab306887e06452fc785f98ce2a5659f4ce9eba6ca645859b943fe5552ea: Status 404 returned error can't find the container with id 087f5ab306887e06452fc785f98ce2a5659f4ce9eba6ca645859b943fe5552ea
Jul 24 19:45:00.293942 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:45:00.293926    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 19:45:01.036657 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:45:01.036626    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748705-8tjvb" event={"ID":"deaafe47-87fb-44d6-ae9f-fa267668ebb3","Type":"ContainerStarted","Data":"087f5ab306887e06452fc785f98ce2a5659f4ce9eba6ca645859b943fe5552ea"}
Jul 24 19:45:03.048629 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:45:03.048545    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748705-8tjvb" event={"ID":"deaafe47-87fb-44d6-ae9f-fa267668ebb3","Type":"ContainerStarted","Data":"b69b9a18056118266e94558dfb0a42ced740741c6e924bd7e2ec8ce01e0dd053"}
Jul 24 19:45:03.066359 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:45:03.066312    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748705-8tjvb" podStartSLOduration=0.619591412 podStartE2EDuration="3.06629941s" totalImagesPullingTime="2.446707998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:45:03.06418702 +0000 UTC m=+1091.582807063" watchObservedRunningTime="2026-07-24 19:45:03.06629941 +0000 UTC m=+1091.584919451"
Jul 24 19:45:04.056102 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:45:04.056015    2567 generic.go:356] "Generic (PLEG): container finished" podID="deaafe47-87fb-44d6-ae9f-fa267668ebb3" containerID="b69b9a18056118266e94558dfb0a42ced740741c6e924bd7e2ec8ce01e0dd053" exitCode=0
Jul 24 19:45:04.056102 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:45:04.056066    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748705-8tjvb" event={"ID":"deaafe47-87fb-44d6-ae9f-fa267668ebb3","Type":"ContainerDied","Data":"b69b9a18056118266e94558dfb0a42ced740741c6e924bd7e2ec8ce01e0dd053"}
Jul 24 19:45:05.186741 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:45:05.186719    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748705-8tjvb"
Jul 24 19:45:06.066373 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:45:06.066344    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748705-8tjvb"
Jul 24 19:45:06.070915 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:45:06.070886    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748705-8tjvb" event={"ID":"deaafe47-87fb-44d6-ae9f-fa267668ebb3","Type":"ContainerDied","Data":"087f5ab306887e06452fc785f98ce2a5659f4ce9eba6ca645859b943fe5552ea"}
Jul 24 19:45:06.071070 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:45:06.070925    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="087f5ab306887e06452fc785f98ce2a5659f4ce9eba6ca645859b943fe5552ea"
Jul 24 19:45:24.207268 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:45:24.207234    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mvq5p"]
Jul 24 19:45:24.207649 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:45:24.207589    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="deaafe47-87fb-44d6-ae9f-fa267668ebb3" containerName="cleanup"
Jul 24 19:45:24.207649 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:45:24.207604    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="deaafe47-87fb-44d6-ae9f-fa267668ebb3" containerName="cleanup"
Jul 24 19:45:24.207725 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:45:24.207666    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="deaafe47-87fb-44d6-ae9f-fa267668ebb3" containerName="cleanup"
Jul 24 19:45:24.215125 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:45:24.215097    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mvq5p"
Jul 24 19:45:24.217763 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:45:24.217741    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-twmhj\""
Jul 24 19:45:24.223925 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:45:24.223902    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mvq5p"]
Jul 24 19:45:24.339695 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:45:24.339665    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c41b55a-24fb-49f2-9cbf-48002b8acb9d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mvq5p\" (UID: \"6c41b55a-24fb-49f2-9cbf-48002b8acb9d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mvq5p"
Jul 24 19:45:24.339866 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:45:24.339728    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5k7x\" (UniqueName: \"kubernetes.io/projected/6c41b55a-24fb-49f2-9cbf-48002b8acb9d-kube-api-access-w5k7x\") pod \"kuadrant-operator-controller-manager-86878c769f-mvq5p\" (UID: \"6c41b55a-24fb-49f2-9cbf-48002b8acb9d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mvq5p"
Jul 24 19:45:24.440632 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:45:24.440590    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5k7x\" (UniqueName: \"kubernetes.io/projected/6c41b55a-24fb-49f2-9cbf-48002b8acb9d-kube-api-access-w5k7x\") pod \"kuadrant-operator-controller-manager-86878c769f-mvq5p\" (UID: \"6c41b55a-24fb-49f2-9cbf-48002b8acb9d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mvq5p"
Jul 24 19:45:24.440833 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:45:24.440667    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c41b55a-24fb-49f2-9cbf-48002b8acb9d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mvq5p\" (UID: \"6c41b55a-24fb-49f2-9cbf-48002b8acb9d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mvq5p"
Jul 24 19:45:24.441019 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:45:24.440999    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c41b55a-24fb-49f2-9cbf-48002b8acb9d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mvq5p\" (UID: \"6c41b55a-24fb-49f2-9cbf-48002b8acb9d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mvq5p"
Jul 24 19:45:24.449701 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:45:24.449678    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5k7x\" (UniqueName: \"kubernetes.io/projected/6c41b55a-24fb-49f2-9cbf-48002b8acb9d-kube-api-access-w5k7x\") pod \"kuadrant-operator-controller-manager-86878c769f-mvq5p\" (UID: \"6c41b55a-24fb-49f2-9cbf-48002b8acb9d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mvq5p"
Jul 24 19:45:24.526547 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:45:24.526451    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mvq5p"
Jul 24 19:45:24.672994 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:45:24.672962    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mvq5p"]
Jul 24 19:45:24.674662 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:45:24.674640    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c41b55a_24fb_49f2_9cbf_48002b8acb9d.slice/crio-e069fa96252c54d042501bd2f5ad3341666bdbbe56e72f8dd65e484a2ff0a863 WatchSource:0}: Error finding container e069fa96252c54d042501bd2f5ad3341666bdbbe56e72f8dd65e484a2ff0a863: Status 404 returned error can't find the container with id e069fa96252c54d042501bd2f5ad3341666bdbbe56e72f8dd65e484a2ff0a863
Jul 24 19:45:25.144741 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:45:25.144711    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mvq5p" event={"ID":"6c41b55a-24fb-49f2-9cbf-48002b8acb9d","Type":"ContainerStarted","Data":"9a1a317cc6649288161f24042c00251ef13a45f36f593a3893c64758564ef66d"}
Jul 24 19:45:25.144911 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:45:25.144759    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mvq5p" event={"ID":"6c41b55a-24fb-49f2-9cbf-48002b8acb9d","Type":"ContainerStarted","Data":"e069fa96252c54d042501bd2f5ad3341666bdbbe56e72f8dd65e484a2ff0a863"}
Jul 24 19:45:25.144911 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:45:25.144802    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mvq5p"
Jul 24 19:45:25.167825 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:45:25.167780    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mvq5p" podStartSLOduration=1.167763798 podStartE2EDuration="1.167763798s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:45:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:45:25.166628617 +0000 UTC m=+1113.685248660" watchObservedRunningTime="2026-07-24 19:45:25.167763798 +0000 UTC m=+1113.686383914"
Jul 24 19:45:36.151631 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:45:36.151601    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mvq5p"
Jul 24 19:46:51.976250 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:46:51.976220    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d87bq_72c2265c-f7f6-462a-bf46-eda3f35de953/ovn-acl-logging/0.log"
Jul 24 19:46:51.976811 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:46:51.976650    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d87bq_72c2265c-f7f6-462a-bf46-eda3f35de953/ovn-acl-logging/0.log"
Jul 24 19:48:02.099641 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:02.099562    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8"]
Jul 24 19:48:02.102947 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:02.102928    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8"
Jul 24 19:48:02.105370 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:02.105350    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-6807f397-kserve-self-signed-certs\""
Jul 24 19:48:02.117845 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:02.117824    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8"]
Jul 24 19:48:02.230332 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:02.230291    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b70bd233-c66d-41f1-91c1-dab5fcfd3722-model-cache\") pod \"e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8\" (UID: \"b70bd233-c66d-41f1-91c1-dab5fcfd3722\") " pod="llm/e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8"
Jul 24 19:48:02.230554 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:02.230348    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b70bd233-c66d-41f1-91c1-dab5fcfd3722-tmp-dir\") pod \"e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8\" (UID: \"b70bd233-c66d-41f1-91c1-dab5fcfd3722\") " pod="llm/e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8"
Jul 24 19:48:02.230633 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:02.230608    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b70bd233-c66d-41f1-91c1-dab5fcfd3722-tls-certs\") pod \"e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8\" (UID: \"b70bd233-c66d-41f1-91c1-dab5fcfd3722\") " pod="llm/e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8"
Jul 24 19:48:02.230692 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:02.230645    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc5mf\" (UniqueName: \"kubernetes.io/projected/b70bd233-c66d-41f1-91c1-dab5fcfd3722-kube-api-access-mc5mf\") pod \"e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8\" (UID: \"b70bd233-c66d-41f1-91c1-dab5fcfd3722\") " pod="llm/e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8"
Jul 24 19:48:02.230692 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:02.230674    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b70bd233-c66d-41f1-91c1-dab5fcfd3722-home\") pod \"e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8\" (UID: \"b70bd233-c66d-41f1-91c1-dab5fcfd3722\") " pod="llm/e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8"
Jul 24 19:48:02.231061 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:02.231033    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b70bd233-c66d-41f1-91c1-dab5fcfd3722-dshm\") pod \"e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8\" (UID: \"b70bd233-c66d-41f1-91c1-dab5fcfd3722\") " pod="llm/e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8"
Jul 24 19:48:02.331955 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:02.331921    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b70bd233-c66d-41f1-91c1-dab5fcfd3722-dshm\") pod \"e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8\" (UID: \"b70bd233-c66d-41f1-91c1-dab5fcfd3722\") " pod="llm/e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8"
Jul 24 19:48:02.331955 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:02.331960    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b70bd233-c66d-41f1-91c1-dab5fcfd3722-model-cache\") pod \"e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8\" (UID: \"b70bd233-c66d-41f1-91c1-dab5fcfd3722\") " pod="llm/e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8"
Jul 24 19:48:02.332142 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:02.331984    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b70bd233-c66d-41f1-91c1-dab5fcfd3722-tmp-dir\") pod \"e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8\" (UID: \"b70bd233-c66d-41f1-91c1-dab5fcfd3722\") " pod="llm/e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8"
Jul 24 19:48:02.332142 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:02.332060    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b70bd233-c66d-41f1-91c1-dab5fcfd3722-tls-certs\") pod \"e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8\" (UID: \"b70bd233-c66d-41f1-91c1-dab5fcfd3722\") " pod="llm/e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8"
Jul 24 19:48:02.332142 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:02.332088    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc5mf\" (UniqueName: \"kubernetes.io/projected/b70bd233-c66d-41f1-91c1-dab5fcfd3722-kube-api-access-mc5mf\") pod \"e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8\" (UID: \"b70bd233-c66d-41f1-91c1-dab5fcfd3722\") " pod="llm/e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8"
Jul 24 19:48:02.332142 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:02.332110    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b70bd233-c66d-41f1-91c1-dab5fcfd3722-home\") pod \"e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8\" (UID: \"b70bd233-c66d-41f1-91c1-dab5fcfd3722\") " pod="llm/e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8"
Jul 24 19:48:02.332457 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:02.332410    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b70bd233-c66d-41f1-91c1-dab5fcfd3722-tmp-dir\") pod \"e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8\" (UID: \"b70bd233-c66d-41f1-91c1-dab5fcfd3722\") " pod="llm/e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8"
Jul 24 19:48:02.332608 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:02.332468    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b70bd233-c66d-41f1-91c1-dab5fcfd3722-model-cache\") pod \"e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8\" (UID: \"b70bd233-c66d-41f1-91c1-dab5fcfd3722\") " pod="llm/e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8"
Jul 24 19:48:02.332608 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:02.332571    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b70bd233-c66d-41f1-91c1-dab5fcfd3722-home\") pod \"e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8\" (UID: \"b70bd233-c66d-41f1-91c1-dab5fcfd3722\") " pod="llm/e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8"
Jul 24 19:48:02.334390 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:02.334364    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b70bd233-c66d-41f1-91c1-dab5fcfd3722-dshm\") pod \"e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8\" (UID: \"b70bd233-c66d-41f1-91c1-dab5fcfd3722\") " pod="llm/e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8"
Jul 24 19:48:02.334933 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:02.334916    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b70bd233-c66d-41f1-91c1-dab5fcfd3722-tls-certs\") pod \"e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8\" (UID: \"b70bd233-c66d-41f1-91c1-dab5fcfd3722\") " pod="llm/e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8"
Jul 24 19:48:02.340856 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:02.340835    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc5mf\" (UniqueName: \"kubernetes.io/projected/b70bd233-c66d-41f1-91c1-dab5fcfd3722-kube-api-access-mc5mf\") pod \"e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8\" (UID: \"b70bd233-c66d-41f1-91c1-dab5fcfd3722\") " pod="llm/e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8"
Jul 24 19:48:02.412044 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:02.412018    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8"
Jul 24 19:48:02.546255 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:02.546229    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8"]
Jul 24 19:48:02.548095 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:48:02.548067    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb70bd233_c66d_41f1_91c1_dab5fcfd3722.slice/crio-3db89a8689cdfe2ba670b3864ce829ef04946729684a4db93b770b9a2034028b WatchSource:0}: Error finding container 3db89a8689cdfe2ba670b3864ce829ef04946729684a4db93b770b9a2034028b: Status 404 returned error can't find the container with id 3db89a8689cdfe2ba670b3864ce829ef04946729684a4db93b770b9a2034028b
Jul 24 19:48:02.872342 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:02.872312    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8" event={"ID":"b70bd233-c66d-41f1-91c1-dab5fcfd3722","Type":"ContainerStarted","Data":"ece960a4d223b35eca89a4bfde683ab1899df663b02e13ed273cd3aeb3e4d55c"}
Jul 24 19:48:02.872558 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:02.872351    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8" event={"ID":"b70bd233-c66d-41f1-91c1-dab5fcfd3722","Type":"ContainerStarted","Data":"3db89a8689cdfe2ba670b3864ce829ef04946729684a4db93b770b9a2034028b"}
Jul 24 19:48:02.889500 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:02.889440    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8" podStartSLOduration=0.889426667 podStartE2EDuration="889.426667ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:48:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:48:02.888568255 +0000 UTC m=+1271.407188291" watchObservedRunningTime="2026-07-24 19:48:02.889426667 +0000 UTC m=+1271.408046707"
Jul 24 19:48:12.413081 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:12.413050    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8"
Jul 24 19:48:12.413477 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:12.413095    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8"
Jul 24 19:48:12.425277 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:12.425253    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8"
Jul 24 19:48:12.935381 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:12.935348    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8"
Jul 24 19:48:13.591021 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:13.590987    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth"]
Jul 24 19:48:13.594796 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:13.594777    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth"
Jul 24 19:48:13.597372 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:13.597353    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-6807f397-kserve-self-signed-certs\""
Jul 24 19:48:13.604859 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:13.604837    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth"]
Jul 24 19:48:13.636562 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:13.636532    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0226a408-f9db-49d6-aac1-7ea1955b7b6b-home\") pod \"e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth\" (UID: \"0226a408-f9db-49d6-aac1-7ea1955b7b6b\") " pod="llm/e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth"
Jul 24 19:48:13.636688 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:13.636582    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0226a408-f9db-49d6-aac1-7ea1955b7b6b-model-cache\") pod \"e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth\" (UID: \"0226a408-f9db-49d6-aac1-7ea1955b7b6b\") " pod="llm/e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth"
Jul 24 19:48:13.636688 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:13.636620    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0226a408-f9db-49d6-aac1-7ea1955b7b6b-tmp-dir\") pod \"e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth\" (UID: \"0226a408-f9db-49d6-aac1-7ea1955b7b6b\") " pod="llm/e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth"
Jul 24 19:48:13.636805 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:13.636733    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0226a408-f9db-49d6-aac1-7ea1955b7b6b-dshm\") pod \"e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth\" (UID: \"0226a408-f9db-49d6-aac1-7ea1955b7b6b\") " pod="llm/e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth"
Jul 24 19:48:13.636805 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:13.636781    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0226a408-f9db-49d6-aac1-7ea1955b7b6b-tls-certs\") pod \"e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth\" (UID: \"0226a408-f9db-49d6-aac1-7ea1955b7b6b\") " pod="llm/e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth"
Jul 24 19:48:13.636902 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:13.636820    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f7lc\" (UniqueName: \"kubernetes.io/projected/0226a408-f9db-49d6-aac1-7ea1955b7b6b-kube-api-access-7f7lc\") pod \"e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth\" (UID: \"0226a408-f9db-49d6-aac1-7ea1955b7b6b\") " pod="llm/e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth"
Jul 24 19:48:13.738097 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:13.738064    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0226a408-f9db-49d6-aac1-7ea1955b7b6b-home\") pod \"e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth\" (UID: \"0226a408-f9db-49d6-aac1-7ea1955b7b6b\") " pod="llm/e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth"
Jul 24 19:48:13.738097 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:13.738104    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0226a408-f9db-49d6-aac1-7ea1955b7b6b-model-cache\") pod \"e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth\" (UID: \"0226a408-f9db-49d6-aac1-7ea1955b7b6b\") " pod="llm/e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth"
Jul 24 19:48:13.738286 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:13.738128    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0226a408-f9db-49d6-aac1-7ea1955b7b6b-tmp-dir\") pod \"e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth\" (UID: \"0226a408-f9db-49d6-aac1-7ea1955b7b6b\") " pod="llm/e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth"
Jul 24 19:48:13.738286 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:13.738211    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0226a408-f9db-49d6-aac1-7ea1955b7b6b-dshm\") pod \"e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth\" (UID: \"0226a408-f9db-49d6-aac1-7ea1955b7b6b\") " pod="llm/e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth"
Jul 24 19:48:13.738286 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:13.738241    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0226a408-f9db-49d6-aac1-7ea1955b7b6b-tls-certs\") pod \"e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth\" (UID: \"0226a408-f9db-49d6-aac1-7ea1955b7b6b\") " pod="llm/e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth"
Jul 24 19:48:13.738286 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:13.738262    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7f7lc\" (UniqueName: \"kubernetes.io/projected/0226a408-f9db-49d6-aac1-7ea1955b7b6b-kube-api-access-7f7lc\") pod \"e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth\" (UID: \"0226a408-f9db-49d6-aac1-7ea1955b7b6b\") " pod="llm/e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth"
Jul 24 19:48:13.738555 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:13.738534    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0226a408-f9db-49d6-aac1-7ea1955b7b6b-home\") pod \"e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth\" (UID: \"0226a408-f9db-49d6-aac1-7ea1955b7b6b\") " pod="llm/e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth"
Jul 24 19:48:13.738607 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:13.738589    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0226a408-f9db-49d6-aac1-7ea1955b7b6b-model-cache\") pod \"e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth\" (UID: \"0226a408-f9db-49d6-aac1-7ea1955b7b6b\") " pod="llm/e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth"
Jul 24 19:48:13.738654 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:13.738619    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0226a408-f9db-49d6-aac1-7ea1955b7b6b-tmp-dir\") pod \"e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth\" (UID: \"0226a408-f9db-49d6-aac1-7ea1955b7b6b\") " pod="llm/e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth"
Jul 24 19:48:13.740752 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:13.740724    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0226a408-f9db-49d6-aac1-7ea1955b7b6b-dshm\") pod \"e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth\" (UID: \"0226a408-f9db-49d6-aac1-7ea1955b7b6b\") " pod="llm/e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth"
Jul 24 19:48:13.740880 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:13.740818    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0226a408-f9db-49d6-aac1-7ea1955b7b6b-tls-certs\") pod \"e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth\" (UID: \"0226a408-f9db-49d6-aac1-7ea1955b7b6b\") " pod="llm/e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth"
Jul 24 19:48:13.747218 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:13.747193    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f7lc\" (UniqueName: \"kubernetes.io/projected/0226a408-f9db-49d6-aac1-7ea1955b7b6b-kube-api-access-7f7lc\") pod \"e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth\" (UID: \"0226a408-f9db-49d6-aac1-7ea1955b7b6b\") " pod="llm/e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth"
Jul 24 19:48:13.905193 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:13.905162    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth"
Jul 24 19:48:14.044788 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:14.044765    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth"]
Jul 24 19:48:14.046621 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:48:14.046594    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0226a408_f9db_49d6_aac1_7ea1955b7b6b.slice/crio-ffa31b84e438d18dad1a9502d1541ad90234bd3794468a2baaeacf2584cab006 WatchSource:0}: Error finding container ffa31b84e438d18dad1a9502d1541ad90234bd3794468a2baaeacf2584cab006: Status 404 returned error can't find the container with id ffa31b84e438d18dad1a9502d1541ad90234bd3794468a2baaeacf2584cab006
Jul 24 19:48:14.934572 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:14.934538    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth" event={"ID":"0226a408-f9db-49d6-aac1-7ea1955b7b6b","Type":"ContainerStarted","Data":"33244784f107c4e33310091216a8270c2ae10d67d92311e8261c64426a90806f"}
Jul 24 19:48:14.934945 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:14.934581    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth" event={"ID":"0226a408-f9db-49d6-aac1-7ea1955b7b6b","Type":"ContainerStarted","Data":"ffa31b84e438d18dad1a9502d1541ad90234bd3794468a2baaeacf2584cab006"}
Jul 24 19:48:14.953153 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:14.953101    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth" podStartSLOduration=1.9530855950000001 podStartE2EDuration="1.953085595s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:48:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:48:14.951898751 +0000 UTC m=+1283.470518981" watchObservedRunningTime="2026-07-24 19:48:14.953085595 +0000 UTC m=+1283.471705636"
Jul 24 19:48:23.905552 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:23.905519    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth"
Jul 24 19:48:23.905917 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:23.905573    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth"
Jul 24 19:48:23.918177 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:23.918149    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth"
Jul 24 19:48:23.986411 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:23.986383    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth"
Jul 24 19:48:45.223337 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:45.223303    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8"]
Jul 24 19:48:46.693388 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:48:46.693346    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth"]
Jul 24 19:49:00.244251 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:00.244210    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8" podUID="b70bd233-c66d-41f1-91c1-dab5fcfd3722" containerName="main" containerID="cri-o://ece960a4d223b35eca89a4bfde683ab1899df663b02e13ed273cd3aeb3e4d55c" gracePeriod=45
Jul 24 19:49:00.491639 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:00.491616    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8"
Jul 24 19:49:00.580382 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:00.580316    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b70bd233-c66d-41f1-91c1-dab5fcfd3722-model-cache\") pod \"b70bd233-c66d-41f1-91c1-dab5fcfd3722\" (UID: \"b70bd233-c66d-41f1-91c1-dab5fcfd3722\") "
Jul 24 19:49:00.580382 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:00.580358    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b70bd233-c66d-41f1-91c1-dab5fcfd3722-tls-certs\") pod \"b70bd233-c66d-41f1-91c1-dab5fcfd3722\" (UID: \"b70bd233-c66d-41f1-91c1-dab5fcfd3722\") "
Jul 24 19:49:00.580613 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:00.580394    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b70bd233-c66d-41f1-91c1-dab5fcfd3722-tmp-dir\") pod \"b70bd233-c66d-41f1-91c1-dab5fcfd3722\" (UID: \"b70bd233-c66d-41f1-91c1-dab5fcfd3722\") "
Jul 24 19:49:00.580613 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:00.580430    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mc5mf\" (UniqueName: \"kubernetes.io/projected/b70bd233-c66d-41f1-91c1-dab5fcfd3722-kube-api-access-mc5mf\") pod \"b70bd233-c66d-41f1-91c1-dab5fcfd3722\" (UID: \"b70bd233-c66d-41f1-91c1-dab5fcfd3722\") "
Jul 24 19:49:00.580613 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:00.580517    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b70bd233-c66d-41f1-91c1-dab5fcfd3722-home\") pod \"b70bd233-c66d-41f1-91c1-dab5fcfd3722\" (UID: \"b70bd233-c66d-41f1-91c1-dab5fcfd3722\") "
Jul 24 19:49:00.580613 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:00.580533    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b70bd233-c66d-41f1-91c1-dab5fcfd3722-dshm\") pod \"b70bd233-c66d-41f1-91c1-dab5fcfd3722\" (UID: \"b70bd233-c66d-41f1-91c1-dab5fcfd3722\") "
Jul 24 19:49:00.580613 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:00.580583    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b70bd233-c66d-41f1-91c1-dab5fcfd3722-model-cache" (OuterVolumeSpecName: "model-cache") pod "b70bd233-c66d-41f1-91c1-dab5fcfd3722" (UID: "b70bd233-c66d-41f1-91c1-dab5fcfd3722"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:49:00.580832 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:00.580706    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b70bd233-c66d-41f1-91c1-dab5fcfd3722-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b70bd233-c66d-41f1-91c1-dab5fcfd3722" (UID: "b70bd233-c66d-41f1-91c1-dab5fcfd3722"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:49:00.580832 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:00.580749    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b70bd233-c66d-41f1-91c1-dab5fcfd3722-model-cache\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:49:00.580832 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:00.580783    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b70bd233-c66d-41f1-91c1-dab5fcfd3722-home" (OuterVolumeSpecName: "home") pod "b70bd233-c66d-41f1-91c1-dab5fcfd3722" (UID: "b70bd233-c66d-41f1-91c1-dab5fcfd3722"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:49:00.582802 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:00.582779    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b70bd233-c66d-41f1-91c1-dab5fcfd3722-dshm" (OuterVolumeSpecName: "dshm") pod "b70bd233-c66d-41f1-91c1-dab5fcfd3722" (UID: "b70bd233-c66d-41f1-91c1-dab5fcfd3722"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:49:00.582905 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:00.582801    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b70bd233-c66d-41f1-91c1-dab5fcfd3722-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b70bd233-c66d-41f1-91c1-dab5fcfd3722" (UID: "b70bd233-c66d-41f1-91c1-dab5fcfd3722"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:49:00.582905 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:00.582801    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b70bd233-c66d-41f1-91c1-dab5fcfd3722-kube-api-access-mc5mf" (OuterVolumeSpecName: "kube-api-access-mc5mf") pod "b70bd233-c66d-41f1-91c1-dab5fcfd3722" (UID: "b70bd233-c66d-41f1-91c1-dab5fcfd3722"). InnerVolumeSpecName "kube-api-access-mc5mf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:49:00.681235 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:00.681206    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b70bd233-c66d-41f1-91c1-dab5fcfd3722-tls-certs\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:49:00.681235 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:00.681232    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b70bd233-c66d-41f1-91c1-dab5fcfd3722-tmp-dir\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:49:00.681235 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:00.681241    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mc5mf\" (UniqueName: \"kubernetes.io/projected/b70bd233-c66d-41f1-91c1-dab5fcfd3722-kube-api-access-mc5mf\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:49:00.681567 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:00.681250    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b70bd233-c66d-41f1-91c1-dab5fcfd3722-home\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:49:00.681567 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:00.681259    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b70bd233-c66d-41f1-91c1-dab5fcfd3722-dshm\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:49:01.143608 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:01.143569    2567 generic.go:356] "Generic (PLEG): container finished" podID="b70bd233-c66d-41f1-91c1-dab5fcfd3722" containerID="ece960a4d223b35eca89a4bfde683ab1899df663b02e13ed273cd3aeb3e4d55c" exitCode=0
Jul 24 19:49:01.143786 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:01.143616    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8"
Jul 24 19:49:01.143786 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:01.143613    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8" event={"ID":"b70bd233-c66d-41f1-91c1-dab5fcfd3722","Type":"ContainerDied","Data":"ece960a4d223b35eca89a4bfde683ab1899df663b02e13ed273cd3aeb3e4d55c"}
Jul 24 19:49:01.143786 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:01.143715    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8" event={"ID":"b70bd233-c66d-41f1-91c1-dab5fcfd3722","Type":"ContainerDied","Data":"3db89a8689cdfe2ba670b3864ce829ef04946729684a4db93b770b9a2034028b"}
Jul 24 19:49:01.143786 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:01.143735    2567 scope.go:117] "RemoveContainer" containerID="ece960a4d223b35eca89a4bfde683ab1899df663b02e13ed273cd3aeb3e4d55c"
Jul 24 19:49:01.153062 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:01.153043    2567 scope.go:117] "RemoveContainer" containerID="ece960a4d223b35eca89a4bfde683ab1899df663b02e13ed273cd3aeb3e4d55c"
Jul 24 19:49:01.153296 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:49:01.153276    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ece960a4d223b35eca89a4bfde683ab1899df663b02e13ed273cd3aeb3e4d55c\": container with ID starting with ece960a4d223b35eca89a4bfde683ab1899df663b02e13ed273cd3aeb3e4d55c not found: ID does not exist" containerID="ece960a4d223b35eca89a4bfde683ab1899df663b02e13ed273cd3aeb3e4d55c"
Jul 24 19:49:01.153362 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:01.153305    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ece960a4d223b35eca89a4bfde683ab1899df663b02e13ed273cd3aeb3e4d55c"} err="failed to get container status \"ece960a4d223b35eca89a4bfde683ab1899df663b02e13ed273cd3aeb3e4d55c\": rpc error: code = NotFound desc = could not find container \"ece960a4d223b35eca89a4bfde683ab1899df663b02e13ed273cd3aeb3e4d55c\": container with ID starting with ece960a4d223b35eca89a4bfde683ab1899df663b02e13ed273cd3aeb3e4d55c not found: ID does not exist"
Jul 24 19:49:01.164685 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:01.164655    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8"]
Jul 24 19:49:01.168536 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:01.168514    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-6807f397-kserve-755677f59f-nhfc8"]
Jul 24 19:49:01.712934 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:01.712888    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth" podUID="0226a408-f9db-49d6-aac1-7ea1955b7b6b" containerName="main" containerID="cri-o://33244784f107c4e33310091216a8270c2ae10d67d92311e8261c64426a90806f" gracePeriod=45
Jul 24 19:49:01.961209 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:01.961186    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth"
Jul 24 19:49:02.071847 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:02.071770    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b70bd233-c66d-41f1-91c1-dab5fcfd3722" path="/var/lib/kubelet/pods/b70bd233-c66d-41f1-91c1-dab5fcfd3722/volumes"
Jul 24 19:49:02.092695 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:02.092665    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7f7lc\" (UniqueName: \"kubernetes.io/projected/0226a408-f9db-49d6-aac1-7ea1955b7b6b-kube-api-access-7f7lc\") pod \"0226a408-f9db-49d6-aac1-7ea1955b7b6b\" (UID: \"0226a408-f9db-49d6-aac1-7ea1955b7b6b\") "
Jul 24 19:49:02.092851 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:02.092728    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0226a408-f9db-49d6-aac1-7ea1955b7b6b-dshm\") pod \"0226a408-f9db-49d6-aac1-7ea1955b7b6b\" (UID: \"0226a408-f9db-49d6-aac1-7ea1955b7b6b\") "
Jul 24 19:49:02.092851 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:02.092777    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0226a408-f9db-49d6-aac1-7ea1955b7b6b-tls-certs\") pod \"0226a408-f9db-49d6-aac1-7ea1955b7b6b\" (UID: \"0226a408-f9db-49d6-aac1-7ea1955b7b6b\") "
Jul 24 19:49:02.092851 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:02.092814    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0226a408-f9db-49d6-aac1-7ea1955b7b6b-home\") pod \"0226a408-f9db-49d6-aac1-7ea1955b7b6b\" (UID: \"0226a408-f9db-49d6-aac1-7ea1955b7b6b\") "
Jul 24 19:49:02.093013 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:02.092891    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0226a408-f9db-49d6-aac1-7ea1955b7b6b-model-cache\") pod \"0226a408-f9db-49d6-aac1-7ea1955b7b6b\" (UID: \"0226a408-f9db-49d6-aac1-7ea1955b7b6b\") "
Jul 24 19:49:02.093013 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:02.092915    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0226a408-f9db-49d6-aac1-7ea1955b7b6b-tmp-dir\") pod \"0226a408-f9db-49d6-aac1-7ea1955b7b6b\" (UID: \"0226a408-f9db-49d6-aac1-7ea1955b7b6b\") "
Jul 24 19:49:02.093165 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:02.093131    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0226a408-f9db-49d6-aac1-7ea1955b7b6b-model-cache" (OuterVolumeSpecName: "model-cache") pod "0226a408-f9db-49d6-aac1-7ea1955b7b6b" (UID: "0226a408-f9db-49d6-aac1-7ea1955b7b6b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:49:02.093165 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:02.093145    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0226a408-f9db-49d6-aac1-7ea1955b7b6b-home" (OuterVolumeSpecName: "home") pod "0226a408-f9db-49d6-aac1-7ea1955b7b6b" (UID: "0226a408-f9db-49d6-aac1-7ea1955b7b6b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:49:02.093320 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:02.093228    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0226a408-f9db-49d6-aac1-7ea1955b7b6b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0226a408-f9db-49d6-aac1-7ea1955b7b6b" (UID: "0226a408-f9db-49d6-aac1-7ea1955b7b6b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:49:02.094843 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:02.094821    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0226a408-f9db-49d6-aac1-7ea1955b7b6b-kube-api-access-7f7lc" (OuterVolumeSpecName: "kube-api-access-7f7lc") pod "0226a408-f9db-49d6-aac1-7ea1955b7b6b" (UID: "0226a408-f9db-49d6-aac1-7ea1955b7b6b"). InnerVolumeSpecName "kube-api-access-7f7lc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:49:02.094939 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:02.094923    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0226a408-f9db-49d6-aac1-7ea1955b7b6b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0226a408-f9db-49d6-aac1-7ea1955b7b6b" (UID: "0226a408-f9db-49d6-aac1-7ea1955b7b6b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:49:02.094997 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:02.094922    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0226a408-f9db-49d6-aac1-7ea1955b7b6b-dshm" (OuterVolumeSpecName: "dshm") pod "0226a408-f9db-49d6-aac1-7ea1955b7b6b" (UID: "0226a408-f9db-49d6-aac1-7ea1955b7b6b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:49:02.150527 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:02.150474    2567 generic.go:356] "Generic (PLEG): container finished" podID="0226a408-f9db-49d6-aac1-7ea1955b7b6b" containerID="33244784f107c4e33310091216a8270c2ae10d67d92311e8261c64426a90806f" exitCode=0
Jul 24 19:49:02.150527 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:02.150531    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth"
Jul 24 19:49:02.150740 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:02.150550    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth" event={"ID":"0226a408-f9db-49d6-aac1-7ea1955b7b6b","Type":"ContainerDied","Data":"33244784f107c4e33310091216a8270c2ae10d67d92311e8261c64426a90806f"}
Jul 24 19:49:02.150740 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:02.150587    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth" event={"ID":"0226a408-f9db-49d6-aac1-7ea1955b7b6b","Type":"ContainerDied","Data":"ffa31b84e438d18dad1a9502d1541ad90234bd3794468a2baaeacf2584cab006"}
Jul 24 19:49:02.150740 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:02.150607    2567 scope.go:117] "RemoveContainer" containerID="33244784f107c4e33310091216a8270c2ae10d67d92311e8261c64426a90806f"
Jul 24 19:49:02.159226 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:02.159211    2567 scope.go:117] "RemoveContainer" containerID="33244784f107c4e33310091216a8270c2ae10d67d92311e8261c64426a90806f"
Jul 24 19:49:02.159535 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:49:02.159464    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33244784f107c4e33310091216a8270c2ae10d67d92311e8261c64426a90806f\": container with ID starting with 33244784f107c4e33310091216a8270c2ae10d67d92311e8261c64426a90806f not found: ID does not exist" containerID="33244784f107c4e33310091216a8270c2ae10d67d92311e8261c64426a90806f"
Jul 24 19:49:02.159535 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:02.159509    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33244784f107c4e33310091216a8270c2ae10d67d92311e8261c64426a90806f"} err="failed to get container status \"33244784f107c4e33310091216a8270c2ae10d67d92311e8261c64426a90806f\": rpc error: code = NotFound desc = could not find container \"33244784f107c4e33310091216a8270c2ae10d67d92311e8261c64426a90806f\": container with ID starting with 33244784f107c4e33310091216a8270c2ae10d67d92311e8261c64426a90806f not found: ID does not exist"
Jul 24 19:49:02.171168 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:02.171144    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth"]
Jul 24 19:49:02.172921 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:02.172901    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-6807f397-kserve-584b6c8455-qwkth"]
Jul 24 19:49:02.194118 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:02.194095    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7f7lc\" (UniqueName: \"kubernetes.io/projected/0226a408-f9db-49d6-aac1-7ea1955b7b6b-kube-api-access-7f7lc\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:49:02.194212 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:02.194119    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0226a408-f9db-49d6-aac1-7ea1955b7b6b-dshm\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:49:02.194212 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:02.194135    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0226a408-f9db-49d6-aac1-7ea1955b7b6b-tls-certs\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:49:02.194212 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:02.194148    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0226a408-f9db-49d6-aac1-7ea1955b7b6b-home\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:49:02.194212 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:02.194159    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0226a408-f9db-49d6-aac1-7ea1955b7b6b-model-cache\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:49:02.194212 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:02.194181    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0226a408-f9db-49d6-aac1-7ea1955b7b6b-tmp-dir\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:49:04.071562 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:49:04.071529    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0226a408-f9db-49d6-aac1-7ea1955b7b6b" path="/var/lib/kubelet/pods/0226a408-f9db-49d6-aac1-7ea1955b7b6b/volumes"
Jul 24 19:51:52.009335 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:51:52.009309    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d87bq_72c2265c-f7f6-462a-bf46-eda3f35de953/ovn-acl-logging/0.log"
Jul 24 19:51:52.010304 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:51:52.010285    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d87bq_72c2265c-f7f6-462a-bf46-eda3f35de953/ovn-acl-logging/0.log"
Jul 24 19:52:37.279604 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:52:37.279575    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9bce955c-54ffcb6d78-wcq6t"]
Jul 24 19:52:37.280094 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:52:37.279962    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b70bd233-c66d-41f1-91c1-dab5fcfd3722" containerName="main"
Jul 24 19:52:37.280094 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:52:37.279979    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b70bd233-c66d-41f1-91c1-dab5fcfd3722" containerName="main"
Jul 24 19:52:37.280094 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:52:37.280006    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0226a408-f9db-49d6-aac1-7ea1955b7b6b" containerName="main"
Jul 24 19:52:37.280094 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:52:37.280014    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0226a408-f9db-49d6-aac1-7ea1955b7b6b" containerName="main"
Jul 24 19:52:37.280296 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:52:37.280108    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b70bd233-c66d-41f1-91c1-dab5fcfd3722" containerName="main"
Jul 24 19:52:37.280296 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:52:37.280121    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0226a408-f9db-49d6-aac1-7ea1955b7b6b" containerName="main"
Jul 24 19:52:37.283546 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:52:37.283528    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9bce955c-54ffcb6d78-wcq6t"
Jul 24 19:52:37.285740 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:52:37.285717    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-9bce955c\""
Jul 24 19:52:37.285837 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:52:37.285742    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-9bce955c-dockercfg-q446r\""
Jul 24 19:52:37.292875 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:52:37.292853    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9bce955c-54ffcb6d78-wcq6t"]
Jul 24 19:52:37.365070 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:52:37.365042    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93b80d1b-bd79-423d-b6d0-1ac09decd97f-plugins-config-volume\") pod \"payload-processing-e2e-ait-9bce955c-54ffcb6d78-wcq6t\" (UID: \"93b80d1b-bd79-423d-b6d0-1ac09decd97f\") " pod="openshift-ingress/payload-processing-e2e-ait-9bce955c-54ffcb6d78-wcq6t"
Jul 24 19:52:37.365231 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:52:37.365103    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsnst\" (UniqueName: \"kubernetes.io/projected/93b80d1b-bd79-423d-b6d0-1ac09decd97f-kube-api-access-gsnst\") pod \"payload-processing-e2e-ait-9bce955c-54ffcb6d78-wcq6t\" (UID: \"93b80d1b-bd79-423d-b6d0-1ac09decd97f\") " pod="openshift-ingress/payload-processing-e2e-ait-9bce955c-54ffcb6d78-wcq6t"
Jul 24 19:52:37.466247 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:52:37.466208    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsnst\" (UniqueName: \"kubernetes.io/projected/93b80d1b-bd79-423d-b6d0-1ac09decd97f-kube-api-access-gsnst\") pod \"payload-processing-e2e-ait-9bce955c-54ffcb6d78-wcq6t\" (UID: \"93b80d1b-bd79-423d-b6d0-1ac09decd97f\") " pod="openshift-ingress/payload-processing-e2e-ait-9bce955c-54ffcb6d78-wcq6t"
Jul 24 19:52:37.466440 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:52:37.466297    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93b80d1b-bd79-423d-b6d0-1ac09decd97f-plugins-config-volume\") pod \"payload-processing-e2e-ait-9bce955c-54ffcb6d78-wcq6t\" (UID: \"93b80d1b-bd79-423d-b6d0-1ac09decd97f\") " pod="openshift-ingress/payload-processing-e2e-ait-9bce955c-54ffcb6d78-wcq6t"
Jul 24 19:52:37.466993 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:52:37.466975    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93b80d1b-bd79-423d-b6d0-1ac09decd97f-plugins-config-volume\") pod \"payload-processing-e2e-ait-9bce955c-54ffcb6d78-wcq6t\" (UID: \"93b80d1b-bd79-423d-b6d0-1ac09decd97f\") " pod="openshift-ingress/payload-processing-e2e-ait-9bce955c-54ffcb6d78-wcq6t"
Jul 24 19:52:37.474856 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:52:37.474834    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsnst\" (UniqueName: \"kubernetes.io/projected/93b80d1b-bd79-423d-b6d0-1ac09decd97f-kube-api-access-gsnst\") pod \"payload-processing-e2e-ait-9bce955c-54ffcb6d78-wcq6t\" (UID: \"93b80d1b-bd79-423d-b6d0-1ac09decd97f\") " pod="openshift-ingress/payload-processing-e2e-ait-9bce955c-54ffcb6d78-wcq6t"
Jul 24 19:52:37.595377 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:52:37.595298    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9bce955c-54ffcb6d78-wcq6t"
Jul 24 19:52:37.733868 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:52:37.733840    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9bce955c-54ffcb6d78-wcq6t"]
Jul 24 19:52:37.736549 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:52:37.736523    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93b80d1b_bd79_423d_b6d0_1ac09decd97f.slice/crio-2200dc3c622175487db691232fbbc6d5e7628546a9d6b945ff1d45de3f3b711d WatchSource:0}: Error finding container 2200dc3c622175487db691232fbbc6d5e7628546a9d6b945ff1d45de3f3b711d: Status 404 returned error can't find the container with id 2200dc3c622175487db691232fbbc6d5e7628546a9d6b945ff1d45de3f3b711d
Jul 24 19:52:37.738494 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:52:37.738465    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 19:52:38.171227 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:52:38.171194    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9bce955c-54ffcb6d78-wcq6t" event={"ID":"93b80d1b-bd79-423d-b6d0-1ac09decd97f","Type":"ContainerStarted","Data":"2200dc3c622175487db691232fbbc6d5e7628546a9d6b945ff1d45de3f3b711d"}
Jul 24 19:52:40.183077 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:52:40.183036    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9bce955c-54ffcb6d78-wcq6t" event={"ID":"93b80d1b-bd79-423d-b6d0-1ac09decd97f","Type":"ContainerStarted","Data":"5cd484abea9ed0e9b501a42f4c4db92e5fe7dbfdb4f9e4ec16379612c0a400c0"}
Jul 24 19:52:40.183562 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:52:40.183105    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-9bce955c-54ffcb6d78-wcq6t"
Jul 24 19:52:40.200332 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:52:40.200282    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-9bce955c-54ffcb6d78-wcq6t" podStartSLOduration=1.6267661150000001 podStartE2EDuration="3.20026805s" totalImagesPullingTime="1.573501935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:52:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:52:40.198112982 +0000 UTC m=+1548.716733024" watchObservedRunningTime="2026-07-24 19:52:40.20026805 +0000 UTC m=+1548.718888095"
Jul 24 19:52:51.190269 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:52:51.190239    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-9bce955c-54ffcb6d78-wcq6t"
Jul 24 19:53:01.766758 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:01.766728    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9bce955c-rcj6t"]
Jul 24 19:53:01.769724 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:01.769709    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9bce955c-rcj6t"
Jul 24 19:53:01.772747 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:01.772729    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gqw4p\""
Jul 24 19:53:01.772818 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:01.772734    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 19:53:01.782396 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:01.782374    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9bce955c-rcj6t"]
Jul 24 19:53:01.881993 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:01.881946    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2da2c8d9-8c0b-4c6a-a0ac-8569b725cf0e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9bce955c-rcj6t\" (UID: \"2da2c8d9-8c0b-4c6a-a0ac-8569b725cf0e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9bce955c-rcj6t"
Jul 24 19:53:01.983100 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:01.983063    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2da2c8d9-8c0b-4c6a-a0ac-8569b725cf0e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9bce955c-rcj6t\" (UID: \"2da2c8d9-8c0b-4c6a-a0ac-8569b725cf0e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9bce955c-rcj6t"
Jul 24 19:53:01.983758 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:01.983724    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2da2c8d9-8c0b-4c6a-a0ac-8569b725cf0e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9bce955c-rcj6t\" (UID: \"2da2c8d9-8c0b-4c6a-a0ac-8569b725cf0e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9bce955c-rcj6t"
Jul 24 19:53:02.079652 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:02.079578    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9bce955c-rcj6t"
Jul 24 19:53:02.213892 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:02.213867    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9bce955c-rcj6t"]
Jul 24 19:53:02.216610 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:53:02.216570    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2da2c8d9_8c0b_4c6a_a0ac_8569b725cf0e.slice/crio-b2498ced3bd4e03ac4b4b1a17f2bdd0c5848f0bb981b56036a0181952f67adb6 WatchSource:0}: Error finding container b2498ced3bd4e03ac4b4b1a17f2bdd0c5848f0bb981b56036a0181952f67adb6: Status 404 returned error can't find the container with id b2498ced3bd4e03ac4b4b1a17f2bdd0c5848f0bb981b56036a0181952f67adb6
Jul 24 19:53:02.281161 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:02.281119    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9bce955c-rcj6t" event={"ID":"2da2c8d9-8c0b-4c6a-a0ac-8569b725cf0e","Type":"ContainerStarted","Data":"b2498ced3bd4e03ac4b4b1a17f2bdd0c5848f0bb981b56036a0181952f67adb6"}
Jul 24 19:53:03.287276 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:03.287182    2567 generic.go:356] "Generic (PLEG): container finished" podID="2da2c8d9-8c0b-4c6a-a0ac-8569b725cf0e" containerID="a9ea8dd8d16ba5fa6f9cd3af5d5fd1e36395ea14a0b828db792d579febad48ed" exitCode=0
Jul 24 19:53:03.287276 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:03.287258    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9bce955c-rcj6t" event={"ID":"2da2c8d9-8c0b-4c6a-a0ac-8569b725cf0e","Type":"ContainerDied","Data":"a9ea8dd8d16ba5fa6f9cd3af5d5fd1e36395ea14a0b828db792d579febad48ed"}
Jul 24 19:53:04.428020 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:04.427993    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9bce955c-rcj6t"
Jul 24 19:53:04.508340 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:04.508300    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2da2c8d9-8c0b-4c6a-a0ac-8569b725cf0e-maas-api-service-ca\") pod \"2da2c8d9-8c0b-4c6a-a0ac-8569b725cf0e\" (UID: \"2da2c8d9-8c0b-4c6a-a0ac-8569b725cf0e\") "
Jul 24 19:53:04.508693 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:04.508670    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2da2c8d9-8c0b-4c6a-a0ac-8569b725cf0e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2da2c8d9-8c0b-4c6a-a0ac-8569b725cf0e" (UID: "2da2c8d9-8c0b-4c6a-a0ac-8569b725cf0e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:53:04.609091 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:04.609010    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2da2c8d9-8c0b-4c6a-a0ac-8569b725cf0e-maas-api-service-ca\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:53:05.297928 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:05.297896    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9bce955c-rcj6t" event={"ID":"2da2c8d9-8c0b-4c6a-a0ac-8569b725cf0e","Type":"ContainerDied","Data":"b2498ced3bd4e03ac4b4b1a17f2bdd0c5848f0bb981b56036a0181952f67adb6"}
Jul 24 19:53:05.298093 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:05.297940    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b2498ced3bd4e03ac4b4b1a17f2bdd0c5848f0bb981b56036a0181952f67adb6"
Jul 24 19:53:05.298093 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:05.297899    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9bce955c-rcj6t"
Jul 24 19:53:12.219559 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:12.219526    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9bce955c-54ffcb6d78-wcq6t"]
Jul 24 19:53:12.220146 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:12.219783    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-9bce955c-54ffcb6d78-wcq6t" podUID="93b80d1b-bd79-423d-b6d0-1ac09decd97f" containerName="payload-processing" containerID="cri-o://5cd484abea9ed0e9b501a42f4c4db92e5fe7dbfdb4f9e4ec16379612c0a400c0" gracePeriod=30
Jul 24 19:53:12.473860 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:12.473794    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9bce955c-54ffcb6d78-wcq6t"
Jul 24 19:53:12.587720 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:12.587683    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93b80d1b-bd79-423d-b6d0-1ac09decd97f-plugins-config-volume\") pod \"93b80d1b-bd79-423d-b6d0-1ac09decd97f\" (UID: \"93b80d1b-bd79-423d-b6d0-1ac09decd97f\") "
Jul 24 19:53:12.587918 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:12.587784    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gsnst\" (UniqueName: \"kubernetes.io/projected/93b80d1b-bd79-423d-b6d0-1ac09decd97f-kube-api-access-gsnst\") pod \"93b80d1b-bd79-423d-b6d0-1ac09decd97f\" (UID: \"93b80d1b-bd79-423d-b6d0-1ac09decd97f\") "
Jul 24 19:53:12.588149 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:12.588117    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93b80d1b-bd79-423d-b6d0-1ac09decd97f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "93b80d1b-bd79-423d-b6d0-1ac09decd97f" (UID: "93b80d1b-bd79-423d-b6d0-1ac09decd97f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:53:12.590050 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:12.590029    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93b80d1b-bd79-423d-b6d0-1ac09decd97f-kube-api-access-gsnst" (OuterVolumeSpecName: "kube-api-access-gsnst") pod "93b80d1b-bd79-423d-b6d0-1ac09decd97f" (UID: "93b80d1b-bd79-423d-b6d0-1ac09decd97f"). InnerVolumeSpecName "kube-api-access-gsnst". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:53:12.689391 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:12.689354    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93b80d1b-bd79-423d-b6d0-1ac09decd97f-plugins-config-volume\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:53:12.689391 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:12.689385    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gsnst\" (UniqueName: \"kubernetes.io/projected/93b80d1b-bd79-423d-b6d0-1ac09decd97f-kube-api-access-gsnst\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:53:13.334877 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:13.334837    2567 generic.go:356] "Generic (PLEG): container finished" podID="93b80d1b-bd79-423d-b6d0-1ac09decd97f" containerID="5cd484abea9ed0e9b501a42f4c4db92e5fe7dbfdb4f9e4ec16379612c0a400c0" exitCode=0
Jul 24 19:53:13.334877 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:13.334876    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9bce955c-54ffcb6d78-wcq6t"
Jul 24 19:53:13.335397 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:13.334924    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9bce955c-54ffcb6d78-wcq6t" event={"ID":"93b80d1b-bd79-423d-b6d0-1ac09decd97f","Type":"ContainerDied","Data":"5cd484abea9ed0e9b501a42f4c4db92e5fe7dbfdb4f9e4ec16379612c0a400c0"}
Jul 24 19:53:13.335397 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:13.334984    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9bce955c-54ffcb6d78-wcq6t" event={"ID":"93b80d1b-bd79-423d-b6d0-1ac09decd97f","Type":"ContainerDied","Data":"2200dc3c622175487db691232fbbc6d5e7628546a9d6b945ff1d45de3f3b711d"}
Jul 24 19:53:13.335397 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:13.335008    2567 scope.go:117] "RemoveContainer" containerID="5cd484abea9ed0e9b501a42f4c4db92e5fe7dbfdb4f9e4ec16379612c0a400c0"
Jul 24 19:53:13.344358 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:13.344342    2567 scope.go:117] "RemoveContainer" containerID="5cd484abea9ed0e9b501a42f4c4db92e5fe7dbfdb4f9e4ec16379612c0a400c0"
Jul 24 19:53:13.344726 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:53:13.344703    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cd484abea9ed0e9b501a42f4c4db92e5fe7dbfdb4f9e4ec16379612c0a400c0\": container with ID starting with 5cd484abea9ed0e9b501a42f4c4db92e5fe7dbfdb4f9e4ec16379612c0a400c0 not found: ID does not exist" containerID="5cd484abea9ed0e9b501a42f4c4db92e5fe7dbfdb4f9e4ec16379612c0a400c0"
Jul 24 19:53:13.344795 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:13.344738    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cd484abea9ed0e9b501a42f4c4db92e5fe7dbfdb4f9e4ec16379612c0a400c0"} err="failed to get container status \"5cd484abea9ed0e9b501a42f4c4db92e5fe7dbfdb4f9e4ec16379612c0a400c0\": rpc error: code = NotFound desc = could not find container \"5cd484abea9ed0e9b501a42f4c4db92e5fe7dbfdb4f9e4ec16379612c0a400c0\": container with ID starting with 5cd484abea9ed0e9b501a42f4c4db92e5fe7dbfdb4f9e4ec16379612c0a400c0 not found: ID does not exist"
Jul 24 19:53:13.356357 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:13.356326    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9bce955c-54ffcb6d78-wcq6t"]
Jul 24 19:53:13.359706 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:13.359683    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9bce955c-54ffcb6d78-wcq6t"]
Jul 24 19:53:14.072254 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:14.072223    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93b80d1b-bd79-423d-b6d0-1ac09decd97f" path="/var/lib/kubelet/pods/93b80d1b-bd79-423d-b6d0-1ac09decd97f/volumes"
Jul 24 19:53:16.846264 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:16.846230    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9bce955c-rcj6t"]
Jul 24 19:53:16.848887 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:16.848862    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9bce955c-rcj6t"]
Jul 24 19:53:18.017275 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:18.017239    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x"]
Jul 24 19:53:18.017812 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:18.017791    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93b80d1b-bd79-423d-b6d0-1ac09decd97f" containerName="payload-processing"
Jul 24 19:53:18.017898 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:18.017814    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="93b80d1b-bd79-423d-b6d0-1ac09decd97f" containerName="payload-processing"
Jul 24 19:53:18.017898 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:18.017839    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2da2c8d9-8c0b-4c6a-a0ac-8569b725cf0e" containerName="revoke-keys"
Jul 24 19:53:18.017898 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:18.017847    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2da2c8d9-8c0b-4c6a-a0ac-8569b725cf0e" containerName="revoke-keys"
Jul 24 19:53:18.018044 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:18.017954    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="93b80d1b-bd79-423d-b6d0-1ac09decd97f" containerName="payload-processing"
Jul 24 19:53:18.018044 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:18.017965    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2da2c8d9-8c0b-4c6a-a0ac-8569b725cf0e" containerName="revoke-keys"
Jul 24 19:53:18.023800 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:18.023777    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x"
Jul 24 19:53:18.026965 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:18.026946    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 24 19:53:18.027393 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:18.027380    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-301a8697-gw-openshift-default-dockercfg-pnkd2\""
Jul 24 19:53:18.033447 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:18.033426    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x"]
Jul 24 19:53:18.072734 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:18.072705    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2da2c8d9-8c0b-4c6a-a0ac-8569b725cf0e" path="/var/lib/kubelet/pods/2da2c8d9-8c0b-4c6a-a0ac-8569b725cf0e/volumes"
Jul 24 19:53:18.140763 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:18.140733    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-istiod-ca-cert\") pod \"e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x\" (UID: \"f77aca8b-8df3-4ef0-b6b1-620fe6bae307\") " pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x"
Jul 24 19:53:18.140926 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:18.140766    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-workload-socket\") pod \"e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x\" (UID: \"f77aca8b-8df3-4ef0-b6b1-620fe6bae307\") " pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x"
Jul 24 19:53:18.140926 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:18.140788    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-istio-podinfo\") pod \"e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x\" (UID: \"f77aca8b-8df3-4ef0-b6b1-620fe6bae307\") " pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x"
Jul 24 19:53:18.140926 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:18.140840    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cm725\" (UniqueName: \"kubernetes.io/projected/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-kube-api-access-cm725\") pod \"e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x\" (UID: \"f77aca8b-8df3-4ef0-b6b1-620fe6bae307\") " pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x"
Jul 24 19:53:18.140926 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:18.140866    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-istio-token\") pod \"e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x\" (UID: \"f77aca8b-8df3-4ef0-b6b1-620fe6bae307\") " pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x"
Jul 24 19:53:18.140926 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:18.140920    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-credential-socket\") pod \"e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x\" (UID: \"f77aca8b-8df3-4ef0-b6b1-620fe6bae307\") " pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x"
Jul 24 19:53:18.141156 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:18.140972    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-istio-envoy\") pod \"e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x\" (UID: \"f77aca8b-8df3-4ef0-b6b1-620fe6bae307\") " pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x"
Jul 24 19:53:18.141156 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:18.141004    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-workload-certs\") pod \"e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x\" (UID: \"f77aca8b-8df3-4ef0-b6b1-620fe6bae307\") " pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x"
Jul 24 19:53:18.141156 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:18.141021    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-istio-data\") pod \"e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x\" (UID: \"f77aca8b-8df3-4ef0-b6b1-620fe6bae307\") " pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x"
Jul 24 19:53:18.241836 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:18.241805    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-credential-socket\") pod \"e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x\" (UID: \"f77aca8b-8df3-4ef0-b6b1-620fe6bae307\") " pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x"
Jul 24 19:53:18.241963 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:18.241852    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-istio-envoy\") pod \"e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x\" (UID: \"f77aca8b-8df3-4ef0-b6b1-620fe6bae307\") " pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x"
Jul 24 19:53:18.242020 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:18.241978    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-workload-certs\") pod \"e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x\" (UID: \"f77aca8b-8df3-4ef0-b6b1-620fe6bae307\") " pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x"
Jul 24 19:53:18.242020 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:18.242009    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-istio-data\") pod \"e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x\" (UID: \"f77aca8b-8df3-4ef0-b6b1-620fe6bae307\") " pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x"
Jul 24 19:53:18.242084 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:18.242075    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-istiod-ca-cert\") pod \"e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x\" (UID: \"f77aca8b-8df3-4ef0-b6b1-620fe6bae307\") " pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x"
Jul 24 19:53:18.242117 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:18.242094    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-workload-socket\") pod \"e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x\" (UID: \"f77aca8b-8df3-4ef0-b6b1-620fe6bae307\") " pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x"
Jul 24 19:53:18.242161 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:18.242123    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-istio-podinfo\") pod \"e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x\" (UID: \"f77aca8b-8df3-4ef0-b6b1-620fe6bae307\") " pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x"
Jul 24 19:53:18.242161 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:18.242151    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cm725\" (UniqueName: \"kubernetes.io/projected/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-kube-api-access-cm725\") pod \"e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x\" (UID: \"f77aca8b-8df3-4ef0-b6b1-620fe6bae307\") " pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x"
Jul 24 19:53:18.242265 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:18.242179    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-istio-token\") pod \"e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x\" (UID: \"f77aca8b-8df3-4ef0-b6b1-620fe6bae307\") " pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x"
Jul 24 19:53:18.242333 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:18.242313    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-credential-socket\") pod \"e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x\" (UID: \"f77aca8b-8df3-4ef0-b6b1-620fe6bae307\") " pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x"
Jul 24 19:53:18.242388 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:18.242334    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-workload-certs\") pod \"e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x\" (UID: \"f77aca8b-8df3-4ef0-b6b1-620fe6bae307\") " pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x"
Jul 24 19:53:18.242456 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:18.242404    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-istio-data\") pod \"e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x\" (UID: \"f77aca8b-8df3-4ef0-b6b1-620fe6bae307\") " pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x"
Jul 24 19:53:18.242544 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:18.242474    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-workload-socket\") pod \"e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x\" (UID: \"f77aca8b-8df3-4ef0-b6b1-620fe6bae307\") " pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x"
Jul 24 19:53:18.243213 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:18.243191    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-istiod-ca-cert\") pod \"e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x\" (UID: \"f77aca8b-8df3-4ef0-b6b1-620fe6bae307\") " pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x"
Jul 24 19:53:18.244454 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:18.244437    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-istio-envoy\") pod \"e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x\" (UID: \"f77aca8b-8df3-4ef0-b6b1-620fe6bae307\") " pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x"
Jul 24 19:53:18.244772 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:18.244743    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-istio-podinfo\") pod \"e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x\" (UID: \"f77aca8b-8df3-4ef0-b6b1-620fe6bae307\") " pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x"
Jul 24 19:53:18.250703 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:18.250670    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-istio-token\") pod \"e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x\" (UID: \"f77aca8b-8df3-4ef0-b6b1-620fe6bae307\") " pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x"
Jul 24 19:53:18.250989 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:18.250970    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cm725\" (UniqueName: \"kubernetes.io/projected/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-kube-api-access-cm725\") pod \"e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x\" (UID: \"f77aca8b-8df3-4ef0-b6b1-620fe6bae307\") " pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x"
Jul 24 19:53:18.334932 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:18.334843    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x"
Jul 24 19:53:18.492552 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:18.492527    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x"]
Jul 24 19:53:18.493817 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:53:18.493789    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf77aca8b_8df3_4ef0_b6b1_620fe6bae307.slice/crio-cc21220642a3cce33d9498a5599002d482b22b5981c1dd32ecfd9724592a3a7b WatchSource:0}: Error finding container cc21220642a3cce33d9498a5599002d482b22b5981c1dd32ecfd9724592a3a7b: Status 404 returned error can't find the container with id cc21220642a3cce33d9498a5599002d482b22b5981c1dd32ecfd9724592a3a7b
Jul 24 19:53:19.368642 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:19.368601    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x" event={"ID":"f77aca8b-8df3-4ef0-b6b1-620fe6bae307","Type":"ContainerStarted","Data":"cc21220642a3cce33d9498a5599002d482b22b5981c1dd32ecfd9724592a3a7b"}
Jul 24 19:53:21.262933 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:21.262897    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 19:53:21.263217 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:21.262967    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 19:53:21.263217 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:21.262997    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 19:53:21.381756 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:21.381721    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x" event={"ID":"f77aca8b-8df3-4ef0-b6b1-620fe6bae307","Type":"ContainerStarted","Data":"5b4096f8e3320567764476bd547581c2c4188775c98f597149ff35ce371db4d2"}
Jul 24 19:53:21.405197 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:21.405136    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x" podStartSLOduration=1.638752601 podStartE2EDuration="4.405114481s" totalImagesPullingTime="2.76636188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:53:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:53:21.402530517 +0000 UTC m=+1589.921150559" watchObservedRunningTime="2026-07-24 19:53:21.405114481 +0000 UTC m=+1589.923734524"
Jul 24 19:53:22.335283 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:22.335244    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x"
Jul 24 19:53:22.340217 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:22.340194    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x"
Jul 24 19:53:22.386016 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:22.385984    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x"
Jul 24 19:53:22.386945 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:22.386928    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x"
Jul 24 19:53:23.708738 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:23.708704    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-301a8697-5fb4d5b5cb-6fsz5"]
Jul 24 19:53:23.712229 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:23.712214    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-301a8697-5fb4d5b5cb-6fsz5"
Jul 24 19:53:23.715524 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:23.715505    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-301a8697-dockercfg-vbpj8\""
Jul 24 19:53:23.715658 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:23.715548    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-301a8697\""
Jul 24 19:53:23.724704 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:23.724682    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-301a8697-5fb4d5b5cb-6fsz5"]
Jul 24 19:53:23.734470 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:23.734438    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-301a8697-bdcbfd7c-mqkpf"]
Jul 24 19:53:23.737850 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:23.737833    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-301a8697-bdcbfd7c-mqkpf"
Jul 24 19:53:23.749137 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:23.749114    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-301a8697-bdcbfd7c-mqkpf"]
Jul 24 19:53:23.793851 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:23.793815    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0554b436-275b-4261-a35e-bfcb1053219d-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-301a8697-5fb4d5b5cb-6fsz5\" (UID: \"0554b436-275b-4261-a35e-bfcb1053219d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-301a8697-5fb4d5b5cb-6fsz5"
Jul 24 19:53:23.794045 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:23.793906    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4jnh\" (UniqueName: \"kubernetes.io/projected/0554b436-275b-4261-a35e-bfcb1053219d-kube-api-access-k4jnh\") pod \"payload-pre-processing-e2e-migrate-301a8697-5fb4d5b5cb-6fsz5\" (UID: \"0554b436-275b-4261-a35e-bfcb1053219d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-301a8697-5fb4d5b5cb-6fsz5"
Jul 24 19:53:23.895350 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:23.895293    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0554b436-275b-4261-a35e-bfcb1053219d-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-301a8697-5fb4d5b5cb-6fsz5\" (UID: \"0554b436-275b-4261-a35e-bfcb1053219d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-301a8697-5fb4d5b5cb-6fsz5"
Jul 24 19:53:23.895541 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:23.895439    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrszv\" (UniqueName: \"kubernetes.io/projected/cb4c00ea-c19d-414f-9137-448ce290d385-kube-api-access-vrszv\") pod \"payload-processing-e2e-migrate-301a8697-bdcbfd7c-mqkpf\" (UID: \"cb4c00ea-c19d-414f-9137-448ce290d385\") " pod="openshift-ingress/payload-processing-e2e-migrate-301a8697-bdcbfd7c-mqkpf"
Jul 24 19:53:23.895541 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:23.895472    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb4c00ea-c19d-414f-9137-448ce290d385-plugins-config-volume\") pod \"payload-processing-e2e-migrate-301a8697-bdcbfd7c-mqkpf\" (UID: \"cb4c00ea-c19d-414f-9137-448ce290d385\") " pod="openshift-ingress/payload-processing-e2e-migrate-301a8697-bdcbfd7c-mqkpf"
Jul 24 19:53:23.895671 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:23.895583    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4jnh\" (UniqueName: \"kubernetes.io/projected/0554b436-275b-4261-a35e-bfcb1053219d-kube-api-access-k4jnh\") pod \"payload-pre-processing-e2e-migrate-301a8697-5fb4d5b5cb-6fsz5\" (UID: \"0554b436-275b-4261-a35e-bfcb1053219d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-301a8697-5fb4d5b5cb-6fsz5"
Jul 24 19:53:23.896041 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:23.896024    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0554b436-275b-4261-a35e-bfcb1053219d-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-301a8697-5fb4d5b5cb-6fsz5\" (UID: \"0554b436-275b-4261-a35e-bfcb1053219d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-301a8697-5fb4d5b5cb-6fsz5"
Jul 24 19:53:23.905070 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:23.905040    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4jnh\" (UniqueName: \"kubernetes.io/projected/0554b436-275b-4261-a35e-bfcb1053219d-kube-api-access-k4jnh\") pod \"payload-pre-processing-e2e-migrate-301a8697-5fb4d5b5cb-6fsz5\" (UID: \"0554b436-275b-4261-a35e-bfcb1053219d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-301a8697-5fb4d5b5cb-6fsz5"
Jul 24 19:53:23.997111 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:23.997031    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb4c00ea-c19d-414f-9137-448ce290d385-plugins-config-volume\") pod \"payload-processing-e2e-migrate-301a8697-bdcbfd7c-mqkpf\" (UID: \"cb4c00ea-c19d-414f-9137-448ce290d385\") " pod="openshift-ingress/payload-processing-e2e-migrate-301a8697-bdcbfd7c-mqkpf"
Jul 24 19:53:23.997246 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:23.997156    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrszv\" (UniqueName: \"kubernetes.io/projected/cb4c00ea-c19d-414f-9137-448ce290d385-kube-api-access-vrszv\") pod \"payload-processing-e2e-migrate-301a8697-bdcbfd7c-mqkpf\" (UID: \"cb4c00ea-c19d-414f-9137-448ce290d385\") " pod="openshift-ingress/payload-processing-e2e-migrate-301a8697-bdcbfd7c-mqkpf"
Jul 24 19:53:23.997739 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:23.997720    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb4c00ea-c19d-414f-9137-448ce290d385-plugins-config-volume\") pod \"payload-processing-e2e-migrate-301a8697-bdcbfd7c-mqkpf\" (UID: \"cb4c00ea-c19d-414f-9137-448ce290d385\") " pod="openshift-ingress/payload-processing-e2e-migrate-301a8697-bdcbfd7c-mqkpf"
Jul 24 19:53:24.004856 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:24.004833    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrszv\" (UniqueName: \"kubernetes.io/projected/cb4c00ea-c19d-414f-9137-448ce290d385-kube-api-access-vrszv\") pod \"payload-processing-e2e-migrate-301a8697-bdcbfd7c-mqkpf\" (UID: \"cb4c00ea-c19d-414f-9137-448ce290d385\") " pod="openshift-ingress/payload-processing-e2e-migrate-301a8697-bdcbfd7c-mqkpf"
Jul 24 19:53:24.022725 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:24.022700    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-301a8697-5fb4d5b5cb-6fsz5"
Jul 24 19:53:24.049163 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:24.049130    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-301a8697-bdcbfd7c-mqkpf"
Jul 24 19:53:24.170164 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:24.170078    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-301a8697-5fb4d5b5cb-6fsz5"]
Jul 24 19:53:24.199007 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:24.198981    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-301a8697-bdcbfd7c-mqkpf"]
Jul 24 19:53:24.205651 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:53:24.205628    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb4c00ea_c19d_414f_9137_448ce290d385.slice/crio-da955459310004a1e416d8d6dc9f261fcf6c94f98fbf322961171b9a4a502f97 WatchSource:0}: Error finding container da955459310004a1e416d8d6dc9f261fcf6c94f98fbf322961171b9a4a502f97: Status 404 returned error can't find the container with id da955459310004a1e416d8d6dc9f261fcf6c94f98fbf322961171b9a4a502f97
Jul 24 19:53:24.397760 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:24.397723    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-301a8697-bdcbfd7c-mqkpf" event={"ID":"cb4c00ea-c19d-414f-9137-448ce290d385","Type":"ContainerStarted","Data":"34002d77c59a86ae20e9e3055413068771c7287f091c0d31e0f2dd9084ba4b6d"}
Jul 24 19:53:24.397936 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:24.397788    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-301a8697-bdcbfd7c-mqkpf"
Jul 24 19:53:24.397936 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:24.397810    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-301a8697-bdcbfd7c-mqkpf" event={"ID":"cb4c00ea-c19d-414f-9137-448ce290d385","Type":"ContainerStarted","Data":"da955459310004a1e416d8d6dc9f261fcf6c94f98fbf322961171b9a4a502f97"}
Jul 24 19:53:24.399327 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:24.399304    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-301a8697-5fb4d5b5cb-6fsz5" event={"ID":"0554b436-275b-4261-a35e-bfcb1053219d","Type":"ContainerStarted","Data":"1deb1f1bf82e17dc9f984ea7ee01218279b6ad360cd0f6ed9a9a323994500cfe"}
Jul 24 19:53:24.399434 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:24.399343    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-301a8697-5fb4d5b5cb-6fsz5" event={"ID":"0554b436-275b-4261-a35e-bfcb1053219d","Type":"ContainerStarted","Data":"ca971e51dce8621a80685b83ed1920138c939fed7b051eb6d2aea86dfc9c131b"}
Jul 24 19:53:24.399507 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:24.399476    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-301a8697-5fb4d5b5cb-6fsz5"
Jul 24 19:53:24.413656 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:24.413609    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-301a8697-bdcbfd7c-mqkpf" podStartSLOduration=1.413595286 podStartE2EDuration="1.413595286s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:53:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:53:24.413211242 +0000 UTC m=+1592.931831283" watchObservedRunningTime="2026-07-24 19:53:24.413595286 +0000 UTC m=+1592.932215327"
Jul 24 19:53:24.428731 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:24.428687    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-301a8697-5fb4d5b5cb-6fsz5" podStartSLOduration=1.428667545 podStartE2EDuration="1.428667545s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:53:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:53:24.428205092 +0000 UTC m=+1592.946825133" watchObservedRunningTime="2026-07-24 19:53:24.428667545 +0000 UTC m=+1592.947287588"
Jul 24 19:53:35.407030 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:35.406999    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-301a8697-bdcbfd7c-mqkpf"
Jul 24 19:53:35.407437 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:35.407070    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-301a8697-5fb4d5b5cb-6fsz5"
Jul 24 19:53:35.463165 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:35.463128    2567 generic.go:356] "Generic (PLEG): container finished" podID="f77aca8b-8df3-4ef0-b6b1-620fe6bae307" containerID="5b4096f8e3320567764476bd547581c2c4188775c98f597149ff35ce371db4d2" exitCode=0
Jul 24 19:53:35.463338 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:35.463191    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x" event={"ID":"f77aca8b-8df3-4ef0-b6b1-620fe6bae307","Type":"ContainerDied","Data":"5b4096f8e3320567764476bd547581c2c4188775c98f597149ff35ce371db4d2"}
Jul 24 19:53:35.463670 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:35.463643    2567 scope.go:117] "RemoveContainer" containerID="5b4096f8e3320567764476bd547581c2c4188775c98f597149ff35ce371db4d2"
Jul 24 19:53:35.464932 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:35.464895    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 19:53:35.465031 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:35.464970    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 19:53:35.465031 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:35.465004    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 19:53:36.470548 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:36.470514    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x" event={"ID":"f77aca8b-8df3-4ef0-b6b1-620fe6bae307","Type":"ContainerStarted","Data":"0d436158d0f947f1ab8f05585552f0c4a7d01ac87d51a5dae1c250a9876e3ee8"}
Jul 24 19:53:37.335294 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:37.335257    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x"
Jul 24 19:53:37.336876 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:37.336844    2567 patch_prober.go:28] interesting pod/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 24 19:53:37.336991 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:37.336907    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x" podUID="f77aca8b-8df3-4ef0-b6b1-620fe6bae307" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 24 19:53:37.386493 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:37.386463    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x"
Jul 24 19:53:38.335309 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:38.335263    2567 patch_prober.go:28] interesting pod/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 24 19:53:38.335820 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:38.335330    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x" podUID="f77aca8b-8df3-4ef0-b6b1-620fe6bae307" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 24 19:53:39.335613 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:39.335580    2567 patch_prober.go:28] interesting pod/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 24 19:53:39.336160 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:39.336128    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x" podUID="f77aca8b-8df3-4ef0-b6b1-620fe6bae307" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 24 19:53:40.339371 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:40.339343    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x"
Jul 24 19:53:40.340236 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:53:40.340221    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x"
Jul 24 19:54:18.340168 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:18.340126    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-301a8697-bdcbfd7c-mqkpf"]
Jul 24 19:54:18.340715 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:18.340366    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-301a8697-bdcbfd7c-mqkpf" podUID="cb4c00ea-c19d-414f-9137-448ce290d385" containerName="payload-processing" containerID="cri-o://34002d77c59a86ae20e9e3055413068771c7287f091c0d31e0f2dd9084ba4b6d" gracePeriod=30
Jul 24 19:54:18.348638 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:18.348539    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-301a8697-5fb4d5b5cb-6fsz5"]
Jul 24 19:54:18.349028 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:18.349000    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-301a8697-5fb4d5b5cb-6fsz5" podUID="0554b436-275b-4261-a35e-bfcb1053219d" containerName="payload-pre-processing" containerID="cri-o://1deb1f1bf82e17dc9f984ea7ee01218279b6ad360cd0f6ed9a9a323994500cfe" gracePeriod=30
Jul 24 19:54:18.595231 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:18.595176    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-301a8697-bdcbfd7c-mqkpf"
Jul 24 19:54:18.621137 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:18.621114    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-301a8697-5fb4d5b5cb-6fsz5"
Jul 24 19:54:18.671048 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:18.671015    2567 generic.go:356] "Generic (PLEG): container finished" podID="0554b436-275b-4261-a35e-bfcb1053219d" containerID="1deb1f1bf82e17dc9f984ea7ee01218279b6ad360cd0f6ed9a9a323994500cfe" exitCode=0
Jul 24 19:54:18.671221 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:18.671052    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-301a8697-5fb4d5b5cb-6fsz5"
Jul 24 19:54:18.671221 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:18.671101    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-301a8697-5fb4d5b5cb-6fsz5" event={"ID":"0554b436-275b-4261-a35e-bfcb1053219d","Type":"ContainerDied","Data":"1deb1f1bf82e17dc9f984ea7ee01218279b6ad360cd0f6ed9a9a323994500cfe"}
Jul 24 19:54:18.671221 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:18.671145    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-301a8697-5fb4d5b5cb-6fsz5" event={"ID":"0554b436-275b-4261-a35e-bfcb1053219d","Type":"ContainerDied","Data":"ca971e51dce8621a80685b83ed1920138c939fed7b051eb6d2aea86dfc9c131b"}
Jul 24 19:54:18.671221 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:18.671173    2567 scope.go:117] "RemoveContainer" containerID="1deb1f1bf82e17dc9f984ea7ee01218279b6ad360cd0f6ed9a9a323994500cfe"
Jul 24 19:54:18.672474 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:18.672450    2567 generic.go:356] "Generic (PLEG): container finished" podID="cb4c00ea-c19d-414f-9137-448ce290d385" containerID="34002d77c59a86ae20e9e3055413068771c7287f091c0d31e0f2dd9084ba4b6d" exitCode=0
Jul 24 19:54:18.672604 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:18.672512    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-301a8697-bdcbfd7c-mqkpf"
Jul 24 19:54:18.672646 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:18.672512    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-301a8697-bdcbfd7c-mqkpf" event={"ID":"cb4c00ea-c19d-414f-9137-448ce290d385","Type":"ContainerDied","Data":"34002d77c59a86ae20e9e3055413068771c7287f091c0d31e0f2dd9084ba4b6d"}
Jul 24 19:54:18.672646 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:18.672634    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-301a8697-bdcbfd7c-mqkpf" event={"ID":"cb4c00ea-c19d-414f-9137-448ce290d385","Type":"ContainerDied","Data":"da955459310004a1e416d8d6dc9f261fcf6c94f98fbf322961171b9a4a502f97"}
Jul 24 19:54:18.679652 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:18.679638    2567 scope.go:117] "RemoveContainer" containerID="1deb1f1bf82e17dc9f984ea7ee01218279b6ad360cd0f6ed9a9a323994500cfe"
Jul 24 19:54:18.679915 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:54:18.679898    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1deb1f1bf82e17dc9f984ea7ee01218279b6ad360cd0f6ed9a9a323994500cfe\": container with ID starting with 1deb1f1bf82e17dc9f984ea7ee01218279b6ad360cd0f6ed9a9a323994500cfe not found: ID does not exist" containerID="1deb1f1bf82e17dc9f984ea7ee01218279b6ad360cd0f6ed9a9a323994500cfe"
Jul 24 19:54:18.679957 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:18.679930    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1deb1f1bf82e17dc9f984ea7ee01218279b6ad360cd0f6ed9a9a323994500cfe"} err="failed to get container status \"1deb1f1bf82e17dc9f984ea7ee01218279b6ad360cd0f6ed9a9a323994500cfe\": rpc error: code = NotFound desc = could not find container \"1deb1f1bf82e17dc9f984ea7ee01218279b6ad360cd0f6ed9a9a323994500cfe\": container with ID starting with 1deb1f1bf82e17dc9f984ea7ee01218279b6ad360cd0f6ed9a9a323994500cfe not found: ID does not exist"
Jul 24 19:54:18.679957 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:18.679947    2567 scope.go:117] "RemoveContainer" containerID="34002d77c59a86ae20e9e3055413068771c7287f091c0d31e0f2dd9084ba4b6d"
Jul 24 19:54:18.687270 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:18.687255    2567 scope.go:117] "RemoveContainer" containerID="34002d77c59a86ae20e9e3055413068771c7287f091c0d31e0f2dd9084ba4b6d"
Jul 24 19:54:18.687494 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:54:18.687462    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34002d77c59a86ae20e9e3055413068771c7287f091c0d31e0f2dd9084ba4b6d\": container with ID starting with 34002d77c59a86ae20e9e3055413068771c7287f091c0d31e0f2dd9084ba4b6d not found: ID does not exist" containerID="34002d77c59a86ae20e9e3055413068771c7287f091c0d31e0f2dd9084ba4b6d"
Jul 24 19:54:18.687543 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:18.687514    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34002d77c59a86ae20e9e3055413068771c7287f091c0d31e0f2dd9084ba4b6d"} err="failed to get container status \"34002d77c59a86ae20e9e3055413068771c7287f091c0d31e0f2dd9084ba4b6d\": rpc error: code = NotFound desc = could not find container \"34002d77c59a86ae20e9e3055413068771c7287f091c0d31e0f2dd9084ba4b6d\": container with ID starting with 34002d77c59a86ae20e9e3055413068771c7287f091c0d31e0f2dd9084ba4b6d not found: ID does not exist"
Jul 24 19:54:18.692947 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:18.692930    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrszv\" (UniqueName: \"kubernetes.io/projected/cb4c00ea-c19d-414f-9137-448ce290d385-kube-api-access-vrszv\") pod \"cb4c00ea-c19d-414f-9137-448ce290d385\" (UID: \"cb4c00ea-c19d-414f-9137-448ce290d385\") "
Jul 24 19:54:18.693011 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:18.692998    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k4jnh\" (UniqueName: \"kubernetes.io/projected/0554b436-275b-4261-a35e-bfcb1053219d-kube-api-access-k4jnh\") pod \"0554b436-275b-4261-a35e-bfcb1053219d\" (UID: \"0554b436-275b-4261-a35e-bfcb1053219d\") "
Jul 24 19:54:18.693071 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:18.693056    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb4c00ea-c19d-414f-9137-448ce290d385-plugins-config-volume\") pod \"cb4c00ea-c19d-414f-9137-448ce290d385\" (UID: \"cb4c00ea-c19d-414f-9137-448ce290d385\") "
Jul 24 19:54:18.693110 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:18.693098    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0554b436-275b-4261-a35e-bfcb1053219d-plugins-config-volume\") pod \"0554b436-275b-4261-a35e-bfcb1053219d\" (UID: \"0554b436-275b-4261-a35e-bfcb1053219d\") "
Jul 24 19:54:18.693373 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:18.693350    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb4c00ea-c19d-414f-9137-448ce290d385-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cb4c00ea-c19d-414f-9137-448ce290d385" (UID: "cb4c00ea-c19d-414f-9137-448ce290d385"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:54:18.693438 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:18.693420    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0554b436-275b-4261-a35e-bfcb1053219d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0554b436-275b-4261-a35e-bfcb1053219d" (UID: "0554b436-275b-4261-a35e-bfcb1053219d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:54:18.695156 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:18.695137    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0554b436-275b-4261-a35e-bfcb1053219d-kube-api-access-k4jnh" (OuterVolumeSpecName: "kube-api-access-k4jnh") pod "0554b436-275b-4261-a35e-bfcb1053219d" (UID: "0554b436-275b-4261-a35e-bfcb1053219d"). InnerVolumeSpecName "kube-api-access-k4jnh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:54:18.695231 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:18.695183    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb4c00ea-c19d-414f-9137-448ce290d385-kube-api-access-vrszv" (OuterVolumeSpecName: "kube-api-access-vrszv") pod "cb4c00ea-c19d-414f-9137-448ce290d385" (UID: "cb4c00ea-c19d-414f-9137-448ce290d385"). InnerVolumeSpecName "kube-api-access-vrszv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:54:18.794611 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:18.794573    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb4c00ea-c19d-414f-9137-448ce290d385-plugins-config-volume\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:54:18.794611 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:18.794614    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0554b436-275b-4261-a35e-bfcb1053219d-plugins-config-volume\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:54:18.794804 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:18.794628    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrszv\" (UniqueName: \"kubernetes.io/projected/cb4c00ea-c19d-414f-9137-448ce290d385-kube-api-access-vrszv\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:54:18.794804 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:18.794643    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4jnh\" (UniqueName: \"kubernetes.io/projected/0554b436-275b-4261-a35e-bfcb1053219d-kube-api-access-k4jnh\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:54:18.994053 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:18.994027    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-301a8697-5fb4d5b5cb-6fsz5"]
Jul 24 19:54:18.997902 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:18.997878    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-301a8697-5fb4d5b5cb-6fsz5"]
Jul 24 19:54:19.007708 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:19.007685    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-301a8697-bdcbfd7c-mqkpf"]
Jul 24 19:54:19.011320 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:19.011301    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-301a8697-bdcbfd7c-mqkpf"]
Jul 24 19:54:20.071214 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:20.071177    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0554b436-275b-4261-a35e-bfcb1053219d" path="/var/lib/kubelet/pods/0554b436-275b-4261-a35e-bfcb1053219d/volumes"
Jul 24 19:54:20.071611 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:20.071574    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb4c00ea-c19d-414f-9137-448ce290d385" path="/var/lib/kubelet/pods/cb4c00ea-c19d-414f-9137-448ce290d385/volumes"
Jul 24 19:54:23.089966 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:23.089923    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x"]
Jul 24 19:54:23.090433 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:23.090176    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x" podUID="f77aca8b-8df3-4ef0-b6b1-620fe6bae307" containerName="istio-proxy" containerID="cri-o://0d436158d0f947f1ab8f05585552f0c4a7d01ac87d51a5dae1c250a9876e3ee8" gracePeriod=30
Jul 24 19:54:23.945875 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:23.945841    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk"]
Jul 24 19:54:23.946194 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:23.946182    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb4c00ea-c19d-414f-9137-448ce290d385" containerName="payload-processing"
Jul 24 19:54:23.946239 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:23.946196    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb4c00ea-c19d-414f-9137-448ce290d385" containerName="payload-processing"
Jul 24 19:54:23.946239 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:23.946212    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0554b436-275b-4261-a35e-bfcb1053219d" containerName="payload-pre-processing"
Jul 24 19:54:23.946239 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:23.946219    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0554b436-275b-4261-a35e-bfcb1053219d" containerName="payload-pre-processing"
Jul 24 19:54:23.946329 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:23.946283    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0554b436-275b-4261-a35e-bfcb1053219d" containerName="payload-pre-processing"
Jul 24 19:54:23.946329 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:23.946294    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb4c00ea-c19d-414f-9137-448ce290d385" containerName="payload-processing"
Jul 24 19:54:23.949434 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:23.949418    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk"
Jul 24 19:54:23.954386 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:23.954364    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-4babb888-openshift-default-dockercfg-rppbd\""
Jul 24 19:54:24.021865 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:24.021834    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk"]
Jul 24 19:54:24.048876 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:24.048845    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f02304dd-bfd2-4371-ac4a-d6c044b83d57-istio-data\") pod \"e2e-ait-4babb888-openshift-default-758489d986-gwvbk\" (UID: \"f02304dd-bfd2-4371-ac4a-d6c044b83d57\") " pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk"
Jul 24 19:54:24.048876 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:24.048876    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f02304dd-bfd2-4371-ac4a-d6c044b83d57-istio-podinfo\") pod \"e2e-ait-4babb888-openshift-default-758489d986-gwvbk\" (UID: \"f02304dd-bfd2-4371-ac4a-d6c044b83d57\") " pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk"
Jul 24 19:54:24.049101 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:24.048940    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f02304dd-bfd2-4371-ac4a-d6c044b83d57-credential-socket\") pod \"e2e-ait-4babb888-openshift-default-758489d986-gwvbk\" (UID: \"f02304dd-bfd2-4371-ac4a-d6c044b83d57\") " pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk"
Jul 24 19:54:24.049101 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:24.048964    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f02304dd-bfd2-4371-ac4a-d6c044b83d57-istio-token\") pod \"e2e-ait-4babb888-openshift-default-758489d986-gwvbk\" (UID: \"f02304dd-bfd2-4371-ac4a-d6c044b83d57\") " pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk"
Jul 24 19:54:24.049101 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:24.048981    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f02304dd-bfd2-4371-ac4a-d6c044b83d57-istio-envoy\") pod \"e2e-ait-4babb888-openshift-default-758489d986-gwvbk\" (UID: \"f02304dd-bfd2-4371-ac4a-d6c044b83d57\") " pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk"
Jul 24 19:54:24.049101 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:24.049044    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f02304dd-bfd2-4371-ac4a-d6c044b83d57-workload-socket\") pod \"e2e-ait-4babb888-openshift-default-758489d986-gwvbk\" (UID: \"f02304dd-bfd2-4371-ac4a-d6c044b83d57\") " pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk"
Jul 24 19:54:24.049101 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:24.049060    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f02304dd-bfd2-4371-ac4a-d6c044b83d57-workload-certs\") pod \"e2e-ait-4babb888-openshift-default-758489d986-gwvbk\" (UID: \"f02304dd-bfd2-4371-ac4a-d6c044b83d57\") " pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk"
Jul 24 19:54:24.049327 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:24.049134    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f02304dd-bfd2-4371-ac4a-d6c044b83d57-istiod-ca-cert\") pod \"e2e-ait-4babb888-openshift-default-758489d986-gwvbk\" (UID: \"f02304dd-bfd2-4371-ac4a-d6c044b83d57\") " pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk"
Jul 24 19:54:24.049327 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:24.049206    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qsmr\" (UniqueName: \"kubernetes.io/projected/f02304dd-bfd2-4371-ac4a-d6c044b83d57-kube-api-access-6qsmr\") pod \"e2e-ait-4babb888-openshift-default-758489d986-gwvbk\" (UID: \"f02304dd-bfd2-4371-ac4a-d6c044b83d57\") " pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk"
Jul 24 19:54:24.150865 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:24.150822    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f02304dd-bfd2-4371-ac4a-d6c044b83d57-credential-socket\") pod \"e2e-ait-4babb888-openshift-default-758489d986-gwvbk\" (UID: \"f02304dd-bfd2-4371-ac4a-d6c044b83d57\") " pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk"
Jul 24 19:54:24.150865 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:24.150869    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f02304dd-bfd2-4371-ac4a-d6c044b83d57-istio-token\") pod \"e2e-ait-4babb888-openshift-default-758489d986-gwvbk\" (UID: \"f02304dd-bfd2-4371-ac4a-d6c044b83d57\") " pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk"
Jul 24 19:54:24.151393 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:24.150899    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f02304dd-bfd2-4371-ac4a-d6c044b83d57-istio-envoy\") pod \"e2e-ait-4babb888-openshift-default-758489d986-gwvbk\" (UID: \"f02304dd-bfd2-4371-ac4a-d6c044b83d57\") " pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk"
Jul 24 19:54:24.151393 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:24.150934    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f02304dd-bfd2-4371-ac4a-d6c044b83d57-workload-socket\") pod \"e2e-ait-4babb888-openshift-default-758489d986-gwvbk\" (UID: \"f02304dd-bfd2-4371-ac4a-d6c044b83d57\") " pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk"
Jul 24 19:54:24.151393 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:24.150960    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f02304dd-bfd2-4371-ac4a-d6c044b83d57-workload-certs\") pod \"e2e-ait-4babb888-openshift-default-758489d986-gwvbk\" (UID: \"f02304dd-bfd2-4371-ac4a-d6c044b83d57\") " pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk"
Jul 24 19:54:24.151393 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:24.150995    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f02304dd-bfd2-4371-ac4a-d6c044b83d57-istiod-ca-cert\") pod \"e2e-ait-4babb888-openshift-default-758489d986-gwvbk\" (UID: \"f02304dd-bfd2-4371-ac4a-d6c044b83d57\") " pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk"
Jul 24 19:54:24.151393 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:24.151050    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qsmr\" (UniqueName: \"kubernetes.io/projected/f02304dd-bfd2-4371-ac4a-d6c044b83d57-kube-api-access-6qsmr\") pod \"e2e-ait-4babb888-openshift-default-758489d986-gwvbk\" (UID: \"f02304dd-bfd2-4371-ac4a-d6c044b83d57\") " pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk"
Jul 24 19:54:24.151393 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:24.151089    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f02304dd-bfd2-4371-ac4a-d6c044b83d57-istio-data\") pod \"e2e-ait-4babb888-openshift-default-758489d986-gwvbk\" (UID: \"f02304dd-bfd2-4371-ac4a-d6c044b83d57\") " pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk"
Jul 24 19:54:24.151393 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:24.151124    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f02304dd-bfd2-4371-ac4a-d6c044b83d57-istio-podinfo\") pod \"e2e-ait-4babb888-openshift-default-758489d986-gwvbk\" (UID: \"f02304dd-bfd2-4371-ac4a-d6c044b83d57\") " pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk"
Jul 24 19:54:24.151748 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:24.151642    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f02304dd-bfd2-4371-ac4a-d6c044b83d57-workload-socket\") pod \"e2e-ait-4babb888-openshift-default-758489d986-gwvbk\" (UID: \"f02304dd-bfd2-4371-ac4a-d6c044b83d57\") " pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk"
Jul 24 19:54:24.152007 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:24.151986    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f02304dd-bfd2-4371-ac4a-d6c044b83d57-workload-certs\") pod \"e2e-ait-4babb888-openshift-default-758489d986-gwvbk\" (UID: \"f02304dd-bfd2-4371-ac4a-d6c044b83d57\") " pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk"
Jul 24 19:54:24.152202 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:24.152180    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f02304dd-bfd2-4371-ac4a-d6c044b83d57-credential-socket\") pod \"e2e-ait-4babb888-openshift-default-758489d986-gwvbk\" (UID: \"f02304dd-bfd2-4371-ac4a-d6c044b83d57\") " pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk"
Jul 24 19:54:24.152404 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:24.152384    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f02304dd-bfd2-4371-ac4a-d6c044b83d57-istio-data\") pod \"e2e-ait-4babb888-openshift-default-758489d986-gwvbk\" (UID: \"f02304dd-bfd2-4371-ac4a-d6c044b83d57\") " pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk"
Jul 24 19:54:24.152786 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:24.152763    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f02304dd-bfd2-4371-ac4a-d6c044b83d57-istiod-ca-cert\") pod \"e2e-ait-4babb888-openshift-default-758489d986-gwvbk\" (UID: \"f02304dd-bfd2-4371-ac4a-d6c044b83d57\") " pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk"
Jul 24 19:54:24.154092 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:24.154072    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f02304dd-bfd2-4371-ac4a-d6c044b83d57-istio-envoy\") pod \"e2e-ait-4babb888-openshift-default-758489d986-gwvbk\" (UID: \"f02304dd-bfd2-4371-ac4a-d6c044b83d57\") " pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk"
Jul 24 19:54:24.154179 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:24.154133    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f02304dd-bfd2-4371-ac4a-d6c044b83d57-istio-podinfo\") pod \"e2e-ait-4babb888-openshift-default-758489d986-gwvbk\" (UID: \"f02304dd-bfd2-4371-ac4a-d6c044b83d57\") " pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk"
Jul 24 19:54:24.163797 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:24.163772    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f02304dd-bfd2-4371-ac4a-d6c044b83d57-istio-token\") pod \"e2e-ait-4babb888-openshift-default-758489d986-gwvbk\" (UID: \"f02304dd-bfd2-4371-ac4a-d6c044b83d57\") " pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk"
Jul 24 19:54:24.164309 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:24.164288    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qsmr\" (UniqueName: \"kubernetes.io/projected/f02304dd-bfd2-4371-ac4a-d6c044b83d57-kube-api-access-6qsmr\") pod \"e2e-ait-4babb888-openshift-default-758489d986-gwvbk\" (UID: \"f02304dd-bfd2-4371-ac4a-d6c044b83d57\") " pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk"
Jul 24 19:54:24.259444 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:24.259362    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk"
Jul 24 19:54:24.396829 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:24.396799    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk"]
Jul 24 19:54:24.398539 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:54:24.398513    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf02304dd_bfd2_4371_ac4a_d6c044b83d57.slice/crio-9ba2eff665eea77cab25b4de99f50aba4f1debf82f9b35c6cfaeac03c0b3a86f WatchSource:0}: Error finding container 9ba2eff665eea77cab25b4de99f50aba4f1debf82f9b35c6cfaeac03c0b3a86f: Status 404 returned error can't find the container with id 9ba2eff665eea77cab25b4de99f50aba4f1debf82f9b35c6cfaeac03c0b3a86f
Jul 24 19:54:24.400602 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:24.400571    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 19:54:24.400673 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:24.400660    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 19:54:24.400714 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:24.400695    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 19:54:24.705215 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:24.705181    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk" event={"ID":"f02304dd-bfd2-4371-ac4a-d6c044b83d57","Type":"ContainerStarted","Data":"081aa22751d1a0317810a3170d9f2ac561c8e9759513685c6d33d8aa2c081f24"}
Jul 24 19:54:24.705606 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:24.705229    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk" event={"ID":"f02304dd-bfd2-4371-ac4a-d6c044b83d57","Type":"ContainerStarted","Data":"9ba2eff665eea77cab25b4de99f50aba4f1debf82f9b35c6cfaeac03c0b3a86f"}
Jul 24 19:54:24.726587 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:24.726541    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk" podStartSLOduration=1.726525981 podStartE2EDuration="1.726525981s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:54:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:54:24.725990436 +0000 UTC m=+1653.244610487" watchObservedRunningTime="2026-07-24 19:54:24.726525981 +0000 UTC m=+1653.245146021"
Jul 24 19:54:25.260204 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:25.260173    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk"
Jul 24 19:54:25.265417 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:25.265393    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk"
Jul 24 19:54:25.342105 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:25.342066    2567 patch_prober.go:28] interesting pod/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 19:54:25.342251 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:25.342124    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x" podUID="f77aca8b-8df3-4ef0-b6b1-620fe6bae307" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 19:54:25.712862 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:25.712827    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk"
Jul 24 19:54:25.713909 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:25.713887    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk"
Jul 24 19:54:27.006830 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:27.006796    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4babb888-bb6578596-4rxr8"]
Jul 24 19:54:27.010163 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:27.010146    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4babb888-bb6578596-4rxr8"
Jul 24 19:54:27.012704 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:27.012681    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-4babb888-dockercfg-ftl74\""
Jul 24 19:54:27.012930 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:27.012914    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-4babb888\""
Jul 24 19:54:27.021459 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:27.021438    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4babb888-bb6578596-4rxr8"]
Jul 24 19:54:27.080911 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:27.080874    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8j47\" (UniqueName: \"kubernetes.io/projected/f59fcc82-d80d-4ced-ba65-679caf681186-kube-api-access-c8j47\") pod \"payload-pre-processing-e2e-ait-4babb888-bb6578596-4rxr8\" (UID: \"f59fcc82-d80d-4ced-ba65-679caf681186\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4babb888-bb6578596-4rxr8"
Jul 24 19:54:27.081081 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:27.080922    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f59fcc82-d80d-4ced-ba65-679caf681186-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-4babb888-bb6578596-4rxr8\" (UID: \"f59fcc82-d80d-4ced-ba65-679caf681186\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4babb888-bb6578596-4rxr8"
Jul 24 19:54:27.181648 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:27.181617    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8j47\" (UniqueName: \"kubernetes.io/projected/f59fcc82-d80d-4ced-ba65-679caf681186-kube-api-access-c8j47\") pod \"payload-pre-processing-e2e-ait-4babb888-bb6578596-4rxr8\" (UID: \"f59fcc82-d80d-4ced-ba65-679caf681186\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4babb888-bb6578596-4rxr8"
Jul 24 19:54:27.181807 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:27.181652    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f59fcc82-d80d-4ced-ba65-679caf681186-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-4babb888-bb6578596-4rxr8\" (UID: \"f59fcc82-d80d-4ced-ba65-679caf681186\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4babb888-bb6578596-4rxr8"
Jul 24 19:54:27.182282 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:27.182265    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f59fcc82-d80d-4ced-ba65-679caf681186-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-4babb888-bb6578596-4rxr8\" (UID: \"f59fcc82-d80d-4ced-ba65-679caf681186\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4babb888-bb6578596-4rxr8"
Jul 24 19:54:27.196036 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:27.196003    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8j47\" (UniqueName: \"kubernetes.io/projected/f59fcc82-d80d-4ced-ba65-679caf681186-kube-api-access-c8j47\") pod \"payload-pre-processing-e2e-ait-4babb888-bb6578596-4rxr8\" (UID: \"f59fcc82-d80d-4ced-ba65-679caf681186\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4babb888-bb6578596-4rxr8"
Jul 24 19:54:27.321437 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:27.321350    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4babb888-bb6578596-4rxr8"
Jul 24 19:54:27.461391 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:27.461361    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4babb888-bb6578596-4rxr8"]
Jul 24 19:54:27.463292 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:54:27.463267    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf59fcc82_d80d_4ced_ba65_679caf681186.slice/crio-cea5003cf49c4737d3c6f63ab81a1b8995e2d77e5b27b457757016303118b231 WatchSource:0}: Error finding container cea5003cf49c4737d3c6f63ab81a1b8995e2d77e5b27b457757016303118b231: Status 404 returned error can't find the container with id cea5003cf49c4737d3c6f63ab81a1b8995e2d77e5b27b457757016303118b231
Jul 24 19:54:27.726259 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:27.726210    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4babb888-bb6578596-4rxr8" event={"ID":"f59fcc82-d80d-4ced-ba65-679caf681186","Type":"ContainerStarted","Data":"f6bb605ff1538a51933116c57a3fe74ceeff1f2c1f47af88521a1f2a47b3810b"}
Jul 24 19:54:27.726437 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:27.726277    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4babb888-bb6578596-4rxr8" event={"ID":"f59fcc82-d80d-4ced-ba65-679caf681186","Type":"ContainerStarted","Data":"cea5003cf49c4737d3c6f63ab81a1b8995e2d77e5b27b457757016303118b231"}
Jul 24 19:54:27.726437 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:27.726307    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-4babb888-bb6578596-4rxr8"
Jul 24 19:54:27.806303 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:27.806251    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-4babb888-bb6578596-4rxr8" podStartSLOduration=1.806235619 podStartE2EDuration="1.806235619s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:54:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:54:27.80543915 +0000 UTC m=+1656.324059191" watchObservedRunningTime="2026-07-24 19:54:27.806235619 +0000 UTC m=+1656.324855659"
Jul 24 19:54:28.348343 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:28.348316    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x"
Jul 24 19:54:28.391826 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:28.391798    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-istio-data\") pod \"f77aca8b-8df3-4ef0-b6b1-620fe6bae307\" (UID: \"f77aca8b-8df3-4ef0-b6b1-620fe6bae307\") "
Jul 24 19:54:28.391974 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:28.391892    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-credential-socket\") pod \"f77aca8b-8df3-4ef0-b6b1-620fe6bae307\" (UID: \"f77aca8b-8df3-4ef0-b6b1-620fe6bae307\") "
Jul 24 19:54:28.391974 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:28.391952    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-workload-socket\") pod \"f77aca8b-8df3-4ef0-b6b1-620fe6bae307\" (UID: \"f77aca8b-8df3-4ef0-b6b1-620fe6bae307\") "
Jul 24 19:54:28.392049 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:28.391980    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-istiod-ca-cert\") pod \"f77aca8b-8df3-4ef0-b6b1-620fe6bae307\" (UID: \"f77aca8b-8df3-4ef0-b6b1-620fe6bae307\") "
Jul 24 19:54:28.392049 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:28.392003    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-istio-envoy\") pod \"f77aca8b-8df3-4ef0-b6b1-620fe6bae307\" (UID: \"f77aca8b-8df3-4ef0-b6b1-620fe6bae307\") "
Jul 24 19:54:28.392146 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:28.392050    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-workload-certs\") pod \"f77aca8b-8df3-4ef0-b6b1-620fe6bae307\" (UID: \"f77aca8b-8df3-4ef0-b6b1-620fe6bae307\") "
Jul 24 19:54:28.392146 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:28.392078    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cm725\" (UniqueName: \"kubernetes.io/projected/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-kube-api-access-cm725\") pod \"f77aca8b-8df3-4ef0-b6b1-620fe6bae307\" (UID: \"f77aca8b-8df3-4ef0-b6b1-620fe6bae307\") "
Jul 24 19:54:28.392146 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:28.392114    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-istio-token\") pod \"f77aca8b-8df3-4ef0-b6b1-620fe6bae307\" (UID: \"f77aca8b-8df3-4ef0-b6b1-620fe6bae307\") "
Jul 24 19:54:28.392298 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:28.392161    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-istio-podinfo\") pod \"f77aca8b-8df3-4ef0-b6b1-620fe6bae307\" (UID: \"f77aca8b-8df3-4ef0-b6b1-620fe6bae307\") "
Jul 24 19:54:28.392298 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:28.392170    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f77aca8b-8df3-4ef0-b6b1-620fe6bae307" (UID: "f77aca8b-8df3-4ef0-b6b1-620fe6bae307"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:54:28.392400 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:28.392302    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f77aca8b-8df3-4ef0-b6b1-620fe6bae307" (UID: "f77aca8b-8df3-4ef0-b6b1-620fe6bae307"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:54:28.392400 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:28.392369    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f77aca8b-8df3-4ef0-b6b1-620fe6bae307" (UID: "f77aca8b-8df3-4ef0-b6b1-620fe6bae307"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:54:28.392599 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:28.392518    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-workload-socket\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:54:28.392599 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:28.392538    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-istiod-ca-cert\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:54:28.392599 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:28.392554    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-credential-socket\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:54:28.392765 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:28.392716    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f77aca8b-8df3-4ef0-b6b1-620fe6bae307" (UID: "f77aca8b-8df3-4ef0-b6b1-620fe6bae307"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:54:28.392765 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:28.392747    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-istio-data" (OuterVolumeSpecName: "istio-data") pod "f77aca8b-8df3-4ef0-b6b1-620fe6bae307" (UID: "f77aca8b-8df3-4ef0-b6b1-620fe6bae307"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:54:28.394608 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:28.394585    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f77aca8b-8df3-4ef0-b6b1-620fe6bae307" (UID: "f77aca8b-8df3-4ef0-b6b1-620fe6bae307"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 19:54:28.394890 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:28.394866    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-istio-token" (OuterVolumeSpecName: "istio-token") pod "f77aca8b-8df3-4ef0-b6b1-620fe6bae307" (UID: "f77aca8b-8df3-4ef0-b6b1-620fe6bae307"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:54:28.394968 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:28.394947    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-kube-api-access-cm725" (OuterVolumeSpecName: "kube-api-access-cm725") pod "f77aca8b-8df3-4ef0-b6b1-620fe6bae307" (UID: "f77aca8b-8df3-4ef0-b6b1-620fe6bae307"). InnerVolumeSpecName "kube-api-access-cm725". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:54:28.395014 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:28.394976    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f77aca8b-8df3-4ef0-b6b1-620fe6bae307" (UID: "f77aca8b-8df3-4ef0-b6b1-620fe6bae307"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:54:28.493928 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:28.493897    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-istio-envoy\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:54:28.493928 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:28.493923    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-workload-certs\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:54:28.493928 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:28.493932    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cm725\" (UniqueName: \"kubernetes.io/projected/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-kube-api-access-cm725\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:54:28.494155 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:28.493941    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-istio-token\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:54:28.494155 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:28.493950    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-istio-podinfo\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:54:28.494155 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:28.493957    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f77aca8b-8df3-4ef0-b6b1-620fe6bae307-istio-data\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:54:28.732944 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:28.732862    2567 generic.go:356] "Generic (PLEG): container finished" podID="f77aca8b-8df3-4ef0-b6b1-620fe6bae307" containerID="0d436158d0f947f1ab8f05585552f0c4a7d01ac87d51a5dae1c250a9876e3ee8" exitCode=0
Jul 24 19:54:28.732944 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:28.732927    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x"
Jul 24 19:54:28.733128 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:28.732949    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x" event={"ID":"f77aca8b-8df3-4ef0-b6b1-620fe6bae307","Type":"ContainerDied","Data":"0d436158d0f947f1ab8f05585552f0c4a7d01ac87d51a5dae1c250a9876e3ee8"}
Jul 24 19:54:28.733128 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:28.733009    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x" event={"ID":"f77aca8b-8df3-4ef0-b6b1-620fe6bae307","Type":"ContainerDied","Data":"cc21220642a3cce33d9498a5599002d482b22b5981c1dd32ecfd9724592a3a7b"}
Jul 24 19:54:28.733128 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:28.733043    2567 scope.go:117] "RemoveContainer" containerID="0d436158d0f947f1ab8f05585552f0c4a7d01ac87d51a5dae1c250a9876e3ee8"
Jul 24 19:54:28.743619 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:28.743391    2567 scope.go:117] "RemoveContainer" containerID="5b4096f8e3320567764476bd547581c2c4188775c98f597149ff35ce371db4d2"
Jul 24 19:54:28.751727 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:28.751709    2567 scope.go:117] "RemoveContainer" containerID="0d436158d0f947f1ab8f05585552f0c4a7d01ac87d51a5dae1c250a9876e3ee8"
Jul 24 19:54:28.751974 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:54:28.751956    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d436158d0f947f1ab8f05585552f0c4a7d01ac87d51a5dae1c250a9876e3ee8\": container with ID starting with 0d436158d0f947f1ab8f05585552f0c4a7d01ac87d51a5dae1c250a9876e3ee8 not found: ID does not exist" containerID="0d436158d0f947f1ab8f05585552f0c4a7d01ac87d51a5dae1c250a9876e3ee8"
Jul 24 19:54:28.752015 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:28.751984    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d436158d0f947f1ab8f05585552f0c4a7d01ac87d51a5dae1c250a9876e3ee8"} err="failed to get container status \"0d436158d0f947f1ab8f05585552f0c4a7d01ac87d51a5dae1c250a9876e3ee8\": rpc error: code = NotFound desc = could not find container \"0d436158d0f947f1ab8f05585552f0c4a7d01ac87d51a5dae1c250a9876e3ee8\": container with ID starting with 0d436158d0f947f1ab8f05585552f0c4a7d01ac87d51a5dae1c250a9876e3ee8 not found: ID does not exist"
Jul 24 19:54:28.752015 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:28.752003    2567 scope.go:117] "RemoveContainer" containerID="5b4096f8e3320567764476bd547581c2c4188775c98f597149ff35ce371db4d2"
Jul 24 19:54:28.752238 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:54:28.752223    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b4096f8e3320567764476bd547581c2c4188775c98f597149ff35ce371db4d2\": container with ID starting with 5b4096f8e3320567764476bd547581c2c4188775c98f597149ff35ce371db4d2 not found: ID does not exist" containerID="5b4096f8e3320567764476bd547581c2c4188775c98f597149ff35ce371db4d2"
Jul 24 19:54:28.752275 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:28.752245    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b4096f8e3320567764476bd547581c2c4188775c98f597149ff35ce371db4d2"} err="failed to get container status \"5b4096f8e3320567764476bd547581c2c4188775c98f597149ff35ce371db4d2\": rpc error: code = NotFound desc = could not find container \"5b4096f8e3320567764476bd547581c2c4188775c98f597149ff35ce371db4d2\": container with ID starting with 5b4096f8e3320567764476bd547581c2c4188775c98f597149ff35ce371db4d2 not found: ID does not exist"
Jul 24 19:54:28.756838 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:28.756818    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x"]
Jul 24 19:54:28.760796 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:28.760778    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-301a8697-gw-openshift-default-6c897559d8-z9t2x"]
Jul 24 19:54:30.071977 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:30.071942    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f77aca8b-8df3-4ef0-b6b1-620fe6bae307" path="/var/lib/kubelet/pods/f77aca8b-8df3-4ef0-b6b1-620fe6bae307/volumes"
Jul 24 19:54:37.784458 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:37.784424    2567 generic.go:356] "Generic (PLEG): container finished" podID="f02304dd-bfd2-4371-ac4a-d6c044b83d57" containerID="081aa22751d1a0317810a3170d9f2ac561c8e9759513685c6d33d8aa2c081f24" exitCode=0
Jul 24 19:54:37.784888 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:37.784473    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk" event={"ID":"f02304dd-bfd2-4371-ac4a-d6c044b83d57","Type":"ContainerDied","Data":"081aa22751d1a0317810a3170d9f2ac561c8e9759513685c6d33d8aa2c081f24"}
Jul 24 19:54:37.784888 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:37.784817    2567 scope.go:117] "RemoveContainer" containerID="081aa22751d1a0317810a3170d9f2ac561c8e9759513685c6d33d8aa2c081f24"
Jul 24 19:54:37.785868 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:37.785837    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 19:54:37.785934 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:37.785920    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 19:54:37.785975 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:37.785956    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 19:54:38.736657 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:38.736621    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-4babb888-bb6578596-4rxr8"
Jul 24 19:54:38.792822 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:38.792792    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk" event={"ID":"f02304dd-bfd2-4371-ac4a-d6c044b83d57","Type":"ContainerStarted","Data":"a908e0428c3ed1a6e363040e07c6730f5a49a48f4d245d8b9f86e84387add329"}
Jul 24 19:54:39.260256 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:39.260216    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk"
Jul 24 19:54:39.261467 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:39.261443    2567 patch_prober.go:28] interesting pod/e2e-ait-4babb888-openshift-default-758489d986-gwvbk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 24 19:54:39.261586 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:39.261530    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk" podUID="f02304dd-bfd2-4371-ac4a-d6c044b83d57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 24 19:54:40.260430 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:40.260390    2567 patch_prober.go:28] interesting pod/e2e-ait-4babb888-openshift-default-758489d986-gwvbk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 24 19:54:40.260850 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:40.260456    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk" podUID="f02304dd-bfd2-4371-ac4a-d6c044b83d57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 24 19:54:40.713532 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:40.713500    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk"
Jul 24 19:54:41.260194 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:41.260159    2567 patch_prober.go:28] interesting pod/e2e-ait-4babb888-openshift-default-758489d986-gwvbk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 24 19:54:41.260374 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:41.260223    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk" podUID="f02304dd-bfd2-4371-ac4a-d6c044b83d57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 24 19:54:42.260796 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:42.260755    2567 patch_prober.go:28] interesting pod/e2e-ait-4babb888-openshift-default-758489d986-gwvbk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 24 19:54:42.261169 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:42.260815    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk" podUID="f02304dd-bfd2-4371-ac4a-d6c044b83d57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 24 19:54:43.264201 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:43.264161    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk"
Jul 24 19:54:43.265300 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:54:43.265280    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk"
Jul 24 19:55:02.560974 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:02.560937    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4babb888-bb6578596-4rxr8"]
Jul 24 19:55:02.561458 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:02.561218    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-4babb888-bb6578596-4rxr8" podUID="f59fcc82-d80d-4ced-ba65-679caf681186" containerName="payload-pre-processing" containerID="cri-o://f6bb605ff1538a51933116c57a3fe74ceeff1f2c1f47af88521a1f2a47b3810b" gracePeriod=30
Jul 24 19:55:02.813264 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:02.813208    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4babb888-bb6578596-4rxr8"
Jul 24 19:55:02.907913 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:02.907881    2567 generic.go:356] "Generic (PLEG): container finished" podID="f59fcc82-d80d-4ced-ba65-679caf681186" containerID="f6bb605ff1538a51933116c57a3fe74ceeff1f2c1f47af88521a1f2a47b3810b" exitCode=0
Jul 24 19:55:02.908087 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:02.907927    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4babb888-bb6578596-4rxr8"
Jul 24 19:55:02.908087 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:02.907970    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4babb888-bb6578596-4rxr8" event={"ID":"f59fcc82-d80d-4ced-ba65-679caf681186","Type":"ContainerDied","Data":"f6bb605ff1538a51933116c57a3fe74ceeff1f2c1f47af88521a1f2a47b3810b"}
Jul 24 19:55:02.908087 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:02.908022    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4babb888-bb6578596-4rxr8" event={"ID":"f59fcc82-d80d-4ced-ba65-679caf681186","Type":"ContainerDied","Data":"cea5003cf49c4737d3c6f63ab81a1b8995e2d77e5b27b457757016303118b231"}
Jul 24 19:55:02.908087 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:02.908044    2567 scope.go:117] "RemoveContainer" containerID="f6bb605ff1538a51933116c57a3fe74ceeff1f2c1f47af88521a1f2a47b3810b"
Jul 24 19:55:02.914351 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:02.914332    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8j47\" (UniqueName: \"kubernetes.io/projected/f59fcc82-d80d-4ced-ba65-679caf681186-kube-api-access-c8j47\") pod \"f59fcc82-d80d-4ced-ba65-679caf681186\" (UID: \"f59fcc82-d80d-4ced-ba65-679caf681186\") "
Jul 24 19:55:02.914507 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:02.914420    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f59fcc82-d80d-4ced-ba65-679caf681186-plugins-config-volume\") pod \"f59fcc82-d80d-4ced-ba65-679caf681186\" (UID: \"f59fcc82-d80d-4ced-ba65-679caf681186\") "
Jul 24 19:55:02.914785 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:02.914758    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f59fcc82-d80d-4ced-ba65-679caf681186-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f59fcc82-d80d-4ced-ba65-679caf681186" (UID: "f59fcc82-d80d-4ced-ba65-679caf681186"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:55:02.916497 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:02.916462    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f59fcc82-d80d-4ced-ba65-679caf681186-kube-api-access-c8j47" (OuterVolumeSpecName: "kube-api-access-c8j47") pod "f59fcc82-d80d-4ced-ba65-679caf681186" (UID: "f59fcc82-d80d-4ced-ba65-679caf681186"). InnerVolumeSpecName "kube-api-access-c8j47". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:55:02.916962 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:02.916945    2567 scope.go:117] "RemoveContainer" containerID="f6bb605ff1538a51933116c57a3fe74ceeff1f2c1f47af88521a1f2a47b3810b"
Jul 24 19:55:02.917241 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:55:02.917223    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6bb605ff1538a51933116c57a3fe74ceeff1f2c1f47af88521a1f2a47b3810b\": container with ID starting with f6bb605ff1538a51933116c57a3fe74ceeff1f2c1f47af88521a1f2a47b3810b not found: ID does not exist" containerID="f6bb605ff1538a51933116c57a3fe74ceeff1f2c1f47af88521a1f2a47b3810b"
Jul 24 19:55:02.917313 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:02.917250    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6bb605ff1538a51933116c57a3fe74ceeff1f2c1f47af88521a1f2a47b3810b"} err="failed to get container status \"f6bb605ff1538a51933116c57a3fe74ceeff1f2c1f47af88521a1f2a47b3810b\": rpc error: code = NotFound desc = could not find container \"f6bb605ff1538a51933116c57a3fe74ceeff1f2c1f47af88521a1f2a47b3810b\": container with ID starting with f6bb605ff1538a51933116c57a3fe74ceeff1f2c1f47af88521a1f2a47b3810b not found: ID does not exist"
Jul 24 19:55:03.015936 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:03.015906    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8j47\" (UniqueName: \"kubernetes.io/projected/f59fcc82-d80d-4ced-ba65-679caf681186-kube-api-access-c8j47\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:55:03.015936 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:03.015931    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f59fcc82-d80d-4ced-ba65-679caf681186-plugins-config-volume\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:55:03.228887 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:03.228861    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4babb888-bb6578596-4rxr8"]
Jul 24 19:55:03.233361 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:03.233334    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4babb888-bb6578596-4rxr8"]
Jul 24 19:55:04.071354 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:04.071312    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f59fcc82-d80d-4ced-ba65-679caf681186" path="/var/lib/kubelet/pods/f59fcc82-d80d-4ced-ba65-679caf681186/volumes"
Jul 24 19:55:08.091068 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:08.091024    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk"]
Jul 24 19:55:08.091557 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:08.091267    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk" podUID="f02304dd-bfd2-4371-ac4a-d6c044b83d57" containerName="istio-proxy" containerID="cri-o://a908e0428c3ed1a6e363040e07c6730f5a49a48f4d245d8b9f86e84387add329" gracePeriod=30
Jul 24 19:55:08.823552 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:08.823521    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6"]
Jul 24 19:55:08.823923 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:08.823909    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f77aca8b-8df3-4ef0-b6b1-620fe6bae307" containerName="istio-proxy"
Jul 24 19:55:08.823980 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:08.823925    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f77aca8b-8df3-4ef0-b6b1-620fe6bae307" containerName="istio-proxy"
Jul 24 19:55:08.823980 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:08.823948    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f77aca8b-8df3-4ef0-b6b1-620fe6bae307" containerName="istio-proxy"
Jul 24 19:55:08.823980 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:08.823954    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f77aca8b-8df3-4ef0-b6b1-620fe6bae307" containerName="istio-proxy"
Jul 24 19:55:08.823980 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:08.823960    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f59fcc82-d80d-4ced-ba65-679caf681186" containerName="payload-pre-processing"
Jul 24 19:55:08.823980 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:08.823966    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f59fcc82-d80d-4ced-ba65-679caf681186" containerName="payload-pre-processing"
Jul 24 19:55:08.824158 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:08.824019    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f77aca8b-8df3-4ef0-b6b1-620fe6bae307" containerName="istio-proxy"
Jul 24 19:55:08.824158 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:08.824030    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f77aca8b-8df3-4ef0-b6b1-620fe6bae307" containerName="istio-proxy"
Jul 24 19:55:08.824158 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:08.824038    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f59fcc82-d80d-4ced-ba65-679caf681186" containerName="payload-pre-processing"
Jul 24 19:55:08.828438 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:08.828420    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6"
Jul 24 19:55:08.830824 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:08.830805    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-9b3176cc-openshift-default-dockercfg-5k6vq\""
Jul 24 19:55:08.838119 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:08.838075    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6"]
Jul 24 19:55:08.867867 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:08.867834    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b385f9fe-bdae-41cf-b5c8-c3724df38fca-istio-podinfo\") pod \"e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6\" (UID: \"b385f9fe-bdae-41cf-b5c8-c3724df38fca\") " pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6"
Jul 24 19:55:08.868010 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:08.867935    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b385f9fe-bdae-41cf-b5c8-c3724df38fca-credential-socket\") pod \"e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6\" (UID: \"b385f9fe-bdae-41cf-b5c8-c3724df38fca\") " pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6"
Jul 24 19:55:08.868010 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:08.867961    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhvhg\" (UniqueName: \"kubernetes.io/projected/b385f9fe-bdae-41cf-b5c8-c3724df38fca-kube-api-access-vhvhg\") pod \"e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6\" (UID: \"b385f9fe-bdae-41cf-b5c8-c3724df38fca\") " pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6"
Jul 24 19:55:08.868010 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:08.867988    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b385f9fe-bdae-41cf-b5c8-c3724df38fca-workload-certs\") pod \"e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6\" (UID: \"b385f9fe-bdae-41cf-b5c8-c3724df38fca\") " pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6"
Jul 24 19:55:08.868010 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:08.868004    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b385f9fe-bdae-41cf-b5c8-c3724df38fca-istio-token\") pod \"e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6\" (UID: \"b385f9fe-bdae-41cf-b5c8-c3724df38fca\") " pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6"
Jul 24 19:55:08.868177 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:08.868021    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b385f9fe-bdae-41cf-b5c8-c3724df38fca-istiod-ca-cert\") pod \"e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6\" (UID: \"b385f9fe-bdae-41cf-b5c8-c3724df38fca\") " pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6"
Jul 24 19:55:08.868177 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:08.868055    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b385f9fe-bdae-41cf-b5c8-c3724df38fca-workload-socket\") pod \"e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6\" (UID: \"b385f9fe-bdae-41cf-b5c8-c3724df38fca\") " pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6"
Jul 24 19:55:08.868177 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:08.868076    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b385f9fe-bdae-41cf-b5c8-c3724df38fca-istio-envoy\") pod \"e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6\" (UID: \"b385f9fe-bdae-41cf-b5c8-c3724df38fca\") " pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6"
Jul 24 19:55:08.868177 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:08.868090    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b385f9fe-bdae-41cf-b5c8-c3724df38fca-istio-data\") pod \"e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6\" (UID: \"b385f9fe-bdae-41cf-b5c8-c3724df38fca\") " pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6"
Jul 24 19:55:08.968844 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:08.968814    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b385f9fe-bdae-41cf-b5c8-c3724df38fca-workload-certs\") pod \"e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6\" (UID: \"b385f9fe-bdae-41cf-b5c8-c3724df38fca\") " pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6"
Jul 24 19:55:08.969038 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:08.968853    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b385f9fe-bdae-41cf-b5c8-c3724df38fca-istio-token\") pod \"e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6\" (UID: \"b385f9fe-bdae-41cf-b5c8-c3724df38fca\") " pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6"
Jul 24 19:55:08.969038 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:08.968875    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b385f9fe-bdae-41cf-b5c8-c3724df38fca-istiod-ca-cert\") pod \"e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6\" (UID: \"b385f9fe-bdae-41cf-b5c8-c3724df38fca\") " pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6"
Jul 24 19:55:08.969038 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:08.968901    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b385f9fe-bdae-41cf-b5c8-c3724df38fca-workload-socket\") pod \"e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6\" (UID: \"b385f9fe-bdae-41cf-b5c8-c3724df38fca\") " pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6"
Jul 24 19:55:08.969038 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:08.969015    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b385f9fe-bdae-41cf-b5c8-c3724df38fca-istio-envoy\") pod \"e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6\" (UID: \"b385f9fe-bdae-41cf-b5c8-c3724df38fca\") " pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6"
Jul 24 19:55:08.969342 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:08.969055    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b385f9fe-bdae-41cf-b5c8-c3724df38fca-istio-data\") pod \"e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6\" (UID: \"b385f9fe-bdae-41cf-b5c8-c3724df38fca\") " pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6"
Jul 24 19:55:08.969342 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:08.969126    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b385f9fe-bdae-41cf-b5c8-c3724df38fca-istio-podinfo\") pod \"e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6\" (UID: \"b385f9fe-bdae-41cf-b5c8-c3724df38fca\") " pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6"
Jul 24 19:55:08.969342 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:08.969248    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b385f9fe-bdae-41cf-b5c8-c3724df38fca-credential-socket\") pod \"e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6\" (UID: \"b385f9fe-bdae-41cf-b5c8-c3724df38fca\") " pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6"
Jul 24 19:55:08.969342 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:08.969264    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b385f9fe-bdae-41cf-b5c8-c3724df38fca-workload-socket\") pod \"e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6\" (UID: \"b385f9fe-bdae-41cf-b5c8-c3724df38fca\") " pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6"
Jul 24 19:55:08.969342 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:08.969277    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhvhg\" (UniqueName: \"kubernetes.io/projected/b385f9fe-bdae-41cf-b5c8-c3724df38fca-kube-api-access-vhvhg\") pod \"e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6\" (UID: \"b385f9fe-bdae-41cf-b5c8-c3724df38fca\") " pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6"
Jul 24 19:55:08.969854 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:08.969831    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b385f9fe-bdae-41cf-b5c8-c3724df38fca-istiod-ca-cert\") pod \"e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6\" (UID: \"b385f9fe-bdae-41cf-b5c8-c3724df38fca\") " pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6"
Jul 24 19:55:08.969960 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:08.969926    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b385f9fe-bdae-41cf-b5c8-c3724df38fca-workload-certs\") pod \"e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6\" (UID: \"b385f9fe-bdae-41cf-b5c8-c3724df38fca\") " pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6"
Jul 24 19:55:08.969960 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:08.969930    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b385f9fe-bdae-41cf-b5c8-c3724df38fca-credential-socket\") pod \"e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6\" (UID: \"b385f9fe-bdae-41cf-b5c8-c3724df38fca\") " pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6"
Jul 24 19:55:08.970174 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:08.970155    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b385f9fe-bdae-41cf-b5c8-c3724df38fca-istio-data\") pod \"e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6\" (UID: \"b385f9fe-bdae-41cf-b5c8-c3724df38fca\") " pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6"
Jul 24 19:55:08.971359 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:08.971335    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b385f9fe-bdae-41cf-b5c8-c3724df38fca-istio-envoy\") pod \"e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6\" (UID: \"b385f9fe-bdae-41cf-b5c8-c3724df38fca\") " pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6"
Jul 24 19:55:08.971786 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:08.971768    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b385f9fe-bdae-41cf-b5c8-c3724df38fca-istio-podinfo\") pod \"e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6\" (UID: \"b385f9fe-bdae-41cf-b5c8-c3724df38fca\") " pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6"
Jul 24 19:55:08.977187 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:08.977165    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b385f9fe-bdae-41cf-b5c8-c3724df38fca-istio-token\") pod \"e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6\" (UID: \"b385f9fe-bdae-41cf-b5c8-c3724df38fca\") " pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6"
Jul 24 19:55:08.977521 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:08.977500    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhvhg\" (UniqueName: \"kubernetes.io/projected/b385f9fe-bdae-41cf-b5c8-c3724df38fca-kube-api-access-vhvhg\") pod \"e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6\" (UID: \"b385f9fe-bdae-41cf-b5c8-c3724df38fca\") " pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6"
Jul 24 19:55:09.141712 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:09.141680    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6"
Jul 24 19:55:09.277060 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:09.277038    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6"]
Jul 24 19:55:09.279374 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:55:09.279346    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb385f9fe_bdae_41cf_b5c8_c3724df38fca.slice/crio-d1a722599e41243b550b62f75228f726c8cb114d412fc50bb57b94fbf7735947 WatchSource:0}: Error finding container d1a722599e41243b550b62f75228f726c8cb114d412fc50bb57b94fbf7735947: Status 404 returned error can't find the container with id d1a722599e41243b550b62f75228f726c8cb114d412fc50bb57b94fbf7735947
Jul 24 19:55:09.281851 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:09.281819    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 19:55:09.281927 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:09.281884    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 19:55:09.281927 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:09.281910    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 19:55:09.948882 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:09.948842    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6" event={"ID":"b385f9fe-bdae-41cf-b5c8-c3724df38fca","Type":"ContainerStarted","Data":"7425a21a8e456c83ec0bd9e3a45ff3554263ac31a5ed00dac1943b3f247a5191"}
Jul 24 19:55:09.949098 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:09.948909    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6" event={"ID":"b385f9fe-bdae-41cf-b5c8-c3724df38fca","Type":"ContainerStarted","Data":"d1a722599e41243b550b62f75228f726c8cb114d412fc50bb57b94fbf7735947"}
Jul 24 19:55:09.996858 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:09.996810    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6" podStartSLOduration=1.996795331 podStartE2EDuration="1.996795331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:55:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:55:09.995404734 +0000 UTC m=+1698.514024788" watchObservedRunningTime="2026-07-24 19:55:09.996795331 +0000 UTC m=+1698.515415371"
Jul 24 19:55:10.142573 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:10.142532    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6"
Jul 24 19:55:10.147387 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:10.147365    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6"
Jul 24 19:55:10.953568 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:10.953531    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6"
Jul 24 19:55:10.960248 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:10.960217    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6"
Jul 24 19:55:12.280196 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:12.280096    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-9b3176cc-6489f57f6d-d4gwf"]
Jul 24 19:55:12.283753 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:12.283737    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-9b3176cc-6489f57f6d-d4gwf"
Jul 24 19:55:12.286030 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:12.286012    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-9b3176cc\""
Jul 24 19:55:12.296930 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:12.296905    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-9b3176cc-6489f57f6d-d4gwf"]
Jul 24 19:55:12.403712 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:12.403664    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71e6bf78-6527-4cd1-a188-be8a7cf87819-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-9b3176cc-6489f57f6d-d4gwf\" (UID: \"71e6bf78-6527-4cd1-a188-be8a7cf87819\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-9b3176cc-6489f57f6d-d4gwf"
Jul 24 19:55:12.404025 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:12.404007    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsljc\" (UniqueName: \"kubernetes.io/projected/71e6bf78-6527-4cd1-a188-be8a7cf87819-kube-api-access-rsljc\") pod \"payload-pre-processing-e2e-derive-9b3176cc-6489f57f6d-d4gwf\" (UID: \"71e6bf78-6527-4cd1-a188-be8a7cf87819\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-9b3176cc-6489f57f6d-d4gwf"
Jul 24 19:55:12.504908 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:12.504869    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71e6bf78-6527-4cd1-a188-be8a7cf87819-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-9b3176cc-6489f57f6d-d4gwf\" (UID: \"71e6bf78-6527-4cd1-a188-be8a7cf87819\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-9b3176cc-6489f57f6d-d4gwf"
Jul 24 19:55:12.505099 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:12.504933    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsljc\" (UniqueName: \"kubernetes.io/projected/71e6bf78-6527-4cd1-a188-be8a7cf87819-kube-api-access-rsljc\") pod \"payload-pre-processing-e2e-derive-9b3176cc-6489f57f6d-d4gwf\" (UID: \"71e6bf78-6527-4cd1-a188-be8a7cf87819\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-9b3176cc-6489f57f6d-d4gwf"
Jul 24 19:55:12.505661 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:12.505637    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71e6bf78-6527-4cd1-a188-be8a7cf87819-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-9b3176cc-6489f57f6d-d4gwf\" (UID: \"71e6bf78-6527-4cd1-a188-be8a7cf87819\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-9b3176cc-6489f57f6d-d4gwf"
Jul 24 19:55:12.515811 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:12.515787    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsljc\" (UniqueName: \"kubernetes.io/projected/71e6bf78-6527-4cd1-a188-be8a7cf87819-kube-api-access-rsljc\") pod \"payload-pre-processing-e2e-derive-9b3176cc-6489f57f6d-d4gwf\" (UID: \"71e6bf78-6527-4cd1-a188-be8a7cf87819\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-9b3176cc-6489f57f6d-d4gwf"
Jul 24 19:55:12.594877 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:12.594806    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-9b3176cc-6489f57f6d-d4gwf"
Jul 24 19:55:12.937644 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:12.937612    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-9b3176cc-6489f57f6d-d4gwf"]
Jul 24 19:55:12.938984 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:55:12.938930    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71e6bf78_6527_4cd1_a188_be8a7cf87819.slice/crio-d867421096ffa56a9039eb43028e5665f8500bb069ed8b515b3b63d24204f1ba WatchSource:0}: Error finding container d867421096ffa56a9039eb43028e5665f8500bb069ed8b515b3b63d24204f1ba: Status 404 returned error can't find the container with id d867421096ffa56a9039eb43028e5665f8500bb069ed8b515b3b63d24204f1ba
Jul 24 19:55:12.965223 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:12.965195    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-9b3176cc-6489f57f6d-d4gwf" event={"ID":"71e6bf78-6527-4cd1-a188-be8a7cf87819","Type":"ContainerStarted","Data":"d867421096ffa56a9039eb43028e5665f8500bb069ed8b515b3b63d24204f1ba"}
Jul 24 19:55:13.337806 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:13.337783    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk"
Jul 24 19:55:13.413387 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:13.413361    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f02304dd-bfd2-4371-ac4a-d6c044b83d57-workload-socket\") pod \"f02304dd-bfd2-4371-ac4a-d6c044b83d57\" (UID: \"f02304dd-bfd2-4371-ac4a-d6c044b83d57\") "
Jul 24 19:55:13.413588 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:13.413418    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f02304dd-bfd2-4371-ac4a-d6c044b83d57-istiod-ca-cert\") pod \"f02304dd-bfd2-4371-ac4a-d6c044b83d57\" (UID: \"f02304dd-bfd2-4371-ac4a-d6c044b83d57\") "
Jul 24 19:55:13.413588 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:13.413449    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f02304dd-bfd2-4371-ac4a-d6c044b83d57-istio-podinfo\") pod \"f02304dd-bfd2-4371-ac4a-d6c044b83d57\" (UID: \"f02304dd-bfd2-4371-ac4a-d6c044b83d57\") "
Jul 24 19:55:13.413588 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:13.413508    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f02304dd-bfd2-4371-ac4a-d6c044b83d57-istio-token\") pod \"f02304dd-bfd2-4371-ac4a-d6c044b83d57\" (UID: \"f02304dd-bfd2-4371-ac4a-d6c044b83d57\") "
Jul 24 19:55:13.413588 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:13.413561    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f02304dd-bfd2-4371-ac4a-d6c044b83d57-istio-data\") pod \"f02304dd-bfd2-4371-ac4a-d6c044b83d57\" (UID: \"f02304dd-bfd2-4371-ac4a-d6c044b83d57\") "
Jul 24 19:55:13.413802 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:13.413589    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f02304dd-bfd2-4371-ac4a-d6c044b83d57-workload-certs\") pod \"f02304dd-bfd2-4371-ac4a-d6c044b83d57\" (UID: \"f02304dd-bfd2-4371-ac4a-d6c044b83d57\") "
Jul 24 19:55:13.413802 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:13.413613    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f02304dd-bfd2-4371-ac4a-d6c044b83d57-istio-envoy\") pod \"f02304dd-bfd2-4371-ac4a-d6c044b83d57\" (UID: \"f02304dd-bfd2-4371-ac4a-d6c044b83d57\") "
Jul 24 19:55:13.413802 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:13.413642    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f02304dd-bfd2-4371-ac4a-d6c044b83d57-credential-socket\") pod \"f02304dd-bfd2-4371-ac4a-d6c044b83d57\" (UID: \"f02304dd-bfd2-4371-ac4a-d6c044b83d57\") "
Jul 24 19:55:13.413802 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:13.413668    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qsmr\" (UniqueName: \"kubernetes.io/projected/f02304dd-bfd2-4371-ac4a-d6c044b83d57-kube-api-access-6qsmr\") pod \"f02304dd-bfd2-4371-ac4a-d6c044b83d57\" (UID: \"f02304dd-bfd2-4371-ac4a-d6c044b83d57\") "
Jul 24 19:55:13.413802 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:13.413665    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f02304dd-bfd2-4371-ac4a-d6c044b83d57-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f02304dd-bfd2-4371-ac4a-d6c044b83d57" (UID: "f02304dd-bfd2-4371-ac4a-d6c044b83d57"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:55:13.414030 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:13.414007    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f02304dd-bfd2-4371-ac4a-d6c044b83d57-workload-socket\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:55:13.414105 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:13.414033    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f02304dd-bfd2-4371-ac4a-d6c044b83d57-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f02304dd-bfd2-4371-ac4a-d6c044b83d57" (UID: "f02304dd-bfd2-4371-ac4a-d6c044b83d57"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:55:13.414105 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:13.414089    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f02304dd-bfd2-4371-ac4a-d6c044b83d57-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f02304dd-bfd2-4371-ac4a-d6c044b83d57" (UID: "f02304dd-bfd2-4371-ac4a-d6c044b83d57"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:55:13.414238 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:13.414216    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f02304dd-bfd2-4371-ac4a-d6c044b83d57-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f02304dd-bfd2-4371-ac4a-d6c044b83d57" (UID: "f02304dd-bfd2-4371-ac4a-d6c044b83d57"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:55:13.414423 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:13.414398    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f02304dd-bfd2-4371-ac4a-d6c044b83d57-istio-data" (OuterVolumeSpecName: "istio-data") pod "f02304dd-bfd2-4371-ac4a-d6c044b83d57" (UID: "f02304dd-bfd2-4371-ac4a-d6c044b83d57"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:55:13.415761 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:13.415735    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f02304dd-bfd2-4371-ac4a-d6c044b83d57-istio-token" (OuterVolumeSpecName: "istio-token") pod "f02304dd-bfd2-4371-ac4a-d6c044b83d57" (UID: "f02304dd-bfd2-4371-ac4a-d6c044b83d57"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:55:13.416093 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:13.416074    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f02304dd-bfd2-4371-ac4a-d6c044b83d57-kube-api-access-6qsmr" (OuterVolumeSpecName: "kube-api-access-6qsmr") pod "f02304dd-bfd2-4371-ac4a-d6c044b83d57" (UID: "f02304dd-bfd2-4371-ac4a-d6c044b83d57"). InnerVolumeSpecName "kube-api-access-6qsmr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:55:13.416244 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:13.416228    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f02304dd-bfd2-4371-ac4a-d6c044b83d57-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f02304dd-bfd2-4371-ac4a-d6c044b83d57" (UID: "f02304dd-bfd2-4371-ac4a-d6c044b83d57"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:55:13.416307 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:13.416241    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f02304dd-bfd2-4371-ac4a-d6c044b83d57-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f02304dd-bfd2-4371-ac4a-d6c044b83d57" (UID: "f02304dd-bfd2-4371-ac4a-d6c044b83d57"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 19:55:13.514610 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:13.514468    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f02304dd-bfd2-4371-ac4a-d6c044b83d57-istiod-ca-cert\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:55:13.514610 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:13.514555    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f02304dd-bfd2-4371-ac4a-d6c044b83d57-istio-podinfo\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:55:13.514610 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:13.514568    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f02304dd-bfd2-4371-ac4a-d6c044b83d57-istio-token\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:55:13.514610 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:13.514579    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f02304dd-bfd2-4371-ac4a-d6c044b83d57-istio-data\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:55:13.514610 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:13.514591    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f02304dd-bfd2-4371-ac4a-d6c044b83d57-workload-certs\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:55:13.514610 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:13.514602    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f02304dd-bfd2-4371-ac4a-d6c044b83d57-istio-envoy\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:55:13.514904 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:13.514613    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f02304dd-bfd2-4371-ac4a-d6c044b83d57-credential-socket\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:55:13.514904 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:13.514628    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qsmr\" (UniqueName: \"kubernetes.io/projected/f02304dd-bfd2-4371-ac4a-d6c044b83d57-kube-api-access-6qsmr\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:55:13.971416 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:13.971381    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-9b3176cc-6489f57f6d-d4gwf" event={"ID":"71e6bf78-6527-4cd1-a188-be8a7cf87819","Type":"ContainerStarted","Data":"3949258f4e4003fee230e9be749ecb427fee03a2cf9a6ece947a2e45566842c2"}
Jul 24 19:55:13.971628 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:13.971451    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-9b3176cc-6489f57f6d-d4gwf"
Jul 24 19:55:13.972951 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:13.972927    2567 generic.go:356] "Generic (PLEG): container finished" podID="f02304dd-bfd2-4371-ac4a-d6c044b83d57" containerID="a908e0428c3ed1a6e363040e07c6730f5a49a48f4d245d8b9f86e84387add329" exitCode=0
Jul 24 19:55:13.973067 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:13.972969    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk"
Jul 24 19:55:13.973067 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:13.972971    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk" event={"ID":"f02304dd-bfd2-4371-ac4a-d6c044b83d57","Type":"ContainerDied","Data":"a908e0428c3ed1a6e363040e07c6730f5a49a48f4d245d8b9f86e84387add329"}
Jul 24 19:55:13.973137 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:13.973106    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk" event={"ID":"f02304dd-bfd2-4371-ac4a-d6c044b83d57","Type":"ContainerDied","Data":"9ba2eff665eea77cab25b4de99f50aba4f1debf82f9b35c6cfaeac03c0b3a86f"}
Jul 24 19:55:13.973176 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:13.973145    2567 scope.go:117] "RemoveContainer" containerID="a908e0428c3ed1a6e363040e07c6730f5a49a48f4d245d8b9f86e84387add329"
Jul 24 19:55:13.982136 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:13.982117    2567 scope.go:117] "RemoveContainer" containerID="081aa22751d1a0317810a3170d9f2ac561c8e9759513685c6d33d8aa2c081f24"
Jul 24 19:55:13.990023 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:13.990007    2567 scope.go:117] "RemoveContainer" containerID="a908e0428c3ed1a6e363040e07c6730f5a49a48f4d245d8b9f86e84387add329"
Jul 24 19:55:13.990257 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:55:13.990238    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a908e0428c3ed1a6e363040e07c6730f5a49a48f4d245d8b9f86e84387add329\": container with ID starting with a908e0428c3ed1a6e363040e07c6730f5a49a48f4d245d8b9f86e84387add329 not found: ID does not exist" containerID="a908e0428c3ed1a6e363040e07c6730f5a49a48f4d245d8b9f86e84387add329"
Jul 24 19:55:13.990341 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:13.990266    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a908e0428c3ed1a6e363040e07c6730f5a49a48f4d245d8b9f86e84387add329"} err="failed to get container status \"a908e0428c3ed1a6e363040e07c6730f5a49a48f4d245d8b9f86e84387add329\": rpc error: code = NotFound desc = could not find container \"a908e0428c3ed1a6e363040e07c6730f5a49a48f4d245d8b9f86e84387add329\": container with ID starting with a908e0428c3ed1a6e363040e07c6730f5a49a48f4d245d8b9f86e84387add329 not found: ID does not exist"
Jul 24 19:55:13.990341 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:13.990282    2567 scope.go:117] "RemoveContainer" containerID="081aa22751d1a0317810a3170d9f2ac561c8e9759513685c6d33d8aa2c081f24"
Jul 24 19:55:13.990527 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:55:13.990513    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"081aa22751d1a0317810a3170d9f2ac561c8e9759513685c6d33d8aa2c081f24\": container with ID starting with 081aa22751d1a0317810a3170d9f2ac561c8e9759513685c6d33d8aa2c081f24 not found: ID does not exist" containerID="081aa22751d1a0317810a3170d9f2ac561c8e9759513685c6d33d8aa2c081f24"
Jul 24 19:55:13.990570 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:13.990533    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"081aa22751d1a0317810a3170d9f2ac561c8e9759513685c6d33d8aa2c081f24"} err="failed to get container status \"081aa22751d1a0317810a3170d9f2ac561c8e9759513685c6d33d8aa2c081f24\": rpc error: code = NotFound desc = could not find container \"081aa22751d1a0317810a3170d9f2ac561c8e9759513685c6d33d8aa2c081f24\": container with ID starting with 081aa22751d1a0317810a3170d9f2ac561c8e9759513685c6d33d8aa2c081f24 not found: ID does not exist"
Jul 24 19:55:13.993792 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:13.993752    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-9b3176cc-6489f57f6d-d4gwf" podStartSLOduration=1.9937407889999998 podStartE2EDuration="1.993740789s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:55:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:55:13.992938442 +0000 UTC m=+1702.511558483" watchObservedRunningTime="2026-07-24 19:55:13.993740789 +0000 UTC m=+1702.512360829"
Jul 24 19:55:14.011372 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:14.011347    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk"]
Jul 24 19:55:14.013959 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:14.013940    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk"]
Jul 24 19:55:14.071263 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:14.071235    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f02304dd-bfd2-4371-ac4a-d6c044b83d57" path="/var/lib/kubelet/pods/f02304dd-bfd2-4371-ac4a-d6c044b83d57/volumes"
Jul 24 19:55:14.265760 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:14.265671    2567 patch_prober.go:28] interesting pod/e2e-ait-4babb888-openshift-default-758489d986-gwvbk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 24 19:55:14.265760 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:14.265741    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-4babb888-openshift-default-758489d986-gwvbk" podUID="f02304dd-bfd2-4371-ac4a-d6c044b83d57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 24 19:55:24.981538 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:24.981421    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-9b3176cc-6489f57f6d-d4gwf"
Jul 24 19:55:25.034798 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:25.034762    2567 generic.go:356] "Generic (PLEG): container finished" podID="b385f9fe-bdae-41cf-b5c8-c3724df38fca" containerID="7425a21a8e456c83ec0bd9e3a45ff3554263ac31a5ed00dac1943b3f247a5191" exitCode=0
Jul 24 19:55:25.034798 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:25.034795    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6" event={"ID":"b385f9fe-bdae-41cf-b5c8-c3724df38fca","Type":"ContainerDied","Data":"7425a21a8e456c83ec0bd9e3a45ff3554263ac31a5ed00dac1943b3f247a5191"}
Jul 24 19:55:25.035196 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:25.035181    2567 scope.go:117] "RemoveContainer" containerID="7425a21a8e456c83ec0bd9e3a45ff3554263ac31a5ed00dac1943b3f247a5191"
Jul 24 19:55:25.036252 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:25.036226    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 19:55:25.036352 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:25.036294    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 19:55:25.036352 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:25.036332    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 19:55:25.954377 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:25.954331    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6"
Jul 24 19:55:26.053069 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:26.053010    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6" event={"ID":"b385f9fe-bdae-41cf-b5c8-c3724df38fca","Type":"ContainerStarted","Data":"7ba7c0dd65502995735d23f0aa4aae0ed72f07e71874eeabb54f6391ad4ce480"}
Jul 24 19:55:26.143435 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:26.143203    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6"
Jul 24 19:55:26.143824 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:26.143797    2567 patch_prober.go:28] interesting pod/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 24 19:55:26.144017 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:26.143991    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6" podUID="b385f9fe-bdae-41cf-b5c8-c3724df38fca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 24 19:55:27.142742 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:27.142703    2567 patch_prober.go:28] interesting pod/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 24 19:55:27.143238 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:27.142770    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6" podUID="b385f9fe-bdae-41cf-b5c8-c3724df38fca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 24 19:55:28.143135 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:28.143096    2567 patch_prober.go:28] interesting pod/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 24 19:55:28.143669 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:28.143167    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6" podUID="b385f9fe-bdae-41cf-b5c8-c3724df38fca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 24 19:55:29.142712 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:29.142667    2567 patch_prober.go:28] interesting pod/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 24 19:55:29.142920 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:29.142735    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6" podUID="b385f9fe-bdae-41cf-b5c8-c3724df38fca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 24 19:55:30.145811 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:30.145779    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6"
Jul 24 19:55:30.146170 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:30.146059    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6"
Jul 24 19:55:30.146874 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:30.146856    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6"
Jul 24 19:55:46.762563 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:46.762525    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-9b3176cc-6489f57f6d-d4gwf"]
Jul 24 19:55:46.763033 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:46.762750    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-9b3176cc-6489f57f6d-d4gwf" podUID="71e6bf78-6527-4cd1-a188-be8a7cf87819" containerName="payload-pre-processing" containerID="cri-o://3949258f4e4003fee230e9be749ecb427fee03a2cf9a6ece947a2e45566842c2" gracePeriod=30
Jul 24 19:55:47.019516 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:47.019432    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-9b3176cc-6489f57f6d-d4gwf"
Jul 24 19:55:47.130147 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:47.130116    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71e6bf78-6527-4cd1-a188-be8a7cf87819-plugins-config-volume\") pod \"71e6bf78-6527-4cd1-a188-be8a7cf87819\" (UID: \"71e6bf78-6527-4cd1-a188-be8a7cf87819\") "
Jul 24 19:55:47.130321 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:47.130170    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rsljc\" (UniqueName: \"kubernetes.io/projected/71e6bf78-6527-4cd1-a188-be8a7cf87819-kube-api-access-rsljc\") pod \"71e6bf78-6527-4cd1-a188-be8a7cf87819\" (UID: \"71e6bf78-6527-4cd1-a188-be8a7cf87819\") "
Jul 24 19:55:47.130548 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:47.130526    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71e6bf78-6527-4cd1-a188-be8a7cf87819-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "71e6bf78-6527-4cd1-a188-be8a7cf87819" (UID: "71e6bf78-6527-4cd1-a188-be8a7cf87819"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:55:47.132636 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:47.132614    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71e6bf78-6527-4cd1-a188-be8a7cf87819-kube-api-access-rsljc" (OuterVolumeSpecName: "kube-api-access-rsljc") pod "71e6bf78-6527-4cd1-a188-be8a7cf87819" (UID: "71e6bf78-6527-4cd1-a188-be8a7cf87819"). InnerVolumeSpecName "kube-api-access-rsljc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:55:47.154738 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:47.154709    2567 generic.go:356] "Generic (PLEG): container finished" podID="71e6bf78-6527-4cd1-a188-be8a7cf87819" containerID="3949258f4e4003fee230e9be749ecb427fee03a2cf9a6ece947a2e45566842c2" exitCode=0
Jul 24 19:55:47.154850 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:47.154772    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-9b3176cc-6489f57f6d-d4gwf"
Jul 24 19:55:47.154850 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:47.154802    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-9b3176cc-6489f57f6d-d4gwf" event={"ID":"71e6bf78-6527-4cd1-a188-be8a7cf87819","Type":"ContainerDied","Data":"3949258f4e4003fee230e9be749ecb427fee03a2cf9a6ece947a2e45566842c2"}
Jul 24 19:55:47.154940 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:47.154868    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-9b3176cc-6489f57f6d-d4gwf" event={"ID":"71e6bf78-6527-4cd1-a188-be8a7cf87819","Type":"ContainerDied","Data":"d867421096ffa56a9039eb43028e5665f8500bb069ed8b515b3b63d24204f1ba"}
Jul 24 19:55:47.154940 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:47.154901    2567 scope.go:117] "RemoveContainer" containerID="3949258f4e4003fee230e9be749ecb427fee03a2cf9a6ece947a2e45566842c2"
Jul 24 19:55:47.171861 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:47.171842    2567 scope.go:117] "RemoveContainer" containerID="3949258f4e4003fee230e9be749ecb427fee03a2cf9a6ece947a2e45566842c2"
Jul 24 19:55:47.172124 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:55:47.172104    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3949258f4e4003fee230e9be749ecb427fee03a2cf9a6ece947a2e45566842c2\": container with ID starting with 3949258f4e4003fee230e9be749ecb427fee03a2cf9a6ece947a2e45566842c2 not found: ID does not exist" containerID="3949258f4e4003fee230e9be749ecb427fee03a2cf9a6ece947a2e45566842c2"
Jul 24 19:55:47.172181 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:47.172132    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3949258f4e4003fee230e9be749ecb427fee03a2cf9a6ece947a2e45566842c2"} err="failed to get container status \"3949258f4e4003fee230e9be749ecb427fee03a2cf9a6ece947a2e45566842c2\": rpc error: code = NotFound desc = could not find container \"3949258f4e4003fee230e9be749ecb427fee03a2cf9a6ece947a2e45566842c2\": container with ID starting with 3949258f4e4003fee230e9be749ecb427fee03a2cf9a6ece947a2e45566842c2 not found: ID does not exist"
Jul 24 19:55:47.181614 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:47.181594    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-9b3176cc-6489f57f6d-d4gwf"]
Jul 24 19:55:47.185832 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:47.185813    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-9b3176cc-6489f57f6d-d4gwf"]
Jul 24 19:55:47.231689 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:47.231663    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71e6bf78-6527-4cd1-a188-be8a7cf87819-plugins-config-volume\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:55:47.231689 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:47.231687    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rsljc\" (UniqueName: \"kubernetes.io/projected/71e6bf78-6527-4cd1-a188-be8a7cf87819-kube-api-access-rsljc\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:55:48.071930 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:48.071901    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71e6bf78-6527-4cd1-a188-be8a7cf87819" path="/var/lib/kubelet/pods/71e6bf78-6527-4cd1-a188-be8a7cf87819/volumes"
Jul 24 19:55:51.428571 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:51.428535    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6"]
Jul 24 19:55:51.429019 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:51.428795    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6" podUID="b385f9fe-bdae-41cf-b5c8-c3724df38fca" containerName="istio-proxy" containerID="cri-o://7ba7c0dd65502995735d23f0aa4aae0ed72f07e71874eeabb54f6391ad4ce480" gracePeriod=30
Jul 24 19:55:56.686668 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:56.686640    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6"
Jul 24 19:55:56.818737 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:56.818645    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b385f9fe-bdae-41cf-b5c8-c3724df38fca-istio-token\") pod \"b385f9fe-bdae-41cf-b5c8-c3724df38fca\" (UID: \"b385f9fe-bdae-41cf-b5c8-c3724df38fca\") "
Jul 24 19:55:56.818737 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:56.818692    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b385f9fe-bdae-41cf-b5c8-c3724df38fca-workload-socket\") pod \"b385f9fe-bdae-41cf-b5c8-c3724df38fca\" (UID: \"b385f9fe-bdae-41cf-b5c8-c3724df38fca\") "
Jul 24 19:55:56.818737 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:56.818722    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vhvhg\" (UniqueName: \"kubernetes.io/projected/b385f9fe-bdae-41cf-b5c8-c3724df38fca-kube-api-access-vhvhg\") pod \"b385f9fe-bdae-41cf-b5c8-c3724df38fca\" (UID: \"b385f9fe-bdae-41cf-b5c8-c3724df38fca\") "
Jul 24 19:55:56.819021 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:56.818748    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b385f9fe-bdae-41cf-b5c8-c3724df38fca-istio-podinfo\") pod \"b385f9fe-bdae-41cf-b5c8-c3724df38fca\" (UID: \"b385f9fe-bdae-41cf-b5c8-c3724df38fca\") "
Jul 24 19:55:56.819021 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:56.818764    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b385f9fe-bdae-41cf-b5c8-c3724df38fca-istiod-ca-cert\") pod \"b385f9fe-bdae-41cf-b5c8-c3724df38fca\" (UID: \"b385f9fe-bdae-41cf-b5c8-c3724df38fca\") "
Jul 24 19:55:56.819021 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:56.818788    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b385f9fe-bdae-41cf-b5c8-c3724df38fca-credential-socket\") pod \"b385f9fe-bdae-41cf-b5c8-c3724df38fca\" (UID: \"b385f9fe-bdae-41cf-b5c8-c3724df38fca\") "
Jul 24 19:55:56.819021 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:56.818807    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b385f9fe-bdae-41cf-b5c8-c3724df38fca-istio-envoy\") pod \"b385f9fe-bdae-41cf-b5c8-c3724df38fca\" (UID: \"b385f9fe-bdae-41cf-b5c8-c3724df38fca\") "
Jul 24 19:55:56.819021 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:56.818852    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b385f9fe-bdae-41cf-b5c8-c3724df38fca-istio-data\") pod \"b385f9fe-bdae-41cf-b5c8-c3724df38fca\" (UID: \"b385f9fe-bdae-41cf-b5c8-c3724df38fca\") "
Jul 24 19:55:56.819021 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:56.818893    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b385f9fe-bdae-41cf-b5c8-c3724df38fca-workload-certs\") pod \"b385f9fe-bdae-41cf-b5c8-c3724df38fca\" (UID: \"b385f9fe-bdae-41cf-b5c8-c3724df38fca\") "
Jul 24 19:55:56.819319 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:56.819136    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b385f9fe-bdae-41cf-b5c8-c3724df38fca-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b385f9fe-bdae-41cf-b5c8-c3724df38fca" (UID: "b385f9fe-bdae-41cf-b5c8-c3724df38fca"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:55:56.819319 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:56.819230    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b385f9fe-bdae-41cf-b5c8-c3724df38fca-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b385f9fe-bdae-41cf-b5c8-c3724df38fca" (UID: "b385f9fe-bdae-41cf-b5c8-c3724df38fca"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:55:56.819410 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:56.819336    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b385f9fe-bdae-41cf-b5c8-c3724df38fca-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b385f9fe-bdae-41cf-b5c8-c3724df38fca" (UID: "b385f9fe-bdae-41cf-b5c8-c3724df38fca"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:55:56.819569 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:56.819470    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b385f9fe-bdae-41cf-b5c8-c3724df38fca-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b385f9fe-bdae-41cf-b5c8-c3724df38fca" (UID: "b385f9fe-bdae-41cf-b5c8-c3724df38fca"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:55:56.819923 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:56.819902    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b385f9fe-bdae-41cf-b5c8-c3724df38fca-istio-data" (OuterVolumeSpecName: "istio-data") pod "b385f9fe-bdae-41cf-b5c8-c3724df38fca" (UID: "b385f9fe-bdae-41cf-b5c8-c3724df38fca"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:55:56.821144 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:56.821115    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b385f9fe-bdae-41cf-b5c8-c3724df38fca-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b385f9fe-bdae-41cf-b5c8-c3724df38fca" (UID: "b385f9fe-bdae-41cf-b5c8-c3724df38fca"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 19:55:56.821271 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:56.821217    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b385f9fe-bdae-41cf-b5c8-c3724df38fca-kube-api-access-vhvhg" (OuterVolumeSpecName: "kube-api-access-vhvhg") pod "b385f9fe-bdae-41cf-b5c8-c3724df38fca" (UID: "b385f9fe-bdae-41cf-b5c8-c3724df38fca"). InnerVolumeSpecName "kube-api-access-vhvhg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:55:56.821536 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:56.821515    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b385f9fe-bdae-41cf-b5c8-c3724df38fca-istio-token" (OuterVolumeSpecName: "istio-token") pod "b385f9fe-bdae-41cf-b5c8-c3724df38fca" (UID: "b385f9fe-bdae-41cf-b5c8-c3724df38fca"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:55:56.821622 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:56.821528    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b385f9fe-bdae-41cf-b5c8-c3724df38fca-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b385f9fe-bdae-41cf-b5c8-c3724df38fca" (UID: "b385f9fe-bdae-41cf-b5c8-c3724df38fca"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:55:56.920506 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:56.920436    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b385f9fe-bdae-41cf-b5c8-c3724df38fca-istio-token\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:55:56.920506 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:56.920500    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b385f9fe-bdae-41cf-b5c8-c3724df38fca-workload-socket\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:55:56.920506 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:56.920511    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhvhg\" (UniqueName: \"kubernetes.io/projected/b385f9fe-bdae-41cf-b5c8-c3724df38fca-kube-api-access-vhvhg\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:55:56.920506 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:56.920521    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b385f9fe-bdae-41cf-b5c8-c3724df38fca-istio-podinfo\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:55:56.920780 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:56.920529    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b385f9fe-bdae-41cf-b5c8-c3724df38fca-istiod-ca-cert\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:55:56.920780 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:56.920538    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b385f9fe-bdae-41cf-b5c8-c3724df38fca-credential-socket\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:55:56.920780 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:56.920545    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b385f9fe-bdae-41cf-b5c8-c3724df38fca-istio-envoy\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:55:56.920780 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:56.920554    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b385f9fe-bdae-41cf-b5c8-c3724df38fca-istio-data\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:55:56.920780 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:56.920562    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b385f9fe-bdae-41cf-b5c8-c3724df38fca-workload-certs\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:55:57.203139 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:57.203104    2567 generic.go:356] "Generic (PLEG): container finished" podID="b385f9fe-bdae-41cf-b5c8-c3724df38fca" containerID="7ba7c0dd65502995735d23f0aa4aae0ed72f07e71874eeabb54f6391ad4ce480" exitCode=0
Jul 24 19:55:57.203310 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:57.203158    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6"
Jul 24 19:55:57.203310 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:57.203188    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6" event={"ID":"b385f9fe-bdae-41cf-b5c8-c3724df38fca","Type":"ContainerDied","Data":"7ba7c0dd65502995735d23f0aa4aae0ed72f07e71874eeabb54f6391ad4ce480"}
Jul 24 19:55:57.203310 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:57.203243    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6" event={"ID":"b385f9fe-bdae-41cf-b5c8-c3724df38fca","Type":"ContainerDied","Data":"d1a722599e41243b550b62f75228f726c8cb114d412fc50bb57b94fbf7735947"}
Jul 24 19:55:57.203310 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:57.203264    2567 scope.go:117] "RemoveContainer" containerID="7ba7c0dd65502995735d23f0aa4aae0ed72f07e71874eeabb54f6391ad4ce480"
Jul 24 19:55:57.212197 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:57.212181    2567 scope.go:117] "RemoveContainer" containerID="7425a21a8e456c83ec0bd9e3a45ff3554263ac31a5ed00dac1943b3f247a5191"
Jul 24 19:55:57.219993 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:57.219972    2567 scope.go:117] "RemoveContainer" containerID="7ba7c0dd65502995735d23f0aa4aae0ed72f07e71874eeabb54f6391ad4ce480"
Jul 24 19:55:57.220269 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:55:57.220242    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ba7c0dd65502995735d23f0aa4aae0ed72f07e71874eeabb54f6391ad4ce480\": container with ID starting with 7ba7c0dd65502995735d23f0aa4aae0ed72f07e71874eeabb54f6391ad4ce480 not found: ID does not exist" containerID="7ba7c0dd65502995735d23f0aa4aae0ed72f07e71874eeabb54f6391ad4ce480"
Jul 24 19:55:57.220353 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:57.220282    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ba7c0dd65502995735d23f0aa4aae0ed72f07e71874eeabb54f6391ad4ce480"} err="failed to get container status \"7ba7c0dd65502995735d23f0aa4aae0ed72f07e71874eeabb54f6391ad4ce480\": rpc error: code = NotFound desc = could not find container \"7ba7c0dd65502995735d23f0aa4aae0ed72f07e71874eeabb54f6391ad4ce480\": container with ID starting with 7ba7c0dd65502995735d23f0aa4aae0ed72f07e71874eeabb54f6391ad4ce480 not found: ID does not exist"
Jul 24 19:55:57.220353 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:57.220306    2567 scope.go:117] "RemoveContainer" containerID="7425a21a8e456c83ec0bd9e3a45ff3554263ac31a5ed00dac1943b3f247a5191"
Jul 24 19:55:57.220619 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:55:57.220602    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7425a21a8e456c83ec0bd9e3a45ff3554263ac31a5ed00dac1943b3f247a5191\": container with ID starting with 7425a21a8e456c83ec0bd9e3a45ff3554263ac31a5ed00dac1943b3f247a5191 not found: ID does not exist" containerID="7425a21a8e456c83ec0bd9e3a45ff3554263ac31a5ed00dac1943b3f247a5191"
Jul 24 19:55:57.220677 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:57.220626    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7425a21a8e456c83ec0bd9e3a45ff3554263ac31a5ed00dac1943b3f247a5191"} err="failed to get container status \"7425a21a8e456c83ec0bd9e3a45ff3554263ac31a5ed00dac1943b3f247a5191\": rpc error: code = NotFound desc = could not find container \"7425a21a8e456c83ec0bd9e3a45ff3554263ac31a5ed00dac1943b3f247a5191\": container with ID starting with 7425a21a8e456c83ec0bd9e3a45ff3554263ac31a5ed00dac1943b3f247a5191 not found: ID does not exist"
Jul 24 19:55:57.225022 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:57.224991    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6"]
Jul 24 19:55:57.228567 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:57.228546    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-9b3176cc-openshift-default-7bddbb5cbd-6kmz6"]
Jul 24 19:55:58.071743 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:55:58.071712    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b385f9fe-bdae-41cf-b5c8-c3724df38fca" path="/var/lib/kubelet/pods/b385f9fe-bdae-41cf-b5c8-c3724df38fca/volumes"
Jul 24 19:56:52.040287 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:56:52.040260    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d87bq_72c2265c-f7f6-462a-bf46-eda3f35de953/ovn-acl-logging/0.log"
Jul 24 19:56:52.042389 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:56:52.042368    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d87bq_72c2265c-f7f6-462a-bf46-eda3f35de953/ovn-acl-logging/0.log"
Jul 24 19:57:30.396667 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:30.396621    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49"]
Jul 24 19:57:30.397296 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:30.396980    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f02304dd-bfd2-4371-ac4a-d6c044b83d57" containerName="istio-proxy"
Jul 24 19:57:30.397296 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:30.396992    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f02304dd-bfd2-4371-ac4a-d6c044b83d57" containerName="istio-proxy"
Jul 24 19:57:30.397296 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:30.397007    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b385f9fe-bdae-41cf-b5c8-c3724df38fca" containerName="istio-proxy"
Jul 24 19:57:30.397296 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:30.397015    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b385f9fe-bdae-41cf-b5c8-c3724df38fca" containerName="istio-proxy"
Jul 24 19:57:30.397296 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:30.397034    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71e6bf78-6527-4cd1-a188-be8a7cf87819" containerName="payload-pre-processing"
Jul 24 19:57:30.397296 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:30.397043    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="71e6bf78-6527-4cd1-a188-be8a7cf87819" containerName="payload-pre-processing"
Jul 24 19:57:30.397296 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:30.397112    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f02304dd-bfd2-4371-ac4a-d6c044b83d57" containerName="istio-proxy"
Jul 24 19:57:30.397296 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:30.397120    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b385f9fe-bdae-41cf-b5c8-c3724df38fca" containerName="istio-proxy"
Jul 24 19:57:30.397296 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:30.397127    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="71e6bf78-6527-4cd1-a188-be8a7cf87819" containerName="payload-pre-processing"
Jul 24 19:57:30.397296 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:30.397141    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b385f9fe-bdae-41cf-b5c8-c3724df38fca" containerName="istio-proxy"
Jul 24 19:57:30.397296 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:30.397150    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f02304dd-bfd2-4371-ac4a-d6c044b83d57" containerName="istio-proxy"
Jul 24 19:57:30.400216 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:30.400194    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49"
Jul 24 19:57:30.402792 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:30.402772    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 24 19:57:30.402897 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:30.402791    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-67d08912-openshift-default-dockercfg-qtk8d\""
Jul 24 19:57:30.420017 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:30.419992    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49"]
Jul 24 19:57:30.467883 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:30.467840    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f6be085-12c0-4d6c-932b-3e50ddc59961-istio-envoy\") pod \"e2e-mt-67d08912-openshift-default-9df476dd4-k5p49\" (UID: \"1f6be085-12c0-4d6c-932b-3e50ddc59961\") " pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49"
Jul 24 19:57:30.467883 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:30.467884    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f6be085-12c0-4d6c-932b-3e50ddc59961-istio-data\") pod \"e2e-mt-67d08912-openshift-default-9df476dd4-k5p49\" (UID: \"1f6be085-12c0-4d6c-932b-3e50ddc59961\") " pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49"
Jul 24 19:57:30.468136 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:30.467998    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f6be085-12c0-4d6c-932b-3e50ddc59961-workload-certs\") pod \"e2e-mt-67d08912-openshift-default-9df476dd4-k5p49\" (UID: \"1f6be085-12c0-4d6c-932b-3e50ddc59961\") " pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49"
Jul 24 19:57:30.468136 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:30.468042    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f6be085-12c0-4d6c-932b-3e50ddc59961-credential-socket\") pod \"e2e-mt-67d08912-openshift-default-9df476dd4-k5p49\" (UID: \"1f6be085-12c0-4d6c-932b-3e50ddc59961\") " pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49"
Jul 24 19:57:30.468136 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:30.468067    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f6be085-12c0-4d6c-932b-3e50ddc59961-workload-socket\") pod \"e2e-mt-67d08912-openshift-default-9df476dd4-k5p49\" (UID: \"1f6be085-12c0-4d6c-932b-3e50ddc59961\") " pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49"
Jul 24 19:57:30.468136 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:30.468088    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f6be085-12c0-4d6c-932b-3e50ddc59961-istio-podinfo\") pod \"e2e-mt-67d08912-openshift-default-9df476dd4-k5p49\" (UID: \"1f6be085-12c0-4d6c-932b-3e50ddc59961\") " pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49"
Jul 24 19:57:30.468136 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:30.468110    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz92h\" (UniqueName: \"kubernetes.io/projected/1f6be085-12c0-4d6c-932b-3e50ddc59961-kube-api-access-tz92h\") pod \"e2e-mt-67d08912-openshift-default-9df476dd4-k5p49\" (UID: \"1f6be085-12c0-4d6c-932b-3e50ddc59961\") " pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49"
Jul 24 19:57:30.468387 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:30.468172    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f6be085-12c0-4d6c-932b-3e50ddc59961-istiod-ca-cert\") pod \"e2e-mt-67d08912-openshift-default-9df476dd4-k5p49\" (UID: \"1f6be085-12c0-4d6c-932b-3e50ddc59961\") " pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49"
Jul 24 19:57:30.468387 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:30.468224    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f6be085-12c0-4d6c-932b-3e50ddc59961-istio-token\") pod \"e2e-mt-67d08912-openshift-default-9df476dd4-k5p49\" (UID: \"1f6be085-12c0-4d6c-932b-3e50ddc59961\") " pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49"
Jul 24 19:57:30.568894 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:30.568862    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f6be085-12c0-4d6c-932b-3e50ddc59961-workload-certs\") pod \"e2e-mt-67d08912-openshift-default-9df476dd4-k5p49\" (UID: \"1f6be085-12c0-4d6c-932b-3e50ddc59961\") " pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49"
Jul 24 19:57:30.569076 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:30.568904    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f6be085-12c0-4d6c-932b-3e50ddc59961-credential-socket\") pod \"e2e-mt-67d08912-openshift-default-9df476dd4-k5p49\" (UID: \"1f6be085-12c0-4d6c-932b-3e50ddc59961\") " pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49"
Jul 24 19:57:30.569076 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:30.568931    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f6be085-12c0-4d6c-932b-3e50ddc59961-workload-socket\") pod \"e2e-mt-67d08912-openshift-default-9df476dd4-k5p49\" (UID: \"1f6be085-12c0-4d6c-932b-3e50ddc59961\") " pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49"
Jul 24 19:57:30.569076 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:30.568953    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f6be085-12c0-4d6c-932b-3e50ddc59961-istio-podinfo\") pod \"e2e-mt-67d08912-openshift-default-9df476dd4-k5p49\" (UID: \"1f6be085-12c0-4d6c-932b-3e50ddc59961\") " pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49"
Jul 24 19:57:30.569076 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:30.568974    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz92h\" (UniqueName: \"kubernetes.io/projected/1f6be085-12c0-4d6c-932b-3e50ddc59961-kube-api-access-tz92h\") pod \"e2e-mt-67d08912-openshift-default-9df476dd4-k5p49\" (UID: \"1f6be085-12c0-4d6c-932b-3e50ddc59961\") " pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49"
Jul 24 19:57:30.569076 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:30.569003    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f6be085-12c0-4d6c-932b-3e50ddc59961-istiod-ca-cert\") pod \"e2e-mt-67d08912-openshift-default-9df476dd4-k5p49\" (UID: \"1f6be085-12c0-4d6c-932b-3e50ddc59961\") " pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49"
Jul 24 19:57:30.569076 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:30.569035    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f6be085-12c0-4d6c-932b-3e50ddc59961-istio-token\") pod \"e2e-mt-67d08912-openshift-default-9df476dd4-k5p49\" (UID: \"1f6be085-12c0-4d6c-932b-3e50ddc59961\") " pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49"
Jul 24 19:57:30.569387 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:30.569157    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f6be085-12c0-4d6c-932b-3e50ddc59961-istio-envoy\") pod \"e2e-mt-67d08912-openshift-default-9df476dd4-k5p49\" (UID: \"1f6be085-12c0-4d6c-932b-3e50ddc59961\") " pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49"
Jul 24 19:57:30.569387 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:30.569219    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f6be085-12c0-4d6c-932b-3e50ddc59961-istio-data\") pod \"e2e-mt-67d08912-openshift-default-9df476dd4-k5p49\" (UID: \"1f6be085-12c0-4d6c-932b-3e50ddc59961\") " pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49"
Jul 24 19:57:30.569387 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:30.569341    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f6be085-12c0-4d6c-932b-3e50ddc59961-workload-certs\") pod \"e2e-mt-67d08912-openshift-default-9df476dd4-k5p49\" (UID: \"1f6be085-12c0-4d6c-932b-3e50ddc59961\") " pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49"
Jul 24 19:57:30.569590 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:30.569389    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f6be085-12c0-4d6c-932b-3e50ddc59961-workload-socket\") pod \"e2e-mt-67d08912-openshift-default-9df476dd4-k5p49\" (UID: \"1f6be085-12c0-4d6c-932b-3e50ddc59961\") " pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49"
Jul 24 19:57:30.569655 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:30.569624    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f6be085-12c0-4d6c-932b-3e50ddc59961-istio-data\") pod \"e2e-mt-67d08912-openshift-default-9df476dd4-k5p49\" (UID: \"1f6be085-12c0-4d6c-932b-3e50ddc59961\") " pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49"
Jul 24 19:57:30.569717 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:30.569696    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f6be085-12c0-4d6c-932b-3e50ddc59961-credential-socket\") pod \"e2e-mt-67d08912-openshift-default-9df476dd4-k5p49\" (UID: \"1f6be085-12c0-4d6c-932b-3e50ddc59961\") " pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49"
Jul 24 19:57:30.570821 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:30.570798    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f6be085-12c0-4d6c-932b-3e50ddc59961-istiod-ca-cert\") pod \"e2e-mt-67d08912-openshift-default-9df476dd4-k5p49\" (UID: \"1f6be085-12c0-4d6c-932b-3e50ddc59961\") " pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49"
Jul 24 19:57:30.571723 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:30.571680    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f6be085-12c0-4d6c-932b-3e50ddc59961-istio-envoy\") pod \"e2e-mt-67d08912-openshift-default-9df476dd4-k5p49\" (UID: \"1f6be085-12c0-4d6c-932b-3e50ddc59961\") " pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49"
Jul 24 19:57:30.571966 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:30.571939    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f6be085-12c0-4d6c-932b-3e50ddc59961-istio-podinfo\") pod \"e2e-mt-67d08912-openshift-default-9df476dd4-k5p49\" (UID: \"1f6be085-12c0-4d6c-932b-3e50ddc59961\") " pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49"
Jul 24 19:57:30.578264 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:30.578239    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f6be085-12c0-4d6c-932b-3e50ddc59961-istio-token\") pod \"e2e-mt-67d08912-openshift-default-9df476dd4-k5p49\" (UID: \"1f6be085-12c0-4d6c-932b-3e50ddc59961\") " pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49"
Jul 24 19:57:30.578811 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:30.578792    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz92h\" (UniqueName: \"kubernetes.io/projected/1f6be085-12c0-4d6c-932b-3e50ddc59961-kube-api-access-tz92h\") pod \"e2e-mt-67d08912-openshift-default-9df476dd4-k5p49\" (UID: \"1f6be085-12c0-4d6c-932b-3e50ddc59961\") " pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49"
Jul 24 19:57:30.710963 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:30.710875    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49"
Jul 24 19:57:30.856267 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:30.856226    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49"]
Jul 24 19:57:30.859916 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:57:30.859889    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f6be085_12c0_4d6c_932b_3e50ddc59961.slice/crio-79db2ead0dec67bc4f01118697da8e95aaf1d4892f1aadd961fa4f0ce0c56992 WatchSource:0}: Error finding container 79db2ead0dec67bc4f01118697da8e95aaf1d4892f1aadd961fa4f0ce0c56992: Status 404 returned error can't find the container with id 79db2ead0dec67bc4f01118697da8e95aaf1d4892f1aadd961fa4f0ce0c56992
Jul 24 19:57:30.862166 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:30.862132    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 19:57:30.862237 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:30.862199    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 19:57:30.862237 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:30.862224    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 19:57:31.651971 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:31.651938    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49" event={"ID":"1f6be085-12c0-4d6c-932b-3e50ddc59961","Type":"ContainerStarted","Data":"7232adf344c7fe8f0e49eff58dce921ad39479ba000ee0236cfac2da1636d924"}
Jul 24 19:57:31.652363 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:31.652010    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49" event={"ID":"1f6be085-12c0-4d6c-932b-3e50ddc59961","Type":"ContainerStarted","Data":"79db2ead0dec67bc4f01118697da8e95aaf1d4892f1aadd961fa4f0ce0c56992"}
Jul 24 19:57:31.673633 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:31.673581    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49" podStartSLOduration=1.6735658519999999 podStartE2EDuration="1.673565852s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:57:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:57:31.671520154 +0000 UTC m=+1840.190140191" watchObservedRunningTime="2026-07-24 19:57:31.673565852 +0000 UTC m=+1840.192185892"
Jul 24 19:57:31.711553 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:31.711516    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49"
Jul 24 19:57:31.716474 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:31.716450    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49"
Jul 24 19:57:32.658240 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:32.658205    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49"
Jul 24 19:57:32.659233 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:32.659216    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49"
Jul 24 19:57:34.355886 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:34.355853    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-67d08912-855b8644bd-s6c87"]
Jul 24 19:57:34.356237 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:34.356198    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f02304dd-bfd2-4371-ac4a-d6c044b83d57" containerName="istio-proxy"
Jul 24 19:57:34.356237 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:34.356209    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f02304dd-bfd2-4371-ac4a-d6c044b83d57" containerName="istio-proxy"
Jul 24 19:57:34.356237 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:34.356225    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b385f9fe-bdae-41cf-b5c8-c3724df38fca" containerName="istio-proxy"
Jul 24 19:57:34.356237 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:34.356230    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b385f9fe-bdae-41cf-b5c8-c3724df38fca" containerName="istio-proxy"
Jul 24 19:57:34.359264 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:34.359245    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-67d08912-855b8644bd-s6c87"
Jul 24 19:57:34.365815 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:34.365790    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-67d08912\""
Jul 24 19:57:34.366425 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:34.366268    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-67d08912-dockercfg-2t6z6\""
Jul 24 19:57:34.374193 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:34.374171    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-67d08912-855b8644bd-s6c87"]
Jul 24 19:57:34.378237 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:34.378218    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-67d08912-cb95cc4cd-66dmh"]
Jul 24 19:57:34.381353 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:34.381337    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-67d08912-cb95cc4cd-66dmh"
Jul 24 19:57:34.392694 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:34.392671    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-67d08912-cb95cc4cd-66dmh"]
Jul 24 19:57:34.505994 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:34.505960    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blbmb\" (UniqueName: \"kubernetes.io/projected/3dbc8542-fcc3-4e00-9983-d6708ca93169-kube-api-access-blbmb\") pod \"payload-pre-processing-e2e-mt-67d08912-855b8644bd-s6c87\" (UID: \"3dbc8542-fcc3-4e00-9983-d6708ca93169\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-67d08912-855b8644bd-s6c87"
Jul 24 19:57:34.506194 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:34.506008    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3dbc8542-fcc3-4e00-9983-d6708ca93169-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-67d08912-855b8644bd-s6c87\" (UID: \"3dbc8542-fcc3-4e00-9983-d6708ca93169\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-67d08912-855b8644bd-s6c87"
Jul 24 19:57:34.506194 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:34.506040    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efe9b446-ec04-400c-83f2-00ea94d521ee-plugins-config-volume\") pod \"payload-processing-e2e-mt-67d08912-cb95cc4cd-66dmh\" (UID: \"efe9b446-ec04-400c-83f2-00ea94d521ee\") " pod="openshift-ingress/payload-processing-e2e-mt-67d08912-cb95cc4cd-66dmh"
Jul 24 19:57:34.506194 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:34.506065    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9qvl\" (UniqueName: \"kubernetes.io/projected/efe9b446-ec04-400c-83f2-00ea94d521ee-kube-api-access-j9qvl\") pod \"payload-processing-e2e-mt-67d08912-cb95cc4cd-66dmh\" (UID: \"efe9b446-ec04-400c-83f2-00ea94d521ee\") " pod="openshift-ingress/payload-processing-e2e-mt-67d08912-cb95cc4cd-66dmh"
Jul 24 19:57:34.607418 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:34.607331    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efe9b446-ec04-400c-83f2-00ea94d521ee-plugins-config-volume\") pod \"payload-processing-e2e-mt-67d08912-cb95cc4cd-66dmh\" (UID: \"efe9b446-ec04-400c-83f2-00ea94d521ee\") " pod="openshift-ingress/payload-processing-e2e-mt-67d08912-cb95cc4cd-66dmh"
Jul 24 19:57:34.607418 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:34.607375    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9qvl\" (UniqueName: \"kubernetes.io/projected/efe9b446-ec04-400c-83f2-00ea94d521ee-kube-api-access-j9qvl\") pod \"payload-processing-e2e-mt-67d08912-cb95cc4cd-66dmh\" (UID: \"efe9b446-ec04-400c-83f2-00ea94d521ee\") " pod="openshift-ingress/payload-processing-e2e-mt-67d08912-cb95cc4cd-66dmh"
Jul 24 19:57:34.607693 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:34.607440    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blbmb\" (UniqueName: \"kubernetes.io/projected/3dbc8542-fcc3-4e00-9983-d6708ca93169-kube-api-access-blbmb\") pod \"payload-pre-processing-e2e-mt-67d08912-855b8644bd-s6c87\" (UID: \"3dbc8542-fcc3-4e00-9983-d6708ca93169\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-67d08912-855b8644bd-s6c87"
Jul 24 19:57:34.607693 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:34.607475    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3dbc8542-fcc3-4e00-9983-d6708ca93169-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-67d08912-855b8644bd-s6c87\" (UID: \"3dbc8542-fcc3-4e00-9983-d6708ca93169\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-67d08912-855b8644bd-s6c87"
Jul 24 19:57:34.608185 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:34.608161    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3dbc8542-fcc3-4e00-9983-d6708ca93169-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-67d08912-855b8644bd-s6c87\" (UID: \"3dbc8542-fcc3-4e00-9983-d6708ca93169\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-67d08912-855b8644bd-s6c87"
Jul 24 19:57:34.608289 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:34.608215    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efe9b446-ec04-400c-83f2-00ea94d521ee-plugins-config-volume\") pod \"payload-processing-e2e-mt-67d08912-cb95cc4cd-66dmh\" (UID: \"efe9b446-ec04-400c-83f2-00ea94d521ee\") " pod="openshift-ingress/payload-processing-e2e-mt-67d08912-cb95cc4cd-66dmh"
Jul 24 19:57:34.615596 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:34.615577    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9qvl\" (UniqueName: \"kubernetes.io/projected/efe9b446-ec04-400c-83f2-00ea94d521ee-kube-api-access-j9qvl\") pod \"payload-processing-e2e-mt-67d08912-cb95cc4cd-66dmh\" (UID: \"efe9b446-ec04-400c-83f2-00ea94d521ee\") " pod="openshift-ingress/payload-processing-e2e-mt-67d08912-cb95cc4cd-66dmh"
Jul 24 19:57:34.615870 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:34.615849    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-blbmb\" (UniqueName: \"kubernetes.io/projected/3dbc8542-fcc3-4e00-9983-d6708ca93169-kube-api-access-blbmb\") pod \"payload-pre-processing-e2e-mt-67d08912-855b8644bd-s6c87\" (UID: \"3dbc8542-fcc3-4e00-9983-d6708ca93169\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-67d08912-855b8644bd-s6c87"
Jul 24 19:57:34.670179 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:34.670158    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-67d08912-855b8644bd-s6c87"
Jul 24 19:57:34.693299 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:34.693271    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-67d08912-cb95cc4cd-66dmh"
Jul 24 19:57:34.822202 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:34.821238    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-67d08912-855b8644bd-s6c87"]
Jul 24 19:57:34.824200 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:57:34.824141    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dbc8542_fcc3_4e00_9983_d6708ca93169.slice/crio-25f1edd88502714f89b7f12775ed165c8b1b8875233c6d011ad5489091c041cb WatchSource:0}: Error finding container 25f1edd88502714f89b7f12775ed165c8b1b8875233c6d011ad5489091c041cb: Status 404 returned error can't find the container with id 25f1edd88502714f89b7f12775ed165c8b1b8875233c6d011ad5489091c041cb
Jul 24 19:57:34.849647 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:34.849624    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-67d08912-cb95cc4cd-66dmh"]
Jul 24 19:57:34.859804 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:57:34.859756    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefe9b446_ec04_400c_83f2_00ea94d521ee.slice/crio-09aff69f92d3cb2f0a64fe151abba5a47be360e14f734e521b858b5abe62fcb4 WatchSource:0}: Error finding container 09aff69f92d3cb2f0a64fe151abba5a47be360e14f734e521b858b5abe62fcb4: Status 404 returned error can't find the container with id 09aff69f92d3cb2f0a64fe151abba5a47be360e14f734e521b858b5abe62fcb4
Jul 24 19:57:35.675196 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:35.675155    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-67d08912-855b8644bd-s6c87" event={"ID":"3dbc8542-fcc3-4e00-9983-d6708ca93169","Type":"ContainerStarted","Data":"b15d1928b5395e2096a7a488c98652a60fe339e46a3cbf61aaa6d69467131f26"}
Jul 24 19:57:35.675701 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:35.675228    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-67d08912-855b8644bd-s6c87"
Jul 24 19:57:35.675701 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:35.675259    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-67d08912-855b8644bd-s6c87" event={"ID":"3dbc8542-fcc3-4e00-9983-d6708ca93169","Type":"ContainerStarted","Data":"25f1edd88502714f89b7f12775ed165c8b1b8875233c6d011ad5489091c041cb"}
Jul 24 19:57:35.676707 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:35.676684    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-67d08912-cb95cc4cd-66dmh" event={"ID":"efe9b446-ec04-400c-83f2-00ea94d521ee","Type":"ContainerStarted","Data":"1b002323d2e39a7e58566841c311282efba1203bb4e7d75199373ec05a82abef"}
Jul 24 19:57:35.676811 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:35.676726    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-67d08912-cb95cc4cd-66dmh" event={"ID":"efe9b446-ec04-400c-83f2-00ea94d521ee","Type":"ContainerStarted","Data":"09aff69f92d3cb2f0a64fe151abba5a47be360e14f734e521b858b5abe62fcb4"}
Jul 24 19:57:35.676811 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:35.676746    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-67d08912-cb95cc4cd-66dmh"
Jul 24 19:57:35.691456 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:35.691416    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-67d08912-855b8644bd-s6c87" podStartSLOduration=1.6914023120000001 podStartE2EDuration="1.691402312s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:57:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:57:35.690359511 +0000 UTC m=+1844.208979595" watchObservedRunningTime="2026-07-24 19:57:35.691402312 +0000 UTC m=+1844.210022353"
Jul 24 19:57:35.705767 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:35.705723    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-67d08912-cb95cc4cd-66dmh" podStartSLOduration=1.705710336 podStartE2EDuration="1.705710336s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:57:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:57:35.704738018 +0000 UTC m=+1844.223358061" watchObservedRunningTime="2026-07-24 19:57:35.705710336 +0000 UTC m=+1844.224330377"
Jul 24 19:57:46.684147 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:46.684115    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-67d08912-cb95cc4cd-66dmh"
Jul 24 19:57:46.684590 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:46.684198    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-67d08912-855b8644bd-s6c87"
Jul 24 19:57:48.010891 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:48.010731    2567 patch_prober.go:28] interesting pod/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": read tcp 10.134.0.2:52678->10.134.0.48:15021: read: connection reset by peer" start-of-body=
Jul 24 19:57:48.010891 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:48.010798    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49" podUID="1f6be085-12c0-4d6c-932b-3e50ddc59961" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": read tcp 10.134.0.2:52678->10.134.0.48:15021: read: connection reset by peer"
Jul 24 19:57:48.741646 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:48.741611    2567 generic.go:356] "Generic (PLEG): container finished" podID="1f6be085-12c0-4d6c-932b-3e50ddc59961" containerID="7232adf344c7fe8f0e49eff58dce921ad39479ba000ee0236cfac2da1636d924" exitCode=0
Jul 24 19:57:48.741842 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:48.741684    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49" event={"ID":"1f6be085-12c0-4d6c-932b-3e50ddc59961","Type":"ContainerDied","Data":"7232adf344c7fe8f0e49eff58dce921ad39479ba000ee0236cfac2da1636d924"}
Jul 24 19:57:48.742054 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:48.742040    2567 scope.go:117] "RemoveContainer" containerID="7232adf344c7fe8f0e49eff58dce921ad39479ba000ee0236cfac2da1636d924"
Jul 24 19:57:48.743032 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:48.743005    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 19:57:48.743089 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:48.743071    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 19:57:48.743124 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:48.743108    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 19:57:49.751811 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:49.751767    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49" event={"ID":"1f6be085-12c0-4d6c-932b-3e50ddc59961","Type":"ContainerStarted","Data":"36b72089ef3498ae8a95db914909672faba82be77632138952f4662645be2108"}
Jul 24 19:57:50.711255 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:50.711219    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49"
Jul 24 19:57:50.711430 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:50.711416    2567 patch_prober.go:28] interesting pod/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 24 19:57:50.711505 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:50.711463    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49" podUID="1f6be085-12c0-4d6c-932b-3e50ddc59961" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 24 19:57:51.711869 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:51.711829    2567 patch_prober.go:28] interesting pod/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 24 19:57:51.712283 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:51.711889    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49" podUID="1f6be085-12c0-4d6c-932b-3e50ddc59961" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 24 19:57:52.711276 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:52.711236    2567 patch_prober.go:28] interesting pod/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 24 19:57:52.711452 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:52.711297    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49" podUID="1f6be085-12c0-4d6c-932b-3e50ddc59961" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 24 19:57:53.714829 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:53.714797    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49"
Jul 24 19:57:53.715282 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:53.715073    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49"
Jul 24 19:57:53.715838 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:53.715819    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49"
Jul 24 19:57:55.825650 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:55.825623    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-67d08912-cb95cc4cd-66dmh"]
Jul 24 19:57:55.826086 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:55.825841    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-67d08912-cb95cc4cd-66dmh" podUID="efe9b446-ec04-400c-83f2-00ea94d521ee" containerName="payload-processing" containerID="cri-o://1b002323d2e39a7e58566841c311282efba1203bb4e7d75199373ec05a82abef" gracePeriod=30
Jul 24 19:57:55.833532 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:55.833508    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-67d08912-855b8644bd-s6c87"]
Jul 24 19:57:55.833744 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:55.833723    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-67d08912-855b8644bd-s6c87" podUID="3dbc8542-fcc3-4e00-9983-d6708ca93169" containerName="payload-pre-processing" containerID="cri-o://b15d1928b5395e2096a7a488c98652a60fe339e46a3cbf61aaa6d69467131f26" gracePeriod=30
Jul 24 19:57:56.087744 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:56.087685    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-67d08912-cb95cc4cd-66dmh"
Jul 24 19:57:56.106699 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:56.106675    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-67d08912-855b8644bd-s6c87"
Jul 24 19:57:56.111334 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:56.111311    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9qvl\" (UniqueName: \"kubernetes.io/projected/efe9b446-ec04-400c-83f2-00ea94d521ee-kube-api-access-j9qvl\") pod \"efe9b446-ec04-400c-83f2-00ea94d521ee\" (UID: \"efe9b446-ec04-400c-83f2-00ea94d521ee\") "
Jul 24 19:57:56.111447 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:56.111343    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efe9b446-ec04-400c-83f2-00ea94d521ee-plugins-config-volume\") pod \"efe9b446-ec04-400c-83f2-00ea94d521ee\" (UID: \"efe9b446-ec04-400c-83f2-00ea94d521ee\") "
Jul 24 19:57:56.111831 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:56.111803    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efe9b446-ec04-400c-83f2-00ea94d521ee-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "efe9b446-ec04-400c-83f2-00ea94d521ee" (UID: "efe9b446-ec04-400c-83f2-00ea94d521ee"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:57:56.113447 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:56.113426    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efe9b446-ec04-400c-83f2-00ea94d521ee-kube-api-access-j9qvl" (OuterVolumeSpecName: "kube-api-access-j9qvl") pod "efe9b446-ec04-400c-83f2-00ea94d521ee" (UID: "efe9b446-ec04-400c-83f2-00ea94d521ee"). InnerVolumeSpecName "kube-api-access-j9qvl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:57:56.212626 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:56.212587    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-blbmb\" (UniqueName: \"kubernetes.io/projected/3dbc8542-fcc3-4e00-9983-d6708ca93169-kube-api-access-blbmb\") pod \"3dbc8542-fcc3-4e00-9983-d6708ca93169\" (UID: \"3dbc8542-fcc3-4e00-9983-d6708ca93169\") "
Jul 24 19:57:56.212805 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:56.212653    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3dbc8542-fcc3-4e00-9983-d6708ca93169-plugins-config-volume\") pod \"3dbc8542-fcc3-4e00-9983-d6708ca93169\" (UID: \"3dbc8542-fcc3-4e00-9983-d6708ca93169\") "
Jul 24 19:57:56.212884 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:56.212814    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9qvl\" (UniqueName: \"kubernetes.io/projected/efe9b446-ec04-400c-83f2-00ea94d521ee-kube-api-access-j9qvl\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:57:56.212884 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:56.212824    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efe9b446-ec04-400c-83f2-00ea94d521ee-plugins-config-volume\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:57:56.213016 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:56.212994    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3dbc8542-fcc3-4e00-9983-d6708ca93169-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3dbc8542-fcc3-4e00-9983-d6708ca93169" (UID: "3dbc8542-fcc3-4e00-9983-d6708ca93169"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:57:56.214779 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:56.214757    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3dbc8542-fcc3-4e00-9983-d6708ca93169-kube-api-access-blbmb" (OuterVolumeSpecName: "kube-api-access-blbmb") pod "3dbc8542-fcc3-4e00-9983-d6708ca93169" (UID: "3dbc8542-fcc3-4e00-9983-d6708ca93169"). InnerVolumeSpecName "kube-api-access-blbmb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:57:56.313681 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:56.313653    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-blbmb\" (UniqueName: \"kubernetes.io/projected/3dbc8542-fcc3-4e00-9983-d6708ca93169-kube-api-access-blbmb\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:57:56.313681 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:56.313675    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3dbc8542-fcc3-4e00-9983-d6708ca93169-plugins-config-volume\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:57:56.787979 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:56.787944    2567 generic.go:356] "Generic (PLEG): container finished" podID="efe9b446-ec04-400c-83f2-00ea94d521ee" containerID="1b002323d2e39a7e58566841c311282efba1203bb4e7d75199373ec05a82abef" exitCode=0
Jul 24 19:57:56.788177 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:56.787990    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-67d08912-cb95cc4cd-66dmh"
Jul 24 19:57:56.788177 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:56.788025    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-67d08912-cb95cc4cd-66dmh" event={"ID":"efe9b446-ec04-400c-83f2-00ea94d521ee","Type":"ContainerDied","Data":"1b002323d2e39a7e58566841c311282efba1203bb4e7d75199373ec05a82abef"}
Jul 24 19:57:56.788177 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:56.788074    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-67d08912-cb95cc4cd-66dmh" event={"ID":"efe9b446-ec04-400c-83f2-00ea94d521ee","Type":"ContainerDied","Data":"09aff69f92d3cb2f0a64fe151abba5a47be360e14f734e521b858b5abe62fcb4"}
Jul 24 19:57:56.788177 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:56.788095    2567 scope.go:117] "RemoveContainer" containerID="1b002323d2e39a7e58566841c311282efba1203bb4e7d75199373ec05a82abef"
Jul 24 19:57:56.789401 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:56.789375    2567 generic.go:356] "Generic (PLEG): container finished" podID="3dbc8542-fcc3-4e00-9983-d6708ca93169" containerID="b15d1928b5395e2096a7a488c98652a60fe339e46a3cbf61aaa6d69467131f26" exitCode=0
Jul 24 19:57:56.789535 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:56.789400    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-67d08912-855b8644bd-s6c87" event={"ID":"3dbc8542-fcc3-4e00-9983-d6708ca93169","Type":"ContainerDied","Data":"b15d1928b5395e2096a7a488c98652a60fe339e46a3cbf61aaa6d69467131f26"}
Jul 24 19:57:56.789535 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:56.789421    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-67d08912-855b8644bd-s6c87"
Jul 24 19:57:56.789535 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:56.789448    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-67d08912-855b8644bd-s6c87" event={"ID":"3dbc8542-fcc3-4e00-9983-d6708ca93169","Type":"ContainerDied","Data":"25f1edd88502714f89b7f12775ed165c8b1b8875233c6d011ad5489091c041cb"}
Jul 24 19:57:56.799019 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:56.798829    2567 scope.go:117] "RemoveContainer" containerID="1b002323d2e39a7e58566841c311282efba1203bb4e7d75199373ec05a82abef"
Jul 24 19:57:56.799724 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:57:56.799698    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b002323d2e39a7e58566841c311282efba1203bb4e7d75199373ec05a82abef\": container with ID starting with 1b002323d2e39a7e58566841c311282efba1203bb4e7d75199373ec05a82abef not found: ID does not exist" containerID="1b002323d2e39a7e58566841c311282efba1203bb4e7d75199373ec05a82abef"
Jul 24 19:57:56.799813 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:56.799739    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b002323d2e39a7e58566841c311282efba1203bb4e7d75199373ec05a82abef"} err="failed to get container status \"1b002323d2e39a7e58566841c311282efba1203bb4e7d75199373ec05a82abef\": rpc error: code = NotFound desc = could not find container \"1b002323d2e39a7e58566841c311282efba1203bb4e7d75199373ec05a82abef\": container with ID starting with 1b002323d2e39a7e58566841c311282efba1203bb4e7d75199373ec05a82abef not found: ID does not exist"
Jul 24 19:57:56.799813 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:56.799764    2567 scope.go:117] "RemoveContainer" containerID="b15d1928b5395e2096a7a488c98652a60fe339e46a3cbf61aaa6d69467131f26"
Jul 24 19:57:56.807950 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:56.807929    2567 scope.go:117] "RemoveContainer" containerID="b15d1928b5395e2096a7a488c98652a60fe339e46a3cbf61aaa6d69467131f26"
Jul 24 19:57:56.808199 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:57:56.808182    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b15d1928b5395e2096a7a488c98652a60fe339e46a3cbf61aaa6d69467131f26\": container with ID starting with b15d1928b5395e2096a7a488c98652a60fe339e46a3cbf61aaa6d69467131f26 not found: ID does not exist" containerID="b15d1928b5395e2096a7a488c98652a60fe339e46a3cbf61aaa6d69467131f26"
Jul 24 19:57:56.808265 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:56.808207    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b15d1928b5395e2096a7a488c98652a60fe339e46a3cbf61aaa6d69467131f26"} err="failed to get container status \"b15d1928b5395e2096a7a488c98652a60fe339e46a3cbf61aaa6d69467131f26\": rpc error: code = NotFound desc = could not find container \"b15d1928b5395e2096a7a488c98652a60fe339e46a3cbf61aaa6d69467131f26\": container with ID starting with b15d1928b5395e2096a7a488c98652a60fe339e46a3cbf61aaa6d69467131f26 not found: ID does not exist"
Jul 24 19:57:56.813570 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:56.813549    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-67d08912-855b8644bd-s6c87"]
Jul 24 19:57:56.819603 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:56.819584    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-67d08912-855b8644bd-s6c87"]
Jul 24 19:57:56.829717 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:56.829697    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-67d08912-cb95cc4cd-66dmh"]
Jul 24 19:57:56.835834 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:56.835812    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-67d08912-cb95cc4cd-66dmh"]
Jul 24 19:57:58.076821 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:58.076792    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3dbc8542-fcc3-4e00-9983-d6708ca93169" path="/var/lib/kubelet/pods/3dbc8542-fcc3-4e00-9983-d6708ca93169/volumes"
Jul 24 19:57:58.077187 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:57:58.077124    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efe9b446-ec04-400c-83f2-00ea94d521ee" path="/var/lib/kubelet/pods/efe9b446-ec04-400c-83f2-00ea94d521ee/volumes"
Jul 24 19:58:07.007265 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:07.007227    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49"]
Jul 24 19:58:07.007855 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:07.007522    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49" podUID="1f6be085-12c0-4d6c-932b-3e50ddc59961" containerName="istio-proxy" containerID="cri-o://36b72089ef3498ae8a95db914909672faba82be77632138952f4662645be2108" gracePeriod=30
Jul 24 19:58:08.717320 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:08.717284    2567 patch_prober.go:28] interesting pod/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 19:58:08.717704 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:08.717344    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49" podUID="1f6be085-12c0-4d6c-932b-3e50ddc59961" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 19:58:12.263613 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:12.263590    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49"
Jul 24 19:58:12.360909 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:12.360888    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f6be085-12c0-4d6c-932b-3e50ddc59961-istio-podinfo\") pod \"1f6be085-12c0-4d6c-932b-3e50ddc59961\" (UID: \"1f6be085-12c0-4d6c-932b-3e50ddc59961\") "
Jul 24 19:58:12.361058 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:12.360918    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f6be085-12c0-4d6c-932b-3e50ddc59961-istio-token\") pod \"1f6be085-12c0-4d6c-932b-3e50ddc59961\" (UID: \"1f6be085-12c0-4d6c-932b-3e50ddc59961\") "
Jul 24 19:58:12.361058 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:12.360945    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f6be085-12c0-4d6c-932b-3e50ddc59961-istio-envoy\") pod \"1f6be085-12c0-4d6c-932b-3e50ddc59961\" (UID: \"1f6be085-12c0-4d6c-932b-3e50ddc59961\") "
Jul 24 19:58:12.361058 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:12.360960    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f6be085-12c0-4d6c-932b-3e50ddc59961-istiod-ca-cert\") pod \"1f6be085-12c0-4d6c-932b-3e50ddc59961\" (UID: \"1f6be085-12c0-4d6c-932b-3e50ddc59961\") "
Jul 24 19:58:12.361058 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:12.361048    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f6be085-12c0-4d6c-932b-3e50ddc59961-workload-socket\") pod \"1f6be085-12c0-4d6c-932b-3e50ddc59961\" (UID: \"1f6be085-12c0-4d6c-932b-3e50ddc59961\") "
Jul 24 19:58:12.361255 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:12.361086    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tz92h\" (UniqueName: \"kubernetes.io/projected/1f6be085-12c0-4d6c-932b-3e50ddc59961-kube-api-access-tz92h\") pod \"1f6be085-12c0-4d6c-932b-3e50ddc59961\" (UID: \"1f6be085-12c0-4d6c-932b-3e50ddc59961\") "
Jul 24 19:58:12.361255 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:12.361151    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f6be085-12c0-4d6c-932b-3e50ddc59961-istio-data\") pod \"1f6be085-12c0-4d6c-932b-3e50ddc59961\" (UID: \"1f6be085-12c0-4d6c-932b-3e50ddc59961\") "
Jul 24 19:58:12.361255 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:12.361177    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f6be085-12c0-4d6c-932b-3e50ddc59961-credential-socket\") pod \"1f6be085-12c0-4d6c-932b-3e50ddc59961\" (UID: \"1f6be085-12c0-4d6c-932b-3e50ddc59961\") "
Jul 24 19:58:12.361255 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:12.361211    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f6be085-12c0-4d6c-932b-3e50ddc59961-workload-certs\") pod \"1f6be085-12c0-4d6c-932b-3e50ddc59961\" (UID: \"1f6be085-12c0-4d6c-932b-3e50ddc59961\") "
Jul 24 19:58:12.361467 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:12.361355    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f6be085-12c0-4d6c-932b-3e50ddc59961-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1f6be085-12c0-4d6c-932b-3e50ddc59961" (UID: "1f6be085-12c0-4d6c-932b-3e50ddc59961"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:58:12.361467 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:12.361440    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f6be085-12c0-4d6c-932b-3e50ddc59961-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1f6be085-12c0-4d6c-932b-3e50ddc59961" (UID: "1f6be085-12c0-4d6c-932b-3e50ddc59961"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:58:12.361644 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:12.361620    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f6be085-12c0-4d6c-932b-3e50ddc59961-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1f6be085-12c0-4d6c-932b-3e50ddc59961" (UID: "1f6be085-12c0-4d6c-932b-3e50ddc59961"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:58:12.361889 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:12.361855    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f6be085-12c0-4d6c-932b-3e50ddc59961-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1f6be085-12c0-4d6c-932b-3e50ddc59961" (UID: "1f6be085-12c0-4d6c-932b-3e50ddc59961"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:58:12.361889 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:12.361859    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f6be085-12c0-4d6c-932b-3e50ddc59961-istiod-ca-cert\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:58:12.362097 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:12.361904    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f6be085-12c0-4d6c-932b-3e50ddc59961-workload-socket\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:58:12.362437 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:12.362410    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f6be085-12c0-4d6c-932b-3e50ddc59961-istio-data" (OuterVolumeSpecName: "istio-data") pod "1f6be085-12c0-4d6c-932b-3e50ddc59961" (UID: "1f6be085-12c0-4d6c-932b-3e50ddc59961"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:58:12.363337 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:12.363312    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1f6be085-12c0-4d6c-932b-3e50ddc59961-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1f6be085-12c0-4d6c-932b-3e50ddc59961" (UID: "1f6be085-12c0-4d6c-932b-3e50ddc59961"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 19:58:12.363337 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:12.363325    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f6be085-12c0-4d6c-932b-3e50ddc59961-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1f6be085-12c0-4d6c-932b-3e50ddc59961" (UID: "1f6be085-12c0-4d6c-932b-3e50ddc59961"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:58:12.363528 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:12.363355    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f6be085-12c0-4d6c-932b-3e50ddc59961-istio-token" (OuterVolumeSpecName: "istio-token") pod "1f6be085-12c0-4d6c-932b-3e50ddc59961" (UID: "1f6be085-12c0-4d6c-932b-3e50ddc59961"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:58:12.363742 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:12.363719    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f6be085-12c0-4d6c-932b-3e50ddc59961-kube-api-access-tz92h" (OuterVolumeSpecName: "kube-api-access-tz92h") pod "1f6be085-12c0-4d6c-932b-3e50ddc59961" (UID: "1f6be085-12c0-4d6c-932b-3e50ddc59961"). InnerVolumeSpecName "kube-api-access-tz92h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:58:12.462812 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:12.462787    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f6be085-12c0-4d6c-932b-3e50ddc59961-istio-data\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:58:12.462812 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:12.462811    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f6be085-12c0-4d6c-932b-3e50ddc59961-credential-socket\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:58:12.462812 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:12.462820    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f6be085-12c0-4d6c-932b-3e50ddc59961-workload-certs\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:58:12.463044 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:12.462829    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f6be085-12c0-4d6c-932b-3e50ddc59961-istio-podinfo\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:58:12.463044 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:12.462836    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f6be085-12c0-4d6c-932b-3e50ddc59961-istio-token\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:58:12.463044 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:12.462843    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f6be085-12c0-4d6c-932b-3e50ddc59961-istio-envoy\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:58:12.463044 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:12.462851    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tz92h\" (UniqueName: \"kubernetes.io/projected/1f6be085-12c0-4d6c-932b-3e50ddc59961-kube-api-access-tz92h\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:58:12.866518 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:12.866452    2567 generic.go:356] "Generic (PLEG): container finished" podID="1f6be085-12c0-4d6c-932b-3e50ddc59961" containerID="36b72089ef3498ae8a95db914909672faba82be77632138952f4662645be2108" exitCode=0
Jul 24 19:58:12.866684 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:12.866536    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49"
Jul 24 19:58:12.866684 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:12.866540    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49" event={"ID":"1f6be085-12c0-4d6c-932b-3e50ddc59961","Type":"ContainerDied","Data":"36b72089ef3498ae8a95db914909672faba82be77632138952f4662645be2108"}
Jul 24 19:58:12.866684 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:12.866617    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49" event={"ID":"1f6be085-12c0-4d6c-932b-3e50ddc59961","Type":"ContainerDied","Data":"79db2ead0dec67bc4f01118697da8e95aaf1d4892f1aadd961fa4f0ce0c56992"}
Jul 24 19:58:12.866684 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:12.866638    2567 scope.go:117] "RemoveContainer" containerID="36b72089ef3498ae8a95db914909672faba82be77632138952f4662645be2108"
Jul 24 19:58:12.875668 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:12.875649    2567 scope.go:117] "RemoveContainer" containerID="7232adf344c7fe8f0e49eff58dce921ad39479ba000ee0236cfac2da1636d924"
Jul 24 19:58:12.883210 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:12.883195    2567 scope.go:117] "RemoveContainer" containerID="36b72089ef3498ae8a95db914909672faba82be77632138952f4662645be2108"
Jul 24 19:58:12.883442 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:58:12.883425    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36b72089ef3498ae8a95db914909672faba82be77632138952f4662645be2108\": container with ID starting with 36b72089ef3498ae8a95db914909672faba82be77632138952f4662645be2108 not found: ID does not exist" containerID="36b72089ef3498ae8a95db914909672faba82be77632138952f4662645be2108"
Jul 24 19:58:12.883543 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:12.883449    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36b72089ef3498ae8a95db914909672faba82be77632138952f4662645be2108"} err="failed to get container status \"36b72089ef3498ae8a95db914909672faba82be77632138952f4662645be2108\": rpc error: code = NotFound desc = could not find container \"36b72089ef3498ae8a95db914909672faba82be77632138952f4662645be2108\": container with ID starting with 36b72089ef3498ae8a95db914909672faba82be77632138952f4662645be2108 not found: ID does not exist"
Jul 24 19:58:12.883543 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:12.883464    2567 scope.go:117] "RemoveContainer" containerID="7232adf344c7fe8f0e49eff58dce921ad39479ba000ee0236cfac2da1636d924"
Jul 24 19:58:12.883750 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:58:12.883732    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7232adf344c7fe8f0e49eff58dce921ad39479ba000ee0236cfac2da1636d924\": container with ID starting with 7232adf344c7fe8f0e49eff58dce921ad39479ba000ee0236cfac2da1636d924 not found: ID does not exist" containerID="7232adf344c7fe8f0e49eff58dce921ad39479ba000ee0236cfac2da1636d924"
Jul 24 19:58:12.883793 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:12.883756    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7232adf344c7fe8f0e49eff58dce921ad39479ba000ee0236cfac2da1636d924"} err="failed to get container status \"7232adf344c7fe8f0e49eff58dce921ad39479ba000ee0236cfac2da1636d924\": rpc error: code = NotFound desc = could not find container \"7232adf344c7fe8f0e49eff58dce921ad39479ba000ee0236cfac2da1636d924\": container with ID starting with 7232adf344c7fe8f0e49eff58dce921ad39479ba000ee0236cfac2da1636d924 not found: ID does not exist"
Jul 24 19:58:12.887626 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:12.887606    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49"]
Jul 24 19:58:12.890942 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:12.890918    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-67d08912-openshift-default-9df476dd4-k5p49"]
Jul 24 19:58:14.071693 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:14.071657    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f6be085-12c0-4d6c-932b-3e50ddc59961" path="/var/lib/kubelet/pods/1f6be085-12c0-4d6c-932b-3e50ddc59961/volumes"
Jul 24 19:58:26.830023 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:26.829986    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88"]
Jul 24 19:58:26.830513 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:26.830329    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efe9b446-ec04-400c-83f2-00ea94d521ee" containerName="payload-processing"
Jul 24 19:58:26.830513 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:26.830341    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="efe9b446-ec04-400c-83f2-00ea94d521ee" containerName="payload-processing"
Jul 24 19:58:26.830513 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:26.830354    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f6be085-12c0-4d6c-932b-3e50ddc59961" containerName="istio-proxy"
Jul 24 19:58:26.830513 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:26.830360    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f6be085-12c0-4d6c-932b-3e50ddc59961" containerName="istio-proxy"
Jul 24 19:58:26.830513 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:26.830368    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dbc8542-fcc3-4e00-9983-d6708ca93169" containerName="payload-pre-processing"
Jul 24 19:58:26.830513 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:26.830374    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dbc8542-fcc3-4e00-9983-d6708ca93169" containerName="payload-pre-processing"
Jul 24 19:58:26.830513 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:26.830381    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f6be085-12c0-4d6c-932b-3e50ddc59961" containerName="istio-proxy"
Jul 24 19:58:26.830513 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:26.830386    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f6be085-12c0-4d6c-932b-3e50ddc59961" containerName="istio-proxy"
Jul 24 19:58:26.830513 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:26.830444    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f6be085-12c0-4d6c-932b-3e50ddc59961" containerName="istio-proxy"
Jul 24 19:58:26.830513 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:26.830465    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f6be085-12c0-4d6c-932b-3e50ddc59961" containerName="istio-proxy"
Jul 24 19:58:26.830513 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:26.830475    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="efe9b446-ec04-400c-83f2-00ea94d521ee" containerName="payload-processing"
Jul 24 19:58:26.830513 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:26.830501    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3dbc8542-fcc3-4e00-9983-d6708ca93169" containerName="payload-pre-processing"
Jul 24 19:58:26.833585 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:26.833563    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88"
Jul 24 19:58:26.836354 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:26.836324    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 24 19:58:26.836499 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:26.836379    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-0f165f39-openshift-default-dockercfg-kb2k9\""
Jul 24 19:58:26.845630 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:26.845608    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88"]
Jul 24 19:58:26.994447 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:26.994410    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-credential-socket\") pod \"e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88\" (UID: \"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e\") " pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88"
Jul 24 19:58:26.994645 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:26.994453    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-istio-podinfo\") pod \"e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88\" (UID: \"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e\") " pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88"
Jul 24 19:58:26.994645 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:26.994582    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-workload-certs\") pod \"e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88\" (UID: \"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e\") " pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88"
Jul 24 19:58:26.994645 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:26.994603    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-istiod-ca-cert\") pod \"e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88\" (UID: \"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e\") " pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88"
Jul 24 19:58:26.994645 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:26.994625    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-workload-socket\") pod \"e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88\" (UID: \"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e\") " pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88"
Jul 24 19:58:26.994785 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:26.994730    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-istio-token\") pod \"e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88\" (UID: \"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e\") " pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88"
Jul 24 19:58:26.994785 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:26.994746    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9n88c\" (UniqueName: \"kubernetes.io/projected/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-kube-api-access-9n88c\") pod \"e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88\" (UID: \"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e\") " pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88"
Jul 24 19:58:26.994785 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:26.994767    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-istio-data\") pod \"e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88\" (UID: \"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e\") " pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88"
Jul 24 19:58:26.994877 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:26.994803    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-istio-envoy\") pod \"e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88\" (UID: \"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e\") " pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88"
Jul 24 19:58:27.095802 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:27.095721    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-istio-envoy\") pod \"e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88\" (UID: \"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e\") " pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88"
Jul 24 19:58:27.095802 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:27.095764    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-credential-socket\") pod \"e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88\" (UID: \"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e\") " pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88"
Jul 24 19:58:27.095802 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:27.095789    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-istio-podinfo\") pod \"e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88\" (UID: \"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e\") " pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88"
Jul 24 19:58:27.096018 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:27.095906    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-workload-certs\") pod \"e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88\" (UID: \"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e\") " pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88"
Jul 24 19:58:27.096018 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:27.095944    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-istiod-ca-cert\") pod \"e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88\" (UID: \"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e\") " pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88"
Jul 24 19:58:27.096018 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:27.095977    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-workload-socket\") pod \"e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88\" (UID: \"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e\") " pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88"
Jul 24 19:58:27.096177 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:27.096090    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-istio-token\") pod \"e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88\" (UID: \"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e\") " pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88"
Jul 24 19:58:27.096177 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:27.096117    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9n88c\" (UniqueName: \"kubernetes.io/projected/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-kube-api-access-9n88c\") pod \"e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88\" (UID: \"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e\") " pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88"
Jul 24 19:58:27.096177 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:27.096144    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-istio-data\") pod \"e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88\" (UID: \"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e\") " pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88"
Jul 24 19:58:27.096326 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:27.096191    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-credential-socket\") pod \"e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88\" (UID: \"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e\") " pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88"
Jul 24 19:58:27.096448 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:27.096427    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-workload-socket\") pod \"e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88\" (UID: \"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e\") " pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88"
Jul 24 19:58:27.096578 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:27.096520    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-istio-data\") pod \"e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88\" (UID: \"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e\") " pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88"
Jul 24 19:58:27.096647 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:27.096574    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-workload-certs\") pod \"e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88\" (UID: \"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e\") " pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88"
Jul 24 19:58:27.096908 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:27.096888    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-istiod-ca-cert\") pod \"e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88\" (UID: \"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e\") " pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88"
Jul 24 19:58:27.098295 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:27.098270    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-istio-envoy\") pod \"e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88\" (UID: \"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e\") " pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88"
Jul 24 19:58:27.098523 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:27.098506    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-istio-podinfo\") pod \"e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88\" (UID: \"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e\") " pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88"
Jul 24 19:58:27.104365 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:27.104340    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-istio-token\") pod \"e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88\" (UID: \"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e\") " pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88"
Jul 24 19:58:27.104648 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:27.104630    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9n88c\" (UniqueName: \"kubernetes.io/projected/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-kube-api-access-9n88c\") pod \"e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88\" (UID: \"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e\") " pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88"
Jul 24 19:58:27.144679 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:27.144646    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88"
Jul 24 19:58:27.295774 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:27.295741    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88"]
Jul 24 19:58:27.299226 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:58:27.299202    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2a4a1b7_ae0a_4a7e_95d2_6268637c049e.slice/crio-86bd1897947273ef1f9c7db5eecda737b4ce46689aafda1224eb4deed04e27db WatchSource:0}: Error finding container 86bd1897947273ef1f9c7db5eecda737b4ce46689aafda1224eb4deed04e27db: Status 404 returned error can't find the container with id 86bd1897947273ef1f9c7db5eecda737b4ce46689aafda1224eb4deed04e27db
Jul 24 19:58:27.301352 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:27.301313    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 19:58:27.301419 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:27.301401    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 19:58:27.301465 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:27.301450    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 19:58:27.938299 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:27.938267    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88" event={"ID":"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e","Type":"ContainerStarted","Data":"3e914ce83024f6ca5f1aa5b94595315d5f91bdbe173c340504eebce60625fbb3"}
Jul 24 19:58:27.938747 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:27.938316    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88" event={"ID":"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e","Type":"ContainerStarted","Data":"86bd1897947273ef1f9c7db5eecda737b4ce46689aafda1224eb4deed04e27db"}
Jul 24 19:58:27.961859 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:27.961733    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88" podStartSLOduration=1.96171674 podStartE2EDuration="1.96171674s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:58:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:58:27.960768757 +0000 UTC m=+1896.479388798" watchObservedRunningTime="2026-07-24 19:58:27.96171674 +0000 UTC m=+1896.480336782"
Jul 24 19:58:28.145173 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:28.145143    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88"
Jul 24 19:58:28.150308 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:28.150284    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88"
Jul 24 19:58:28.943775 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:28.943743    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88"
Jul 24 19:58:28.944684 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:28.944667    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88"
Jul 24 19:58:30.730129 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:30.730095    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0f165f39-575b57f564-hhcsr"]
Jul 24 19:58:30.733675 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:30.733642    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0f165f39-575b57f564-hhcsr"
Jul 24 19:58:30.738659 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:30.738637    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-0f165f39\""
Jul 24 19:58:30.738795 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:30.738762    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-0f165f39-dockercfg-shkhj\""
Jul 24 19:58:30.751790 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:30.751764    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0f165f39-575b57f564-hhcsr"]
Jul 24 19:58:30.757442 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:30.757417    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0f165f39-7fcc997686-jjtzv"]
Jul 24 19:58:30.760732 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:30.760715    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-0f165f39-7fcc997686-jjtzv"
Jul 24 19:58:30.770366 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:30.770271    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0f165f39-7fcc997686-jjtzv"]
Jul 24 19:58:30.832377 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:30.832339    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkmnn\" (UniqueName: \"kubernetes.io/projected/252d8759-4613-44b9-9dfd-23753a0068f8-kube-api-access-lkmnn\") pod \"payload-pre-processing-e2e-mt-0f165f39-575b57f564-hhcsr\" (UID: \"252d8759-4613-44b9-9dfd-23753a0068f8\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0f165f39-575b57f564-hhcsr"
Jul 24 19:58:30.832625 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:30.832400    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b70898b-477c-4291-9667-7713e879f018-plugins-config-volume\") pod \"payload-processing-e2e-mt-0f165f39-7fcc997686-jjtzv\" (UID: \"5b70898b-477c-4291-9667-7713e879f018\") " pod="openshift-ingress/payload-processing-e2e-mt-0f165f39-7fcc997686-jjtzv"
Jul 24 19:58:30.832625 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:30.832434    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s94hl\" (UniqueName: \"kubernetes.io/projected/5b70898b-477c-4291-9667-7713e879f018-kube-api-access-s94hl\") pod \"payload-processing-e2e-mt-0f165f39-7fcc997686-jjtzv\" (UID: \"5b70898b-477c-4291-9667-7713e879f018\") " pod="openshift-ingress/payload-processing-e2e-mt-0f165f39-7fcc997686-jjtzv"
Jul 24 19:58:30.832625 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:30.832467    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/252d8759-4613-44b9-9dfd-23753a0068f8-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-0f165f39-575b57f564-hhcsr\" (UID: \"252d8759-4613-44b9-9dfd-23753a0068f8\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0f165f39-575b57f564-hhcsr"
Jul 24 19:58:30.933515 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:30.933454    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkmnn\" (UniqueName: \"kubernetes.io/projected/252d8759-4613-44b9-9dfd-23753a0068f8-kube-api-access-lkmnn\") pod \"payload-pre-processing-e2e-mt-0f165f39-575b57f564-hhcsr\" (UID: \"252d8759-4613-44b9-9dfd-23753a0068f8\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0f165f39-575b57f564-hhcsr"
Jul 24 19:58:30.933707 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:30.933525    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b70898b-477c-4291-9667-7713e879f018-plugins-config-volume\") pod \"payload-processing-e2e-mt-0f165f39-7fcc997686-jjtzv\" (UID: \"5b70898b-477c-4291-9667-7713e879f018\") " pod="openshift-ingress/payload-processing-e2e-mt-0f165f39-7fcc997686-jjtzv"
Jul 24 19:58:30.933707 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:30.933547    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s94hl\" (UniqueName: \"kubernetes.io/projected/5b70898b-477c-4291-9667-7713e879f018-kube-api-access-s94hl\") pod \"payload-processing-e2e-mt-0f165f39-7fcc997686-jjtzv\" (UID: \"5b70898b-477c-4291-9667-7713e879f018\") " pod="openshift-ingress/payload-processing-e2e-mt-0f165f39-7fcc997686-jjtzv"
Jul 24 19:58:30.933845 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:30.933711    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/252d8759-4613-44b9-9dfd-23753a0068f8-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-0f165f39-575b57f564-hhcsr\" (UID: \"252d8759-4613-44b9-9dfd-23753a0068f8\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0f165f39-575b57f564-hhcsr"
Jul 24 19:58:30.934308 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:30.934284    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b70898b-477c-4291-9667-7713e879f018-plugins-config-volume\") pod \"payload-processing-e2e-mt-0f165f39-7fcc997686-jjtzv\" (UID: \"5b70898b-477c-4291-9667-7713e879f018\") " pod="openshift-ingress/payload-processing-e2e-mt-0f165f39-7fcc997686-jjtzv"
Jul 24 19:58:30.934589 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:30.934569    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/252d8759-4613-44b9-9dfd-23753a0068f8-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-0f165f39-575b57f564-hhcsr\" (UID: \"252d8759-4613-44b9-9dfd-23753a0068f8\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0f165f39-575b57f564-hhcsr"
Jul 24 19:58:30.944746 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:30.944719    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s94hl\" (UniqueName: \"kubernetes.io/projected/5b70898b-477c-4291-9667-7713e879f018-kube-api-access-s94hl\") pod \"payload-processing-e2e-mt-0f165f39-7fcc997686-jjtzv\" (UID: \"5b70898b-477c-4291-9667-7713e879f018\") " pod="openshift-ingress/payload-processing-e2e-mt-0f165f39-7fcc997686-jjtzv"
Jul 24 19:58:30.944841 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:30.944760    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkmnn\" (UniqueName: \"kubernetes.io/projected/252d8759-4613-44b9-9dfd-23753a0068f8-kube-api-access-lkmnn\") pod \"payload-pre-processing-e2e-mt-0f165f39-575b57f564-hhcsr\" (UID: \"252d8759-4613-44b9-9dfd-23753a0068f8\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0f165f39-575b57f564-hhcsr"
Jul 24 19:58:31.044989 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:31.044901    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0f165f39-575b57f564-hhcsr"
Jul 24 19:58:31.074965 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:31.074939    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-0f165f39-7fcc997686-jjtzv"
Jul 24 19:58:31.205589 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:31.205560    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0f165f39-575b57f564-hhcsr"]
Jul 24 19:58:31.207630 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:58:31.207604    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod252d8759_4613_44b9_9dfd_23753a0068f8.slice/crio-54e2484ad5bf2021fb99ff011786498bba0fe711a8757ff8d8d13d2f8ee16d60 WatchSource:0}: Error finding container 54e2484ad5bf2021fb99ff011786498bba0fe711a8757ff8d8d13d2f8ee16d60: Status 404 returned error can't find the container with id 54e2484ad5bf2021fb99ff011786498bba0fe711a8757ff8d8d13d2f8ee16d60
Jul 24 19:58:31.231179 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:31.231118    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0f165f39-7fcc997686-jjtzv"]
Jul 24 19:58:31.237862 ip-10-0-133-84 kubenswrapper[2567]: W0724 19:58:31.237835    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b70898b_477c_4291_9667_7713e879f018.slice/crio-766d63cd8ffb01a3d3d7eb6a66220b8f56a01cd23a46dca01717b7af14ad5e3b WatchSource:0}: Error finding container 766d63cd8ffb01a3d3d7eb6a66220b8f56a01cd23a46dca01717b7af14ad5e3b: Status 404 returned error can't find the container with id 766d63cd8ffb01a3d3d7eb6a66220b8f56a01cd23a46dca01717b7af14ad5e3b
Jul 24 19:58:31.961624 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:31.961590    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-0f165f39-7fcc997686-jjtzv" event={"ID":"5b70898b-477c-4291-9667-7713e879f018","Type":"ContainerStarted","Data":"de81382844c0adb6ecbeea182d3ffe48c29d697ae51c24b387e29a0f37d8b151"}
Jul 24 19:58:31.962066 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:31.961692    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-0f165f39-7fcc997686-jjtzv" event={"ID":"5b70898b-477c-4291-9667-7713e879f018","Type":"ContainerStarted","Data":"766d63cd8ffb01a3d3d7eb6a66220b8f56a01cd23a46dca01717b7af14ad5e3b"}
Jul 24 19:58:31.962066 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:31.961726    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-0f165f39-7fcc997686-jjtzv"
Jul 24 19:58:31.963171 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:31.963152    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0f165f39-575b57f564-hhcsr" event={"ID":"252d8759-4613-44b9-9dfd-23753a0068f8","Type":"ContainerStarted","Data":"b0f4a97840d5ec74bffd254a4c98471dbb0a7ff76e8eac7d115321a4dba38e27"}
Jul 24 19:58:31.963254 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:31.963193    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0f165f39-575b57f564-hhcsr" event={"ID":"252d8759-4613-44b9-9dfd-23753a0068f8","Type":"ContainerStarted","Data":"54e2484ad5bf2021fb99ff011786498bba0fe711a8757ff8d8d13d2f8ee16d60"}
Jul 24 19:58:31.963254 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:31.963217    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-0f165f39-575b57f564-hhcsr"
Jul 24 19:58:31.979613 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:31.979571    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-0f165f39-7fcc997686-jjtzv" podStartSLOduration=1.979556396 podStartE2EDuration="1.979556396s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:58:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:58:31.978282374 +0000 UTC m=+1900.496902408" watchObservedRunningTime="2026-07-24 19:58:31.979556396 +0000 UTC m=+1900.498176433"
Jul 24 19:58:31.995529 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:31.995463    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-0f165f39-575b57f564-hhcsr" podStartSLOduration=1.995450403 podStartE2EDuration="1.995450403s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:58:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:58:31.994129087 +0000 UTC m=+1900.512749129" watchObservedRunningTime="2026-07-24 19:58:31.995450403 +0000 UTC m=+1900.514070443"
Jul 24 19:58:42.970702 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:42.970669    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-0f165f39-7fcc997686-jjtzv"
Jul 24 19:58:42.972248 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:42.970899    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-0f165f39-575b57f564-hhcsr"
Jul 24 19:58:43.945858 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:43.945822    2567 patch_prober.go:28] interesting pod/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 24 19:58:43.946363 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:43.946315    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88" podUID="c2a4a1b7-ae0a-4a7e-95d2-6268637c049e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 24 19:58:44.022956 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:44.022928    2567 generic.go:356] "Generic (PLEG): container finished" podID="c2a4a1b7-ae0a-4a7e-95d2-6268637c049e" containerID="3e914ce83024f6ca5f1aa5b94595315d5f91bdbe173c340504eebce60625fbb3" exitCode=0
Jul 24 19:58:44.023302 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:44.023001    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88" event={"ID":"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e","Type":"ContainerDied","Data":"3e914ce83024f6ca5f1aa5b94595315d5f91bdbe173c340504eebce60625fbb3"}
Jul 24 19:58:44.023395 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:44.023381    2567 scope.go:117] "RemoveContainer" containerID="3e914ce83024f6ca5f1aa5b94595315d5f91bdbe173c340504eebce60625fbb3"
Jul 24 19:58:44.024430 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:44.024398    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 19:58:44.024522 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:44.024502    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 19:58:44.024564 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:44.024550    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 19:58:45.030166 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:45.030131    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88" event={"ID":"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e","Type":"ContainerStarted","Data":"bd14c7ed71ba86fd43b2519c894c2d3eff13d1bd2c2bfd3c501d45e2082ef43c"}
Jul 24 19:58:45.145767 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:45.145721    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88"
Jul 24 19:58:45.145986 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:45.145864    2567 patch_prober.go:28] interesting pod/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 24 19:58:45.145986 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:45.145911    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88" podUID="c2a4a1b7-ae0a-4a7e-95d2-6268637c049e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 24 19:58:46.145760 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:46.145714    2567 patch_prober.go:28] interesting pod/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 24 19:58:46.146276 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:46.145793    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88" podUID="c2a4a1b7-ae0a-4a7e-95d2-6268637c049e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 24 19:58:47.145797 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:47.145759    2567 patch_prober.go:28] interesting pod/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 24 19:58:47.146412 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:47.146383    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88" podUID="c2a4a1b7-ae0a-4a7e-95d2-6268637c049e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 24 19:58:48.145757 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:48.145718    2567 patch_prober.go:28] interesting pod/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 24 19:58:48.146054 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:48.146024    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88" podUID="c2a4a1b7-ae0a-4a7e-95d2-6268637c049e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 24 19:58:49.145807 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:49.145763    2567 patch_prober.go:28] interesting pod/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 24 19:58:49.146023 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:49.145837    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88" podUID="c2a4a1b7-ae0a-4a7e-95d2-6268637c049e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 24 19:58:50.148794 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:50.148767    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88"
Jul 24 19:58:50.149157 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:50.149027    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88"
Jul 24 19:58:50.149587 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:58:50.149569    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88"
Jul 24 19:59:44.669519 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:59:44.669471    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0f165f39-7fcc997686-jjtzv"]
Jul 24 19:59:44.670044 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:59:44.669736    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-0f165f39-7fcc997686-jjtzv" podUID="5b70898b-477c-4291-9667-7713e879f018" containerName="payload-processing" containerID="cri-o://de81382844c0adb6ecbeea182d3ffe48c29d697ae51c24b387e29a0f37d8b151" gracePeriod=30
Jul 24 19:59:44.677525 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:59:44.677495    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0f165f39-575b57f564-hhcsr"]
Jul 24 19:59:44.677739 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:59:44.677704    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-0f165f39-575b57f564-hhcsr" podUID="252d8759-4613-44b9-9dfd-23753a0068f8" containerName="payload-pre-processing" containerID="cri-o://b0f4a97840d5ec74bffd254a4c98471dbb0a7ff76e8eac7d115321a4dba38e27" gracePeriod=30
Jul 24 19:59:44.957397 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:59:44.957373    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-0f165f39-7fcc997686-jjtzv"
Jul 24 19:59:44.960582 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:59:44.960561    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0f165f39-575b57f564-hhcsr"
Jul 24 19:59:45.133651 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:59:45.133619    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkmnn\" (UniqueName: \"kubernetes.io/projected/252d8759-4613-44b9-9dfd-23753a0068f8-kube-api-access-lkmnn\") pod \"252d8759-4613-44b9-9dfd-23753a0068f8\" (UID: \"252d8759-4613-44b9-9dfd-23753a0068f8\") "
Jul 24 19:59:45.133828 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:59:45.133719    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s94hl\" (UniqueName: \"kubernetes.io/projected/5b70898b-477c-4291-9667-7713e879f018-kube-api-access-s94hl\") pod \"5b70898b-477c-4291-9667-7713e879f018\" (UID: \"5b70898b-477c-4291-9667-7713e879f018\") "
Jul 24 19:59:45.133828 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:59:45.133757    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/252d8759-4613-44b9-9dfd-23753a0068f8-plugins-config-volume\") pod \"252d8759-4613-44b9-9dfd-23753a0068f8\" (UID: \"252d8759-4613-44b9-9dfd-23753a0068f8\") "
Jul 24 19:59:45.133828 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:59:45.133780    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b70898b-477c-4291-9667-7713e879f018-plugins-config-volume\") pod \"5b70898b-477c-4291-9667-7713e879f018\" (UID: \"5b70898b-477c-4291-9667-7713e879f018\") "
Jul 24 19:59:45.134151 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:59:45.134115    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/252d8759-4613-44b9-9dfd-23753a0068f8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "252d8759-4613-44b9-9dfd-23753a0068f8" (UID: "252d8759-4613-44b9-9dfd-23753a0068f8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:59:45.134294 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:59:45.134182    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b70898b-477c-4291-9667-7713e879f018-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5b70898b-477c-4291-9667-7713e879f018" (UID: "5b70898b-477c-4291-9667-7713e879f018"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:59:45.135968 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:59:45.135941    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b70898b-477c-4291-9667-7713e879f018-kube-api-access-s94hl" (OuterVolumeSpecName: "kube-api-access-s94hl") pod "5b70898b-477c-4291-9667-7713e879f018" (UID: "5b70898b-477c-4291-9667-7713e879f018"). InnerVolumeSpecName "kube-api-access-s94hl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:59:45.135968 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:59:45.135949    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/252d8759-4613-44b9-9dfd-23753a0068f8-kube-api-access-lkmnn" (OuterVolumeSpecName: "kube-api-access-lkmnn") pod "252d8759-4613-44b9-9dfd-23753a0068f8" (UID: "252d8759-4613-44b9-9dfd-23753a0068f8"). InnerVolumeSpecName "kube-api-access-lkmnn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:59:45.235266 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:59:45.235193    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s94hl\" (UniqueName: \"kubernetes.io/projected/5b70898b-477c-4291-9667-7713e879f018-kube-api-access-s94hl\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:59:45.235266 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:59:45.235222    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/252d8759-4613-44b9-9dfd-23753a0068f8-plugins-config-volume\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:59:45.235266 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:59:45.235234    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b70898b-477c-4291-9667-7713e879f018-plugins-config-volume\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:59:45.235266 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:59:45.235242    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkmnn\" (UniqueName: \"kubernetes.io/projected/252d8759-4613-44b9-9dfd-23753a0068f8-kube-api-access-lkmnn\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 19:59:45.320589 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:59:45.320558    2567 generic.go:356] "Generic (PLEG): container finished" podID="5b70898b-477c-4291-9667-7713e879f018" containerID="de81382844c0adb6ecbeea182d3ffe48c29d697ae51c24b387e29a0f37d8b151" exitCode=0
Jul 24 19:59:45.320767 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:59:45.320604    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-0f165f39-7fcc997686-jjtzv"
Jul 24 19:59:45.320767 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:59:45.320647    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-0f165f39-7fcc997686-jjtzv" event={"ID":"5b70898b-477c-4291-9667-7713e879f018","Type":"ContainerDied","Data":"de81382844c0adb6ecbeea182d3ffe48c29d697ae51c24b387e29a0f37d8b151"}
Jul 24 19:59:45.320767 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:59:45.320705    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-0f165f39-7fcc997686-jjtzv" event={"ID":"5b70898b-477c-4291-9667-7713e879f018","Type":"ContainerDied","Data":"766d63cd8ffb01a3d3d7eb6a66220b8f56a01cd23a46dca01717b7af14ad5e3b"}
Jul 24 19:59:45.320767 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:59:45.320733    2567 scope.go:117] "RemoveContainer" containerID="de81382844c0adb6ecbeea182d3ffe48c29d697ae51c24b387e29a0f37d8b151"
Jul 24 19:59:45.321961 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:59:45.321937    2567 generic.go:356] "Generic (PLEG): container finished" podID="252d8759-4613-44b9-9dfd-23753a0068f8" containerID="b0f4a97840d5ec74bffd254a4c98471dbb0a7ff76e8eac7d115321a4dba38e27" exitCode=0
Jul 24 19:59:45.322066 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:59:45.321962    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0f165f39-575b57f564-hhcsr" event={"ID":"252d8759-4613-44b9-9dfd-23753a0068f8","Type":"ContainerDied","Data":"b0f4a97840d5ec74bffd254a4c98471dbb0a7ff76e8eac7d115321a4dba38e27"}
Jul 24 19:59:45.322066 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:59:45.321977    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0f165f39-575b57f564-hhcsr"
Jul 24 19:59:45.322066 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:59:45.322013    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0f165f39-575b57f564-hhcsr" event={"ID":"252d8759-4613-44b9-9dfd-23753a0068f8","Type":"ContainerDied","Data":"54e2484ad5bf2021fb99ff011786498bba0fe711a8757ff8d8d13d2f8ee16d60"}
Jul 24 19:59:45.330404 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:59:45.330375    2567 scope.go:117] "RemoveContainer" containerID="de81382844c0adb6ecbeea182d3ffe48c29d697ae51c24b387e29a0f37d8b151"
Jul 24 19:59:45.330692 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:59:45.330674    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de81382844c0adb6ecbeea182d3ffe48c29d697ae51c24b387e29a0f37d8b151\": container with ID starting with de81382844c0adb6ecbeea182d3ffe48c29d697ae51c24b387e29a0f37d8b151 not found: ID does not exist" containerID="de81382844c0adb6ecbeea182d3ffe48c29d697ae51c24b387e29a0f37d8b151"
Jul 24 19:59:45.330799 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:59:45.330698    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de81382844c0adb6ecbeea182d3ffe48c29d697ae51c24b387e29a0f37d8b151"} err="failed to get container status \"de81382844c0adb6ecbeea182d3ffe48c29d697ae51c24b387e29a0f37d8b151\": rpc error: code = NotFound desc = could not find container \"de81382844c0adb6ecbeea182d3ffe48c29d697ae51c24b387e29a0f37d8b151\": container with ID starting with de81382844c0adb6ecbeea182d3ffe48c29d697ae51c24b387e29a0f37d8b151 not found: ID does not exist"
Jul 24 19:59:45.330799 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:59:45.330714    2567 scope.go:117] "RemoveContainer" containerID="b0f4a97840d5ec74bffd254a4c98471dbb0a7ff76e8eac7d115321a4dba38e27"
Jul 24 19:59:45.339521 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:59:45.339500    2567 scope.go:117] "RemoveContainer" containerID="b0f4a97840d5ec74bffd254a4c98471dbb0a7ff76e8eac7d115321a4dba38e27"
Jul 24 19:59:45.339787 ip-10-0-133-84 kubenswrapper[2567]: E0724 19:59:45.339771    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0f4a97840d5ec74bffd254a4c98471dbb0a7ff76e8eac7d115321a4dba38e27\": container with ID starting with b0f4a97840d5ec74bffd254a4c98471dbb0a7ff76e8eac7d115321a4dba38e27 not found: ID does not exist" containerID="b0f4a97840d5ec74bffd254a4c98471dbb0a7ff76e8eac7d115321a4dba38e27"
Jul 24 19:59:45.339858 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:59:45.339796    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0f4a97840d5ec74bffd254a4c98471dbb0a7ff76e8eac7d115321a4dba38e27"} err="failed to get container status \"b0f4a97840d5ec74bffd254a4c98471dbb0a7ff76e8eac7d115321a4dba38e27\": rpc error: code = NotFound desc = could not find container \"b0f4a97840d5ec74bffd254a4c98471dbb0a7ff76e8eac7d115321a4dba38e27\": container with ID starting with b0f4a97840d5ec74bffd254a4c98471dbb0a7ff76e8eac7d115321a4dba38e27 not found: ID does not exist"
Jul 24 19:59:45.345527 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:59:45.345506    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0f165f39-7fcc997686-jjtzv"]
Jul 24 19:59:45.349557 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:59:45.349539    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0f165f39-7fcc997686-jjtzv"]
Jul 24 19:59:45.361616 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:59:45.361591    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0f165f39-575b57f564-hhcsr"]
Jul 24 19:59:45.365360 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:59:45.365335    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0f165f39-575b57f564-hhcsr"]
Jul 24 19:59:46.071084 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:59:46.071009    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="252d8759-4613-44b9-9dfd-23753a0068f8" path="/var/lib/kubelet/pods/252d8759-4613-44b9-9dfd-23753a0068f8/volumes"
Jul 24 19:59:46.071436 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:59:46.071363    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b70898b-477c-4291-9667-7713e879f018" path="/var/lib/kubelet/pods/5b70898b-477c-4291-9667-7713e879f018/volumes"
Jul 24 19:59:52.182409 ip-10-0-133-84 kubenswrapper[2567]: I0724 19:59:52.182380    2567 scope.go:117] "RemoveContainer" containerID="a9ea8dd8d16ba5fa6f9cd3af5d5fd1e36395ea14a0b828db792d579febad48ed"
Jul 24 20:00:40.427585 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:00:40.427546    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88"]
Jul 24 20:00:40.428077 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:00:40.427812    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88" podUID="c2a4a1b7-ae0a-4a7e-95d2-6268637c049e" containerName="istio-proxy" containerID="cri-o://bd14c7ed71ba86fd43b2519c894c2d3eff13d1bd2c2bfd3c501d45e2082ef43c" gracePeriod=30
Jul 24 20:00:45.606170 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:00:45.606140    2567 generic.go:356] "Generic (PLEG): container finished" podID="c2a4a1b7-ae0a-4a7e-95d2-6268637c049e" containerID="bd14c7ed71ba86fd43b2519c894c2d3eff13d1bd2c2bfd3c501d45e2082ef43c" exitCode=0
Jul 24 20:00:45.606621 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:00:45.606222    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88" event={"ID":"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e","Type":"ContainerDied","Data":"bd14c7ed71ba86fd43b2519c894c2d3eff13d1bd2c2bfd3c501d45e2082ef43c"}
Jul 24 20:00:45.606621 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:00:45.606286    2567 scope.go:117] "RemoveContainer" containerID="3e914ce83024f6ca5f1aa5b94595315d5f91bdbe173c340504eebce60625fbb3"
Jul 24 20:00:45.687024 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:00:45.686995    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88"
Jul 24 20:00:45.775814 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:00:45.775723    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9n88c\" (UniqueName: \"kubernetes.io/projected/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-kube-api-access-9n88c\") pod \"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e\" (UID: \"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e\") "
Jul 24 20:00:45.775814 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:00:45.775764    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-credential-socket\") pod \"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e\" (UID: \"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e\") "
Jul 24 20:00:45.775814 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:00:45.775811    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-istio-podinfo\") pod \"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e\" (UID: \"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e\") "
Jul 24 20:00:45.776118 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:00:45.775925    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-istio-envoy\") pod \"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e\" (UID: \"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e\") "
Jul 24 20:00:45.776118 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:00:45.775979    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-istio-data\") pod \"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e\" (UID: \"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e\") "
Jul 24 20:00:45.776118 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:00:45.776009    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-workload-socket\") pod \"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e\" (UID: \"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e\") "
Jul 24 20:00:45.776118 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:00:45.776066    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-istio-token\") pod \"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e\" (UID: \"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e\") "
Jul 24 20:00:45.776118 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:00:45.776101    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c2a4a1b7-ae0a-4a7e-95d2-6268637c049e" (UID: "c2a4a1b7-ae0a-4a7e-95d2-6268637c049e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:00:45.776386 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:00:45.776134    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-workload-certs\") pod \"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e\" (UID: \"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e\") "
Jul 24 20:00:45.776386 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:00:45.776214    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-istiod-ca-cert\") pod \"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e\" (UID: \"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e\") "
Jul 24 20:00:45.776386 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:00:45.776365    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c2a4a1b7-ae0a-4a7e-95d2-6268637c049e" (UID: "c2a4a1b7-ae0a-4a7e-95d2-6268637c049e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:00:45.776655 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:00:45.776635    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c2a4a1b7-ae0a-4a7e-95d2-6268637c049e" (UID: "c2a4a1b7-ae0a-4a7e-95d2-6268637c049e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:00:45.776739 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:00:45.776722    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-istiod-ca-cert\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:00:45.776799 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:00:45.776745    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-credential-socket\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:00:45.776799 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:00:45.776760    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-workload-socket\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:00:45.776911 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:00:45.776852    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c2a4a1b7-ae0a-4a7e-95d2-6268637c049e" (UID: "c2a4a1b7-ae0a-4a7e-95d2-6268637c049e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:00:45.777386 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:00:45.777361    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-istio-data" (OuterVolumeSpecName: "istio-data") pod "c2a4a1b7-ae0a-4a7e-95d2-6268637c049e" (UID: "c2a4a1b7-ae0a-4a7e-95d2-6268637c049e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:00:45.778248 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:00:45.778222    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c2a4a1b7-ae0a-4a7e-95d2-6268637c049e" (UID: "c2a4a1b7-ae0a-4a7e-95d2-6268637c049e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:00:45.778715 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:00:45.778693    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-kube-api-access-9n88c" (OuterVolumeSpecName: "kube-api-access-9n88c") pod "c2a4a1b7-ae0a-4a7e-95d2-6268637c049e" (UID: "c2a4a1b7-ae0a-4a7e-95d2-6268637c049e"). InnerVolumeSpecName "kube-api-access-9n88c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:00:45.778822 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:00:45.778730    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c2a4a1b7-ae0a-4a7e-95d2-6268637c049e" (UID: "c2a4a1b7-ae0a-4a7e-95d2-6268637c049e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 20:00:45.778913 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:00:45.778894    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-istio-token" (OuterVolumeSpecName: "istio-token") pod "c2a4a1b7-ae0a-4a7e-95d2-6268637c049e" (UID: "c2a4a1b7-ae0a-4a7e-95d2-6268637c049e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:00:45.877868 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:00:45.877831    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-istio-data\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:00:45.877868 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:00:45.877858    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-istio-token\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:00:45.877868 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:00:45.877867    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-workload-certs\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:00:45.877868 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:00:45.877875    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9n88c\" (UniqueName: \"kubernetes.io/projected/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-kube-api-access-9n88c\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:00:45.877868 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:00:45.877884    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-istio-podinfo\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:00:45.878296 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:00:45.877892    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e-istio-envoy\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:00:46.612116 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:00:46.612084    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88"
Jul 24 20:00:46.612116 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:00:46.612090    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88" event={"ID":"c2a4a1b7-ae0a-4a7e-95d2-6268637c049e","Type":"ContainerDied","Data":"86bd1897947273ef1f9c7db5eecda737b4ce46689aafda1224eb4deed04e27db"}
Jul 24 20:00:46.612688 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:00:46.612144    2567 scope.go:117] "RemoveContainer" containerID="bd14c7ed71ba86fd43b2519c894c2d3eff13d1bd2c2bfd3c501d45e2082ef43c"
Jul 24 20:00:46.630614 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:00:46.630587    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88"]
Jul 24 20:00:46.637783 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:00:46.637757    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-0f165f39-openshift-default-f79bf86fb-bwf88"]
Jul 24 20:00:48.071001 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:00:48.070972    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2a4a1b7-ae0a-4a7e-95d2-6268637c049e" path="/var/lib/kubelet/pods/c2a4a1b7-ae0a-4a7e-95d2-6268637c049e/volumes"
Jul 24 20:01:35.643661 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:35.643617    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv"]
Jul 24 20:01:35.644308 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:35.643990    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2a4a1b7-ae0a-4a7e-95d2-6268637c049e" containerName="istio-proxy"
Jul 24 20:01:35.644308 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:35.644003    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2a4a1b7-ae0a-4a7e-95d2-6268637c049e" containerName="istio-proxy"
Jul 24 20:01:35.644308 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:35.644013    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b70898b-477c-4291-9667-7713e879f018" containerName="payload-processing"
Jul 24 20:01:35.644308 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:35.644019    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b70898b-477c-4291-9667-7713e879f018" containerName="payload-processing"
Jul 24 20:01:35.644308 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:35.644033    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2a4a1b7-ae0a-4a7e-95d2-6268637c049e" containerName="istio-proxy"
Jul 24 20:01:35.644308 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:35.644039    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2a4a1b7-ae0a-4a7e-95d2-6268637c049e" containerName="istio-proxy"
Jul 24 20:01:35.644308 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:35.644050    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="252d8759-4613-44b9-9dfd-23753a0068f8" containerName="payload-pre-processing"
Jul 24 20:01:35.644308 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:35.644056    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="252d8759-4613-44b9-9dfd-23753a0068f8" containerName="payload-pre-processing"
Jul 24 20:01:35.644308 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:35.644115    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="252d8759-4613-44b9-9dfd-23753a0068f8" containerName="payload-pre-processing"
Jul 24 20:01:35.644308 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:35.644125    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2a4a1b7-ae0a-4a7e-95d2-6268637c049e" containerName="istio-proxy"
Jul 24 20:01:35.644308 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:35.644131    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2a4a1b7-ae0a-4a7e-95d2-6268637c049e" containerName="istio-proxy"
Jul 24 20:01:35.644308 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:35.644137    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b70898b-477c-4291-9667-7713e879f018" containerName="payload-processing"
Jul 24 20:01:35.646874 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:35.646852    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv"
Jul 24 20:01:35.649527 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:35.649504    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 24 20:01:35.649643 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:35.649556    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-839a20-openshift-default-dockercfg-rfd9v\""
Jul 24 20:01:35.659640 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:35.659614    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv"]
Jul 24 20:01:35.730846 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:35.730804    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f85020a1-105a-494e-9a5d-06ccdf4bf882-workload-certs\") pod \"e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv\" (UID: \"f85020a1-105a-494e-9a5d-06ccdf4bf882\") " pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv"
Jul 24 20:01:35.731021 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:35.730855    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gts5n\" (UniqueName: \"kubernetes.io/projected/f85020a1-105a-494e-9a5d-06ccdf4bf882-kube-api-access-gts5n\") pod \"e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv\" (UID: \"f85020a1-105a-494e-9a5d-06ccdf4bf882\") " pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv"
Jul 24 20:01:35.731021 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:35.731002    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f85020a1-105a-494e-9a5d-06ccdf4bf882-istio-podinfo\") pod \"e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv\" (UID: \"f85020a1-105a-494e-9a5d-06ccdf4bf882\") " pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv"
Jul 24 20:01:35.731121 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:35.731055    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f85020a1-105a-494e-9a5d-06ccdf4bf882-istiod-ca-cert\") pod \"e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv\" (UID: \"f85020a1-105a-494e-9a5d-06ccdf4bf882\") " pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv"
Jul 24 20:01:35.731121 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:35.731113    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f85020a1-105a-494e-9a5d-06ccdf4bf882-credential-socket\") pod \"e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv\" (UID: \"f85020a1-105a-494e-9a5d-06ccdf4bf882\") " pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv"
Jul 24 20:01:35.731280 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:35.731144    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f85020a1-105a-494e-9a5d-06ccdf4bf882-istio-envoy\") pod \"e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv\" (UID: \"f85020a1-105a-494e-9a5d-06ccdf4bf882\") " pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv"
Jul 24 20:01:35.731280 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:35.731175    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f85020a1-105a-494e-9a5d-06ccdf4bf882-workload-socket\") pod \"e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv\" (UID: \"f85020a1-105a-494e-9a5d-06ccdf4bf882\") " pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv"
Jul 24 20:01:35.731280 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:35.731224    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f85020a1-105a-494e-9a5d-06ccdf4bf882-istio-token\") pod \"e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv\" (UID: \"f85020a1-105a-494e-9a5d-06ccdf4bf882\") " pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv"
Jul 24 20:01:35.731280 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:35.731272    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f85020a1-105a-494e-9a5d-06ccdf4bf882-istio-data\") pod \"e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv\" (UID: \"f85020a1-105a-494e-9a5d-06ccdf4bf882\") " pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv"
Jul 24 20:01:35.832343 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:35.832301    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f85020a1-105a-494e-9a5d-06ccdf4bf882-istio-podinfo\") pod \"e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv\" (UID: \"f85020a1-105a-494e-9a5d-06ccdf4bf882\") " pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv"
Jul 24 20:01:35.832343 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:35.832347    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f85020a1-105a-494e-9a5d-06ccdf4bf882-istiod-ca-cert\") pod \"e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv\" (UID: \"f85020a1-105a-494e-9a5d-06ccdf4bf882\") " pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv"
Jul 24 20:01:35.832620 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:35.832380    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f85020a1-105a-494e-9a5d-06ccdf4bf882-credential-socket\") pod \"e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv\" (UID: \"f85020a1-105a-494e-9a5d-06ccdf4bf882\") " pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv"
Jul 24 20:01:35.832620 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:35.832403    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f85020a1-105a-494e-9a5d-06ccdf4bf882-istio-envoy\") pod \"e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv\" (UID: \"f85020a1-105a-494e-9a5d-06ccdf4bf882\") " pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv"
Jul 24 20:01:35.832620 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:35.832431    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f85020a1-105a-494e-9a5d-06ccdf4bf882-workload-socket\") pod \"e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv\" (UID: \"f85020a1-105a-494e-9a5d-06ccdf4bf882\") " pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv"
Jul 24 20:01:35.832620 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:35.832464    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f85020a1-105a-494e-9a5d-06ccdf4bf882-istio-token\") pod \"e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv\" (UID: \"f85020a1-105a-494e-9a5d-06ccdf4bf882\") " pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv"
Jul 24 20:01:35.832620 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:35.832532    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f85020a1-105a-494e-9a5d-06ccdf4bf882-istio-data\") pod \"e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv\" (UID: \"f85020a1-105a-494e-9a5d-06ccdf4bf882\") " pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv"
Jul 24 20:01:35.832921 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:35.832894    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f85020a1-105a-494e-9a5d-06ccdf4bf882-credential-socket\") pod \"e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv\" (UID: \"f85020a1-105a-494e-9a5d-06ccdf4bf882\") " pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv"
Jul 24 20:01:35.833088 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:35.832913    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f85020a1-105a-494e-9a5d-06ccdf4bf882-workload-certs\") pod \"e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv\" (UID: \"f85020a1-105a-494e-9a5d-06ccdf4bf882\") " pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv"
Jul 24 20:01:35.833223 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:35.833202    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gts5n\" (UniqueName: \"kubernetes.io/projected/f85020a1-105a-494e-9a5d-06ccdf4bf882-kube-api-access-gts5n\") pod \"e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv\" (UID: \"f85020a1-105a-494e-9a5d-06ccdf4bf882\") " pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv"
Jul 24 20:01:35.833342 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:35.833083    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f85020a1-105a-494e-9a5d-06ccdf4bf882-istio-data\") pod \"e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv\" (UID: \"f85020a1-105a-494e-9a5d-06ccdf4bf882\") " pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv"
Jul 24 20:01:35.833342 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:35.833108    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f85020a1-105a-494e-9a5d-06ccdf4bf882-workload-socket\") pod \"e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv\" (UID: \"f85020a1-105a-494e-9a5d-06ccdf4bf882\") " pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv"
Jul 24 20:01:35.833342 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:35.833311    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f85020a1-105a-494e-9a5d-06ccdf4bf882-workload-certs\") pod \"e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv\" (UID: \"f85020a1-105a-494e-9a5d-06ccdf4bf882\") " pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv"
Jul 24 20:01:35.833476 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:35.833383    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f85020a1-105a-494e-9a5d-06ccdf4bf882-istiod-ca-cert\") pod \"e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv\" (UID: \"f85020a1-105a-494e-9a5d-06ccdf4bf882\") " pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv"
Jul 24 20:01:35.835405 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:35.835387    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f85020a1-105a-494e-9a5d-06ccdf4bf882-istio-envoy\") pod \"e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv\" (UID: \"f85020a1-105a-494e-9a5d-06ccdf4bf882\") " pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv"
Jul 24 20:01:35.835636 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:35.835619    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f85020a1-105a-494e-9a5d-06ccdf4bf882-istio-podinfo\") pod \"e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv\" (UID: \"f85020a1-105a-494e-9a5d-06ccdf4bf882\") " pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv"
Jul 24 20:01:35.841755 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:35.841728    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gts5n\" (UniqueName: \"kubernetes.io/projected/f85020a1-105a-494e-9a5d-06ccdf4bf882-kube-api-access-gts5n\") pod \"e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv\" (UID: \"f85020a1-105a-494e-9a5d-06ccdf4bf882\") " pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv"
Jul 24 20:01:35.841862 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:35.841833    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f85020a1-105a-494e-9a5d-06ccdf4bf882-istio-token\") pod \"e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv\" (UID: \"f85020a1-105a-494e-9a5d-06ccdf4bf882\") " pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv"
Jul 24 20:01:35.958087 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:35.958009    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv"
Jul 24 20:01:36.096069 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:36.096047    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv"]
Jul 24 20:01:36.098324 ip-10-0-133-84 kubenswrapper[2567]: W0724 20:01:36.098296    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf85020a1_105a_494e_9a5d_06ccdf4bf882.slice/crio-bfbe6d86b6657a252cb3c01a322829bbbbdf78b75cc3725246cdd358048e991f WatchSource:0}: Error finding container bfbe6d86b6657a252cb3c01a322829bbbbdf78b75cc3725246cdd358048e991f: Status 404 returned error can't find the container with id bfbe6d86b6657a252cb3c01a322829bbbbdf78b75cc3725246cdd358048e991f
Jul 24 20:01:36.100367 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:36.100333    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 20:01:36.100465 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:36.100398    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 20:01:36.100465 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:36.100427    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 20:01:36.850899 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:36.850869    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv" event={"ID":"f85020a1-105a-494e-9a5d-06ccdf4bf882","Type":"ContainerStarted","Data":"ae42e61386c5680227c9456be208cb6086f6433b9361de605cff6660b5ab60e0"}
Jul 24 20:01:36.851250 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:36.850919    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv" event={"ID":"f85020a1-105a-494e-9a5d-06ccdf4bf882","Type":"ContainerStarted","Data":"bfbe6d86b6657a252cb3c01a322829bbbbdf78b75cc3725246cdd358048e991f"}
Jul 24 20:01:36.870084 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:36.870038    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv" podStartSLOduration=1.870024127 podStartE2EDuration="1.870024127s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:01:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:01:36.868207133 +0000 UTC m=+2085.386827166" watchObservedRunningTime="2026-07-24 20:01:36.870024127 +0000 UTC m=+2085.388644208"
Jul 24 20:01:36.958344 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:36.958308    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv"
Jul 24 20:01:37.963336 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:37.963308    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv"
Jul 24 20:01:38.859060 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:38.859025    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv"
Jul 24 20:01:38.860056 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:38.860031    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv"
Jul 24 20:01:39.748666 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:39.748636    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-839a20-dc84f9984-n6772"]
Jul 24 20:01:39.752046 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:39.752023    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-839a20-dc84f9984-n6772"
Jul 24 20:01:39.754907 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:39.754753    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-839a20\""
Jul 24 20:01:39.754907 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:39.754755    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-839a20-dockercfg-gtjn9\""
Jul 24 20:01:39.762754 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:39.762732    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-839a20-dc84f9984-n6772"]
Jul 24 20:01:39.783314 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:39.783283    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-839a20-6687d5d7cb-shxvh"]
Jul 24 20:01:39.786454 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:39.786439    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-839a20-6687d5d7cb-shxvh"
Jul 24 20:01:39.794186 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:39.794167    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-839a20-6687d5d7cb-shxvh"]
Jul 24 20:01:39.872475 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:39.872438    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59d5f662-9a77-4b07-a7a6-925b5175dd94-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-839a20-6687d5d7cb-shxvh\" (UID: \"59d5f662-9a77-4b07-a7a6-925b5175dd94\") " pod="openshift-ingress/payload-processing-e2e-inf-a-839a20-6687d5d7cb-shxvh"
Jul 24 20:01:39.872671 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:39.872505    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5db65\" (UniqueName: \"kubernetes.io/projected/13c4dd60-cf7b-4675-a18f-f80eefe70a1a-kube-api-access-5db65\") pod \"payload-pre-processing-e2e-inf-a-839a20-dc84f9984-n6772\" (UID: \"13c4dd60-cf7b-4675-a18f-f80eefe70a1a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-839a20-dc84f9984-n6772"
Jul 24 20:01:39.872671 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:39.872542    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc8gs\" (UniqueName: \"kubernetes.io/projected/59d5f662-9a77-4b07-a7a6-925b5175dd94-kube-api-access-fc8gs\") pod \"payload-processing-e2e-inf-a-839a20-6687d5d7cb-shxvh\" (UID: \"59d5f662-9a77-4b07-a7a6-925b5175dd94\") " pod="openshift-ingress/payload-processing-e2e-inf-a-839a20-6687d5d7cb-shxvh"
Jul 24 20:01:39.872671 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:39.872575    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13c4dd60-cf7b-4675-a18f-f80eefe70a1a-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-839a20-dc84f9984-n6772\" (UID: \"13c4dd60-cf7b-4675-a18f-f80eefe70a1a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-839a20-dc84f9984-n6772"
Jul 24 20:01:39.974046 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:39.974002    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59d5f662-9a77-4b07-a7a6-925b5175dd94-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-839a20-6687d5d7cb-shxvh\" (UID: \"59d5f662-9a77-4b07-a7a6-925b5175dd94\") " pod="openshift-ingress/payload-processing-e2e-inf-a-839a20-6687d5d7cb-shxvh"
Jul 24 20:01:39.974046 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:39.974039    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5db65\" (UniqueName: \"kubernetes.io/projected/13c4dd60-cf7b-4675-a18f-f80eefe70a1a-kube-api-access-5db65\") pod \"payload-pre-processing-e2e-inf-a-839a20-dc84f9984-n6772\" (UID: \"13c4dd60-cf7b-4675-a18f-f80eefe70a1a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-839a20-dc84f9984-n6772"
Jul 24 20:01:39.974299 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:39.974062    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc8gs\" (UniqueName: \"kubernetes.io/projected/59d5f662-9a77-4b07-a7a6-925b5175dd94-kube-api-access-fc8gs\") pod \"payload-processing-e2e-inf-a-839a20-6687d5d7cb-shxvh\" (UID: \"59d5f662-9a77-4b07-a7a6-925b5175dd94\") " pod="openshift-ingress/payload-processing-e2e-inf-a-839a20-6687d5d7cb-shxvh"
Jul 24 20:01:39.974299 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:39.974084    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13c4dd60-cf7b-4675-a18f-f80eefe70a1a-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-839a20-dc84f9984-n6772\" (UID: \"13c4dd60-cf7b-4675-a18f-f80eefe70a1a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-839a20-dc84f9984-n6772"
Jul 24 20:01:39.975022 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:39.974997    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59d5f662-9a77-4b07-a7a6-925b5175dd94-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-839a20-6687d5d7cb-shxvh\" (UID: \"59d5f662-9a77-4b07-a7a6-925b5175dd94\") " pod="openshift-ingress/payload-processing-e2e-inf-a-839a20-6687d5d7cb-shxvh"
Jul 24 20:01:39.975096 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:39.974997    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13c4dd60-cf7b-4675-a18f-f80eefe70a1a-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-839a20-dc84f9984-n6772\" (UID: \"13c4dd60-cf7b-4675-a18f-f80eefe70a1a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-839a20-dc84f9984-n6772"
Jul 24 20:01:39.982356 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:39.982329    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5db65\" (UniqueName: \"kubernetes.io/projected/13c4dd60-cf7b-4675-a18f-f80eefe70a1a-kube-api-access-5db65\") pod \"payload-pre-processing-e2e-inf-a-839a20-dc84f9984-n6772\" (UID: \"13c4dd60-cf7b-4675-a18f-f80eefe70a1a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-839a20-dc84f9984-n6772"
Jul 24 20:01:39.982468 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:39.982392    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc8gs\" (UniqueName: \"kubernetes.io/projected/59d5f662-9a77-4b07-a7a6-925b5175dd94-kube-api-access-fc8gs\") pod \"payload-processing-e2e-inf-a-839a20-6687d5d7cb-shxvh\" (UID: \"59d5f662-9a77-4b07-a7a6-925b5175dd94\") " pod="openshift-ingress/payload-processing-e2e-inf-a-839a20-6687d5d7cb-shxvh"
Jul 24 20:01:40.064094 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:40.064008    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-839a20-dc84f9984-n6772"
Jul 24 20:01:40.097755 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:40.097732    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-839a20-6687d5d7cb-shxvh"
Jul 24 20:01:40.215496 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:40.215446    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-839a20-dc84f9984-n6772"]
Jul 24 20:01:40.216543 ip-10-0-133-84 kubenswrapper[2567]: W0724 20:01:40.216467    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13c4dd60_cf7b_4675_a18f_f80eefe70a1a.slice/crio-f101af9e8b802b1639724df59eb05e8c22a5401d33544cd237b4727e2f4188f2 WatchSource:0}: Error finding container f101af9e8b802b1639724df59eb05e8c22a5401d33544cd237b4727e2f4188f2: Status 404 returned error can't find the container with id f101af9e8b802b1639724df59eb05e8c22a5401d33544cd237b4727e2f4188f2
Jul 24 20:01:40.252209 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:40.251949    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-839a20-6687d5d7cb-shxvh"]
Jul 24 20:01:40.254409 ip-10-0-133-84 kubenswrapper[2567]: W0724 20:01:40.254385    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59d5f662_9a77_4b07_a7a6_925b5175dd94.slice/crio-dd2d6000244e3260a9bec659e14ae8dec85c4d5afad22298418424ca85f5b094 WatchSource:0}: Error finding container dd2d6000244e3260a9bec659e14ae8dec85c4d5afad22298418424ca85f5b094: Status 404 returned error can't find the container with id dd2d6000244e3260a9bec659e14ae8dec85c4d5afad22298418424ca85f5b094
Jul 24 20:01:40.870248 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:40.870208    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-839a20-6687d5d7cb-shxvh" event={"ID":"59d5f662-9a77-4b07-a7a6-925b5175dd94","Type":"ContainerStarted","Data":"d443be77ca66db54a597d8186ff607e62a5c5f6cdd55dc85560633f4fc439202"}
Jul 24 20:01:40.870764 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:40.870280    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-839a20-6687d5d7cb-shxvh"
Jul 24 20:01:40.870764 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:40.870308    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-839a20-6687d5d7cb-shxvh" event={"ID":"59d5f662-9a77-4b07-a7a6-925b5175dd94","Type":"ContainerStarted","Data":"dd2d6000244e3260a9bec659e14ae8dec85c4d5afad22298418424ca85f5b094"}
Jul 24 20:01:40.871803 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:40.871781    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-839a20-dc84f9984-n6772" event={"ID":"13c4dd60-cf7b-4675-a18f-f80eefe70a1a","Type":"ContainerStarted","Data":"37cdc598323c60ff041abe4b02582895ed1a4d69491f29c7036d89511583e158"}
Jul 24 20:01:40.871917 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:40.871819    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-839a20-dc84f9984-n6772" event={"ID":"13c4dd60-cf7b-4675-a18f-f80eefe70a1a","Type":"ContainerStarted","Data":"f101af9e8b802b1639724df59eb05e8c22a5401d33544cd237b4727e2f4188f2"}
Jul 24 20:01:40.871917 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:40.871838    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-839a20-dc84f9984-n6772"
Jul 24 20:01:40.885412 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:40.885358    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-839a20-6687d5d7cb-shxvh" podStartSLOduration=1.8853442729999998 podStartE2EDuration="1.885344273s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:01:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:01:40.883988202 +0000 UTC m=+2089.402608246" watchObservedRunningTime="2026-07-24 20:01:40.885344273 +0000 UTC m=+2089.403964314"
Jul 24 20:01:40.901245 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:40.901203    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-839a20-dc84f9984-n6772" podStartSLOduration=1.901190054 podStartE2EDuration="1.901190054s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:01:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:01:40.899075128 +0000 UTC m=+2089.417695170" watchObservedRunningTime="2026-07-24 20:01:40.901190054 +0000 UTC m=+2089.419810094"
Jul 24 20:01:47.699774 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:47.699733    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-6a7079-6949588b6d-lbc8k"]
Jul 24 20:01:47.703541 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:47.703507    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-6a7079-6949588b6d-lbc8k"
Jul 24 20:01:47.705814 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:47.705788    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-6a7079-dockercfg-v4crd\""
Jul 24 20:01:47.705965 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:47.705813    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-6a7079\""
Jul 24 20:01:47.712867 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:47.712840    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-6a7079-6949588b6d-lbc8k"]
Jul 24 20:01:47.852509 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:47.851969    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxfrv\" (UniqueName: \"kubernetes.io/projected/1d2a619c-7f3c-4cb4-9d7d-c185ca229a53-kube-api-access-jxfrv\") pod \"payload-processing-e2e-inf-b-6a7079-6949588b6d-lbc8k\" (UID: \"1d2a619c-7f3c-4cb4-9d7d-c185ca229a53\") " pod="openshift-ingress/payload-processing-e2e-inf-b-6a7079-6949588b6d-lbc8k"
Jul 24 20:01:47.852509 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:47.852038    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d2a619c-7f3c-4cb4-9d7d-c185ca229a53-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-6a7079-6949588b6d-lbc8k\" (UID: \"1d2a619c-7f3c-4cb4-9d7d-c185ca229a53\") " pod="openshift-ingress/payload-processing-e2e-inf-b-6a7079-6949588b6d-lbc8k"
Jul 24 20:01:47.953352 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:47.953245    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxfrv\" (UniqueName: \"kubernetes.io/projected/1d2a619c-7f3c-4cb4-9d7d-c185ca229a53-kube-api-access-jxfrv\") pod \"payload-processing-e2e-inf-b-6a7079-6949588b6d-lbc8k\" (UID: \"1d2a619c-7f3c-4cb4-9d7d-c185ca229a53\") " pod="openshift-ingress/payload-processing-e2e-inf-b-6a7079-6949588b6d-lbc8k"
Jul 24 20:01:47.953649 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:47.953627    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d2a619c-7f3c-4cb4-9d7d-c185ca229a53-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-6a7079-6949588b6d-lbc8k\" (UID: \"1d2a619c-7f3c-4cb4-9d7d-c185ca229a53\") " pod="openshift-ingress/payload-processing-e2e-inf-b-6a7079-6949588b6d-lbc8k"
Jul 24 20:01:47.954577 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:47.954549    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d2a619c-7f3c-4cb4-9d7d-c185ca229a53-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-6a7079-6949588b6d-lbc8k\" (UID: \"1d2a619c-7f3c-4cb4-9d7d-c185ca229a53\") " pod="openshift-ingress/payload-processing-e2e-inf-b-6a7079-6949588b6d-lbc8k"
Jul 24 20:01:47.962104 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:47.962075    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxfrv\" (UniqueName: \"kubernetes.io/projected/1d2a619c-7f3c-4cb4-9d7d-c185ca229a53-kube-api-access-jxfrv\") pod \"payload-processing-e2e-inf-b-6a7079-6949588b6d-lbc8k\" (UID: \"1d2a619c-7f3c-4cb4-9d7d-c185ca229a53\") " pod="openshift-ingress/payload-processing-e2e-inf-b-6a7079-6949588b6d-lbc8k"
Jul 24 20:01:48.018189 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:48.018154    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-6a7079-6949588b6d-lbc8k"
Jul 24 20:01:48.210970 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:48.210941    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-6a7079-6949588b6d-lbc8k"]
Jul 24 20:01:48.212647 ip-10-0-133-84 kubenswrapper[2567]: W0724 20:01:48.212616    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d2a619c_7f3c_4cb4_9d7d_c185ca229a53.slice/crio-d3adabe7827f66ca65b419d7e7ce6f8175eb05df033f1c0898f57fb17b90be3c WatchSource:0}: Error finding container d3adabe7827f66ca65b419d7e7ce6f8175eb05df033f1c0898f57fb17b90be3c: Status 404 returned error can't find the container with id d3adabe7827f66ca65b419d7e7ce6f8175eb05df033f1c0898f57fb17b90be3c
Jul 24 20:01:48.910271 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:48.910232    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-6a7079-6949588b6d-lbc8k" event={"ID":"1d2a619c-7f3c-4cb4-9d7d-c185ca229a53","Type":"ContainerStarted","Data":"5be6d8d394602896995b7d81915184acc6824793499f8462b079b868c836fa1c"}
Jul 24 20:01:48.910680 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:48.910283    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-6a7079-6949588b6d-lbc8k" event={"ID":"1d2a619c-7f3c-4cb4-9d7d-c185ca229a53","Type":"ContainerStarted","Data":"d3adabe7827f66ca65b419d7e7ce6f8175eb05df033f1c0898f57fb17b90be3c"}
Jul 24 20:01:48.910680 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:48.910322    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-6a7079-6949588b6d-lbc8k"
Jul 24 20:01:48.931555 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:48.931453    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-6a7079-6949588b6d-lbc8k" podStartSLOduration=1.931430761 podStartE2EDuration="1.931430761s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:01:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:01:48.928192783 +0000 UTC m=+2097.446812824" watchObservedRunningTime="2026-07-24 20:01:48.931430761 +0000 UTC m=+2097.450050806"
Jul 24 20:01:51.879367 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:51.879336    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-839a20-6687d5d7cb-shxvh"
Jul 24 20:01:51.879768 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:51.879407    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-839a20-dc84f9984-n6772"
Jul 24 20:01:52.072287 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:52.072261    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d87bq_72c2265c-f7f6-462a-bf46-eda3f35de953/ovn-acl-logging/0.log"
Jul 24 20:01:52.075284 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:52.075264    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d87bq_72c2265c-f7f6-462a-bf46-eda3f35de953/ovn-acl-logging/0.log"
Jul 24 20:01:52.933596 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:52.933562    2567 generic.go:356] "Generic (PLEG): container finished" podID="f85020a1-105a-494e-9a5d-06ccdf4bf882" containerID="ae42e61386c5680227c9456be208cb6086f6433b9361de605cff6660b5ab60e0" exitCode=0
Jul 24 20:01:52.934012 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:52.933624    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv" event={"ID":"f85020a1-105a-494e-9a5d-06ccdf4bf882","Type":"ContainerDied","Data":"ae42e61386c5680227c9456be208cb6086f6433b9361de605cff6660b5ab60e0"}
Jul 24 20:01:52.934012 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:52.934003    2567 scope.go:117] "RemoveContainer" containerID="ae42e61386c5680227c9456be208cb6086f6433b9361de605cff6660b5ab60e0"
Jul 24 20:01:52.935058 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:52.935029    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 20:01:52.935136 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:52.935097    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 20:01:52.935136 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:52.935128    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 20:01:53.859863 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:53.859830    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv"
Jul 24 20:01:53.941928 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:53.941897    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv" event={"ID":"f85020a1-105a-494e-9a5d-06ccdf4bf882","Type":"ContainerStarted","Data":"0e3f28c4e77fa2624d5632ca58089a062cdcb20f87511fb9873429f03ad6b8a7"}
Jul 24 20:01:53.959084 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:53.958993    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv"
Jul 24 20:01:53.960538 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:53.960510    2567 patch_prober.go:28] interesting pod/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 24 20:01:53.960658 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:53.960566    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv" podUID="f85020a1-105a-494e-9a5d-06ccdf4bf882" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 24 20:01:54.959172 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:54.959135    2567 patch_prober.go:28] interesting pod/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 24 20:01:54.959789 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:54.959757    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv" podUID="f85020a1-105a-494e-9a5d-06ccdf4bf882" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 24 20:01:55.959256 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:55.959218    2567 patch_prober.go:28] interesting pod/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 24 20:01:55.959934 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:55.959880    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv" podUID="f85020a1-105a-494e-9a5d-06ccdf4bf882" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 24 20:01:56.959466 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:56.959426    2567 patch_prober.go:28] interesting pod/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 24 20:01:56.959904 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:56.959517    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv" podUID="f85020a1-105a-494e-9a5d-06ccdf4bf882" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 24 20:01:57.963285 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:57.963255    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv"
Jul 24 20:01:57.963702 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:57.963521    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv"
Jul 24 20:01:57.964228 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:57.964212    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv"
Jul 24 20:01:59.917617 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:01:59.917588    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-6a7079-6949588b6d-lbc8k"
Jul 24 20:02:11.586542 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:02:11.586506    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-6a7079/test-model-6a7079-kserve-6cf9db77b9-n26h5"]
Jul 24 20:02:11.590059 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:02:11.590040    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6a7079/test-model-6a7079-kserve-6cf9db77b9-n26h5"
Jul 24 20:02:11.592586 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:02:11.592563    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-6a7079\"/\"openshift-service-ca.crt\""
Jul 24 20:02:11.593439 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:02:11.593423    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-6a7079\"/\"kube-root-ca.crt\""
Jul 24 20:02:11.593439 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:02:11.593429    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-6a7079\"/\"test-model-6a7079-kserve-self-signed-certs\""
Jul 24 20:02:11.593618 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:02:11.593505    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-6a7079\"/\"default-dockercfg-j96p9\""
Jul 24 20:02:11.599711 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:02:11.599689    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-6a7079/test-model-6a7079-kserve-6cf9db77b9-n26h5"]
Jul 24 20:02:11.692304 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:02:11.692273    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvlnm\" (UniqueName: \"kubernetes.io/projected/d6fea60f-2b84-4b59-8b03-a25ddda940b3-kube-api-access-zvlnm\") pod \"test-model-6a7079-kserve-6cf9db77b9-n26h5\" (UID: \"d6fea60f-2b84-4b59-8b03-a25ddda940b3\") " pod="ai-tenant-e2e-inf-b-6a7079/test-model-6a7079-kserve-6cf9db77b9-n26h5"
Jul 24 20:02:11.692304 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:02:11.692308    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6fea60f-2b84-4b59-8b03-a25ddda940b3-tls-certs\") pod \"test-model-6a7079-kserve-6cf9db77b9-n26h5\" (UID: \"d6fea60f-2b84-4b59-8b03-a25ddda940b3\") " pod="ai-tenant-e2e-inf-b-6a7079/test-model-6a7079-kserve-6cf9db77b9-n26h5"
Jul 24 20:02:11.692535 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:02:11.692328    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6fea60f-2b84-4b59-8b03-a25ddda940b3-model-cache\") pod \"test-model-6a7079-kserve-6cf9db77b9-n26h5\" (UID: \"d6fea60f-2b84-4b59-8b03-a25ddda940b3\") " pod="ai-tenant-e2e-inf-b-6a7079/test-model-6a7079-kserve-6cf9db77b9-n26h5"
Jul 24 20:02:11.692535 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:02:11.692410    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6fea60f-2b84-4b59-8b03-a25ddda940b3-tmp-dir\") pod \"test-model-6a7079-kserve-6cf9db77b9-n26h5\" (UID: \"d6fea60f-2b84-4b59-8b03-a25ddda940b3\") " pod="ai-tenant-e2e-inf-b-6a7079/test-model-6a7079-kserve-6cf9db77b9-n26h5"
Jul 24 20:02:11.692535 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:02:11.692444    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6fea60f-2b84-4b59-8b03-a25ddda940b3-home\") pod \"test-model-6a7079-kserve-6cf9db77b9-n26h5\" (UID: \"d6fea60f-2b84-4b59-8b03-a25ddda940b3\") " pod="ai-tenant-e2e-inf-b-6a7079/test-model-6a7079-kserve-6cf9db77b9-n26h5"
Jul 24 20:02:11.692535 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:02:11.692470    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6fea60f-2b84-4b59-8b03-a25ddda940b3-dshm\") pod \"test-model-6a7079-kserve-6cf9db77b9-n26h5\" (UID: \"d6fea60f-2b84-4b59-8b03-a25ddda940b3\") " pod="ai-tenant-e2e-inf-b-6a7079/test-model-6a7079-kserve-6cf9db77b9-n26h5"
Jul 24 20:02:11.793915 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:02:11.793879    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvlnm\" (UniqueName: \"kubernetes.io/projected/d6fea60f-2b84-4b59-8b03-a25ddda940b3-kube-api-access-zvlnm\") pod \"test-model-6a7079-kserve-6cf9db77b9-n26h5\" (UID: \"d6fea60f-2b84-4b59-8b03-a25ddda940b3\") " pod="ai-tenant-e2e-inf-b-6a7079/test-model-6a7079-kserve-6cf9db77b9-n26h5"
Jul 24 20:02:11.793915 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:02:11.793915    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6fea60f-2b84-4b59-8b03-a25ddda940b3-tls-certs\") pod \"test-model-6a7079-kserve-6cf9db77b9-n26h5\" (UID: \"d6fea60f-2b84-4b59-8b03-a25ddda940b3\") " pod="ai-tenant-e2e-inf-b-6a7079/test-model-6a7079-kserve-6cf9db77b9-n26h5"
Jul 24 20:02:11.794116 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:02:11.793946    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6fea60f-2b84-4b59-8b03-a25ddda940b3-model-cache\") pod \"test-model-6a7079-kserve-6cf9db77b9-n26h5\" (UID: \"d6fea60f-2b84-4b59-8b03-a25ddda940b3\") " pod="ai-tenant-e2e-inf-b-6a7079/test-model-6a7079-kserve-6cf9db77b9-n26h5"
Jul 24 20:02:11.794116 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:02:11.793995    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6fea60f-2b84-4b59-8b03-a25ddda940b3-tmp-dir\") pod \"test-model-6a7079-kserve-6cf9db77b9-n26h5\" (UID: \"d6fea60f-2b84-4b59-8b03-a25ddda940b3\") " pod="ai-tenant-e2e-inf-b-6a7079/test-model-6a7079-kserve-6cf9db77b9-n26h5"
Jul 24 20:02:11.794116 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:02:11.794028    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6fea60f-2b84-4b59-8b03-a25ddda940b3-home\") pod \"test-model-6a7079-kserve-6cf9db77b9-n26h5\" (UID: \"d6fea60f-2b84-4b59-8b03-a25ddda940b3\") " pod="ai-tenant-e2e-inf-b-6a7079/test-model-6a7079-kserve-6cf9db77b9-n26h5"
Jul 24 20:02:11.794277 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:02:11.794175    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6fea60f-2b84-4b59-8b03-a25ddda940b3-dshm\") pod \"test-model-6a7079-kserve-6cf9db77b9-n26h5\" (UID: \"d6fea60f-2b84-4b59-8b03-a25ddda940b3\") " pod="ai-tenant-e2e-inf-b-6a7079/test-model-6a7079-kserve-6cf9db77b9-n26h5"
Jul 24 20:02:11.794424 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:02:11.794405    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6fea60f-2b84-4b59-8b03-a25ddda940b3-model-cache\") pod \"test-model-6a7079-kserve-6cf9db77b9-n26h5\" (UID: \"d6fea60f-2b84-4b59-8b03-a25ddda940b3\") " pod="ai-tenant-e2e-inf-b-6a7079/test-model-6a7079-kserve-6cf9db77b9-n26h5"
Jul 24 20:02:11.794528 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:02:11.794426    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6fea60f-2b84-4b59-8b03-a25ddda940b3-tmp-dir\") pod \"test-model-6a7079-kserve-6cf9db77b9-n26h5\" (UID: \"d6fea60f-2b84-4b59-8b03-a25ddda940b3\") " pod="ai-tenant-e2e-inf-b-6a7079/test-model-6a7079-kserve-6cf9db77b9-n26h5"
Jul 24 20:02:11.794528 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:02:11.794497    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6fea60f-2b84-4b59-8b03-a25ddda940b3-home\") pod \"test-model-6a7079-kserve-6cf9db77b9-n26h5\" (UID: \"d6fea60f-2b84-4b59-8b03-a25ddda940b3\") " pod="ai-tenant-e2e-inf-b-6a7079/test-model-6a7079-kserve-6cf9db77b9-n26h5"
Jul 24 20:02:11.796523 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:02:11.796473    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6fea60f-2b84-4b59-8b03-a25ddda940b3-dshm\") pod \"test-model-6a7079-kserve-6cf9db77b9-n26h5\" (UID: \"d6fea60f-2b84-4b59-8b03-a25ddda940b3\") " pod="ai-tenant-e2e-inf-b-6a7079/test-model-6a7079-kserve-6cf9db77b9-n26h5"
Jul 24 20:02:11.796630 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:02:11.796615    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6fea60f-2b84-4b59-8b03-a25ddda940b3-tls-certs\") pod \"test-model-6a7079-kserve-6cf9db77b9-n26h5\" (UID: \"d6fea60f-2b84-4b59-8b03-a25ddda940b3\") " pod="ai-tenant-e2e-inf-b-6a7079/test-model-6a7079-kserve-6cf9db77b9-n26h5"
Jul 24 20:02:11.805651 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:02:11.805631    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvlnm\" (UniqueName: \"kubernetes.io/projected/d6fea60f-2b84-4b59-8b03-a25ddda940b3-kube-api-access-zvlnm\") pod \"test-model-6a7079-kserve-6cf9db77b9-n26h5\" (UID: \"d6fea60f-2b84-4b59-8b03-a25ddda940b3\") " pod="ai-tenant-e2e-inf-b-6a7079/test-model-6a7079-kserve-6cf9db77b9-n26h5"
Jul 24 20:02:11.902757 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:02:11.902730    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6a7079/test-model-6a7079-kserve-6cf9db77b9-n26h5"
Jul 24 20:02:12.044716 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:02:12.044673    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-6a7079/test-model-6a7079-kserve-6cf9db77b9-n26h5"]
Jul 24 20:02:13.049288 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:02:13.049250    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6a7079/test-model-6a7079-kserve-6cf9db77b9-n26h5" event={"ID":"d6fea60f-2b84-4b59-8b03-a25ddda940b3","Type":"ContainerStarted","Data":"db685be53f6ed4bce8b4446094c92cc0776f45214b36dd26c2c268b51c20d35c"}
Jul 24 20:02:13.049288 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:02:13.049292    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6a7079/test-model-6a7079-kserve-6cf9db77b9-n26h5" event={"ID":"d6fea60f-2b84-4b59-8b03-a25ddda940b3","Type":"ContainerStarted","Data":"ab68d200869575b129df1c66da15451fd30217220facdfe9697e60e49c834a8d"}
Jul 24 20:02:13.067944 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:02:13.067896    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-6a7079/test-model-6a7079-kserve-6cf9db77b9-n26h5" podStartSLOduration=2.067879275 podStartE2EDuration="2.067879275s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:02:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:02:13.06567668 +0000 UTC m=+2121.584296720" watchObservedRunningTime="2026-07-24 20:02:13.067879275 +0000 UTC m=+2121.586499316"
Jul 24 20:02:21.903376 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:02:21.903342    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-6a7079/test-model-6a7079-kserve-6cf9db77b9-n26h5"
Jul 24 20:02:21.903376 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:02:21.903382    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-6a7079/test-model-6a7079-kserve-6cf9db77b9-n26h5"
Jul 24 20:02:21.915931 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:02:21.915909    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-6a7079/test-model-6a7079-kserve-6cf9db77b9-n26h5"
Jul 24 20:02:22.103844 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:02:22.103814    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-6a7079/test-model-6a7079-kserve-6cf9db77b9-n26h5"
Jul 24 20:02:51.277932 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:02:51.277895    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-6a7079/test-model-6a7079-kserve-6cf9db77b9-n26h5"]
Jul 24 20:03:01.901348 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:01.901312    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-839a20-6687d5d7cb-shxvh"]
Jul 24 20:03:01.901776 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:01.901580    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-839a20-6687d5d7cb-shxvh" podUID="59d5f662-9a77-4b07-a7a6-925b5175dd94" containerName="payload-processing" containerID="cri-o://d443be77ca66db54a597d8186ff607e62a5c5f6cdd55dc85560633f4fc439202" gracePeriod=30
Jul 24 20:03:01.912088 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:01.912051    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-839a20-dc84f9984-n6772"]
Jul 24 20:03:01.912335 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:01.912287    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-839a20-dc84f9984-n6772" podUID="13c4dd60-cf7b-4675-a18f-f80eefe70a1a" containerName="payload-pre-processing" containerID="cri-o://37cdc598323c60ff041abe4b02582895ed1a4d69491f29c7036d89511583e158" gracePeriod=30
Jul 24 20:03:02.184412 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:02.184383    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-839a20-6687d5d7cb-shxvh"
Jul 24 20:03:02.187327 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:02.187302    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-839a20-dc84f9984-n6772"
Jul 24 20:03:02.245535 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:02.245500    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fc8gs\" (UniqueName: \"kubernetes.io/projected/59d5f662-9a77-4b07-a7a6-925b5175dd94-kube-api-access-fc8gs\") pod \"59d5f662-9a77-4b07-a7a6-925b5175dd94\" (UID: \"59d5f662-9a77-4b07-a7a6-925b5175dd94\") "
Jul 24 20:03:02.245721 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:02.245554    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59d5f662-9a77-4b07-a7a6-925b5175dd94-plugins-config-volume\") pod \"59d5f662-9a77-4b07-a7a6-925b5175dd94\" (UID: \"59d5f662-9a77-4b07-a7a6-925b5175dd94\") "
Jul 24 20:03:02.245721 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:02.245583    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13c4dd60-cf7b-4675-a18f-f80eefe70a1a-plugins-config-volume\") pod \"13c4dd60-cf7b-4675-a18f-f80eefe70a1a\" (UID: \"13c4dd60-cf7b-4675-a18f-f80eefe70a1a\") "
Jul 24 20:03:02.245721 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:02.245653    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5db65\" (UniqueName: \"kubernetes.io/projected/13c4dd60-cf7b-4675-a18f-f80eefe70a1a-kube-api-access-5db65\") pod \"13c4dd60-cf7b-4675-a18f-f80eefe70a1a\" (UID: \"13c4dd60-cf7b-4675-a18f-f80eefe70a1a\") "
Jul 24 20:03:02.245965 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:02.245936    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13c4dd60-cf7b-4675-a18f-f80eefe70a1a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "13c4dd60-cf7b-4675-a18f-f80eefe70a1a" (UID: "13c4dd60-cf7b-4675-a18f-f80eefe70a1a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:03:02.246044 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:02.245987    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59d5f662-9a77-4b07-a7a6-925b5175dd94-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "59d5f662-9a77-4b07-a7a6-925b5175dd94" (UID: "59d5f662-9a77-4b07-a7a6-925b5175dd94"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:03:02.247786 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:02.247761    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13c4dd60-cf7b-4675-a18f-f80eefe70a1a-kube-api-access-5db65" (OuterVolumeSpecName: "kube-api-access-5db65") pod "13c4dd60-cf7b-4675-a18f-f80eefe70a1a" (UID: "13c4dd60-cf7b-4675-a18f-f80eefe70a1a"). InnerVolumeSpecName "kube-api-access-5db65". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:03:02.247865 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:02.247844    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59d5f662-9a77-4b07-a7a6-925b5175dd94-kube-api-access-fc8gs" (OuterVolumeSpecName: "kube-api-access-fc8gs") pod "59d5f662-9a77-4b07-a7a6-925b5175dd94" (UID: "59d5f662-9a77-4b07-a7a6-925b5175dd94"). InnerVolumeSpecName "kube-api-access-fc8gs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:03:02.284116 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:02.284086    2567 generic.go:356] "Generic (PLEG): container finished" podID="13c4dd60-cf7b-4675-a18f-f80eefe70a1a" containerID="37cdc598323c60ff041abe4b02582895ed1a4d69491f29c7036d89511583e158" exitCode=0
Jul 24 20:03:02.284238 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:02.284125    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-839a20-dc84f9984-n6772"
Jul 24 20:03:02.284238 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:02.284178    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-839a20-dc84f9984-n6772" event={"ID":"13c4dd60-cf7b-4675-a18f-f80eefe70a1a","Type":"ContainerDied","Data":"37cdc598323c60ff041abe4b02582895ed1a4d69491f29c7036d89511583e158"}
Jul 24 20:03:02.284238 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:02.284231    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-839a20-dc84f9984-n6772" event={"ID":"13c4dd60-cf7b-4675-a18f-f80eefe70a1a","Type":"ContainerDied","Data":"f101af9e8b802b1639724df59eb05e8c22a5401d33544cd237b4727e2f4188f2"}
Jul 24 20:03:02.284400 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:02.284255    2567 scope.go:117] "RemoveContainer" containerID="37cdc598323c60ff041abe4b02582895ed1a4d69491f29c7036d89511583e158"
Jul 24 20:03:02.285439 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:02.285419    2567 generic.go:356] "Generic (PLEG): container finished" podID="59d5f662-9a77-4b07-a7a6-925b5175dd94" containerID="d443be77ca66db54a597d8186ff607e62a5c5f6cdd55dc85560633f4fc439202" exitCode=0
Jul 24 20:03:02.285543 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:02.285466    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-839a20-6687d5d7cb-shxvh"
Jul 24 20:03:02.285605 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:02.285451    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-839a20-6687d5d7cb-shxvh" event={"ID":"59d5f662-9a77-4b07-a7a6-925b5175dd94","Type":"ContainerDied","Data":"d443be77ca66db54a597d8186ff607e62a5c5f6cdd55dc85560633f4fc439202"}
Jul 24 20:03:02.285657 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:02.285608    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-839a20-6687d5d7cb-shxvh" event={"ID":"59d5f662-9a77-4b07-a7a6-925b5175dd94","Type":"ContainerDied","Data":"dd2d6000244e3260a9bec659e14ae8dec85c4d5afad22298418424ca85f5b094"}
Jul 24 20:03:02.294870 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:02.294851    2567 scope.go:117] "RemoveContainer" containerID="37cdc598323c60ff041abe4b02582895ed1a4d69491f29c7036d89511583e158"
Jul 24 20:03:02.295143 ip-10-0-133-84 kubenswrapper[2567]: E0724 20:03:02.295113    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37cdc598323c60ff041abe4b02582895ed1a4d69491f29c7036d89511583e158\": container with ID starting with 37cdc598323c60ff041abe4b02582895ed1a4d69491f29c7036d89511583e158 not found: ID does not exist" containerID="37cdc598323c60ff041abe4b02582895ed1a4d69491f29c7036d89511583e158"
Jul 24 20:03:02.295233 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:02.295155    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37cdc598323c60ff041abe4b02582895ed1a4d69491f29c7036d89511583e158"} err="failed to get container status \"37cdc598323c60ff041abe4b02582895ed1a4d69491f29c7036d89511583e158\": rpc error: code = NotFound desc = could not find container \"37cdc598323c60ff041abe4b02582895ed1a4d69491f29c7036d89511583e158\": container with ID starting with 37cdc598323c60ff041abe4b02582895ed1a4d69491f29c7036d89511583e158 not found: ID does not exist"
Jul 24 20:03:02.295233 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:02.295177    2567 scope.go:117] "RemoveContainer" containerID="d443be77ca66db54a597d8186ff607e62a5c5f6cdd55dc85560633f4fc439202"
Jul 24 20:03:02.303043 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:02.303025    2567 scope.go:117] "RemoveContainer" containerID="d443be77ca66db54a597d8186ff607e62a5c5f6cdd55dc85560633f4fc439202"
Jul 24 20:03:02.303283 ip-10-0-133-84 kubenswrapper[2567]: E0724 20:03:02.303266    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d443be77ca66db54a597d8186ff607e62a5c5f6cdd55dc85560633f4fc439202\": container with ID starting with d443be77ca66db54a597d8186ff607e62a5c5f6cdd55dc85560633f4fc439202 not found: ID does not exist" containerID="d443be77ca66db54a597d8186ff607e62a5c5f6cdd55dc85560633f4fc439202"
Jul 24 20:03:02.303336 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:02.303290    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d443be77ca66db54a597d8186ff607e62a5c5f6cdd55dc85560633f4fc439202"} err="failed to get container status \"d443be77ca66db54a597d8186ff607e62a5c5f6cdd55dc85560633f4fc439202\": rpc error: code = NotFound desc = could not find container \"d443be77ca66db54a597d8186ff607e62a5c5f6cdd55dc85560633f4fc439202\": container with ID starting with d443be77ca66db54a597d8186ff607e62a5c5f6cdd55dc85560633f4fc439202 not found: ID does not exist"
Jul 24 20:03:02.306634 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:02.306609    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-839a20-dc84f9984-n6772"]
Jul 24 20:03:02.308305 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:02.308283    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-839a20-dc84f9984-n6772"]
Jul 24 20:03:02.318771 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:02.318745    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-839a20-6687d5d7cb-shxvh"]
Jul 24 20:03:02.323367 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:02.323347    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-839a20-6687d5d7cb-shxvh"]
Jul 24 20:03:02.346996 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:02.346976    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5db65\" (UniqueName: \"kubernetes.io/projected/13c4dd60-cf7b-4675-a18f-f80eefe70a1a-kube-api-access-5db65\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:03:02.346996 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:02.346998    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fc8gs\" (UniqueName: \"kubernetes.io/projected/59d5f662-9a77-4b07-a7a6-925b5175dd94-kube-api-access-fc8gs\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:03:02.347135 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:02.347008    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59d5f662-9a77-4b07-a7a6-925b5175dd94-plugins-config-volume\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:03:02.347135 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:02.347018    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13c4dd60-cf7b-4675-a18f-f80eefe70a1a-plugins-config-volume\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:03:04.072255 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:04.072217    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13c4dd60-cf7b-4675-a18f-f80eefe70a1a" path="/var/lib/kubelet/pods/13c4dd60-cf7b-4675-a18f-f80eefe70a1a/volumes"
Jul 24 20:03:04.072630 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:04.072608    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59d5f662-9a77-4b07-a7a6-925b5175dd94" path="/var/lib/kubelet/pods/59d5f662-9a77-4b07-a7a6-925b5175dd94/volumes"
Jul 24 20:03:06.297139 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:06.297096    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-6a7079/test-model-6a7079-kserve-6cf9db77b9-n26h5" podUID="d6fea60f-2b84-4b59-8b03-a25ddda940b3" containerName="main" containerID="cri-o://db685be53f6ed4bce8b4446094c92cc0776f45214b36dd26c2c268b51c20d35c" gracePeriod=45
Jul 24 20:03:06.551467 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:06.551410    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6a7079/test-model-6a7079-kserve-6cf9db77b9-n26h5"
Jul 24 20:03:06.686632 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:06.686603    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6fea60f-2b84-4b59-8b03-a25ddda940b3-dshm\") pod \"d6fea60f-2b84-4b59-8b03-a25ddda940b3\" (UID: \"d6fea60f-2b84-4b59-8b03-a25ddda940b3\") "
Jul 24 20:03:06.686803 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:06.686675    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6fea60f-2b84-4b59-8b03-a25ddda940b3-tls-certs\") pod \"d6fea60f-2b84-4b59-8b03-a25ddda940b3\" (UID: \"d6fea60f-2b84-4b59-8b03-a25ddda940b3\") "
Jul 24 20:03:06.686803 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:06.686696    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6fea60f-2b84-4b59-8b03-a25ddda940b3-tmp-dir\") pod \"d6fea60f-2b84-4b59-8b03-a25ddda940b3\" (UID: \"d6fea60f-2b84-4b59-8b03-a25ddda940b3\") "
Jul 24 20:03:06.686803 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:06.686722    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zvlnm\" (UniqueName: \"kubernetes.io/projected/d6fea60f-2b84-4b59-8b03-a25ddda940b3-kube-api-access-zvlnm\") pod \"d6fea60f-2b84-4b59-8b03-a25ddda940b3\" (UID: \"d6fea60f-2b84-4b59-8b03-a25ddda940b3\") "
Jul 24 20:03:06.686803 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:06.686757    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6fea60f-2b84-4b59-8b03-a25ddda940b3-model-cache\") pod \"d6fea60f-2b84-4b59-8b03-a25ddda940b3\" (UID: \"d6fea60f-2b84-4b59-8b03-a25ddda940b3\") "
Jul 24 20:03:06.687024 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:06.686835    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6fea60f-2b84-4b59-8b03-a25ddda940b3-home\") pod \"d6fea60f-2b84-4b59-8b03-a25ddda940b3\" (UID: \"d6fea60f-2b84-4b59-8b03-a25ddda940b3\") "
Jul 24 20:03:06.687024 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:06.686990    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6fea60f-2b84-4b59-8b03-a25ddda940b3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d6fea60f-2b84-4b59-8b03-a25ddda940b3" (UID: "d6fea60f-2b84-4b59-8b03-a25ddda940b3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:03:06.687146 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:06.687056    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6fea60f-2b84-4b59-8b03-a25ddda940b3-model-cache" (OuterVolumeSpecName: "model-cache") pod "d6fea60f-2b84-4b59-8b03-a25ddda940b3" (UID: "d6fea60f-2b84-4b59-8b03-a25ddda940b3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:03:06.687203 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:06.687163    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6fea60f-2b84-4b59-8b03-a25ddda940b3-home" (OuterVolumeSpecName: "home") pod "d6fea60f-2b84-4b59-8b03-a25ddda940b3" (UID: "d6fea60f-2b84-4b59-8b03-a25ddda940b3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:03:06.687260 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:06.687245    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6fea60f-2b84-4b59-8b03-a25ddda940b3-tmp-dir\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:03:06.687315 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:06.687266    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6fea60f-2b84-4b59-8b03-a25ddda940b3-model-cache\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:03:06.689119 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:06.689091    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6fea60f-2b84-4b59-8b03-a25ddda940b3-kube-api-access-zvlnm" (OuterVolumeSpecName: "kube-api-access-zvlnm") pod "d6fea60f-2b84-4b59-8b03-a25ddda940b3" (UID: "d6fea60f-2b84-4b59-8b03-a25ddda940b3"). InnerVolumeSpecName "kube-api-access-zvlnm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:03:06.689243 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:06.689140    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6fea60f-2b84-4b59-8b03-a25ddda940b3-dshm" (OuterVolumeSpecName: "dshm") pod "d6fea60f-2b84-4b59-8b03-a25ddda940b3" (UID: "d6fea60f-2b84-4b59-8b03-a25ddda940b3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:03:06.689243 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:06.689152    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6fea60f-2b84-4b59-8b03-a25ddda940b3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d6fea60f-2b84-4b59-8b03-a25ddda940b3" (UID: "d6fea60f-2b84-4b59-8b03-a25ddda940b3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 20:03:06.787819 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:06.787790    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6fea60f-2b84-4b59-8b03-a25ddda940b3-tls-certs\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:03:06.787819 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:06.787816    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zvlnm\" (UniqueName: \"kubernetes.io/projected/d6fea60f-2b84-4b59-8b03-a25ddda940b3-kube-api-access-zvlnm\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:03:06.787819 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:06.787827    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6fea60f-2b84-4b59-8b03-a25ddda940b3-home\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:03:06.788020 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:06.787835    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6fea60f-2b84-4b59-8b03-a25ddda940b3-dshm\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:03:07.312306 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:07.312273    2567 generic.go:356] "Generic (PLEG): container finished" podID="d6fea60f-2b84-4b59-8b03-a25ddda940b3" containerID="db685be53f6ed4bce8b4446094c92cc0776f45214b36dd26c2c268b51c20d35c" exitCode=0
Jul 24 20:03:07.312838 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:07.312312    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6a7079/test-model-6a7079-kserve-6cf9db77b9-n26h5"
Jul 24 20:03:07.312838 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:07.312362    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6a7079/test-model-6a7079-kserve-6cf9db77b9-n26h5" event={"ID":"d6fea60f-2b84-4b59-8b03-a25ddda940b3","Type":"ContainerDied","Data":"db685be53f6ed4bce8b4446094c92cc0776f45214b36dd26c2c268b51c20d35c"}
Jul 24 20:03:07.312838 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:07.312409    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6a7079/test-model-6a7079-kserve-6cf9db77b9-n26h5" event={"ID":"d6fea60f-2b84-4b59-8b03-a25ddda940b3","Type":"ContainerDied","Data":"ab68d200869575b129df1c66da15451fd30217220facdfe9697e60e49c834a8d"}
Jul 24 20:03:07.312838 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:07.312435    2567 scope.go:117] "RemoveContainer" containerID="db685be53f6ed4bce8b4446094c92cc0776f45214b36dd26c2c268b51c20d35c"
Jul 24 20:03:07.320959 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:07.320942    2567 scope.go:117] "RemoveContainer" containerID="db685be53f6ed4bce8b4446094c92cc0776f45214b36dd26c2c268b51c20d35c"
Jul 24 20:03:07.321239 ip-10-0-133-84 kubenswrapper[2567]: E0724 20:03:07.321221    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db685be53f6ed4bce8b4446094c92cc0776f45214b36dd26c2c268b51c20d35c\": container with ID starting with db685be53f6ed4bce8b4446094c92cc0776f45214b36dd26c2c268b51c20d35c not found: ID does not exist" containerID="db685be53f6ed4bce8b4446094c92cc0776f45214b36dd26c2c268b51c20d35c"
Jul 24 20:03:07.321314 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:07.321248    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db685be53f6ed4bce8b4446094c92cc0776f45214b36dd26c2c268b51c20d35c"} err="failed to get container status \"db685be53f6ed4bce8b4446094c92cc0776f45214b36dd26c2c268b51c20d35c\": rpc error: code = NotFound desc = could not find container \"db685be53f6ed4bce8b4446094c92cc0776f45214b36dd26c2c268b51c20d35c\": container with ID starting with db685be53f6ed4bce8b4446094c92cc0776f45214b36dd26c2c268b51c20d35c not found: ID does not exist"
Jul 24 20:03:07.336444 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:07.336420    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-6a7079/test-model-6a7079-kserve-6cf9db77b9-n26h5"]
Jul 24 20:03:07.339101 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:07.339078    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-6a7079/test-model-6a7079-kserve-6cf9db77b9-n26h5"]
Jul 24 20:03:08.071543 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:08.071510    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6fea60f-2b84-4b59-8b03-a25ddda940b3" path="/var/lib/kubelet/pods/d6fea60f-2b84-4b59-8b03-a25ddda940b3/volumes"
Jul 24 20:03:13.279599 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:13.279563    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv"]
Jul 24 20:03:13.280042 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:13.279803    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv" podUID="f85020a1-105a-494e-9a5d-06ccdf4bf882" containerName="istio-proxy" containerID="cri-o://0e3f28c4e77fa2624d5632ca58089a062cdcb20f87511fb9873429f03ad6b8a7" gracePeriod=30
Jul 24 20:03:18.536225 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:18.536201    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv"
Jul 24 20:03:18.697047 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:18.697015    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f85020a1-105a-494e-9a5d-06ccdf4bf882-istio-podinfo\") pod \"f85020a1-105a-494e-9a5d-06ccdf4bf882\" (UID: \"f85020a1-105a-494e-9a5d-06ccdf4bf882\") "
Jul 24 20:03:18.697241 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:18.697054    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f85020a1-105a-494e-9a5d-06ccdf4bf882-istio-data\") pod \"f85020a1-105a-494e-9a5d-06ccdf4bf882\" (UID: \"f85020a1-105a-494e-9a5d-06ccdf4bf882\") "
Jul 24 20:03:18.697241 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:18.697094    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f85020a1-105a-494e-9a5d-06ccdf4bf882-workload-certs\") pod \"f85020a1-105a-494e-9a5d-06ccdf4bf882\" (UID: \"f85020a1-105a-494e-9a5d-06ccdf4bf882\") "
Jul 24 20:03:18.697241 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:18.697121    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f85020a1-105a-494e-9a5d-06ccdf4bf882-istiod-ca-cert\") pod \"f85020a1-105a-494e-9a5d-06ccdf4bf882\" (UID: \"f85020a1-105a-494e-9a5d-06ccdf4bf882\") "
Jul 24 20:03:18.697241 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:18.697156    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f85020a1-105a-494e-9a5d-06ccdf4bf882-credential-socket\") pod \"f85020a1-105a-494e-9a5d-06ccdf4bf882\" (UID: \"f85020a1-105a-494e-9a5d-06ccdf4bf882\") "
Jul 24 20:03:18.697241 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:18.697193    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f85020a1-105a-494e-9a5d-06ccdf4bf882-istio-envoy\") pod \"f85020a1-105a-494e-9a5d-06ccdf4bf882\" (UID: \"f85020a1-105a-494e-9a5d-06ccdf4bf882\") "
Jul 24 20:03:18.697241 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:18.697213    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f85020a1-105a-494e-9a5d-06ccdf4bf882-workload-socket\") pod \"f85020a1-105a-494e-9a5d-06ccdf4bf882\" (UID: \"f85020a1-105a-494e-9a5d-06ccdf4bf882\") "
Jul 24 20:03:18.697598 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:18.697250    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f85020a1-105a-494e-9a5d-06ccdf4bf882-istio-token\") pod \"f85020a1-105a-494e-9a5d-06ccdf4bf882\" (UID: \"f85020a1-105a-494e-9a5d-06ccdf4bf882\") "
Jul 24 20:03:18.697598 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:18.697282    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gts5n\" (UniqueName: \"kubernetes.io/projected/f85020a1-105a-494e-9a5d-06ccdf4bf882-kube-api-access-gts5n\") pod \"f85020a1-105a-494e-9a5d-06ccdf4bf882\" (UID: \"f85020a1-105a-494e-9a5d-06ccdf4bf882\") "
Jul 24 20:03:18.697598 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:18.697453    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f85020a1-105a-494e-9a5d-06ccdf4bf882-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f85020a1-105a-494e-9a5d-06ccdf4bf882" (UID: "f85020a1-105a-494e-9a5d-06ccdf4bf882"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:03:18.697598 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:18.697515    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f85020a1-105a-494e-9a5d-06ccdf4bf882-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f85020a1-105a-494e-9a5d-06ccdf4bf882" (UID: "f85020a1-105a-494e-9a5d-06ccdf4bf882"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:03:18.697598 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:18.697590    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f85020a1-105a-494e-9a5d-06ccdf4bf882-workload-certs\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:03:18.698017 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:18.697607    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f85020a1-105a-494e-9a5d-06ccdf4bf882-credential-socket\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:03:18.698017 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:18.697622    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f85020a1-105a-494e-9a5d-06ccdf4bf882-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f85020a1-105a-494e-9a5d-06ccdf4bf882" (UID: "f85020a1-105a-494e-9a5d-06ccdf4bf882"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:03:18.698017 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:18.697714    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f85020a1-105a-494e-9a5d-06ccdf4bf882-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f85020a1-105a-494e-9a5d-06ccdf4bf882" (UID: "f85020a1-105a-494e-9a5d-06ccdf4bf882"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:03:18.698017 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:18.697918    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f85020a1-105a-494e-9a5d-06ccdf4bf882-istio-data" (OuterVolumeSpecName: "istio-data") pod "f85020a1-105a-494e-9a5d-06ccdf4bf882" (UID: "f85020a1-105a-494e-9a5d-06ccdf4bf882"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:03:18.699454 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:18.699431    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f85020a1-105a-494e-9a5d-06ccdf4bf882-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f85020a1-105a-494e-9a5d-06ccdf4bf882" (UID: "f85020a1-105a-494e-9a5d-06ccdf4bf882"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:03:18.699611 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:18.699595    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f85020a1-105a-494e-9a5d-06ccdf4bf882-kube-api-access-gts5n" (OuterVolumeSpecName: "kube-api-access-gts5n") pod "f85020a1-105a-494e-9a5d-06ccdf4bf882" (UID: "f85020a1-105a-494e-9a5d-06ccdf4bf882"). InnerVolumeSpecName "kube-api-access-gts5n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:03:18.699611 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:18.699598    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f85020a1-105a-494e-9a5d-06ccdf4bf882-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f85020a1-105a-494e-9a5d-06ccdf4bf882" (UID: "f85020a1-105a-494e-9a5d-06ccdf4bf882"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 20:03:18.699738 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:18.699721    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f85020a1-105a-494e-9a5d-06ccdf4bf882-istio-token" (OuterVolumeSpecName: "istio-token") pod "f85020a1-105a-494e-9a5d-06ccdf4bf882" (UID: "f85020a1-105a-494e-9a5d-06ccdf4bf882"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:03:18.799007 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:18.798978    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f85020a1-105a-494e-9a5d-06ccdf4bf882-istio-token\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:03:18.799007 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:18.799001    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gts5n\" (UniqueName: \"kubernetes.io/projected/f85020a1-105a-494e-9a5d-06ccdf4bf882-kube-api-access-gts5n\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:03:18.799007 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:18.799010    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f85020a1-105a-494e-9a5d-06ccdf4bf882-istio-podinfo\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:03:18.799213 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:18.799019    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f85020a1-105a-494e-9a5d-06ccdf4bf882-istio-data\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:03:18.799213 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:18.799027    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f85020a1-105a-494e-9a5d-06ccdf4bf882-istiod-ca-cert\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:03:18.799213 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:18.799036    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f85020a1-105a-494e-9a5d-06ccdf4bf882-istio-envoy\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:03:18.799213 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:18.799044    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f85020a1-105a-494e-9a5d-06ccdf4bf882-workload-socket\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:03:19.371603 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:19.371565    2567 generic.go:356] "Generic (PLEG): container finished" podID="f85020a1-105a-494e-9a5d-06ccdf4bf882" containerID="0e3f28c4e77fa2624d5632ca58089a062cdcb20f87511fb9873429f03ad6b8a7" exitCode=0
Jul 24 20:03:19.371785 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:19.371620    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv"
Jul 24 20:03:19.371785 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:19.371649    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv" event={"ID":"f85020a1-105a-494e-9a5d-06ccdf4bf882","Type":"ContainerDied","Data":"0e3f28c4e77fa2624d5632ca58089a062cdcb20f87511fb9873429f03ad6b8a7"}
Jul 24 20:03:19.371785 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:19.371708    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv" event={"ID":"f85020a1-105a-494e-9a5d-06ccdf4bf882","Type":"ContainerDied","Data":"bfbe6d86b6657a252cb3c01a322829bbbbdf78b75cc3725246cdd358048e991f"}
Jul 24 20:03:19.371785 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:19.371731    2567 scope.go:117] "RemoveContainer" containerID="0e3f28c4e77fa2624d5632ca58089a062cdcb20f87511fb9873429f03ad6b8a7"
Jul 24 20:03:19.381051 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:19.381037    2567 scope.go:117] "RemoveContainer" containerID="ae42e61386c5680227c9456be208cb6086f6433b9361de605cff6660b5ab60e0"
Jul 24 20:03:19.388797 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:19.388779    2567 scope.go:117] "RemoveContainer" containerID="0e3f28c4e77fa2624d5632ca58089a062cdcb20f87511fb9873429f03ad6b8a7"
Jul 24 20:03:19.389055 ip-10-0-133-84 kubenswrapper[2567]: E0724 20:03:19.389035    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e3f28c4e77fa2624d5632ca58089a062cdcb20f87511fb9873429f03ad6b8a7\": container with ID starting with 0e3f28c4e77fa2624d5632ca58089a062cdcb20f87511fb9873429f03ad6b8a7 not found: ID does not exist" containerID="0e3f28c4e77fa2624d5632ca58089a062cdcb20f87511fb9873429f03ad6b8a7"
Jul 24 20:03:19.389107 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:19.389064    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e3f28c4e77fa2624d5632ca58089a062cdcb20f87511fb9873429f03ad6b8a7"} err="failed to get container status \"0e3f28c4e77fa2624d5632ca58089a062cdcb20f87511fb9873429f03ad6b8a7\": rpc error: code = NotFound desc = could not find container \"0e3f28c4e77fa2624d5632ca58089a062cdcb20f87511fb9873429f03ad6b8a7\": container with ID starting with 0e3f28c4e77fa2624d5632ca58089a062cdcb20f87511fb9873429f03ad6b8a7 not found: ID does not exist"
Jul 24 20:03:19.389107 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:19.389082    2567 scope.go:117] "RemoveContainer" containerID="ae42e61386c5680227c9456be208cb6086f6433b9361de605cff6660b5ab60e0"
Jul 24 20:03:19.389283 ip-10-0-133-84 kubenswrapper[2567]: E0724 20:03:19.389262    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae42e61386c5680227c9456be208cb6086f6433b9361de605cff6660b5ab60e0\": container with ID starting with ae42e61386c5680227c9456be208cb6086f6433b9361de605cff6660b5ab60e0 not found: ID does not exist" containerID="ae42e61386c5680227c9456be208cb6086f6433b9361de605cff6660b5ab60e0"
Jul 24 20:03:19.389334 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:19.389292    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae42e61386c5680227c9456be208cb6086f6433b9361de605cff6660b5ab60e0"} err="failed to get container status \"ae42e61386c5680227c9456be208cb6086f6433b9361de605cff6660b5ab60e0\": rpc error: code = NotFound desc = could not find container \"ae42e61386c5680227c9456be208cb6086f6433b9361de605cff6660b5ab60e0\": container with ID starting with ae42e61386c5680227c9456be208cb6086f6433b9361de605cff6660b5ab60e0 not found: ID does not exist"
Jul 24 20:03:19.393941 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:19.393919    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv"]
Jul 24 20:03:19.397861 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:19.397838    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-839a20-openshift-default-797bc78b68-22gfv"]
Jul 24 20:03:20.072069 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:20.072041    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f85020a1-105a-494e-9a5d-06ccdf4bf882" path="/var/lib/kubelet/pods/f85020a1-105a-494e-9a5d-06ccdf4bf882/volumes"
Jul 24 20:03:24.234042 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:24.234007    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-6a7079-6949588b6d-lbc8k"]
Jul 24 20:03:24.234553 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:24.234249    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-6a7079-6949588b6d-lbc8k" podUID="1d2a619c-7f3c-4cb4-9d7d-c185ca229a53" containerName="payload-processing" containerID="cri-o://5be6d8d394602896995b7d81915184acc6824793499f8462b079b868c836fa1c" gracePeriod=30
Jul 24 20:03:24.397620 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:24.397588    2567 generic.go:356] "Generic (PLEG): container finished" podID="1d2a619c-7f3c-4cb4-9d7d-c185ca229a53" containerID="5be6d8d394602896995b7d81915184acc6824793499f8462b079b868c836fa1c" exitCode=0
Jul 24 20:03:24.397786 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:24.397656    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-6a7079-6949588b6d-lbc8k" event={"ID":"1d2a619c-7f3c-4cb4-9d7d-c185ca229a53","Type":"ContainerDied","Data":"5be6d8d394602896995b7d81915184acc6824793499f8462b079b868c836fa1c"}
Jul 24 20:03:24.484966 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:24.484909    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-6a7079-6949588b6d-lbc8k"
Jul 24 20:03:24.653857 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:24.653825    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxfrv\" (UniqueName: \"kubernetes.io/projected/1d2a619c-7f3c-4cb4-9d7d-c185ca229a53-kube-api-access-jxfrv\") pod \"1d2a619c-7f3c-4cb4-9d7d-c185ca229a53\" (UID: \"1d2a619c-7f3c-4cb4-9d7d-c185ca229a53\") "
Jul 24 20:03:24.654038 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:24.653872    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d2a619c-7f3c-4cb4-9d7d-c185ca229a53-plugins-config-volume\") pod \"1d2a619c-7f3c-4cb4-9d7d-c185ca229a53\" (UID: \"1d2a619c-7f3c-4cb4-9d7d-c185ca229a53\") "
Jul 24 20:03:24.654261 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:24.654227    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d2a619c-7f3c-4cb4-9d7d-c185ca229a53-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1d2a619c-7f3c-4cb4-9d7d-c185ca229a53" (UID: "1d2a619c-7f3c-4cb4-9d7d-c185ca229a53"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:03:24.656130 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:24.656110    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d2a619c-7f3c-4cb4-9d7d-c185ca229a53-kube-api-access-jxfrv" (OuterVolumeSpecName: "kube-api-access-jxfrv") pod "1d2a619c-7f3c-4cb4-9d7d-c185ca229a53" (UID: "1d2a619c-7f3c-4cb4-9d7d-c185ca229a53"). InnerVolumeSpecName "kube-api-access-jxfrv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:03:24.755598 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:24.755514    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxfrv\" (UniqueName: \"kubernetes.io/projected/1d2a619c-7f3c-4cb4-9d7d-c185ca229a53-kube-api-access-jxfrv\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:03:24.755598 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:24.755550    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d2a619c-7f3c-4cb4-9d7d-c185ca229a53-plugins-config-volume\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:03:25.404528 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:25.404497    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-6a7079-6949588b6d-lbc8k"
Jul 24 20:03:25.404973 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:25.404476    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-6a7079-6949588b6d-lbc8k" event={"ID":"1d2a619c-7f3c-4cb4-9d7d-c185ca229a53","Type":"ContainerDied","Data":"d3adabe7827f66ca65b419d7e7ce6f8175eb05df033f1c0898f57fb17b90be3c"}
Jul 24 20:03:25.404973 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:25.404623    2567 scope.go:117] "RemoveContainer" containerID="5be6d8d394602896995b7d81915184acc6824793499f8462b079b868c836fa1c"
Jul 24 20:03:25.424357 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:25.424295    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-6a7079-6949588b6d-lbc8k"]
Jul 24 20:03:25.425951 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:25.425929    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-6a7079-6949588b6d-lbc8k"]
Jul 24 20:03:26.072297 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:26.072260    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d2a619c-7f3c-4cb4-9d7d-c185ca229a53" path="/var/lib/kubelet/pods/1d2a619c-7f3c-4cb4-9d7d-c185ca229a53/volumes"
Jul 24 20:03:36.101279 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.101247    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf"]
Jul 24 20:03:36.101719 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.101615    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d2a619c-7f3c-4cb4-9d7d-c185ca229a53" containerName="payload-processing"
Jul 24 20:03:36.101719 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.101628    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d2a619c-7f3c-4cb4-9d7d-c185ca229a53" containerName="payload-processing"
Jul 24 20:03:36.101719 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.101636    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f85020a1-105a-494e-9a5d-06ccdf4bf882" containerName="istio-proxy"
Jul 24 20:03:36.101719 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.101641    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f85020a1-105a-494e-9a5d-06ccdf4bf882" containerName="istio-proxy"
Jul 24 20:03:36.101719 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.101662    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f85020a1-105a-494e-9a5d-06ccdf4bf882" containerName="istio-proxy"
Jul 24 20:03:36.101719 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.101667    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f85020a1-105a-494e-9a5d-06ccdf4bf882" containerName="istio-proxy"
Jul 24 20:03:36.101719 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.101675    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59d5f662-9a77-4b07-a7a6-925b5175dd94" containerName="payload-processing"
Jul 24 20:03:36.101719 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.101681    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="59d5f662-9a77-4b07-a7a6-925b5175dd94" containerName="payload-processing"
Jul 24 20:03:36.101719 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.101692    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13c4dd60-cf7b-4675-a18f-f80eefe70a1a" containerName="payload-pre-processing"
Jul 24 20:03:36.101719 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.101698    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="13c4dd60-cf7b-4675-a18f-f80eefe70a1a" containerName="payload-pre-processing"
Jul 24 20:03:36.101719 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.101703    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6fea60f-2b84-4b59-8b03-a25ddda940b3" containerName="main"
Jul 24 20:03:36.101719 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.101708    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6fea60f-2b84-4b59-8b03-a25ddda940b3" containerName="main"
Jul 24 20:03:36.102383 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.101755    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f85020a1-105a-494e-9a5d-06ccdf4bf882" containerName="istio-proxy"
Jul 24 20:03:36.102383 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.101762    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="13c4dd60-cf7b-4675-a18f-f80eefe70a1a" containerName="payload-pre-processing"
Jul 24 20:03:36.102383 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.101768    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="59d5f662-9a77-4b07-a7a6-925b5175dd94" containerName="payload-processing"
Jul 24 20:03:36.102383 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.101773    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d2a619c-7f3c-4cb4-9d7d-c185ca229a53" containerName="payload-processing"
Jul 24 20:03:36.102383 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.101779    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6fea60f-2b84-4b59-8b03-a25ddda940b3" containerName="main"
Jul 24 20:03:36.102383 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.101785    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f85020a1-105a-494e-9a5d-06ccdf4bf882" containerName="istio-proxy"
Jul 24 20:03:36.106260 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.106240    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf"
Jul 24 20:03:36.108766 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.108747    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 24 20:03:36.108766 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.108753    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-cff930-openshift-default-dockercfg-65gbr\""
Jul 24 20:03:36.117585 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.117556    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf"]
Jul 24 20:03:36.142311 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.142280    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5252fc64-56da-4181-bc47-433233938943-istio-envoy\") pod \"e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf\" (UID: \"5252fc64-56da-4181-bc47-433233938943\") " pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf"
Jul 24 20:03:36.142469 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.142316    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5252fc64-56da-4181-bc47-433233938943-istio-data\") pod \"e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf\" (UID: \"5252fc64-56da-4181-bc47-433233938943\") " pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf"
Jul 24 20:03:36.142469 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.142341    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5252fc64-56da-4181-bc47-433233938943-istio-podinfo\") pod \"e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf\" (UID: \"5252fc64-56da-4181-bc47-433233938943\") " pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf"
Jul 24 20:03:36.142469 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.142386    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hm45\" (UniqueName: \"kubernetes.io/projected/5252fc64-56da-4181-bc47-433233938943-kube-api-access-8hm45\") pod \"e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf\" (UID: \"5252fc64-56da-4181-bc47-433233938943\") " pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf"
Jul 24 20:03:36.142469 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.142414    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5252fc64-56da-4181-bc47-433233938943-istiod-ca-cert\") pod \"e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf\" (UID: \"5252fc64-56da-4181-bc47-433233938943\") " pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf"
Jul 24 20:03:36.142666 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.142551    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5252fc64-56da-4181-bc47-433233938943-workload-socket\") pod \"e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf\" (UID: \"5252fc64-56da-4181-bc47-433233938943\") " pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf"
Jul 24 20:03:36.142666 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.142568    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5252fc64-56da-4181-bc47-433233938943-credential-socket\") pod \"e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf\" (UID: \"5252fc64-56da-4181-bc47-433233938943\") " pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf"
Jul 24 20:03:36.142666 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.142583    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5252fc64-56da-4181-bc47-433233938943-workload-certs\") pod \"e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf\" (UID: \"5252fc64-56da-4181-bc47-433233938943\") " pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf"
Jul 24 20:03:36.142666 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.142610    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5252fc64-56da-4181-bc47-433233938943-istio-token\") pod \"e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf\" (UID: \"5252fc64-56da-4181-bc47-433233938943\") " pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf"
Jul 24 20:03:36.243607 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.243576    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5252fc64-56da-4181-bc47-433233938943-workload-socket\") pod \"e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf\" (UID: \"5252fc64-56da-4181-bc47-433233938943\") " pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf"
Jul 24 20:03:36.243607 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.243614    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5252fc64-56da-4181-bc47-433233938943-credential-socket\") pod \"e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf\" (UID: \"5252fc64-56da-4181-bc47-433233938943\") " pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf"
Jul 24 20:03:36.243874 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.243639    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5252fc64-56da-4181-bc47-433233938943-workload-certs\") pod \"e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf\" (UID: \"5252fc64-56da-4181-bc47-433233938943\") " pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf"
Jul 24 20:03:36.243874 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.243669    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5252fc64-56da-4181-bc47-433233938943-istio-token\") pod \"e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf\" (UID: \"5252fc64-56da-4181-bc47-433233938943\") " pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf"
Jul 24 20:03:36.243874 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.243713    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5252fc64-56da-4181-bc47-433233938943-istio-envoy\") pod \"e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf\" (UID: \"5252fc64-56da-4181-bc47-433233938943\") " pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf"
Jul 24 20:03:36.243874 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.243733    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5252fc64-56da-4181-bc47-433233938943-istio-data\") pod \"e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf\" (UID: \"5252fc64-56da-4181-bc47-433233938943\") " pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf"
Jul 24 20:03:36.243874 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.243775    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5252fc64-56da-4181-bc47-433233938943-istio-podinfo\") pod \"e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf\" (UID: \"5252fc64-56da-4181-bc47-433233938943\") " pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf"
Jul 24 20:03:36.244132 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.243881    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hm45\" (UniqueName: \"kubernetes.io/projected/5252fc64-56da-4181-bc47-433233938943-kube-api-access-8hm45\") pod \"e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf\" (UID: \"5252fc64-56da-4181-bc47-433233938943\") " pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf"
Jul 24 20:03:36.244132 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.243940    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5252fc64-56da-4181-bc47-433233938943-istiod-ca-cert\") pod \"e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf\" (UID: \"5252fc64-56da-4181-bc47-433233938943\") " pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf"
Jul 24 20:03:36.244132 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.244010    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5252fc64-56da-4181-bc47-433233938943-workload-socket\") pod \"e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf\" (UID: \"5252fc64-56da-4181-bc47-433233938943\") " pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf"
Jul 24 20:03:36.244132 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.244066    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5252fc64-56da-4181-bc47-433233938943-workload-certs\") pod \"e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf\" (UID: \"5252fc64-56da-4181-bc47-433233938943\") " pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf"
Jul 24 20:03:36.244366 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.244343    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5252fc64-56da-4181-bc47-433233938943-credential-socket\") pod \"e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf\" (UID: \"5252fc64-56da-4181-bc47-433233938943\") " pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf"
Jul 24 20:03:36.244428 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.244416    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5252fc64-56da-4181-bc47-433233938943-istio-data\") pod \"e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf\" (UID: \"5252fc64-56da-4181-bc47-433233938943\") " pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf"
Jul 24 20:03:36.244820 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.244755    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5252fc64-56da-4181-bc47-433233938943-istiod-ca-cert\") pod \"e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf\" (UID: \"5252fc64-56da-4181-bc47-433233938943\") " pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf"
Jul 24 20:03:36.246330 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.246305    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5252fc64-56da-4181-bc47-433233938943-istio-envoy\") pod \"e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf\" (UID: \"5252fc64-56da-4181-bc47-433233938943\") " pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf"
Jul 24 20:03:36.246566 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.246549    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5252fc64-56da-4181-bc47-433233938943-istio-podinfo\") pod \"e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf\" (UID: \"5252fc64-56da-4181-bc47-433233938943\") " pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf"
Jul 24 20:03:36.251804 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.251784    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5252fc64-56da-4181-bc47-433233938943-istio-token\") pod \"e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf\" (UID: \"5252fc64-56da-4181-bc47-433233938943\") " pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf"
Jul 24 20:03:36.251804 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.251793    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hm45\" (UniqueName: \"kubernetes.io/projected/5252fc64-56da-4181-bc47-433233938943-kube-api-access-8hm45\") pod \"e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf\" (UID: \"5252fc64-56da-4181-bc47-433233938943\") " pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf"
Jul 24 20:03:36.416689 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.416657    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf"
Jul 24 20:03:36.553309 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.553277    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf"]
Jul 24 20:03:36.554465 ip-10-0-133-84 kubenswrapper[2567]: W0724 20:03:36.554440    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5252fc64_56da_4181_bc47_433233938943.slice/crio-31bce4ec9f3d0ca26a39f9d458e2604704eed97396bcb4fab60f700562a2b9ae WatchSource:0}: Error finding container 31bce4ec9f3d0ca26a39f9d458e2604704eed97396bcb4fab60f700562a2b9ae: Status 404 returned error can't find the container with id 31bce4ec9f3d0ca26a39f9d458e2604704eed97396bcb4fab60f700562a2b9ae
Jul 24 20:03:36.556444 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.556414    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 20:03:36.556545 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.556475    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 20:03:36.556545 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:36.556524    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 20:03:37.462419 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:37.462381    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf" event={"ID":"5252fc64-56da-4181-bc47-433233938943","Type":"ContainerStarted","Data":"249cba85202cb92e59f05d73771d77129729abc27447b91992204db049311d0b"}
Jul 24 20:03:37.462816 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:37.462450    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf" event={"ID":"5252fc64-56da-4181-bc47-433233938943","Type":"ContainerStarted","Data":"31bce4ec9f3d0ca26a39f9d458e2604704eed97396bcb4fab60f700562a2b9ae"}
Jul 24 20:03:37.482868 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:37.482806    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf" podStartSLOduration=1.482788121 podStartE2EDuration="1.482788121s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:03:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:03:37.481423751 +0000 UTC m=+2206.000043793" watchObservedRunningTime="2026-07-24 20:03:37.482788121 +0000 UTC m=+2206.001408163"
Jul 24 20:03:38.417066 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:38.417030    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf"
Jul 24 20:03:38.422927 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:38.422902    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf"
Jul 24 20:03:38.466731 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:38.466697    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf"
Jul 24 20:03:38.467729 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:38.467710    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf"
Jul 24 20:03:40.321555 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:40.320338    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-cff930-6b5f968c88-hzmjt"]
Jul 24 20:03:40.325911 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:40.325888    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-cff930-6b5f968c88-hzmjt"
Jul 24 20:03:40.328549 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:40.328525    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-cff930\""
Jul 24 20:03:40.328816 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:40.328763    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-cff930-dockercfg-xjljp\""
Jul 24 20:03:40.332153 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:40.332131    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-cff930-6b5f968c88-hzmjt"]
Jul 24 20:03:40.378240 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:40.378210    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5397411a-a079-4e4d-9786-e920a111ceb9-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-cff930-6b5f968c88-hzmjt\" (UID: \"5397411a-a079-4e4d-9786-e920a111ceb9\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-cff930-6b5f968c88-hzmjt"
Jul 24 20:03:40.378240 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:40.378243    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-st2ss\" (UniqueName: \"kubernetes.io/projected/5397411a-a079-4e4d-9786-e920a111ceb9-kube-api-access-st2ss\") pod \"payload-pre-processing-e2e-api-a-cff930-6b5f968c88-hzmjt\" (UID: \"5397411a-a079-4e4d-9786-e920a111ceb9\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-cff930-6b5f968c88-hzmjt"
Jul 24 20:03:40.401898 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:40.401867    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-cff930-6f86c455bb-9wdnc"]
Jul 24 20:03:40.405297 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:40.405280    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-cff930-6f86c455bb-9wdnc"
Jul 24 20:03:40.415679 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:40.415652    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-cff930-6f86c455bb-9wdnc"]
Jul 24 20:03:40.479688 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:40.479658    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sdjb\" (UniqueName: \"kubernetes.io/projected/723ae22b-ce8e-431a-8ab7-ce57a5bfaee3-kube-api-access-2sdjb\") pod \"payload-processing-e2e-api-a-cff930-6f86c455bb-9wdnc\" (UID: \"723ae22b-ce8e-431a-8ab7-ce57a5bfaee3\") " pod="openshift-ingress/payload-processing-e2e-api-a-cff930-6f86c455bb-9wdnc"
Jul 24 20:03:40.479833 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:40.479706    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/723ae22b-ce8e-431a-8ab7-ce57a5bfaee3-plugins-config-volume\") pod \"payload-processing-e2e-api-a-cff930-6f86c455bb-9wdnc\" (UID: \"723ae22b-ce8e-431a-8ab7-ce57a5bfaee3\") " pod="openshift-ingress/payload-processing-e2e-api-a-cff930-6f86c455bb-9wdnc"
Jul 24 20:03:40.479833 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:40.479825    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5397411a-a079-4e4d-9786-e920a111ceb9-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-cff930-6b5f968c88-hzmjt\" (UID: \"5397411a-a079-4e4d-9786-e920a111ceb9\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-cff930-6b5f968c88-hzmjt"
Jul 24 20:03:40.479927 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:40.479846    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st2ss\" (UniqueName: \"kubernetes.io/projected/5397411a-a079-4e4d-9786-e920a111ceb9-kube-api-access-st2ss\") pod \"payload-pre-processing-e2e-api-a-cff930-6b5f968c88-hzmjt\" (UID: \"5397411a-a079-4e4d-9786-e920a111ceb9\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-cff930-6b5f968c88-hzmjt"
Jul 24 20:03:40.480616 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:40.480597    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5397411a-a079-4e4d-9786-e920a111ceb9-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-cff930-6b5f968c88-hzmjt\" (UID: \"5397411a-a079-4e4d-9786-e920a111ceb9\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-cff930-6b5f968c88-hzmjt"
Jul 24 20:03:40.487864 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:40.487832    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-st2ss\" (UniqueName: \"kubernetes.io/projected/5397411a-a079-4e4d-9786-e920a111ceb9-kube-api-access-st2ss\") pod \"payload-pre-processing-e2e-api-a-cff930-6b5f968c88-hzmjt\" (UID: \"5397411a-a079-4e4d-9786-e920a111ceb9\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-cff930-6b5f968c88-hzmjt"
Jul 24 20:03:40.581147 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:40.580993    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sdjb\" (UniqueName: \"kubernetes.io/projected/723ae22b-ce8e-431a-8ab7-ce57a5bfaee3-kube-api-access-2sdjb\") pod \"payload-processing-e2e-api-a-cff930-6f86c455bb-9wdnc\" (UID: \"723ae22b-ce8e-431a-8ab7-ce57a5bfaee3\") " pod="openshift-ingress/payload-processing-e2e-api-a-cff930-6f86c455bb-9wdnc"
Jul 24 20:03:40.581147 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:40.581108    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/723ae22b-ce8e-431a-8ab7-ce57a5bfaee3-plugins-config-volume\") pod \"payload-processing-e2e-api-a-cff930-6f86c455bb-9wdnc\" (UID: \"723ae22b-ce8e-431a-8ab7-ce57a5bfaee3\") " pod="openshift-ingress/payload-processing-e2e-api-a-cff930-6f86c455bb-9wdnc"
Jul 24 20:03:40.581914 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:40.581892    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/723ae22b-ce8e-431a-8ab7-ce57a5bfaee3-plugins-config-volume\") pod \"payload-processing-e2e-api-a-cff930-6f86c455bb-9wdnc\" (UID: \"723ae22b-ce8e-431a-8ab7-ce57a5bfaee3\") " pod="openshift-ingress/payload-processing-e2e-api-a-cff930-6f86c455bb-9wdnc"
Jul 24 20:03:40.589440 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:40.589411    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sdjb\" (UniqueName: \"kubernetes.io/projected/723ae22b-ce8e-431a-8ab7-ce57a5bfaee3-kube-api-access-2sdjb\") pod \"payload-processing-e2e-api-a-cff930-6f86c455bb-9wdnc\" (UID: \"723ae22b-ce8e-431a-8ab7-ce57a5bfaee3\") " pod="openshift-ingress/payload-processing-e2e-api-a-cff930-6f86c455bb-9wdnc"
Jul 24 20:03:40.638362 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:40.638320    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-cff930-6b5f968c88-hzmjt"
Jul 24 20:03:40.718251 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:40.718214    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-cff930-6f86c455bb-9wdnc"
Jul 24 20:03:40.784621 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:40.781407    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-cff930-6b5f968c88-hzmjt"]
Jul 24 20:03:40.785506 ip-10-0-133-84 kubenswrapper[2567]: W0724 20:03:40.785453    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5397411a_a079_4e4d_9786_e920a111ceb9.slice/crio-6fd3f85c551f58abced701546b3e9076da52943acca768e28a36b940f04aa0c4 WatchSource:0}: Error finding container 6fd3f85c551f58abced701546b3e9076da52943acca768e28a36b940f04aa0c4: Status 404 returned error can't find the container with id 6fd3f85c551f58abced701546b3e9076da52943acca768e28a36b940f04aa0c4
Jul 24 20:03:40.878524 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:40.878497    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-cff930-6f86c455bb-9wdnc"]
Jul 24 20:03:40.880143 ip-10-0-133-84 kubenswrapper[2567]: W0724 20:03:40.880115    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod723ae22b_ce8e_431a_8ab7_ce57a5bfaee3.slice/crio-866fbad78b5d9072b9f9781c00bb96d45557e39510e55a30ad8a9e99a79db694 WatchSource:0}: Error finding container 866fbad78b5d9072b9f9781c00bb96d45557e39510e55a30ad8a9e99a79db694: Status 404 returned error can't find the container with id 866fbad78b5d9072b9f9781c00bb96d45557e39510e55a30ad8a9e99a79db694
Jul 24 20:03:41.482645 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:41.482609    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-cff930-6f86c455bb-9wdnc" event={"ID":"723ae22b-ce8e-431a-8ab7-ce57a5bfaee3","Type":"ContainerStarted","Data":"be632c1cdb8f9611590475f170ab59d313ba17eaa5789e4bc1324e8d2d973cd2"}
Jul 24 20:03:41.483155 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:41.482664    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-cff930-6f86c455bb-9wdnc" event={"ID":"723ae22b-ce8e-431a-8ab7-ce57a5bfaee3","Type":"ContainerStarted","Data":"866fbad78b5d9072b9f9781c00bb96d45557e39510e55a30ad8a9e99a79db694"}
Jul 24 20:03:41.483155 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:41.482779    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-cff930-6f86c455bb-9wdnc"
Jul 24 20:03:41.484190 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:41.484166    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-cff930-6b5f968c88-hzmjt" event={"ID":"5397411a-a079-4e4d-9786-e920a111ceb9","Type":"ContainerStarted","Data":"343c8fd82e0caa045930b725e1213ecb52df114014e5fd8c7a5c5f5885223982"}
Jul 24 20:03:41.484289 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:41.484211    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-cff930-6b5f968c88-hzmjt" event={"ID":"5397411a-a079-4e4d-9786-e920a111ceb9","Type":"ContainerStarted","Data":"6fd3f85c551f58abced701546b3e9076da52943acca768e28a36b940f04aa0c4"}
Jul 24 20:03:41.484289 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:41.484260    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-cff930-6b5f968c88-hzmjt"
Jul 24 20:03:41.499121 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:41.499067    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-cff930-6f86c455bb-9wdnc" podStartSLOduration=1.499051707 podStartE2EDuration="1.499051707s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:03:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:03:41.49778712 +0000 UTC m=+2210.016407162" watchObservedRunningTime="2026-07-24 20:03:41.499051707 +0000 UTC m=+2210.017671727"
Jul 24 20:03:41.515417 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:41.515342    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-cff930-6b5f968c88-hzmjt" podStartSLOduration=1.515325797 podStartE2EDuration="1.515325797s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:03:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:03:41.513780065 +0000 UTC m=+2210.032400120" watchObservedRunningTime="2026-07-24 20:03:41.515325797 +0000 UTC m=+2210.033945838"
Jul 24 20:03:48.340076 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:48.340034    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-e316a0-7bc5c7cd88-cd4z5"]
Jul 24 20:03:48.345532 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:48.345474    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e316a0-7bc5c7cd88-cd4z5"
Jul 24 20:03:48.348422 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:48.348390    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-e316a0-dockercfg-b9b8h\""
Jul 24 20:03:48.352502 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:48.348678    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-e316a0\""
Jul 24 20:03:48.359094 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:48.359056    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-e316a0-7bc5c7cd88-cd4z5"]
Jul 24 20:03:48.464067 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:48.464022    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9qjg\" (UniqueName: \"kubernetes.io/projected/8c2fda6a-41f4-4cf2-b6b0-357f53abc7b9-kube-api-access-b9qjg\") pod \"payload-pre-processing-e2e-api-b-e316a0-7bc5c7cd88-cd4z5\" (UID: \"8c2fda6a-41f4-4cf2-b6b0-357f53abc7b9\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-e316a0-7bc5c7cd88-cd4z5"
Jul 24 20:03:48.464222 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:48.464080    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c2fda6a-41f4-4cf2-b6b0-357f53abc7b9-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-e316a0-7bc5c7cd88-cd4z5\" (UID: \"8c2fda6a-41f4-4cf2-b6b0-357f53abc7b9\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-e316a0-7bc5c7cd88-cd4z5"
Jul 24 20:03:48.565121 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:48.565079    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c2fda6a-41f4-4cf2-b6b0-357f53abc7b9-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-e316a0-7bc5c7cd88-cd4z5\" (UID: \"8c2fda6a-41f4-4cf2-b6b0-357f53abc7b9\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-e316a0-7bc5c7cd88-cd4z5"
Jul 24 20:03:48.565300 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:48.565227    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9qjg\" (UniqueName: \"kubernetes.io/projected/8c2fda6a-41f4-4cf2-b6b0-357f53abc7b9-kube-api-access-b9qjg\") pod \"payload-pre-processing-e2e-api-b-e316a0-7bc5c7cd88-cd4z5\" (UID: \"8c2fda6a-41f4-4cf2-b6b0-357f53abc7b9\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-e316a0-7bc5c7cd88-cd4z5"
Jul 24 20:03:48.565957 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:48.565940    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c2fda6a-41f4-4cf2-b6b0-357f53abc7b9-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-e316a0-7bc5c7cd88-cd4z5\" (UID: \"8c2fda6a-41f4-4cf2-b6b0-357f53abc7b9\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-e316a0-7bc5c7cd88-cd4z5"
Jul 24 20:03:48.573554 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:48.573526    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9qjg\" (UniqueName: \"kubernetes.io/projected/8c2fda6a-41f4-4cf2-b6b0-357f53abc7b9-kube-api-access-b9qjg\") pod \"payload-pre-processing-e2e-api-b-e316a0-7bc5c7cd88-cd4z5\" (UID: \"8c2fda6a-41f4-4cf2-b6b0-357f53abc7b9\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-e316a0-7bc5c7cd88-cd4z5"
Jul 24 20:03:48.669919 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:48.669876    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e316a0-7bc5c7cd88-cd4z5"
Jul 24 20:03:48.887879 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:48.887850    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-e316a0-7bc5c7cd88-cd4z5"]
Jul 24 20:03:48.889585 ip-10-0-133-84 kubenswrapper[2567]: W0724 20:03:48.889554    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c2fda6a_41f4_4cf2_b6b0_357f53abc7b9.slice/crio-16cfb559c5188b3bc0f8c6a9e26c29e35029c8c54b251229c33fcbb23e6c4310 WatchSource:0}: Error finding container 16cfb559c5188b3bc0f8c6a9e26c29e35029c8c54b251229c33fcbb23e6c4310: Status 404 returned error can't find the container with id 16cfb559c5188b3bc0f8c6a9e26c29e35029c8c54b251229c33fcbb23e6c4310
Jul 24 20:03:49.526383 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:49.526352    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e316a0-7bc5c7cd88-cd4z5" event={"ID":"8c2fda6a-41f4-4cf2-b6b0-357f53abc7b9","Type":"ContainerStarted","Data":"5e17328bc62f9f79d2354972dc9005609773a1c6a27b3bc11055823f910f156b"}
Jul 24 20:03:49.526884 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:49.526406    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e316a0-7bc5c7cd88-cd4z5" event={"ID":"8c2fda6a-41f4-4cf2-b6b0-357f53abc7b9","Type":"ContainerStarted","Data":"16cfb559c5188b3bc0f8c6a9e26c29e35029c8c54b251229c33fcbb23e6c4310"}
Jul 24 20:03:49.526884 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:49.526440    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e316a0-7bc5c7cd88-cd4z5"
Jul 24 20:03:49.544954 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:49.544873    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e316a0-7bc5c7cd88-cd4z5" podStartSLOduration=1.544850254 podStartE2EDuration="1.544850254s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:03:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:03:49.541972156 +0000 UTC m=+2218.060592200" watchObservedRunningTime="2026-07-24 20:03:49.544850254 +0000 UTC m=+2218.063470296"
Jul 24 20:03:52.492001 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:52.491909    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-cff930-6b5f968c88-hzmjt"
Jul 24 20:03:52.492391 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:52.492075    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-cff930-6f86c455bb-9wdnc"
Jul 24 20:03:54.508648 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:54.508610    2567 patch_prober.go:28] interesting pod/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 24 20:03:54.509029 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:54.508673    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf" podUID="5252fc64-56da-4181-bc47-433233938943" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 24 20:03:55.561999 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:55.561967    2567 generic.go:356] "Generic (PLEG): container finished" podID="5252fc64-56da-4181-bc47-433233938943" containerID="249cba85202cb92e59f05d73771d77129729abc27447b91992204db049311d0b" exitCode=0
Jul 24 20:03:55.562438 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:55.562042    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf" event={"ID":"5252fc64-56da-4181-bc47-433233938943","Type":"ContainerDied","Data":"249cba85202cb92e59f05d73771d77129729abc27447b91992204db049311d0b"}
Jul 24 20:03:55.562438 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:55.562408    2567 scope.go:117] "RemoveContainer" containerID="249cba85202cb92e59f05d73771d77129729abc27447b91992204db049311d0b"
Jul 24 20:03:55.563403 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:55.563373    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 20:03:55.563534 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:55.563476    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 20:03:55.563606 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:55.563548    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 20:03:56.568898 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:56.568858    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf" event={"ID":"5252fc64-56da-4181-bc47-433233938943","Type":"ContainerStarted","Data":"d9f1fb8901d60b73aff85ac493d0bdb6e43d86f85773daf187fd62591ba92ebd"}
Jul 24 20:03:57.417798 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:57.417761    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf"
Jul 24 20:03:57.418005 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:57.417985    2567 patch_prober.go:28] interesting pod/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 24 20:03:57.418050 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:57.418032    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf" podUID="5252fc64-56da-4181-bc47-433233938943" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 24 20:03:58.417311 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:58.417277    2567 patch_prober.go:28] interesting pod/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 24 20:03:58.417690 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:58.417331    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf" podUID="5252fc64-56da-4181-bc47-433233938943" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 24 20:03:59.417683 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:59.417644    2567 patch_prober.go:28] interesting pod/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 24 20:03:59.418075 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:03:59.417704    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf" podUID="5252fc64-56da-4181-bc47-433233938943" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 24 20:04:00.417195 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:00.417160    2567 patch_prober.go:28] interesting pod/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 24 20:04:00.417381 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:00.417215    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf" podUID="5252fc64-56da-4181-bc47-433233938943" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 24 20:04:00.534206 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:00.534177    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e316a0-7bc5c7cd88-cd4z5"
Jul 24 20:04:01.421028 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:01.420996    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf"
Jul 24 20:04:01.421285 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:01.421263    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf"
Jul 24 20:04:01.421888 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:01.421869    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf"
Jul 24 20:04:15.672571 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:15.672461    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-cff930-6f86c455bb-9wdnc"]
Jul 24 20:04:15.672975 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:15.672746    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-cff930-6f86c455bb-9wdnc" podUID="723ae22b-ce8e-431a-8ab7-ce57a5bfaee3" containerName="payload-processing" containerID="cri-o://be632c1cdb8f9611590475f170ab59d313ba17eaa5789e4bc1324e8d2d973cd2" gracePeriod=30
Jul 24 20:04:15.679727 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:15.678182    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-cff930-6b5f968c88-hzmjt"]
Jul 24 20:04:15.679727 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:15.678421    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-cff930-6b5f968c88-hzmjt" podUID="5397411a-a079-4e4d-9786-e920a111ceb9" containerName="payload-pre-processing" containerID="cri-o://343c8fd82e0caa045930b725e1213ecb52df114014e5fd8c7a5c5f5885223982" gracePeriod=30
Jul 24 20:04:15.945466 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:15.945440    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-cff930-6f86c455bb-9wdnc"
Jul 24 20:04:15.967721 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:15.967694    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-cff930-6b5f968c88-hzmjt"
Jul 24 20:04:16.020692 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:16.020660    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5397411a-a079-4e4d-9786-e920a111ceb9-plugins-config-volume\") pod \"5397411a-a079-4e4d-9786-e920a111ceb9\" (UID: \"5397411a-a079-4e4d-9786-e920a111ceb9\") "
Jul 24 20:04:16.020692 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:16.020696    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/723ae22b-ce8e-431a-8ab7-ce57a5bfaee3-plugins-config-volume\") pod \"723ae22b-ce8e-431a-8ab7-ce57a5bfaee3\" (UID: \"723ae22b-ce8e-431a-8ab7-ce57a5bfaee3\") "
Jul 24 20:04:16.020962 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:16.020724    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2sdjb\" (UniqueName: \"kubernetes.io/projected/723ae22b-ce8e-431a-8ab7-ce57a5bfaee3-kube-api-access-2sdjb\") pod \"723ae22b-ce8e-431a-8ab7-ce57a5bfaee3\" (UID: \"723ae22b-ce8e-431a-8ab7-ce57a5bfaee3\") "
Jul 24 20:04:16.021081 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:16.021056    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/723ae22b-ce8e-431a-8ab7-ce57a5bfaee3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "723ae22b-ce8e-431a-8ab7-ce57a5bfaee3" (UID: "723ae22b-ce8e-431a-8ab7-ce57a5bfaee3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:04:16.021081 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:16.021066    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5397411a-a079-4e4d-9786-e920a111ceb9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5397411a-a079-4e4d-9786-e920a111ceb9" (UID: "5397411a-a079-4e4d-9786-e920a111ceb9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:04:16.023028 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:16.022992    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/723ae22b-ce8e-431a-8ab7-ce57a5bfaee3-kube-api-access-2sdjb" (OuterVolumeSpecName: "kube-api-access-2sdjb") pod "723ae22b-ce8e-431a-8ab7-ce57a5bfaee3" (UID: "723ae22b-ce8e-431a-8ab7-ce57a5bfaee3"). InnerVolumeSpecName "kube-api-access-2sdjb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:04:16.121751 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:16.121719    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-st2ss\" (UniqueName: \"kubernetes.io/projected/5397411a-a079-4e4d-9786-e920a111ceb9-kube-api-access-st2ss\") pod \"5397411a-a079-4e4d-9786-e920a111ceb9\" (UID: \"5397411a-a079-4e4d-9786-e920a111ceb9\") "
Jul 24 20:04:16.121959 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:16.121946    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5397411a-a079-4e4d-9786-e920a111ceb9-plugins-config-volume\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:04:16.122013 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:16.121963    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/723ae22b-ce8e-431a-8ab7-ce57a5bfaee3-plugins-config-volume\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:04:16.122013 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:16.121973    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2sdjb\" (UniqueName: \"kubernetes.io/projected/723ae22b-ce8e-431a-8ab7-ce57a5bfaee3-kube-api-access-2sdjb\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:04:16.123936 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:16.123912    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5397411a-a079-4e4d-9786-e920a111ceb9-kube-api-access-st2ss" (OuterVolumeSpecName: "kube-api-access-st2ss") pod "5397411a-a079-4e4d-9786-e920a111ceb9" (UID: "5397411a-a079-4e4d-9786-e920a111ceb9"). InnerVolumeSpecName "kube-api-access-st2ss". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:04:16.222683 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:16.222594    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-st2ss\" (UniqueName: \"kubernetes.io/projected/5397411a-a079-4e4d-9786-e920a111ceb9-kube-api-access-st2ss\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:04:16.672775 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:16.672736    2567 generic.go:356] "Generic (PLEG): container finished" podID="723ae22b-ce8e-431a-8ab7-ce57a5bfaee3" containerID="be632c1cdb8f9611590475f170ab59d313ba17eaa5789e4bc1324e8d2d973cd2" exitCode=0
Jul 24 20:04:16.673287 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:16.672811    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-cff930-6f86c455bb-9wdnc"
Jul 24 20:04:16.673287 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:16.672839    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-cff930-6f86c455bb-9wdnc" event={"ID":"723ae22b-ce8e-431a-8ab7-ce57a5bfaee3","Type":"ContainerDied","Data":"be632c1cdb8f9611590475f170ab59d313ba17eaa5789e4bc1324e8d2d973cd2"}
Jul 24 20:04:16.673287 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:16.672945    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-cff930-6f86c455bb-9wdnc" event={"ID":"723ae22b-ce8e-431a-8ab7-ce57a5bfaee3","Type":"ContainerDied","Data":"866fbad78b5d9072b9f9781c00bb96d45557e39510e55a30ad8a9e99a79db694"}
Jul 24 20:04:16.673287 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:16.672977    2567 scope.go:117] "RemoveContainer" containerID="be632c1cdb8f9611590475f170ab59d313ba17eaa5789e4bc1324e8d2d973cd2"
Jul 24 20:04:16.674407 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:16.674355    2567 generic.go:356] "Generic (PLEG): container finished" podID="5397411a-a079-4e4d-9786-e920a111ceb9" containerID="343c8fd82e0caa045930b725e1213ecb52df114014e5fd8c7a5c5f5885223982" exitCode=0
Jul 24 20:04:16.674521 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:16.674409    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-cff930-6b5f968c88-hzmjt" event={"ID":"5397411a-a079-4e4d-9786-e920a111ceb9","Type":"ContainerDied","Data":"343c8fd82e0caa045930b725e1213ecb52df114014e5fd8c7a5c5f5885223982"}
Jul 24 20:04:16.674521 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:16.674459    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-cff930-6b5f968c88-hzmjt" event={"ID":"5397411a-a079-4e4d-9786-e920a111ceb9","Type":"ContainerDied","Data":"6fd3f85c551f58abced701546b3e9076da52943acca768e28a36b940f04aa0c4"}
Jul 24 20:04:16.674521 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:16.674412    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-cff930-6b5f968c88-hzmjt"
Jul 24 20:04:16.683226 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:16.683206    2567 scope.go:117] "RemoveContainer" containerID="be632c1cdb8f9611590475f170ab59d313ba17eaa5789e4bc1324e8d2d973cd2"
Jul 24 20:04:16.683648 ip-10-0-133-84 kubenswrapper[2567]: E0724 20:04:16.683627    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be632c1cdb8f9611590475f170ab59d313ba17eaa5789e4bc1324e8d2d973cd2\": container with ID starting with be632c1cdb8f9611590475f170ab59d313ba17eaa5789e4bc1324e8d2d973cd2 not found: ID does not exist" containerID="be632c1cdb8f9611590475f170ab59d313ba17eaa5789e4bc1324e8d2d973cd2"
Jul 24 20:04:16.683763 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:16.683658    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be632c1cdb8f9611590475f170ab59d313ba17eaa5789e4bc1324e8d2d973cd2"} err="failed to get container status \"be632c1cdb8f9611590475f170ab59d313ba17eaa5789e4bc1324e8d2d973cd2\": rpc error: code = NotFound desc = could not find container \"be632c1cdb8f9611590475f170ab59d313ba17eaa5789e4bc1324e8d2d973cd2\": container with ID starting with be632c1cdb8f9611590475f170ab59d313ba17eaa5789e4bc1324e8d2d973cd2 not found: ID does not exist"
Jul 24 20:04:16.683763 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:16.683680    2567 scope.go:117] "RemoveContainer" containerID="343c8fd82e0caa045930b725e1213ecb52df114014e5fd8c7a5c5f5885223982"
Jul 24 20:04:16.690128 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:16.690102    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-cff930-6f86c455bb-9wdnc"]
Jul 24 20:04:16.692013 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:16.691991    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-cff930-6f86c455bb-9wdnc"]
Jul 24 20:04:16.697891 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:16.697873    2567 scope.go:117] "RemoveContainer" containerID="343c8fd82e0caa045930b725e1213ecb52df114014e5fd8c7a5c5f5885223982"
Jul 24 20:04:16.698204 ip-10-0-133-84 kubenswrapper[2567]: E0724 20:04:16.698186    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"343c8fd82e0caa045930b725e1213ecb52df114014e5fd8c7a5c5f5885223982\": container with ID starting with 343c8fd82e0caa045930b725e1213ecb52df114014e5fd8c7a5c5f5885223982 not found: ID does not exist" containerID="343c8fd82e0caa045930b725e1213ecb52df114014e5fd8c7a5c5f5885223982"
Jul 24 20:04:16.698284 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:16.698212    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"343c8fd82e0caa045930b725e1213ecb52df114014e5fd8c7a5c5f5885223982"} err="failed to get container status \"343c8fd82e0caa045930b725e1213ecb52df114014e5fd8c7a5c5f5885223982\": rpc error: code = NotFound desc = could not find container \"343c8fd82e0caa045930b725e1213ecb52df114014e5fd8c7a5c5f5885223982\": container with ID starting with 343c8fd82e0caa045930b725e1213ecb52df114014e5fd8c7a5c5f5885223982 not found: ID does not exist"
Jul 24 20:04:16.706397 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:16.706372    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-cff930-6b5f968c88-hzmjt"]
Jul 24 20:04:16.713607 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:16.713580    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-cff930-6b5f968c88-hzmjt"]
Jul 24 20:04:18.071426 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:18.071392    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5397411a-a079-4e4d-9786-e920a111ceb9" path="/var/lib/kubelet/pods/5397411a-a079-4e4d-9786-e920a111ceb9/volumes"
Jul 24 20:04:18.071816 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:18.071769    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="723ae22b-ce8e-431a-8ab7-ce57a5bfaee3" path="/var/lib/kubelet/pods/723ae22b-ce8e-431a-8ab7-ce57a5bfaee3/volumes"
Jul 24 20:04:26.765198 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:26.765163    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf"]
Jul 24 20:04:26.765864 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:26.765454    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf" podUID="5252fc64-56da-4181-bc47-433233938943" containerName="istio-proxy" containerID="cri-o://d9f1fb8901d60b73aff85ac493d0bdb6e43d86f85773daf187fd62591ba92ebd" gracePeriod=30
Jul 24 20:04:31.423589 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:31.423541    2567 patch_prober.go:28] interesting pod/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 20:04:31.424041 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:31.423611    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf" podUID="5252fc64-56da-4181-bc47-433233938943" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 20:04:32.022324 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:32.022297    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf"
Jul 24 20:04:32.052228 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:32.052147    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5252fc64-56da-4181-bc47-433233938943-istio-data\") pod \"5252fc64-56da-4181-bc47-433233938943\" (UID: \"5252fc64-56da-4181-bc47-433233938943\") "
Jul 24 20:04:32.052228 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:32.052189    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5252fc64-56da-4181-bc47-433233938943-istio-token\") pod \"5252fc64-56da-4181-bc47-433233938943\" (UID: \"5252fc64-56da-4181-bc47-433233938943\") "
Jul 24 20:04:32.052228 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:32.052217    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5252fc64-56da-4181-bc47-433233938943-istiod-ca-cert\") pod \"5252fc64-56da-4181-bc47-433233938943\" (UID: \"5252fc64-56da-4181-bc47-433233938943\") "
Jul 24 20:04:32.052551 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:32.052243    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5252fc64-56da-4181-bc47-433233938943-istio-envoy\") pod \"5252fc64-56da-4181-bc47-433233938943\" (UID: \"5252fc64-56da-4181-bc47-433233938943\") "
Jul 24 20:04:32.052551 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:32.052317    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5252fc64-56da-4181-bc47-433233938943-istio-podinfo\") pod \"5252fc64-56da-4181-bc47-433233938943\" (UID: \"5252fc64-56da-4181-bc47-433233938943\") "
Jul 24 20:04:32.052551 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:32.052339    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5252fc64-56da-4181-bc47-433233938943-credential-socket\") pod \"5252fc64-56da-4181-bc47-433233938943\" (UID: \"5252fc64-56da-4181-bc47-433233938943\") "
Jul 24 20:04:32.052551 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:32.052383    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5252fc64-56da-4181-bc47-433233938943-workload-certs\") pod \"5252fc64-56da-4181-bc47-433233938943\" (UID: \"5252fc64-56da-4181-bc47-433233938943\") "
Jul 24 20:04:32.052551 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:32.052432    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5252fc64-56da-4181-bc47-433233938943-workload-socket\") pod \"5252fc64-56da-4181-bc47-433233938943\" (UID: \"5252fc64-56da-4181-bc47-433233938943\") "
Jul 24 20:04:32.052551 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:32.052459    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8hm45\" (UniqueName: \"kubernetes.io/projected/5252fc64-56da-4181-bc47-433233938943-kube-api-access-8hm45\") pod \"5252fc64-56da-4181-bc47-433233938943\" (UID: \"5252fc64-56da-4181-bc47-433233938943\") "
Jul 24 20:04:32.052878 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:32.052806    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5252fc64-56da-4181-bc47-433233938943-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5252fc64-56da-4181-bc47-433233938943" (UID: "5252fc64-56da-4181-bc47-433233938943"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:04:32.052878 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:32.052827    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5252fc64-56da-4181-bc47-433233938943-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5252fc64-56da-4181-bc47-433233938943" (UID: "5252fc64-56da-4181-bc47-433233938943"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:04:32.053097 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:32.053019    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5252fc64-56da-4181-bc47-433233938943-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5252fc64-56da-4181-bc47-433233938943" (UID: "5252fc64-56da-4181-bc47-433233938943"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:04:32.053097 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:32.053073    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5252fc64-56da-4181-bc47-433233938943-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5252fc64-56da-4181-bc47-433233938943" (UID: "5252fc64-56da-4181-bc47-433233938943"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:04:32.053452 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:32.053222    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5252fc64-56da-4181-bc47-433233938943-istio-data" (OuterVolumeSpecName: "istio-data") pod "5252fc64-56da-4181-bc47-433233938943" (UID: "5252fc64-56da-4181-bc47-433233938943"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:04:32.054756 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:32.054733    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5252fc64-56da-4181-bc47-433233938943-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5252fc64-56da-4181-bc47-433233938943" (UID: "5252fc64-56da-4181-bc47-433233938943"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 20:04:32.054880 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:32.054779    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5252fc64-56da-4181-bc47-433233938943-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5252fc64-56da-4181-bc47-433233938943" (UID: "5252fc64-56da-4181-bc47-433233938943"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:04:32.055225 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:32.055205    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5252fc64-56da-4181-bc47-433233938943-kube-api-access-8hm45" (OuterVolumeSpecName: "kube-api-access-8hm45") pod "5252fc64-56da-4181-bc47-433233938943" (UID: "5252fc64-56da-4181-bc47-433233938943"). InnerVolumeSpecName "kube-api-access-8hm45". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:04:32.055322 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:32.055223    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5252fc64-56da-4181-bc47-433233938943-istio-token" (OuterVolumeSpecName: "istio-token") pod "5252fc64-56da-4181-bc47-433233938943" (UID: "5252fc64-56da-4181-bc47-433233938943"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:04:32.153949 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:32.153909    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5252fc64-56da-4181-bc47-433233938943-istio-token\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:04:32.153949 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:32.153944    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5252fc64-56da-4181-bc47-433233938943-istiod-ca-cert\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:04:32.153949 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:32.153958    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5252fc64-56da-4181-bc47-433233938943-istio-envoy\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:04:32.154199 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:32.153971    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5252fc64-56da-4181-bc47-433233938943-istio-podinfo\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:04:32.154199 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:32.153982    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5252fc64-56da-4181-bc47-433233938943-credential-socket\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:04:32.154199 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:32.153994    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5252fc64-56da-4181-bc47-433233938943-workload-certs\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:04:32.154199 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:32.154005    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5252fc64-56da-4181-bc47-433233938943-workload-socket\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:04:32.154199 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:32.154017    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hm45\" (UniqueName: \"kubernetes.io/projected/5252fc64-56da-4181-bc47-433233938943-kube-api-access-8hm45\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:04:32.154199 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:32.154030    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5252fc64-56da-4181-bc47-433233938943-istio-data\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:04:32.756905 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:32.756866    2567 generic.go:356] "Generic (PLEG): container finished" podID="5252fc64-56da-4181-bc47-433233938943" containerID="d9f1fb8901d60b73aff85ac493d0bdb6e43d86f85773daf187fd62591ba92ebd" exitCode=0
Jul 24 20:04:32.757449 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:32.756915    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf"
Jul 24 20:04:32.757449 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:32.756954    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf" event={"ID":"5252fc64-56da-4181-bc47-433233938943","Type":"ContainerDied","Data":"d9f1fb8901d60b73aff85ac493d0bdb6e43d86f85773daf187fd62591ba92ebd"}
Jul 24 20:04:32.757449 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:32.757014    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf" event={"ID":"5252fc64-56da-4181-bc47-433233938943","Type":"ContainerDied","Data":"31bce4ec9f3d0ca26a39f9d458e2604704eed97396bcb4fab60f700562a2b9ae"}
Jul 24 20:04:32.757449 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:32.757038    2567 scope.go:117] "RemoveContainer" containerID="d9f1fb8901d60b73aff85ac493d0bdb6e43d86f85773daf187fd62591ba92ebd"
Jul 24 20:04:32.765682 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:32.765666    2567 scope.go:117] "RemoveContainer" containerID="249cba85202cb92e59f05d73771d77129729abc27447b91992204db049311d0b"
Jul 24 20:04:32.774559 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:32.774542    2567 scope.go:117] "RemoveContainer" containerID="d9f1fb8901d60b73aff85ac493d0bdb6e43d86f85773daf187fd62591ba92ebd"
Jul 24 20:04:32.774893 ip-10-0-133-84 kubenswrapper[2567]: E0724 20:04:32.774870    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9f1fb8901d60b73aff85ac493d0bdb6e43d86f85773daf187fd62591ba92ebd\": container with ID starting with d9f1fb8901d60b73aff85ac493d0bdb6e43d86f85773daf187fd62591ba92ebd not found: ID does not exist" containerID="d9f1fb8901d60b73aff85ac493d0bdb6e43d86f85773daf187fd62591ba92ebd"
Jul 24 20:04:32.774958 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:32.774904    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9f1fb8901d60b73aff85ac493d0bdb6e43d86f85773daf187fd62591ba92ebd"} err="failed to get container status \"d9f1fb8901d60b73aff85ac493d0bdb6e43d86f85773daf187fd62591ba92ebd\": rpc error: code = NotFound desc = could not find container \"d9f1fb8901d60b73aff85ac493d0bdb6e43d86f85773daf187fd62591ba92ebd\": container with ID starting with d9f1fb8901d60b73aff85ac493d0bdb6e43d86f85773daf187fd62591ba92ebd not found: ID does not exist"
Jul 24 20:04:32.774958 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:32.774922    2567 scope.go:117] "RemoveContainer" containerID="249cba85202cb92e59f05d73771d77129729abc27447b91992204db049311d0b"
Jul 24 20:04:32.775218 ip-10-0-133-84 kubenswrapper[2567]: E0724 20:04:32.775200    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"249cba85202cb92e59f05d73771d77129729abc27447b91992204db049311d0b\": container with ID starting with 249cba85202cb92e59f05d73771d77129729abc27447b91992204db049311d0b not found: ID does not exist" containerID="249cba85202cb92e59f05d73771d77129729abc27447b91992204db049311d0b"
Jul 24 20:04:32.775270 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:32.775225    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"249cba85202cb92e59f05d73771d77129729abc27447b91992204db049311d0b"} err="failed to get container status \"249cba85202cb92e59f05d73771d77129729abc27447b91992204db049311d0b\": rpc error: code = NotFound desc = could not find container \"249cba85202cb92e59f05d73771d77129729abc27447b91992204db049311d0b\": container with ID starting with 249cba85202cb92e59f05d73771d77129729abc27447b91992204db049311d0b not found: ID does not exist"
Jul 24 20:04:32.775309 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:32.775295    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf"]
Jul 24 20:04:32.779670 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:32.779646    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-cff930-openshift-default-8f8f8f69d-gq8lf"]
Jul 24 20:04:34.071885 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:34.071856    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5252fc64-56da-4181-bc47-433233938943" path="/var/lib/kubelet/pods/5252fc64-56da-4181-bc47-433233938943/volumes"
Jul 24 20:04:42.601911 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:42.601877    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-e316a0-7bc5c7cd88-cd4z5"]
Jul 24 20:04:42.602448 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:42.602204    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e316a0-7bc5c7cd88-cd4z5" podUID="8c2fda6a-41f4-4cf2-b6b0-357f53abc7b9" containerName="payload-pre-processing" containerID="cri-o://5e17328bc62f9f79d2354972dc9005609773a1c6a27b3bc11055823f910f156b" gracePeriod=30
Jul 24 20:04:42.805798 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:42.805763    2567 generic.go:356] "Generic (PLEG): container finished" podID="8c2fda6a-41f4-4cf2-b6b0-357f53abc7b9" containerID="5e17328bc62f9f79d2354972dc9005609773a1c6a27b3bc11055823f910f156b" exitCode=0
Jul 24 20:04:42.805949 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:42.805840    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e316a0-7bc5c7cd88-cd4z5" event={"ID":"8c2fda6a-41f4-4cf2-b6b0-357f53abc7b9","Type":"ContainerDied","Data":"5e17328bc62f9f79d2354972dc9005609773a1c6a27b3bc11055823f910f156b"}
Jul 24 20:04:42.849192 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:42.849169    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e316a0-7bc5c7cd88-cd4z5"
Jul 24 20:04:42.951768 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:42.951738    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b9qjg\" (UniqueName: \"kubernetes.io/projected/8c2fda6a-41f4-4cf2-b6b0-357f53abc7b9-kube-api-access-b9qjg\") pod \"8c2fda6a-41f4-4cf2-b6b0-357f53abc7b9\" (UID: \"8c2fda6a-41f4-4cf2-b6b0-357f53abc7b9\") "
Jul 24 20:04:42.951937 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:42.951841    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c2fda6a-41f4-4cf2-b6b0-357f53abc7b9-plugins-config-volume\") pod \"8c2fda6a-41f4-4cf2-b6b0-357f53abc7b9\" (UID: \"8c2fda6a-41f4-4cf2-b6b0-357f53abc7b9\") "
Jul 24 20:04:42.952211 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:42.952176    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c2fda6a-41f4-4cf2-b6b0-357f53abc7b9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8c2fda6a-41f4-4cf2-b6b0-357f53abc7b9" (UID: "8c2fda6a-41f4-4cf2-b6b0-357f53abc7b9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:04:42.953999 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:42.953982    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c2fda6a-41f4-4cf2-b6b0-357f53abc7b9-kube-api-access-b9qjg" (OuterVolumeSpecName: "kube-api-access-b9qjg") pod "8c2fda6a-41f4-4cf2-b6b0-357f53abc7b9" (UID: "8c2fda6a-41f4-4cf2-b6b0-357f53abc7b9"). InnerVolumeSpecName "kube-api-access-b9qjg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:04:43.053352 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:43.053315    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9qjg\" (UniqueName: \"kubernetes.io/projected/8c2fda6a-41f4-4cf2-b6b0-357f53abc7b9-kube-api-access-b9qjg\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:04:43.053352 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:43.053341    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c2fda6a-41f4-4cf2-b6b0-357f53abc7b9-plugins-config-volume\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:04:43.812432 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:43.812407    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e316a0-7bc5c7cd88-cd4z5"
Jul 24 20:04:43.812854 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:43.812402    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e316a0-7bc5c7cd88-cd4z5" event={"ID":"8c2fda6a-41f4-4cf2-b6b0-357f53abc7b9","Type":"ContainerDied","Data":"16cfb559c5188b3bc0f8c6a9e26c29e35029c8c54b251229c33fcbb23e6c4310"}
Jul 24 20:04:43.812854 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:43.812552    2567 scope.go:117] "RemoveContainer" containerID="5e17328bc62f9f79d2354972dc9005609773a1c6a27b3bc11055823f910f156b"
Jul 24 20:04:43.832698 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:43.832669    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-e316a0-7bc5c7cd88-cd4z5"]
Jul 24 20:04:43.836223 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:43.836200    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-e316a0-7bc5c7cd88-cd4z5"]
Jul 24 20:04:44.071781 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:44.071695    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c2fda6a-41f4-4cf2-b6b0-357f53abc7b9" path="/var/lib/kubelet/pods/8c2fda6a-41f4-4cf2-b6b0-357f53abc7b9/volumes"
Jul 24 20:04:54.604296 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:54.604261    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq"]
Jul 24 20:04:54.604698 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:54.604605    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5252fc64-56da-4181-bc47-433233938943" containerName="istio-proxy"
Jul 24 20:04:54.604698 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:54.604616    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5252fc64-56da-4181-bc47-433233938943" containerName="istio-proxy"
Jul 24 20:04:54.604698 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:54.604638    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5397411a-a079-4e4d-9786-e920a111ceb9" containerName="payload-pre-processing"
Jul 24 20:04:54.604698 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:54.604643    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5397411a-a079-4e4d-9786-e920a111ceb9" containerName="payload-pre-processing"
Jul 24 20:04:54.604698 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:54.604652    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c2fda6a-41f4-4cf2-b6b0-357f53abc7b9" containerName="payload-pre-processing"
Jul 24 20:04:54.604698 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:54.604658    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c2fda6a-41f4-4cf2-b6b0-357f53abc7b9" containerName="payload-pre-processing"
Jul 24 20:04:54.604698 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:54.604664    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5252fc64-56da-4181-bc47-433233938943" containerName="istio-proxy"
Jul 24 20:04:54.604698 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:54.604669    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5252fc64-56da-4181-bc47-433233938943" containerName="istio-proxy"
Jul 24 20:04:54.604698 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:54.604675    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="723ae22b-ce8e-431a-8ab7-ce57a5bfaee3" containerName="payload-processing"
Jul 24 20:04:54.604698 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:54.604680    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="723ae22b-ce8e-431a-8ab7-ce57a5bfaee3" containerName="payload-processing"
Jul 24 20:04:54.605055 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:54.604730    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c2fda6a-41f4-4cf2-b6b0-357f53abc7b9" containerName="payload-pre-processing"
Jul 24 20:04:54.605055 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:54.604740    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="5252fc64-56da-4181-bc47-433233938943" containerName="istio-proxy"
Jul 24 20:04:54.605055 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:54.604746    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="5397411a-a079-4e4d-9786-e920a111ceb9" containerName="payload-pre-processing"
Jul 24 20:04:54.605055 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:54.604753    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="723ae22b-ce8e-431a-8ab7-ce57a5bfaee3" containerName="payload-processing"
Jul 24 20:04:54.609403 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:54.609383    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq"
Jul 24 20:04:54.611958 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:54.611927    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-8abb86-openshift-default-dockercfg-x5t6f\""
Jul 24 20:04:54.612101 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:54.611959    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 24 20:04:54.619338 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:54.619313    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq"]
Jul 24 20:04:54.764227 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:54.764189    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9214ccf1-343c-4837-85e6-8fa646722e2c-istio-token\") pod \"e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq\" (UID: \"9214ccf1-343c-4837-85e6-8fa646722e2c\") " pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq"
Jul 24 20:04:54.764227 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:54.764224    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk66w\" (UniqueName: \"kubernetes.io/projected/9214ccf1-343c-4837-85e6-8fa646722e2c-kube-api-access-hk66w\") pod \"e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq\" (UID: \"9214ccf1-343c-4837-85e6-8fa646722e2c\") " pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq"
Jul 24 20:04:54.764426 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:54.764256    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9214ccf1-343c-4837-85e6-8fa646722e2c-workload-socket\") pod \"e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq\" (UID: \"9214ccf1-343c-4837-85e6-8fa646722e2c\") " pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq"
Jul 24 20:04:54.764426 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:54.764359    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9214ccf1-343c-4837-85e6-8fa646722e2c-istio-envoy\") pod \"e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq\" (UID: \"9214ccf1-343c-4837-85e6-8fa646722e2c\") " pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq"
Jul 24 20:04:54.764426 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:54.764383    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9214ccf1-343c-4837-85e6-8fa646722e2c-istio-data\") pod \"e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq\" (UID: \"9214ccf1-343c-4837-85e6-8fa646722e2c\") " pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq"
Jul 24 20:04:54.764426 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:54.764400    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9214ccf1-343c-4837-85e6-8fa646722e2c-istio-podinfo\") pod \"e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq\" (UID: \"9214ccf1-343c-4837-85e6-8fa646722e2c\") " pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq"
Jul 24 20:04:54.764587 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:54.764426    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9214ccf1-343c-4837-85e6-8fa646722e2c-istiod-ca-cert\") pod \"e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq\" (UID: \"9214ccf1-343c-4837-85e6-8fa646722e2c\") " pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq"
Jul 24 20:04:54.764587 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:54.764509    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9214ccf1-343c-4837-85e6-8fa646722e2c-credential-socket\") pod \"e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq\" (UID: \"9214ccf1-343c-4837-85e6-8fa646722e2c\") " pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq"
Jul 24 20:04:54.764587 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:54.764548    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9214ccf1-343c-4837-85e6-8fa646722e2c-workload-certs\") pod \"e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq\" (UID: \"9214ccf1-343c-4837-85e6-8fa646722e2c\") " pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq"
Jul 24 20:04:54.865708 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:54.865678    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9214ccf1-343c-4837-85e6-8fa646722e2c-istio-envoy\") pod \"e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq\" (UID: \"9214ccf1-343c-4837-85e6-8fa646722e2c\") " pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq"
Jul 24 20:04:54.865913 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:54.865718    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9214ccf1-343c-4837-85e6-8fa646722e2c-istio-data\") pod \"e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq\" (UID: \"9214ccf1-343c-4837-85e6-8fa646722e2c\") " pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq"
Jul 24 20:04:54.865913 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:54.865743    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9214ccf1-343c-4837-85e6-8fa646722e2c-istio-podinfo\") pod \"e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq\" (UID: \"9214ccf1-343c-4837-85e6-8fa646722e2c\") " pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq"
Jul 24 20:04:54.865913 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:54.865772    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9214ccf1-343c-4837-85e6-8fa646722e2c-istiod-ca-cert\") pod \"e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq\" (UID: \"9214ccf1-343c-4837-85e6-8fa646722e2c\") " pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq"
Jul 24 20:04:54.865913 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:54.865801    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9214ccf1-343c-4837-85e6-8fa646722e2c-credential-socket\") pod \"e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq\" (UID: \"9214ccf1-343c-4837-85e6-8fa646722e2c\") " pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq"
Jul 24 20:04:54.865913 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:54.865830    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9214ccf1-343c-4837-85e6-8fa646722e2c-workload-certs\") pod \"e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq\" (UID: \"9214ccf1-343c-4837-85e6-8fa646722e2c\") " pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq"
Jul 24 20:04:54.865913 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:54.865862    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9214ccf1-343c-4837-85e6-8fa646722e2c-istio-token\") pod \"e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq\" (UID: \"9214ccf1-343c-4837-85e6-8fa646722e2c\") " pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq"
Jul 24 20:04:54.865913 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:54.865886    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk66w\" (UniqueName: \"kubernetes.io/projected/9214ccf1-343c-4837-85e6-8fa646722e2c-kube-api-access-hk66w\") pod \"e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq\" (UID: \"9214ccf1-343c-4837-85e6-8fa646722e2c\") " pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq"
Jul 24 20:04:54.866280 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:54.865933    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9214ccf1-343c-4837-85e6-8fa646722e2c-workload-socket\") pod \"e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq\" (UID: \"9214ccf1-343c-4837-85e6-8fa646722e2c\") " pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq"
Jul 24 20:04:54.866280 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:54.866197    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9214ccf1-343c-4837-85e6-8fa646722e2c-credential-socket\") pod \"e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq\" (UID: \"9214ccf1-343c-4837-85e6-8fa646722e2c\") " pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq"
Jul 24 20:04:54.866386 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:54.866334    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9214ccf1-343c-4837-85e6-8fa646722e2c-workload-socket\") pod \"e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq\" (UID: \"9214ccf1-343c-4837-85e6-8fa646722e2c\") " pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq"
Jul 24 20:04:54.866386 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:54.866369    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9214ccf1-343c-4837-85e6-8fa646722e2c-workload-certs\") pod \"e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq\" (UID: \"9214ccf1-343c-4837-85e6-8fa646722e2c\") " pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq"
Jul 24 20:04:54.866476 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:54.866409    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9214ccf1-343c-4837-85e6-8fa646722e2c-istio-data\") pod \"e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq\" (UID: \"9214ccf1-343c-4837-85e6-8fa646722e2c\") " pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq"
Jul 24 20:04:54.866770 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:54.866753    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9214ccf1-343c-4837-85e6-8fa646722e2c-istiod-ca-cert\") pod \"e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq\" (UID: \"9214ccf1-343c-4837-85e6-8fa646722e2c\") " pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq"
Jul 24 20:04:54.868602 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:54.868581    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9214ccf1-343c-4837-85e6-8fa646722e2c-istio-envoy\") pod \"e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq\" (UID: \"9214ccf1-343c-4837-85e6-8fa646722e2c\") " pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq"
Jul 24 20:04:54.868888 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:54.868870    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9214ccf1-343c-4837-85e6-8fa646722e2c-istio-podinfo\") pod \"e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq\" (UID: \"9214ccf1-343c-4837-85e6-8fa646722e2c\") " pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq"
Jul 24 20:04:54.873845 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:54.873819    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk66w\" (UniqueName: \"kubernetes.io/projected/9214ccf1-343c-4837-85e6-8fa646722e2c-kube-api-access-hk66w\") pod \"e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq\" (UID: \"9214ccf1-343c-4837-85e6-8fa646722e2c\") " pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq"
Jul 24 20:04:54.873981 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:54.873964    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9214ccf1-343c-4837-85e6-8fa646722e2c-istio-token\") pod \"e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq\" (UID: \"9214ccf1-343c-4837-85e6-8fa646722e2c\") " pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq"
Jul 24 20:04:54.920744 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:54.920716    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq"
Jul 24 20:04:55.089077 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:55.088950    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq"]
Jul 24 20:04:55.091888 ip-10-0-133-84 kubenswrapper[2567]: W0724 20:04:55.091859    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9214ccf1_343c_4837_85e6_8fa646722e2c.slice/crio-04f135bccc26d89a388b5981d8c6f6e6323582c55627cf3aa403072a5377e535 WatchSource:0}: Error finding container 04f135bccc26d89a388b5981d8c6f6e6323582c55627cf3aa403072a5377e535: Status 404 returned error can't find the container with id 04f135bccc26d89a388b5981d8c6f6e6323582c55627cf3aa403072a5377e535
Jul 24 20:04:55.093928 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:55.093898    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 20:04:55.094022 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:55.093959    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 20:04:55.094022 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:55.093988    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 20:04:55.869292 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:55.869256    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq" event={"ID":"9214ccf1-343c-4837-85e6-8fa646722e2c","Type":"ContainerStarted","Data":"639b60c946fefb2ae4ccd2df66824298b7a8ceabfbabcd771805f11c2878252f"}
Jul 24 20:04:55.869710 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:55.869336    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq" event={"ID":"9214ccf1-343c-4837-85e6-8fa646722e2c","Type":"ContainerStarted","Data":"04f135bccc26d89a388b5981d8c6f6e6323582c55627cf3aa403072a5377e535"}
Jul 24 20:04:55.889978 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:55.889926    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq" podStartSLOduration=1.8899093919999999 podStartE2EDuration="1.889909392s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:04:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:04:55.887715166 +0000 UTC m=+2284.406335223" watchObservedRunningTime="2026-07-24 20:04:55.889909392 +0000 UTC m=+2284.408529493"
Jul 24 20:04:55.921774 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:55.921735    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq"
Jul 24 20:04:56.926215 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:56.926186    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq"
Jul 24 20:04:57.879816 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:57.879780    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq"
Jul 24 20:04:57.880914 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:57.880889    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq"
Jul 24 20:04:58.638145 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:58.638114    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-8abb86-5b8d99466d-nglkh"]
Jul 24 20:04:58.638630 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:58.638556    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="5252fc64-56da-4181-bc47-433233938943" containerName="istio-proxy"
Jul 24 20:04:58.641872 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:58.641852    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-8abb86-5b8d99466d-nglkh"
Jul 24 20:04:58.644421 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:58.644398    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-8abb86\""
Jul 24 20:04:58.644421 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:58.644420    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-8abb86-dockercfg-8jxrc\""
Jul 24 20:04:58.652825 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:58.652803    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-8abb86-5b8d99466d-nglkh"]
Jul 24 20:04:58.684767 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:58.684738    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-8abb86-644fcbcf66-gxgpt"]
Jul 24 20:04:58.688104 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:58.688078    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-8abb86-644fcbcf66-gxgpt"
Jul 24 20:04:58.698476 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:58.698454    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-8abb86-644fcbcf66-gxgpt"]
Jul 24 20:04:58.801056 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:58.801017    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/451b8933-4bb9-4295-ad1f-8c31ecfba634-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-8abb86-644fcbcf66-gxgpt\" (UID: \"451b8933-4bb9-4295-ad1f-8c31ecfba634\") " pod="openshift-ingress/payload-processing-e2e-shared-a-8abb86-644fcbcf66-gxgpt"
Jul 24 20:04:58.801056 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:58.801065    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g468p\" (UniqueName: \"kubernetes.io/projected/451b8933-4bb9-4295-ad1f-8c31ecfba634-kube-api-access-g468p\") pod \"payload-processing-e2e-shared-a-8abb86-644fcbcf66-gxgpt\" (UID: \"451b8933-4bb9-4295-ad1f-8c31ecfba634\") " pod="openshift-ingress/payload-processing-e2e-shared-a-8abb86-644fcbcf66-gxgpt"
Jul 24 20:04:58.801313 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:58.801098    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrbjx\" (UniqueName: \"kubernetes.io/projected/69095654-3535-447c-b554-7fd6feadff1a-kube-api-access-qrbjx\") pod \"payload-pre-processing-e2e-shared-a-8abb86-5b8d99466d-nglkh\" (UID: \"69095654-3535-447c-b554-7fd6feadff1a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-8abb86-5b8d99466d-nglkh"
Jul 24 20:04:58.801313 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:58.801141    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/69095654-3535-447c-b554-7fd6feadff1a-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-8abb86-5b8d99466d-nglkh\" (UID: \"69095654-3535-447c-b554-7fd6feadff1a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-8abb86-5b8d99466d-nglkh"
Jul 24 20:04:58.902159 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:58.902075    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/451b8933-4bb9-4295-ad1f-8c31ecfba634-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-8abb86-644fcbcf66-gxgpt\" (UID: \"451b8933-4bb9-4295-ad1f-8c31ecfba634\") " pod="openshift-ingress/payload-processing-e2e-shared-a-8abb86-644fcbcf66-gxgpt"
Jul 24 20:04:58.902159 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:58.902109    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g468p\" (UniqueName: \"kubernetes.io/projected/451b8933-4bb9-4295-ad1f-8c31ecfba634-kube-api-access-g468p\") pod \"payload-processing-e2e-shared-a-8abb86-644fcbcf66-gxgpt\" (UID: \"451b8933-4bb9-4295-ad1f-8c31ecfba634\") " pod="openshift-ingress/payload-processing-e2e-shared-a-8abb86-644fcbcf66-gxgpt"
Jul 24 20:04:58.902159 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:58.902134    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrbjx\" (UniqueName: \"kubernetes.io/projected/69095654-3535-447c-b554-7fd6feadff1a-kube-api-access-qrbjx\") pod \"payload-pre-processing-e2e-shared-a-8abb86-5b8d99466d-nglkh\" (UID: \"69095654-3535-447c-b554-7fd6feadff1a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-8abb86-5b8d99466d-nglkh"
Jul 24 20:04:58.902440 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:58.902269    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/69095654-3535-447c-b554-7fd6feadff1a-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-8abb86-5b8d99466d-nglkh\" (UID: \"69095654-3535-447c-b554-7fd6feadff1a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-8abb86-5b8d99466d-nglkh"
Jul 24 20:04:58.902853 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:58.902835    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/451b8933-4bb9-4295-ad1f-8c31ecfba634-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-8abb86-644fcbcf66-gxgpt\" (UID: \"451b8933-4bb9-4295-ad1f-8c31ecfba634\") " pod="openshift-ingress/payload-processing-e2e-shared-a-8abb86-644fcbcf66-gxgpt"
Jul 24 20:04:58.903024 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:58.903004    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/69095654-3535-447c-b554-7fd6feadff1a-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-8abb86-5b8d99466d-nglkh\" (UID: \"69095654-3535-447c-b554-7fd6feadff1a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-8abb86-5b8d99466d-nglkh"
Jul 24 20:04:58.913426 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:58.913400    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrbjx\" (UniqueName: \"kubernetes.io/projected/69095654-3535-447c-b554-7fd6feadff1a-kube-api-access-qrbjx\") pod \"payload-pre-processing-e2e-shared-a-8abb86-5b8d99466d-nglkh\" (UID: \"69095654-3535-447c-b554-7fd6feadff1a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-8abb86-5b8d99466d-nglkh"
Jul 24 20:04:58.913426 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:58.913415    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g468p\" (UniqueName: \"kubernetes.io/projected/451b8933-4bb9-4295-ad1f-8c31ecfba634-kube-api-access-g468p\") pod \"payload-processing-e2e-shared-a-8abb86-644fcbcf66-gxgpt\" (UID: \"451b8933-4bb9-4295-ad1f-8c31ecfba634\") " pod="openshift-ingress/payload-processing-e2e-shared-a-8abb86-644fcbcf66-gxgpt"
Jul 24 20:04:58.953585 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:58.953553    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-8abb86-5b8d99466d-nglkh"
Jul 24 20:04:58.998592 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:58.998554    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-8abb86-644fcbcf66-gxgpt"
Jul 24 20:04:59.104409 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:59.104260    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-8abb86-5b8d99466d-nglkh"]
Jul 24 20:04:59.106801 ip-10-0-133-84 kubenswrapper[2567]: W0724 20:04:59.106772    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69095654_3535_447c_b554_7fd6feadff1a.slice/crio-a9ebb92c943eecb219aa788865a1caad21864c760c93a09984855f19fb37d65c WatchSource:0}: Error finding container a9ebb92c943eecb219aa788865a1caad21864c760c93a09984855f19fb37d65c: Status 404 returned error can't find the container with id a9ebb92c943eecb219aa788865a1caad21864c760c93a09984855f19fb37d65c
Jul 24 20:04:59.149189 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:59.149167    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-8abb86-644fcbcf66-gxgpt"]
Jul 24 20:04:59.151516 ip-10-0-133-84 kubenswrapper[2567]: W0724 20:04:59.151464    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod451b8933_4bb9_4295_ad1f_8c31ecfba634.slice/crio-3cbfae0f4d951a5ac9b333be5af05b217ded887007949d35ae8bc6734b3db76e WatchSource:0}: Error finding container 3cbfae0f4d951a5ac9b333be5af05b217ded887007949d35ae8bc6734b3db76e: Status 404 returned error can't find the container with id 3cbfae0f4d951a5ac9b333be5af05b217ded887007949d35ae8bc6734b3db76e
Jul 24 20:04:59.889342 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:59.889300    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-8abb86-5b8d99466d-nglkh" event={"ID":"69095654-3535-447c-b554-7fd6feadff1a","Type":"ContainerStarted","Data":"f77f4ea3d2a73ee20c6e520156c614ef2902ff90cbf7a7bab6facb2816404325"}
Jul 24 20:04:59.889843 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:59.889508    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-8abb86-5b8d99466d-nglkh"
Jul 24 20:04:59.889843 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:59.889559    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-8abb86-5b8d99466d-nglkh" event={"ID":"69095654-3535-447c-b554-7fd6feadff1a","Type":"ContainerStarted","Data":"a9ebb92c943eecb219aa788865a1caad21864c760c93a09984855f19fb37d65c"}
Jul 24 20:04:59.890783 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:59.890759    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-8abb86-644fcbcf66-gxgpt" event={"ID":"451b8933-4bb9-4295-ad1f-8c31ecfba634","Type":"ContainerStarted","Data":"fb05b0c10425ef94b9ccec70259807e2f4cbef4276c878667de582904762a6a4"}
Jul 24 20:04:59.890893 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:59.890804    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-8abb86-644fcbcf66-gxgpt" event={"ID":"451b8933-4bb9-4295-ad1f-8c31ecfba634","Type":"ContainerStarted","Data":"3cbfae0f4d951a5ac9b333be5af05b217ded887007949d35ae8bc6734b3db76e"}
Jul 24 20:04:59.891022 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:59.891004    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-8abb86-644fcbcf66-gxgpt"
Jul 24 20:04:59.906118 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:59.906058    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-8abb86-5b8d99466d-nglkh" podStartSLOduration=1.9060433730000002 podStartE2EDuration="1.906043373s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:04:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:04:59.90444889 +0000 UTC m=+2288.423068958" watchObservedRunningTime="2026-07-24 20:04:59.906043373 +0000 UTC m=+2288.424663415"
Jul 24 20:04:59.920832 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:04:59.920781    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-8abb86-644fcbcf66-gxgpt" podStartSLOduration=1.9207671720000001 podStartE2EDuration="1.920767172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:04:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:04:59.919421464 +0000 UTC m=+2288.438041506" watchObservedRunningTime="2026-07-24 20:04:59.920767172 +0000 UTC m=+2288.439387212"
Jul 24 20:05:07.582390 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:07.582352    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-3e15b4-64796bcfb4-xjgdv"]
Jul 24 20:05:07.586060 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:07.586041    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3e15b4-64796bcfb4-xjgdv"
Jul 24 20:05:07.588398 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:07.588378    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-3e15b4\""
Jul 24 20:05:07.595875 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:07.595848    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-3e15b4-64796bcfb4-xjgdv"]
Jul 24 20:05:07.601381 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:07.601359    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-3e15b4-867bf66c4b-7gbpd"]
Jul 24 20:05:07.604905 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:07.604884    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-3e15b4-867bf66c4b-7gbpd"
Jul 24 20:05:07.607915 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:07.607847    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-3e15b4-dockercfg-s7dwz\""
Jul 24 20:05:07.615762 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:07.615740    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-3e15b4-867bf66c4b-7gbpd"]
Jul 24 20:05:07.686751 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:07.686721    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62263dbb-2ed0-4556-90af-152655d45374-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-3e15b4-64796bcfb4-xjgdv\" (UID: \"62263dbb-2ed0-4556-90af-152655d45374\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3e15b4-64796bcfb4-xjgdv"
Jul 24 20:05:07.686921 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:07.686776    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jb67\" (UniqueName: \"kubernetes.io/projected/62263dbb-2ed0-4556-90af-152655d45374-kube-api-access-8jb67\") pod \"payload-pre-processing-e2e-shared-b-3e15b4-64796bcfb4-xjgdv\" (UID: \"62263dbb-2ed0-4556-90af-152655d45374\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3e15b4-64796bcfb4-xjgdv"
Jul 24 20:05:07.787888 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:07.787845    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4bc146ff-e749-4624-ac0f-a732faea2119-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-3e15b4-867bf66c4b-7gbpd\" (UID: \"4bc146ff-e749-4624-ac0f-a732faea2119\") " pod="openshift-ingress/payload-processing-e2e-shared-b-3e15b4-867bf66c4b-7gbpd"
Jul 24 20:05:07.788053 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:07.787894    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jb67\" (UniqueName: \"kubernetes.io/projected/62263dbb-2ed0-4556-90af-152655d45374-kube-api-access-8jb67\") pod \"payload-pre-processing-e2e-shared-b-3e15b4-64796bcfb4-xjgdv\" (UID: \"62263dbb-2ed0-4556-90af-152655d45374\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3e15b4-64796bcfb4-xjgdv"
Jul 24 20:05:07.788053 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:07.788038    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vlzk\" (UniqueName: \"kubernetes.io/projected/4bc146ff-e749-4624-ac0f-a732faea2119-kube-api-access-9vlzk\") pod \"payload-processing-e2e-shared-b-3e15b4-867bf66c4b-7gbpd\" (UID: \"4bc146ff-e749-4624-ac0f-a732faea2119\") " pod="openshift-ingress/payload-processing-e2e-shared-b-3e15b4-867bf66c4b-7gbpd"
Jul 24 20:05:07.788139 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:07.788073    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62263dbb-2ed0-4556-90af-152655d45374-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-3e15b4-64796bcfb4-xjgdv\" (UID: \"62263dbb-2ed0-4556-90af-152655d45374\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3e15b4-64796bcfb4-xjgdv"
Jul 24 20:05:07.788795 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:07.788773    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62263dbb-2ed0-4556-90af-152655d45374-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-3e15b4-64796bcfb4-xjgdv\" (UID: \"62263dbb-2ed0-4556-90af-152655d45374\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3e15b4-64796bcfb4-xjgdv"
Jul 24 20:05:07.795885 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:07.795854    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jb67\" (UniqueName: \"kubernetes.io/projected/62263dbb-2ed0-4556-90af-152655d45374-kube-api-access-8jb67\") pod \"payload-pre-processing-e2e-shared-b-3e15b4-64796bcfb4-xjgdv\" (UID: \"62263dbb-2ed0-4556-90af-152655d45374\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3e15b4-64796bcfb4-xjgdv"
Jul 24 20:05:07.888537 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:07.888510    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vlzk\" (UniqueName: \"kubernetes.io/projected/4bc146ff-e749-4624-ac0f-a732faea2119-kube-api-access-9vlzk\") pod \"payload-processing-e2e-shared-b-3e15b4-867bf66c4b-7gbpd\" (UID: \"4bc146ff-e749-4624-ac0f-a732faea2119\") " pod="openshift-ingress/payload-processing-e2e-shared-b-3e15b4-867bf66c4b-7gbpd"
Jul 24 20:05:07.888683 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:07.888574    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4bc146ff-e749-4624-ac0f-a732faea2119-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-3e15b4-867bf66c4b-7gbpd\" (UID: \"4bc146ff-e749-4624-ac0f-a732faea2119\") " pod="openshift-ingress/payload-processing-e2e-shared-b-3e15b4-867bf66c4b-7gbpd"
Jul 24 20:05:07.889291 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:07.889273    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4bc146ff-e749-4624-ac0f-a732faea2119-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-3e15b4-867bf66c4b-7gbpd\" (UID: \"4bc146ff-e749-4624-ac0f-a732faea2119\") " pod="openshift-ingress/payload-processing-e2e-shared-b-3e15b4-867bf66c4b-7gbpd"
Jul 24 20:05:07.896168 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:07.896137    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vlzk\" (UniqueName: \"kubernetes.io/projected/4bc146ff-e749-4624-ac0f-a732faea2119-kube-api-access-9vlzk\") pod \"payload-processing-e2e-shared-b-3e15b4-867bf66c4b-7gbpd\" (UID: \"4bc146ff-e749-4624-ac0f-a732faea2119\") " pod="openshift-ingress/payload-processing-e2e-shared-b-3e15b4-867bf66c4b-7gbpd"
Jul 24 20:05:07.898021 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:07.897988    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3e15b4-64796bcfb4-xjgdv"
Jul 24 20:05:07.916094 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:07.916070    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-3e15b4-867bf66c4b-7gbpd"
Jul 24 20:05:08.065168 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:08.065137    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-3e15b4-64796bcfb4-xjgdv"]
Jul 24 20:05:08.067250 ip-10-0-133-84 kubenswrapper[2567]: W0724 20:05:08.067208    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62263dbb_2ed0_4556_90af_152655d45374.slice/crio-bf014443200c5bc891a00ca51971e8b5e6184a96e33da9201a84a7e892aa5a04 WatchSource:0}: Error finding container bf014443200c5bc891a00ca51971e8b5e6184a96e33da9201a84a7e892aa5a04: Status 404 returned error can't find the container with id bf014443200c5bc891a00ca51971e8b5e6184a96e33da9201a84a7e892aa5a04
Jul 24 20:05:08.083811 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:08.083791    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-3e15b4-867bf66c4b-7gbpd"]
Jul 24 20:05:08.086662 ip-10-0-133-84 kubenswrapper[2567]: W0724 20:05:08.086638    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bc146ff_e749_4624_ac0f_a732faea2119.slice/crio-14de5bfddb6d525b0cf3414165d1aad7462e4920d6601433f73c4a5518e47541 WatchSource:0}: Error finding container 14de5bfddb6d525b0cf3414165d1aad7462e4920d6601433f73c4a5518e47541: Status 404 returned error can't find the container with id 14de5bfddb6d525b0cf3414165d1aad7462e4920d6601433f73c4a5518e47541
Jul 24 20:05:08.939383 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:08.939336    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3e15b4-64796bcfb4-xjgdv" event={"ID":"62263dbb-2ed0-4556-90af-152655d45374","Type":"ContainerStarted","Data":"9161d9cb482a660cb2e4234799244dc91b3f77d0b057b0d12022a10a8fb570c1"}
Jul 24 20:05:08.939878 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:08.939445    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3e15b4-64796bcfb4-xjgdv" event={"ID":"62263dbb-2ed0-4556-90af-152655d45374","Type":"ContainerStarted","Data":"bf014443200c5bc891a00ca51971e8b5e6184a96e33da9201a84a7e892aa5a04"}
Jul 24 20:05:08.939878 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:08.939664    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3e15b4-64796bcfb4-xjgdv"
Jul 24 20:05:08.941387 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:08.941355    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-3e15b4-867bf66c4b-7gbpd" event={"ID":"4bc146ff-e749-4624-ac0f-a732faea2119","Type":"ContainerStarted","Data":"75a5742a6da1f6b6ff268ebee0ba82c21a73e9605114caca7c174e2eed3e6b3f"}
Jul 24 20:05:08.941536 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:08.941404    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-3e15b4-867bf66c4b-7gbpd" event={"ID":"4bc146ff-e749-4624-ac0f-a732faea2119","Type":"ContainerStarted","Data":"14de5bfddb6d525b0cf3414165d1aad7462e4920d6601433f73c4a5518e47541"}
Jul 24 20:05:08.941536 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:08.941525    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-3e15b4-867bf66c4b-7gbpd"
Jul 24 20:05:08.956298 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:08.956247    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3e15b4-64796bcfb4-xjgdv" podStartSLOduration=1.9562334099999998 podStartE2EDuration="1.95623341s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:05:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:05:08.954810487 +0000 UTC m=+2297.473430529" watchObservedRunningTime="2026-07-24 20:05:08.95623341 +0000 UTC m=+2297.474853450"
Jul 24 20:05:08.970311 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:08.970264    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-3e15b4-867bf66c4b-7gbpd" podStartSLOduration=1.970243693 podStartE2EDuration="1.970243693s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:05:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:05:08.969618613 +0000 UTC m=+2297.488238655" watchObservedRunningTime="2026-07-24 20:05:08.970243693 +0000 UTC m=+2297.488863735"
Jul 24 20:05:10.897949 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:10.897900    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-8abb86-5b8d99466d-nglkh" podUID="69095654-3535-447c-b554-7fd6feadff1a" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.64:9004: connect: connection refused"
Jul 24 20:05:10.898359 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:10.898333    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-8abb86-644fcbcf66-gxgpt"
Jul 24 20:05:10.955975 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:10.955938    2567 generic.go:356] "Generic (PLEG): container finished" podID="9214ccf1-343c-4837-85e6-8fa646722e2c" containerID="639b60c946fefb2ae4ccd2df66824298b7a8ceabfbabcd771805f11c2878252f" exitCode=0
Jul 24 20:05:10.956150 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:10.956015    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq" event={"ID":"9214ccf1-343c-4837-85e6-8fa646722e2c","Type":"ContainerDied","Data":"639b60c946fefb2ae4ccd2df66824298b7a8ceabfbabcd771805f11c2878252f"}
Jul 24 20:05:10.956449 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:10.956434    2567 scope.go:117] "RemoveContainer" containerID="639b60c946fefb2ae4ccd2df66824298b7a8ceabfbabcd771805f11c2878252f"
Jul 24 20:05:10.957758 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:10.957721    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 20:05:10.957866 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:10.957815    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 20:05:10.957927 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:10.957894    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 20:05:11.965304 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:11.965273    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq" event={"ID":"9214ccf1-343c-4837-85e6-8fa646722e2c","Type":"ContainerStarted","Data":"8e4b49fcfcf483389b6048c734ef1fd91f1f8a152206b1221ce7f3e7d708a67b"}
Jul 24 20:05:12.880535 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:12.880500    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq"
Jul 24 20:05:12.921711 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:12.921682    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq"
Jul 24 20:05:12.922866 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:12.922836    2567 patch_prober.go:28] interesting pod/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Jul 24 20:05:12.922986 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:12.922889    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq" podUID="9214ccf1-343c-4837-85e6-8fa646722e2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Jul 24 20:05:13.921894 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:13.921860    2567 patch_prober.go:28] interesting pod/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Jul 24 20:05:13.922299 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:13.921910    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq" podUID="9214ccf1-343c-4837-85e6-8fa646722e2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Jul 24 20:05:14.921546 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:14.921508    2567 patch_prober.go:28] interesting pod/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Jul 24 20:05:14.921721 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:14.921572    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq" podUID="9214ccf1-343c-4837-85e6-8fa646722e2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Jul 24 20:05:15.921910 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:15.921867    2567 patch_prober.go:28] interesting pod/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Jul 24 20:05:15.922385 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:15.921932    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq" podUID="9214ccf1-343c-4837-85e6-8fa646722e2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Jul 24 20:05:16.925096 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:16.925065    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq"
Jul 24 20:05:16.926269 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:16.926236    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq"
Jul 24 20:05:19.951883 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:19.951855    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-3e15b4-867bf66c4b-7gbpd"
Jul 24 20:05:19.952271 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:19.951918    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3e15b4-64796bcfb4-xjgdv"
Jul 24 20:05:20.896978 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:05:20.896947    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-8abb86-5b8d99466d-nglkh"
Jul 24 20:06:52.104510 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:06:52.104465    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d87bq_72c2265c-f7f6-462a-bf46-eda3f35de953/ovn-acl-logging/0.log"
Jul 24 20:06:52.108311 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:06:52.108287    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d87bq_72c2265c-f7f6-462a-bf46-eda3f35de953/ovn-acl-logging/0.log"
Jul 24 20:08:11.603017 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:08:11.602981    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-8abb86/sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l"]
Jul 24 20:08:11.606624 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:08:11.606607    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8abb86/sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l"
Jul 24 20:08:11.609082 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:08:11.609054    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-8abb86\"/\"openshift-service-ca.crt\""
Jul 24 20:08:11.610410 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:08:11.610385    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-8abb86\"/\"kube-root-ca.crt\""
Jul 24 20:08:11.610559 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:08:11.610389    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8abb86\"/\"sub-test-model-8abb86-kserve-self-signed-certs\""
Jul 24 20:08:11.610559 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:08:11.610430    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8abb86\"/\"default-dockercfg-bg7jr\""
Jul 24 20:08:11.616175 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:08:11.616155    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8abb86/sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l"]
Jul 24 20:08:11.716829 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:08:11.716794    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da5a10ce-36fb-4b0f-906d-6158771a4895-tmp-dir\") pod \"sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l\" (UID: \"da5a10ce-36fb-4b0f-906d-6158771a4895\") " pod="ai-tenant-e2e-shared-a-8abb86/sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l"
Jul 24 20:08:11.716997 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:08:11.716835    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da5a10ce-36fb-4b0f-906d-6158771a4895-home\") pod \"sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l\" (UID: \"da5a10ce-36fb-4b0f-906d-6158771a4895\") " pod="ai-tenant-e2e-shared-a-8abb86/sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l"
Jul 24 20:08:11.716997 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:08:11.716866    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xcwk\" (UniqueName: \"kubernetes.io/projected/da5a10ce-36fb-4b0f-906d-6158771a4895-kube-api-access-6xcwk\") pod \"sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l\" (UID: \"da5a10ce-36fb-4b0f-906d-6158771a4895\") " pod="ai-tenant-e2e-shared-a-8abb86/sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l"
Jul 24 20:08:11.717072 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:08:11.716997    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da5a10ce-36fb-4b0f-906d-6158771a4895-dshm\") pod \"sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l\" (UID: \"da5a10ce-36fb-4b0f-906d-6158771a4895\") " pod="ai-tenant-e2e-shared-a-8abb86/sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l"
Jul 24 20:08:11.717072 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:08:11.717025    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da5a10ce-36fb-4b0f-906d-6158771a4895-tls-certs\") pod \"sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l\" (UID: \"da5a10ce-36fb-4b0f-906d-6158771a4895\") " pod="ai-tenant-e2e-shared-a-8abb86/sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l"
Jul 24 20:08:11.717072 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:08:11.717046    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da5a10ce-36fb-4b0f-906d-6158771a4895-model-cache\") pod \"sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l\" (UID: \"da5a10ce-36fb-4b0f-906d-6158771a4895\") " pod="ai-tenant-e2e-shared-a-8abb86/sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l"
Jul 24 20:08:11.817688 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:08:11.817652    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da5a10ce-36fb-4b0f-906d-6158771a4895-home\") pod \"sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l\" (UID: \"da5a10ce-36fb-4b0f-906d-6158771a4895\") " pod="ai-tenant-e2e-shared-a-8abb86/sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l"
Jul 24 20:08:11.817688 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:08:11.817689    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xcwk\" (UniqueName: \"kubernetes.io/projected/da5a10ce-36fb-4b0f-906d-6158771a4895-kube-api-access-6xcwk\") pod \"sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l\" (UID: \"da5a10ce-36fb-4b0f-906d-6158771a4895\") " pod="ai-tenant-e2e-shared-a-8abb86/sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l"
Jul 24 20:08:11.817910 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:08:11.817750    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da5a10ce-36fb-4b0f-906d-6158771a4895-dshm\") pod \"sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l\" (UID: \"da5a10ce-36fb-4b0f-906d-6158771a4895\") " pod="ai-tenant-e2e-shared-a-8abb86/sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l"
Jul 24 20:08:11.817910 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:08:11.817766    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da5a10ce-36fb-4b0f-906d-6158771a4895-tls-certs\") pod \"sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l\" (UID: \"da5a10ce-36fb-4b0f-906d-6158771a4895\") " pod="ai-tenant-e2e-shared-a-8abb86/sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l"
Jul 24 20:08:11.817910 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:08:11.817785    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da5a10ce-36fb-4b0f-906d-6158771a4895-model-cache\") pod \"sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l\" (UID: \"da5a10ce-36fb-4b0f-906d-6158771a4895\") " pod="ai-tenant-e2e-shared-a-8abb86/sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l"
Jul 24 20:08:11.817910 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:08:11.817853    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da5a10ce-36fb-4b0f-906d-6158771a4895-tmp-dir\") pod \"sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l\" (UID: \"da5a10ce-36fb-4b0f-906d-6158771a4895\") " pod="ai-tenant-e2e-shared-a-8abb86/sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l"
Jul 24 20:08:11.818104 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:08:11.818081    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da5a10ce-36fb-4b0f-906d-6158771a4895-home\") pod \"sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l\" (UID: \"da5a10ce-36fb-4b0f-906d-6158771a4895\") " pod="ai-tenant-e2e-shared-a-8abb86/sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l"
Jul 24 20:08:11.818193 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:08:11.818166    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da5a10ce-36fb-4b0f-906d-6158771a4895-tmp-dir\") pod \"sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l\" (UID: \"da5a10ce-36fb-4b0f-906d-6158771a4895\") " pod="ai-tenant-e2e-shared-a-8abb86/sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l"
Jul 24 20:08:11.818193 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:08:11.818186    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da5a10ce-36fb-4b0f-906d-6158771a4895-model-cache\") pod \"sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l\" (UID: \"da5a10ce-36fb-4b0f-906d-6158771a4895\") " pod="ai-tenant-e2e-shared-a-8abb86/sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l"
Jul 24 20:08:11.820171 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:08:11.820148    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da5a10ce-36fb-4b0f-906d-6158771a4895-dshm\") pod \"sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l\" (UID: \"da5a10ce-36fb-4b0f-906d-6158771a4895\") " pod="ai-tenant-e2e-shared-a-8abb86/sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l"
Jul 24 20:08:11.820318 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:08:11.820300    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da5a10ce-36fb-4b0f-906d-6158771a4895-tls-certs\") pod \"sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l\" (UID: \"da5a10ce-36fb-4b0f-906d-6158771a4895\") " pod="ai-tenant-e2e-shared-a-8abb86/sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l"
Jul 24 20:08:11.826630 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:08:11.826611    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xcwk\" (UniqueName: \"kubernetes.io/projected/da5a10ce-36fb-4b0f-906d-6158771a4895-kube-api-access-6xcwk\") pod \"sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l\" (UID: \"da5a10ce-36fb-4b0f-906d-6158771a4895\") " pod="ai-tenant-e2e-shared-a-8abb86/sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l"
Jul 24 20:08:11.916410 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:08:11.916377    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8abb86/sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l"
Jul 24 20:08:12.052260 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:08:12.052222    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8abb86/sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l"]
Jul 24 20:08:12.054595 ip-10-0-133-84 kubenswrapper[2567]: W0724 20:08:12.054522    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podda5a10ce_36fb_4b0f_906d_6158771a4895.slice/crio-38e3ca994dc0823e807cad7e1a047602374e1102c0a6cded05f5ffd94052fb97 WatchSource:0}: Error finding container 38e3ca994dc0823e807cad7e1a047602374e1102c0a6cded05f5ffd94052fb97: Status 404 returned error can't find the container with id 38e3ca994dc0823e807cad7e1a047602374e1102c0a6cded05f5ffd94052fb97
Jul 24 20:08:12.867141 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:08:12.867105    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8abb86/sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l" event={"ID":"da5a10ce-36fb-4b0f-906d-6158771a4895","Type":"ContainerStarted","Data":"5cd27943878176e9605e21c231dcaf2cc56099a5c38542bfc10ad3c95aec1093"}
Jul 24 20:08:12.867141 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:08:12.867147    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8abb86/sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l" event={"ID":"da5a10ce-36fb-4b0f-906d-6158771a4895","Type":"ContainerStarted","Data":"38e3ca994dc0823e807cad7e1a047602374e1102c0a6cded05f5ffd94052fb97"}
Jul 24 20:08:12.885476 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:08:12.885426    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-8abb86/sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l" podStartSLOduration=1.885410411 podStartE2EDuration="1.885410411s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:08:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:08:12.88432811 +0000 UTC m=+2481.402948151" watchObservedRunningTime="2026-07-24 20:08:12.885410411 +0000 UTC m=+2481.404030449"
Jul 24 20:08:21.917119 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:08:21.917082    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-8abb86/sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l"
Jul 24 20:08:21.917651 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:08:21.917162    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-8abb86/sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l"
Jul 24 20:08:21.929936 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:08:21.929913    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-8abb86/sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l"
Jul 24 20:08:22.927937 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:08:22.927911    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-8abb86/sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l"
Jul 24 20:09:10.920317 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:09:10.920283    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8abb86/sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l"]
Jul 24 20:09:25.940155 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:09:25.940095    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-8abb86/sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l" podUID="da5a10ce-36fb-4b0f-906d-6158771a4895" containerName="main" containerID="cri-o://5cd27943878176e9605e21c231dcaf2cc56099a5c38542bfc10ad3c95aec1093" gracePeriod=45
Jul 24 20:09:26.188851 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:09:26.188825    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8abb86/sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l"
Jul 24 20:09:26.239298 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:09:26.238721    2567 generic.go:356] "Generic (PLEG): container finished" podID="da5a10ce-36fb-4b0f-906d-6158771a4895" containerID="5cd27943878176e9605e21c231dcaf2cc56099a5c38542bfc10ad3c95aec1093" exitCode=0
Jul 24 20:09:26.239298 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:09:26.238774    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8abb86/sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l" event={"ID":"da5a10ce-36fb-4b0f-906d-6158771a4895","Type":"ContainerDied","Data":"5cd27943878176e9605e21c231dcaf2cc56099a5c38542bfc10ad3c95aec1093"}
Jul 24 20:09:26.239298 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:09:26.238805    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8abb86/sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l" event={"ID":"da5a10ce-36fb-4b0f-906d-6158771a4895","Type":"ContainerDied","Data":"38e3ca994dc0823e807cad7e1a047602374e1102c0a6cded05f5ffd94052fb97"}
Jul 24 20:09:26.239298 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:09:26.238827    2567 scope.go:117] "RemoveContainer" containerID="5cd27943878176e9605e21c231dcaf2cc56099a5c38542bfc10ad3c95aec1093"
Jul 24 20:09:26.239298 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:09:26.238982    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8abb86/sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l"
Jul 24 20:09:26.248109 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:09:26.248090    2567 scope.go:117] "RemoveContainer" containerID="5cd27943878176e9605e21c231dcaf2cc56099a5c38542bfc10ad3c95aec1093"
Jul 24 20:09:26.248325 ip-10-0-133-84 kubenswrapper[2567]: E0724 20:09:26.248308    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cd27943878176e9605e21c231dcaf2cc56099a5c38542bfc10ad3c95aec1093\": container with ID starting with 5cd27943878176e9605e21c231dcaf2cc56099a5c38542bfc10ad3c95aec1093 not found: ID does not exist" containerID="5cd27943878176e9605e21c231dcaf2cc56099a5c38542bfc10ad3c95aec1093"
Jul 24 20:09:26.248375 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:09:26.248335    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cd27943878176e9605e21c231dcaf2cc56099a5c38542bfc10ad3c95aec1093"} err="failed to get container status \"5cd27943878176e9605e21c231dcaf2cc56099a5c38542bfc10ad3c95aec1093\": rpc error: code = NotFound desc = could not find container \"5cd27943878176e9605e21c231dcaf2cc56099a5c38542bfc10ad3c95aec1093\": container with ID starting with 5cd27943878176e9605e21c231dcaf2cc56099a5c38542bfc10ad3c95aec1093 not found: ID does not exist"
Jul 24 20:09:26.323066 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:09:26.323035    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da5a10ce-36fb-4b0f-906d-6158771a4895-tmp-dir\") pod \"da5a10ce-36fb-4b0f-906d-6158771a4895\" (UID: \"da5a10ce-36fb-4b0f-906d-6158771a4895\") "
Jul 24 20:09:26.323066 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:09:26.323073    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da5a10ce-36fb-4b0f-906d-6158771a4895-dshm\") pod \"da5a10ce-36fb-4b0f-906d-6158771a4895\" (UID: \"da5a10ce-36fb-4b0f-906d-6158771a4895\") "
Jul 24 20:09:26.323243 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:09:26.323109    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da5a10ce-36fb-4b0f-906d-6158771a4895-model-cache\") pod \"da5a10ce-36fb-4b0f-906d-6158771a4895\" (UID: \"da5a10ce-36fb-4b0f-906d-6158771a4895\") "
Jul 24 20:09:26.323243 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:09:26.323221    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xcwk\" (UniqueName: \"kubernetes.io/projected/da5a10ce-36fb-4b0f-906d-6158771a4895-kube-api-access-6xcwk\") pod \"da5a10ce-36fb-4b0f-906d-6158771a4895\" (UID: \"da5a10ce-36fb-4b0f-906d-6158771a4895\") "
Jul 24 20:09:26.323344 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:09:26.323257    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da5a10ce-36fb-4b0f-906d-6158771a4895-home\") pod \"da5a10ce-36fb-4b0f-906d-6158771a4895\" (UID: \"da5a10ce-36fb-4b0f-906d-6158771a4895\") "
Jul 24 20:09:26.323344 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:09:26.323286    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da5a10ce-36fb-4b0f-906d-6158771a4895-tls-certs\") pod \"da5a10ce-36fb-4b0f-906d-6158771a4895\" (UID: \"da5a10ce-36fb-4b0f-906d-6158771a4895\") "
Jul 24 20:09:26.323344 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:09:26.323332    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da5a10ce-36fb-4b0f-906d-6158771a4895-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "da5a10ce-36fb-4b0f-906d-6158771a4895" (UID: "da5a10ce-36fb-4b0f-906d-6158771a4895"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:09:26.323525 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:09:26.323380    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da5a10ce-36fb-4b0f-906d-6158771a4895-model-cache" (OuterVolumeSpecName: "model-cache") pod "da5a10ce-36fb-4b0f-906d-6158771a4895" (UID: "da5a10ce-36fb-4b0f-906d-6158771a4895"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:09:26.323525 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:09:26.323517    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da5a10ce-36fb-4b0f-906d-6158771a4895-home" (OuterVolumeSpecName: "home") pod "da5a10ce-36fb-4b0f-906d-6158771a4895" (UID: "da5a10ce-36fb-4b0f-906d-6158771a4895"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:09:26.323653 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:09:26.323640    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da5a10ce-36fb-4b0f-906d-6158771a4895-home\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:09:26.323702 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:09:26.323656    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da5a10ce-36fb-4b0f-906d-6158771a4895-tmp-dir\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:09:26.323702 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:09:26.323671    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da5a10ce-36fb-4b0f-906d-6158771a4895-model-cache\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:09:26.325553 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:09:26.325530    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da5a10ce-36fb-4b0f-906d-6158771a4895-dshm" (OuterVolumeSpecName: "dshm") pod "da5a10ce-36fb-4b0f-906d-6158771a4895" (UID: "da5a10ce-36fb-4b0f-906d-6158771a4895"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:09:26.325553 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:09:26.325534    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da5a10ce-36fb-4b0f-906d-6158771a4895-kube-api-access-6xcwk" (OuterVolumeSpecName: "kube-api-access-6xcwk") pod "da5a10ce-36fb-4b0f-906d-6158771a4895" (UID: "da5a10ce-36fb-4b0f-906d-6158771a4895"). InnerVolumeSpecName "kube-api-access-6xcwk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:09:26.325707 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:09:26.325631    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da5a10ce-36fb-4b0f-906d-6158771a4895-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "da5a10ce-36fb-4b0f-906d-6158771a4895" (UID: "da5a10ce-36fb-4b0f-906d-6158771a4895"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 20:09:26.425061 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:09:26.425026    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da5a10ce-36fb-4b0f-906d-6158771a4895-tls-certs\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:09:26.425061 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:09:26.425056    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da5a10ce-36fb-4b0f-906d-6158771a4895-dshm\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:09:26.425061 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:09:26.425065    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xcwk\" (UniqueName: \"kubernetes.io/projected/da5a10ce-36fb-4b0f-906d-6158771a4895-kube-api-access-6xcwk\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:09:26.561009 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:09:26.560982    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8abb86/sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l"]
Jul 24 20:09:26.564843 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:09:26.564821    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-8abb86/sub-test-model-8abb86-kserve-859cbcc5b9-tpb2l"]
Jul 24 20:09:28.071941 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:09:28.071905    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da5a10ce-36fb-4b0f-906d-6158771a4895" path="/var/lib/kubelet/pods/da5a10ce-36fb-4b0f-906d-6158771a4895/volumes"
Jul 24 20:10:56.510100 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:10:56.510063    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-11ccc9-5fd96b4544-vmfsn"]
Jul 24 20:10:56.510690 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:10:56.510670    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da5a10ce-36fb-4b0f-906d-6158771a4895" containerName="main"
Jul 24 20:10:56.510747 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:10:56.510694    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="da5a10ce-36fb-4b0f-906d-6158771a4895" containerName="main"
Jul 24 20:10:56.510818 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:10:56.510806    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="da5a10ce-36fb-4b0f-906d-6158771a4895" containerName="main"
Jul 24 20:10:56.513792 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:10:56.513768    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-11ccc9-5fd96b4544-vmfsn"
Jul 24 20:10:56.516113 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:10:56.516078    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-11ccc9\""
Jul 24 20:10:56.516375 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:10:56.516362    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-11ccc9-dockercfg-5tlpw\""
Jul 24 20:10:56.525388 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:10:56.525364    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-11ccc9-5fd96b4544-vmfsn"]
Jul 24 20:10:56.541023 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:10:56.540985    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-11ccc9-5d6b8d7486-9fs84"]
Jul 24 20:10:56.544456 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:10:56.544435    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-11ccc9-5d6b8d7486-9fs84"
Jul 24 20:10:56.554342 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:10:56.554302    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-11ccc9-5d6b8d7486-9fs84"]
Jul 24 20:10:56.673386 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:10:56.673345    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06338445-58c6-48e7-b221-dc274a95a237-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-11ccc9-5d6b8d7486-9fs84\" (UID: \"06338445-58c6-48e7-b221-dc274a95a237\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-11ccc9-5d6b8d7486-9fs84"
Jul 24 20:10:56.673386 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:10:56.673391    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjpld\" (UniqueName: \"kubernetes.io/projected/06338445-58c6-48e7-b221-dc274a95a237-kube-api-access-jjpld\") pod \"payload-processing-e2e-ipp-a-11ccc9-5d6b8d7486-9fs84\" (UID: \"06338445-58c6-48e7-b221-dc274a95a237\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-11ccc9-5d6b8d7486-9fs84"
Jul 24 20:10:56.673633 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:10:56.673418    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3d1abee9-4fad-4dcc-9735-b6bb83c3f17a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-11ccc9-5fd96b4544-vmfsn\" (UID: \"3d1abee9-4fad-4dcc-9735-b6bb83c3f17a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-11ccc9-5fd96b4544-vmfsn"
Jul 24 20:10:56.673633 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:10:56.673525    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ns9jb\" (UniqueName: \"kubernetes.io/projected/3d1abee9-4fad-4dcc-9735-b6bb83c3f17a-kube-api-access-ns9jb\") pod \"payload-pre-processing-e2e-ipp-a-11ccc9-5fd96b4544-vmfsn\" (UID: \"3d1abee9-4fad-4dcc-9735-b6bb83c3f17a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-11ccc9-5fd96b4544-vmfsn"
Jul 24 20:10:56.774876 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:10:56.774768    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3d1abee9-4fad-4dcc-9735-b6bb83c3f17a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-11ccc9-5fd96b4544-vmfsn\" (UID: \"3d1abee9-4fad-4dcc-9735-b6bb83c3f17a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-11ccc9-5fd96b4544-vmfsn"
Jul 24 20:10:56.774876 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:10:56.774845    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ns9jb\" (UniqueName: \"kubernetes.io/projected/3d1abee9-4fad-4dcc-9735-b6bb83c3f17a-kube-api-access-ns9jb\") pod \"payload-pre-processing-e2e-ipp-a-11ccc9-5fd96b4544-vmfsn\" (UID: \"3d1abee9-4fad-4dcc-9735-b6bb83c3f17a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-11ccc9-5fd96b4544-vmfsn"
Jul 24 20:10:56.775127 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:10:56.774954    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06338445-58c6-48e7-b221-dc274a95a237-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-11ccc9-5d6b8d7486-9fs84\" (UID: \"06338445-58c6-48e7-b221-dc274a95a237\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-11ccc9-5d6b8d7486-9fs84"
Jul 24 20:10:56.775127 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:10:56.774981    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjpld\" (UniqueName: \"kubernetes.io/projected/06338445-58c6-48e7-b221-dc274a95a237-kube-api-access-jjpld\") pod \"payload-processing-e2e-ipp-a-11ccc9-5d6b8d7486-9fs84\" (UID: \"06338445-58c6-48e7-b221-dc274a95a237\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-11ccc9-5d6b8d7486-9fs84"
Jul 24 20:10:56.775542 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:10:56.775521    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3d1abee9-4fad-4dcc-9735-b6bb83c3f17a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-11ccc9-5fd96b4544-vmfsn\" (UID: \"3d1abee9-4fad-4dcc-9735-b6bb83c3f17a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-11ccc9-5fd96b4544-vmfsn"
Jul 24 20:10:56.775674 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:10:56.775657    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06338445-58c6-48e7-b221-dc274a95a237-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-11ccc9-5d6b8d7486-9fs84\" (UID: \"06338445-58c6-48e7-b221-dc274a95a237\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-11ccc9-5d6b8d7486-9fs84"
Jul 24 20:10:56.783409 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:10:56.783374    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjpld\" (UniqueName: \"kubernetes.io/projected/06338445-58c6-48e7-b221-dc274a95a237-kube-api-access-jjpld\") pod \"payload-processing-e2e-ipp-a-11ccc9-5d6b8d7486-9fs84\" (UID: \"06338445-58c6-48e7-b221-dc274a95a237\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-11ccc9-5d6b8d7486-9fs84"
Jul 24 20:10:56.783548 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:10:56.783376    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ns9jb\" (UniqueName: \"kubernetes.io/projected/3d1abee9-4fad-4dcc-9735-b6bb83c3f17a-kube-api-access-ns9jb\") pod \"payload-pre-processing-e2e-ipp-a-11ccc9-5fd96b4544-vmfsn\" (UID: \"3d1abee9-4fad-4dcc-9735-b6bb83c3f17a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-11ccc9-5fd96b4544-vmfsn"
Jul 24 20:10:56.824690 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:10:56.824659    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-11ccc9-5fd96b4544-vmfsn"
Jul 24 20:10:56.855987 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:10:56.855954    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-11ccc9-5d6b8d7486-9fs84"
Jul 24 20:10:56.991010 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:10:56.990980    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-11ccc9-5fd96b4544-vmfsn"]
Jul 24 20:10:56.993021 ip-10-0-133-84 kubenswrapper[2567]: W0724 20:10:56.992990    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d1abee9_4fad_4dcc_9735_b6bb83c3f17a.slice/crio-eb319bb0b2ed71e1186225527a31772072a9869ddc0f08e28a8c33688b654da2 WatchSource:0}: Error finding container eb319bb0b2ed71e1186225527a31772072a9869ddc0f08e28a8c33688b654da2: Status 404 returned error can't find the container with id eb319bb0b2ed71e1186225527a31772072a9869ddc0f08e28a8c33688b654da2
Jul 24 20:10:57.013585 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:10:57.013560    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-11ccc9-5d6b8d7486-9fs84"]
Jul 24 20:10:57.026328 ip-10-0-133-84 kubenswrapper[2567]: W0724 20:10:57.026297    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06338445_58c6_48e7_b221_dc274a95a237.slice/crio-20a43d1d575d55fb7a277502d24e7b631f467a9887c09306e65ec72b1c81464f WatchSource:0}: Error finding container 20a43d1d575d55fb7a277502d24e7b631f467a9887c09306e65ec72b1c81464f: Status 404 returned error can't find the container with id 20a43d1d575d55fb7a277502d24e7b631f467a9887c09306e65ec72b1c81464f
Jul 24 20:10:57.695763 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:10:57.695721    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-11ccc9-5d6b8d7486-9fs84" event={"ID":"06338445-58c6-48e7-b221-dc274a95a237","Type":"ContainerStarted","Data":"27dee13063ccea91a2107bd5231a3594e38eb95fd87862d0018b0597a75815ee"}
Jul 24 20:10:57.696236 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:10:57.695786    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-11ccc9-5d6b8d7486-9fs84" event={"ID":"06338445-58c6-48e7-b221-dc274a95a237","Type":"ContainerStarted","Data":"20a43d1d575d55fb7a277502d24e7b631f467a9887c09306e65ec72b1c81464f"}
Jul 24 20:10:57.696236 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:10:57.695953    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-11ccc9-5d6b8d7486-9fs84"
Jul 24 20:10:57.697264 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:10:57.697237    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-11ccc9-5fd96b4544-vmfsn" event={"ID":"3d1abee9-4fad-4dcc-9735-b6bb83c3f17a","Type":"ContainerStarted","Data":"40b1020d578b9efb6af973fc1a033259abf1db63031861576b61bd82209a8d67"}
Jul 24 20:10:57.697380 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:10:57.697283    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-11ccc9-5fd96b4544-vmfsn" event={"ID":"3d1abee9-4fad-4dcc-9735-b6bb83c3f17a","Type":"ContainerStarted","Data":"eb319bb0b2ed71e1186225527a31772072a9869ddc0f08e28a8c33688b654da2"}
Jul 24 20:10:57.697380 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:10:57.697309    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-11ccc9-5fd96b4544-vmfsn"
Jul 24 20:10:57.712178 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:10:57.712123    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-11ccc9-5d6b8d7486-9fs84" podStartSLOduration=1.712105233 podStartE2EDuration="1.712105233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:10:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:10:57.711742865 +0000 UTC m=+2646.230362917" watchObservedRunningTime="2026-07-24 20:10:57.712105233 +0000 UTC m=+2646.230725275"
Jul 24 20:10:57.728447 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:10:57.728395    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-11ccc9-5fd96b4544-vmfsn" podStartSLOduration=1.7283769100000002 podStartE2EDuration="1.72837691s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:10:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:10:57.726539242 +0000 UTC m=+2646.245159284" watchObservedRunningTime="2026-07-24 20:10:57.72837691 +0000 UTC m=+2646.246996953"
Jul 24 20:11:08.704131 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:11:08.704100    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-11ccc9-5fd96b4544-vmfsn"
Jul 24 20:11:08.704533 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:11:08.704173    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-11ccc9-5d6b8d7486-9fs84"
Jul 24 20:11:19.240145 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:11:19.240103    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-75b982-f8d684f44-jc77b"]
Jul 24 20:11:19.243644 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:11:19.243623    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-75b982-f8d684f44-jc77b"
Jul 24 20:11:19.246050 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:11:19.246027    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-75b982\""
Jul 24 20:11:19.246118 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:11:19.246051    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-75b982-dockercfg-xclc5\""
Jul 24 20:11:19.254692 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:11:19.254663    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-75b982-f8d684f44-jc77b"]
Jul 24 20:11:19.264256 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:11:19.264225    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-75b982-6b66f4b9d-gppkb"]
Jul 24 20:11:19.267705 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:11:19.267679    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-75b982-6b66f4b9d-gppkb"
Jul 24 20:11:19.277018 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:11:19.276992    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-75b982-6b66f4b9d-gppkb"]
Jul 24 20:11:19.295405 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:11:19.295375    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82f09e72-6966-40b5-a5c0-d7e3ea91387f-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-75b982-6b66f4b9d-gppkb\" (UID: \"82f09e72-6966-40b5-a5c0-d7e3ea91387f\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-75b982-6b66f4b9d-gppkb"
Jul 24 20:11:19.295586 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:11:19.295412    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qghx2\" (UniqueName: \"kubernetes.io/projected/c03627eb-9f45-4ceb-85fe-bfde55af4fe6-kube-api-access-qghx2\") pod \"payload-pre-processing-e2e-ipp-b-75b982-f8d684f44-jc77b\" (UID: \"c03627eb-9f45-4ceb-85fe-bfde55af4fe6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-75b982-f8d684f44-jc77b"
Jul 24 20:11:19.295586 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:11:19.295443    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c03627eb-9f45-4ceb-85fe-bfde55af4fe6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-75b982-f8d684f44-jc77b\" (UID: \"c03627eb-9f45-4ceb-85fe-bfde55af4fe6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-75b982-f8d684f44-jc77b"
Jul 24 20:11:19.295699 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:11:19.295590    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjh48\" (UniqueName: \"kubernetes.io/projected/82f09e72-6966-40b5-a5c0-d7e3ea91387f-kube-api-access-zjh48\") pod \"payload-processing-e2e-ipp-b-75b982-6b66f4b9d-gppkb\" (UID: \"82f09e72-6966-40b5-a5c0-d7e3ea91387f\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-75b982-6b66f4b9d-gppkb"
Jul 24 20:11:19.396381 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:11:19.396341    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjh48\" (UniqueName: \"kubernetes.io/projected/82f09e72-6966-40b5-a5c0-d7e3ea91387f-kube-api-access-zjh48\") pod \"payload-processing-e2e-ipp-b-75b982-6b66f4b9d-gppkb\" (UID: \"82f09e72-6966-40b5-a5c0-d7e3ea91387f\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-75b982-6b66f4b9d-gppkb"
Jul 24 20:11:19.396580 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:11:19.396420    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82f09e72-6966-40b5-a5c0-d7e3ea91387f-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-75b982-6b66f4b9d-gppkb\" (UID: \"82f09e72-6966-40b5-a5c0-d7e3ea91387f\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-75b982-6b66f4b9d-gppkb"
Jul 24 20:11:19.396580 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:11:19.396448    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qghx2\" (UniqueName: \"kubernetes.io/projected/c03627eb-9f45-4ceb-85fe-bfde55af4fe6-kube-api-access-qghx2\") pod \"payload-pre-processing-e2e-ipp-b-75b982-f8d684f44-jc77b\" (UID: \"c03627eb-9f45-4ceb-85fe-bfde55af4fe6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-75b982-f8d684f44-jc77b"
Jul 24 20:11:19.396580 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:11:19.396469    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c03627eb-9f45-4ceb-85fe-bfde55af4fe6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-75b982-f8d684f44-jc77b\" (UID: \"c03627eb-9f45-4ceb-85fe-bfde55af4fe6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-75b982-f8d684f44-jc77b"
Jul 24 20:11:19.397220 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:11:19.397201    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c03627eb-9f45-4ceb-85fe-bfde55af4fe6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-75b982-f8d684f44-jc77b\" (UID: \"c03627eb-9f45-4ceb-85fe-bfde55af4fe6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-75b982-f8d684f44-jc77b"
Jul 24 20:11:19.397394 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:11:19.397369    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82f09e72-6966-40b5-a5c0-d7e3ea91387f-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-75b982-6b66f4b9d-gppkb\" (UID: \"82f09e72-6966-40b5-a5c0-d7e3ea91387f\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-75b982-6b66f4b9d-gppkb"
Jul 24 20:11:19.404951 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:11:19.404916    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qghx2\" (UniqueName: \"kubernetes.io/projected/c03627eb-9f45-4ceb-85fe-bfde55af4fe6-kube-api-access-qghx2\") pod \"payload-pre-processing-e2e-ipp-b-75b982-f8d684f44-jc77b\" (UID: \"c03627eb-9f45-4ceb-85fe-bfde55af4fe6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-75b982-f8d684f44-jc77b"
Jul 24 20:11:19.405073 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:11:19.405028    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjh48\" (UniqueName: \"kubernetes.io/projected/82f09e72-6966-40b5-a5c0-d7e3ea91387f-kube-api-access-zjh48\") pod \"payload-processing-e2e-ipp-b-75b982-6b66f4b9d-gppkb\" (UID: \"82f09e72-6966-40b5-a5c0-d7e3ea91387f\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-75b982-6b66f4b9d-gppkb"
Jul 24 20:11:19.556394 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:11:19.556297    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-75b982-f8d684f44-jc77b"
Jul 24 20:11:19.579652 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:11:19.579622    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-75b982-6b66f4b9d-gppkb"
Jul 24 20:11:19.720082 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:11:19.720053    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-75b982-f8d684f44-jc77b"]
Jul 24 20:11:19.722888 ip-10-0-133-84 kubenswrapper[2567]: W0724 20:11:19.722854    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc03627eb_9f45_4ceb_85fe_bfde55af4fe6.slice/crio-047de1e72e3dcf2c780dd7e7dde754415e48b6567212c8794aafb5fdd3d4962b WatchSource:0}: Error finding container 047de1e72e3dcf2c780dd7e7dde754415e48b6567212c8794aafb5fdd3d4962b: Status 404 returned error can't find the container with id 047de1e72e3dcf2c780dd7e7dde754415e48b6567212c8794aafb5fdd3d4962b
Jul 24 20:11:19.741887 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:11:19.741859    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-75b982-6b66f4b9d-gppkb"]
Jul 24 20:11:19.744230 ip-10-0-133-84 kubenswrapper[2567]: W0724 20:11:19.744192    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82f09e72_6966_40b5_a5c0_d7e3ea91387f.slice/crio-53f81e93ce67114421b003229114aeaa45b91aefc8ccfccbdaa35ad69f6b2371 WatchSource:0}: Error finding container 53f81e93ce67114421b003229114aeaa45b91aefc8ccfccbdaa35ad69f6b2371: Status 404 returned error can't find the container with id 53f81e93ce67114421b003229114aeaa45b91aefc8ccfccbdaa35ad69f6b2371
Jul 24 20:11:19.807126 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:11:19.807060    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-75b982-f8d684f44-jc77b" event={"ID":"c03627eb-9f45-4ceb-85fe-bfde55af4fe6","Type":"ContainerStarted","Data":"047de1e72e3dcf2c780dd7e7dde754415e48b6567212c8794aafb5fdd3d4962b"}
Jul 24 20:11:19.808778 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:11:19.808751    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-75b982-6b66f4b9d-gppkb" event={"ID":"82f09e72-6966-40b5-a5c0-d7e3ea91387f","Type":"ContainerStarted","Data":"53f81e93ce67114421b003229114aeaa45b91aefc8ccfccbdaa35ad69f6b2371"}
Jul 24 20:11:20.815810 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:11:20.815773    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-75b982-f8d684f44-jc77b" event={"ID":"c03627eb-9f45-4ceb-85fe-bfde55af4fe6","Type":"ContainerStarted","Data":"a7cb07b5df471928f875fb9db2d3fd875c4c98e00af14735b5cce577468f9cbd"}
Jul 24 20:11:20.816223 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:11:20.815844    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-75b982-f8d684f44-jc77b"
Jul 24 20:11:20.817369 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:11:20.817338    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-75b982-6b66f4b9d-gppkb" event={"ID":"82f09e72-6966-40b5-a5c0-d7e3ea91387f","Type":"ContainerStarted","Data":"5ab14b937224515ddb87297ca2e335cac1f3d9934256b92641e7caf04d07d79f"}
Jul 24 20:11:20.817584 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:11:20.817459    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-75b982-6b66f4b9d-gppkb"
Jul 24 20:11:20.836126 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:11:20.836062    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-75b982-f8d684f44-jc77b" podStartSLOduration=1.836037346 podStartE2EDuration="1.836037346s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:11:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:11:20.834193399 +0000 UTC m=+2669.352813440" watchObservedRunningTime="2026-07-24 20:11:20.836037346 +0000 UTC m=+2669.354657390"
Jul 24 20:11:20.858514 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:11:20.858437    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-75b982-6b66f4b9d-gppkb" podStartSLOduration=1.858419843 podStartE2EDuration="1.858419843s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:11:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:11:20.855954384 +0000 UTC m=+2669.374574425" watchObservedRunningTime="2026-07-24 20:11:20.858419843 +0000 UTC m=+2669.377039915"
Jul 24 20:11:31.824828 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:11:31.824784    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-75b982-f8d684f44-jc77b" podUID="c03627eb-9f45-4ceb-85fe-bfde55af4fe6" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.71:9004: connect: connection refused"
Jul 24 20:11:31.825261 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:11:31.825120    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-75b982-6b66f4b9d-gppkb"
Jul 24 20:11:41.823929 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:11:41.823897    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-75b982-f8d684f44-jc77b"
Jul 24 20:11:48.709362 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:11:48.709328    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-75b982-6b66f4b9d-gppkb_82f09e72-6966-40b5-a5c0-d7e3ea91387f/payload-processing/0.log"
Jul 24 20:11:52.140650 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:11:52.140622    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d87bq_72c2265c-f7f6-462a-bf46-eda3f35de953/ovn-acl-logging/0.log"
Jul 24 20:11:52.146435 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:11:52.146414    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d87bq_72c2265c-f7f6-462a-bf46-eda3f35de953/ovn-acl-logging/0.log"
Jul 24 20:12:55.973258 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:12:55.973227    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-11ccc9-5d6b8d7486-9fs84_06338445-58c6-48e7-b221-dc274a95a237/payload-processing/0.log"
Jul 24 20:12:56.225702 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:12:56.225615    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-75b982-6b66f4b9d-gppkb_82f09e72-6966-40b5-a5c0-d7e3ea91387f/payload-processing/0.log"
Jul 24 20:13:03.224691 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:03.224662    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-67ff20-f6ddbffcd-d52g4"]
Jul 24 20:13:03.228664 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:03.228641    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-67ff20-f6ddbffcd-d52g4"
Jul 24 20:13:03.231323 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:03.231298    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-67ff20\""
Jul 24 20:13:03.231441 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:03.231322    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-67ff20-dockercfg-8hlcr\""
Jul 24 20:13:03.239189 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:03.239163    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-67ff20-f6ddbffcd-d52g4"]
Jul 24 20:13:03.301426 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:03.301388    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0429727b-5d3e-40ce-b314-8b4b1809de78-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-67ff20-f6ddbffcd-d52g4\" (UID: \"0429727b-5d3e-40ce-b314-8b4b1809de78\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-67ff20-f6ddbffcd-d52g4"
Jul 24 20:13:03.301627 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:03.301540    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzgsr\" (UniqueName: \"kubernetes.io/projected/0429727b-5d3e-40ce-b314-8b4b1809de78-kube-api-access-mzgsr\") pod \"payload-processing-e2e-ipp-cleanup-67ff20-f6ddbffcd-d52g4\" (UID: \"0429727b-5d3e-40ce-b314-8b4b1809de78\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-67ff20-f6ddbffcd-d52g4"
Jul 24 20:13:03.402129 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:03.402094    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzgsr\" (UniqueName: \"kubernetes.io/projected/0429727b-5d3e-40ce-b314-8b4b1809de78-kube-api-access-mzgsr\") pod \"payload-processing-e2e-ipp-cleanup-67ff20-f6ddbffcd-d52g4\" (UID: \"0429727b-5d3e-40ce-b314-8b4b1809de78\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-67ff20-f6ddbffcd-d52g4"
Jul 24 20:13:03.402305 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:03.402180    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0429727b-5d3e-40ce-b314-8b4b1809de78-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-67ff20-f6ddbffcd-d52g4\" (UID: \"0429727b-5d3e-40ce-b314-8b4b1809de78\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-67ff20-f6ddbffcd-d52g4"
Jul 24 20:13:03.402956 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:03.402928    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0429727b-5d3e-40ce-b314-8b4b1809de78-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-67ff20-f6ddbffcd-d52g4\" (UID: \"0429727b-5d3e-40ce-b314-8b4b1809de78\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-67ff20-f6ddbffcd-d52g4"
Jul 24 20:13:03.409920 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:03.409897    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzgsr\" (UniqueName: \"kubernetes.io/projected/0429727b-5d3e-40ce-b314-8b4b1809de78-kube-api-access-mzgsr\") pod \"payload-processing-e2e-ipp-cleanup-67ff20-f6ddbffcd-d52g4\" (UID: \"0429727b-5d3e-40ce-b314-8b4b1809de78\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-67ff20-f6ddbffcd-d52g4"
Jul 24 20:13:03.541082 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:03.540984    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-67ff20-f6ddbffcd-d52g4"
Jul 24 20:13:03.675916 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:03.675890    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-67ff20-f6ddbffcd-d52g4"]
Jul 24 20:13:03.678732 ip-10-0-133-84 kubenswrapper[2567]: W0724 20:13:03.678700    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0429727b_5d3e_40ce_b314_8b4b1809de78.slice/crio-64dd3f949e6222c1e1aa03cc6a2d03ba657ad779c2d35afbc6d8e11ca67a7217 WatchSource:0}: Error finding container 64dd3f949e6222c1e1aa03cc6a2d03ba657ad779c2d35afbc6d8e11ca67a7217: Status 404 returned error can't find the container with id 64dd3f949e6222c1e1aa03cc6a2d03ba657ad779c2d35afbc6d8e11ca67a7217
Jul 24 20:13:04.338379 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:04.338340    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-67ff20-f6ddbffcd-d52g4" event={"ID":"0429727b-5d3e-40ce-b314-8b4b1809de78","Type":"ContainerStarted","Data":"15bb530be466793334ee21629352a615911282a59a705f255131e5ffa37c9837"}
Jul 24 20:13:04.338861 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:04.338405    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-67ff20-f6ddbffcd-d52g4" event={"ID":"0429727b-5d3e-40ce-b314-8b4b1809de78","Type":"ContainerStarted","Data":"64dd3f949e6222c1e1aa03cc6a2d03ba657ad779c2d35afbc6d8e11ca67a7217"}
Jul 24 20:13:04.338861 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:04.338577    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-67ff20-f6ddbffcd-d52g4"
Jul 24 20:13:04.353694 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:04.353643    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-67ff20-f6ddbffcd-d52g4" podStartSLOduration=1.353625131 podStartE2EDuration="1.353625131s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:13:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:13:04.353355432 +0000 UTC m=+2772.871975477" watchObservedRunningTime="2026-07-24 20:13:04.353625131 +0000 UTC m=+2772.872245164"
Jul 24 20:13:15.346646 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:15.346547    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-67ff20-f6ddbffcd-d52g4"
Jul 24 20:13:20.829660 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:20.829618    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-67ff20-m6bq7"]
Jul 24 20:13:20.834063 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:20.834044    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-67ff20-m6bq7"
Jul 24 20:13:20.836963 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:20.836939    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gqw4p\""
Jul 24 20:13:20.839820 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:20.839802    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 20:13:20.849875 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:20.849851    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-67ff20-m6bq7"]
Jul 24 20:13:20.968254 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:20.968219    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c81bf1a-c25d-475c-9465-2d478a3ca486-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-67ff20-m6bq7\" (UID: \"1c81bf1a-c25d-475c-9465-2d478a3ca486\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-67ff20-m6bq7"
Jul 24 20:13:21.069579 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:21.069546    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c81bf1a-c25d-475c-9465-2d478a3ca486-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-67ff20-m6bq7\" (UID: \"1c81bf1a-c25d-475c-9465-2d478a3ca486\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-67ff20-m6bq7"
Jul 24 20:13:21.070157 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:21.070139    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c81bf1a-c25d-475c-9465-2d478a3ca486-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-67ff20-m6bq7\" (UID: \"1c81bf1a-c25d-475c-9465-2d478a3ca486\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-67ff20-m6bq7"
Jul 24 20:13:21.145925 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:21.145890    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-67ff20-m6bq7"
Jul 24 20:13:21.497086 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:21.497063    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-67ff20-m6bq7"]
Jul 24 20:13:21.498793 ip-10-0-133-84 kubenswrapper[2567]: W0724 20:13:21.498763    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c81bf1a_c25d_475c_9465_2d478a3ca486.slice/crio-6db860a18467d6c9e19ad505d7645df29b743eb2359fc8c30dd38b636484d354 WatchSource:0}: Error finding container 6db860a18467d6c9e19ad505d7645df29b743eb2359fc8c30dd38b636484d354: Status 404 returned error can't find the container with id 6db860a18467d6c9e19ad505d7645df29b743eb2359fc8c30dd38b636484d354
Jul 24 20:13:22.438785 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:22.438744    2567 generic.go:356] "Generic (PLEG): container finished" podID="1c81bf1a-c25d-475c-9465-2d478a3ca486" containerID="7de89ef3bb4b8fc163b68f748ad20c35354f17579dd7fb2022054dd50328ac58" exitCode=0
Jul 24 20:13:22.439223 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:22.438833    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-67ff20-m6bq7" event={"ID":"1c81bf1a-c25d-475c-9465-2d478a3ca486","Type":"ContainerDied","Data":"7de89ef3bb4b8fc163b68f748ad20c35354f17579dd7fb2022054dd50328ac58"}
Jul 24 20:13:22.439223 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:22.438964    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-67ff20-m6bq7" event={"ID":"1c81bf1a-c25d-475c-9465-2d478a3ca486","Type":"ContainerStarted","Data":"6db860a18467d6c9e19ad505d7645df29b743eb2359fc8c30dd38b636484d354"}
Jul 24 20:13:23.584812 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:23.584788    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-67ff20-m6bq7"
Jul 24 20:13:23.699214 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:23.699128    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c81bf1a-c25d-475c-9465-2d478a3ca486-maas-api-service-ca\") pod \"1c81bf1a-c25d-475c-9465-2d478a3ca486\" (UID: \"1c81bf1a-c25d-475c-9465-2d478a3ca486\") "
Jul 24 20:13:23.699468 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:23.699445    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c81bf1a-c25d-475c-9465-2d478a3ca486-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1c81bf1a-c25d-475c-9465-2d478a3ca486" (UID: "1c81bf1a-c25d-475c-9465-2d478a3ca486"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:13:23.800446 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:23.800414    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c81bf1a-c25d-475c-9465-2d478a3ca486-maas-api-service-ca\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:13:24.450208 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:24.450174    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-67ff20-m6bq7"
Jul 24 20:13:24.450390 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:24.450177    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-67ff20-m6bq7" event={"ID":"1c81bf1a-c25d-475c-9465-2d478a3ca486","Type":"ContainerDied","Data":"6db860a18467d6c9e19ad505d7645df29b743eb2359fc8c30dd38b636484d354"}
Jul 24 20:13:24.450390 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:24.450301    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6db860a18467d6c9e19ad505d7645df29b743eb2359fc8c30dd38b636484d354"
Jul 24 20:13:32.011797 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:32.011759    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-67ff20-f6ddbffcd-d52g4"]
Jul 24 20:13:32.012254 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:32.012010    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-67ff20-f6ddbffcd-d52g4" podUID="0429727b-5d3e-40ce-b314-8b4b1809de78" containerName="payload-processing" containerID="cri-o://15bb530be466793334ee21629352a615911282a59a705f255131e5ffa37c9837" gracePeriod=30
Jul 24 20:13:32.284289 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:32.284264    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-67ff20-f6ddbffcd-d52g4"
Jul 24 20:13:32.387757 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:32.387723    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0429727b-5d3e-40ce-b314-8b4b1809de78-plugins-config-volume\") pod \"0429727b-5d3e-40ce-b314-8b4b1809de78\" (UID: \"0429727b-5d3e-40ce-b314-8b4b1809de78\") "
Jul 24 20:13:32.387948 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:32.387814    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mzgsr\" (UniqueName: \"kubernetes.io/projected/0429727b-5d3e-40ce-b314-8b4b1809de78-kube-api-access-mzgsr\") pod \"0429727b-5d3e-40ce-b314-8b4b1809de78\" (UID: \"0429727b-5d3e-40ce-b314-8b4b1809de78\") "
Jul 24 20:13:32.388099 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:32.388078    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0429727b-5d3e-40ce-b314-8b4b1809de78-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0429727b-5d3e-40ce-b314-8b4b1809de78" (UID: "0429727b-5d3e-40ce-b314-8b4b1809de78"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:13:32.390032 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:32.390013    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0429727b-5d3e-40ce-b314-8b4b1809de78-kube-api-access-mzgsr" (OuterVolumeSpecName: "kube-api-access-mzgsr") pod "0429727b-5d3e-40ce-b314-8b4b1809de78" (UID: "0429727b-5d3e-40ce-b314-8b4b1809de78"). InnerVolumeSpecName "kube-api-access-mzgsr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:13:32.489677 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:32.489641    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0429727b-5d3e-40ce-b314-8b4b1809de78-plugins-config-volume\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:13:32.489677 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:32.489673    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzgsr\" (UniqueName: \"kubernetes.io/projected/0429727b-5d3e-40ce-b314-8b4b1809de78-kube-api-access-mzgsr\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:13:32.491962 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:32.491925    2567 generic.go:356] "Generic (PLEG): container finished" podID="0429727b-5d3e-40ce-b314-8b4b1809de78" containerID="15bb530be466793334ee21629352a615911282a59a705f255131e5ffa37c9837" exitCode=0
Jul 24 20:13:32.492118 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:32.491967    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-67ff20-f6ddbffcd-d52g4"
Jul 24 20:13:32.492118 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:32.491970    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-67ff20-f6ddbffcd-d52g4" event={"ID":"0429727b-5d3e-40ce-b314-8b4b1809de78","Type":"ContainerDied","Data":"15bb530be466793334ee21629352a615911282a59a705f255131e5ffa37c9837"}
Jul 24 20:13:32.492118 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:32.492101    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-67ff20-f6ddbffcd-d52g4" event={"ID":"0429727b-5d3e-40ce-b314-8b4b1809de78","Type":"ContainerDied","Data":"64dd3f949e6222c1e1aa03cc6a2d03ba657ad779c2d35afbc6d8e11ca67a7217"}
Jul 24 20:13:32.492279 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:32.492134    2567 scope.go:117] "RemoveContainer" containerID="15bb530be466793334ee21629352a615911282a59a705f255131e5ffa37c9837"
Jul 24 20:13:32.501809 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:32.501790    2567 scope.go:117] "RemoveContainer" containerID="15bb530be466793334ee21629352a615911282a59a705f255131e5ffa37c9837"
Jul 24 20:13:32.502055 ip-10-0-133-84 kubenswrapper[2567]: E0724 20:13:32.502040    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15bb530be466793334ee21629352a615911282a59a705f255131e5ffa37c9837\": container with ID starting with 15bb530be466793334ee21629352a615911282a59a705f255131e5ffa37c9837 not found: ID does not exist" containerID="15bb530be466793334ee21629352a615911282a59a705f255131e5ffa37c9837"
Jul 24 20:13:32.502107 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:32.502062    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15bb530be466793334ee21629352a615911282a59a705f255131e5ffa37c9837"} err="failed to get container status \"15bb530be466793334ee21629352a615911282a59a705f255131e5ffa37c9837\": rpc error: code = NotFound desc = could not find container \"15bb530be466793334ee21629352a615911282a59a705f255131e5ffa37c9837\": container with ID starting with 15bb530be466793334ee21629352a615911282a59a705f255131e5ffa37c9837 not found: ID does not exist"
Jul 24 20:13:32.518809 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:32.518750    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-67ff20-f6ddbffcd-d52g4"]
Jul 24 20:13:32.522536 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:32.522516    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-67ff20-f6ddbffcd-d52g4"]
Jul 24 20:13:34.072802 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:34.072771    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0429727b-5d3e-40ce-b314-8b4b1809de78" path="/var/lib/kubelet/pods/0429727b-5d3e-40ce-b314-8b4b1809de78/volumes"
Jul 24 20:13:35.881757 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:35.881725    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-67ff20-m6bq7"]
Jul 24 20:13:35.883735 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:35.883709    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-67ff20-m6bq7"]
Jul 24 20:13:36.071742 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:36.071707    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c81bf1a-c25d-475c-9465-2d478a3ca486" path="/var/lib/kubelet/pods/1c81bf1a-c25d-475c-9465-2d478a3ca486/volumes"
Jul 24 20:13:46.254387 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:46.254349    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-11ccc9-kqxjv"]
Jul 24 20:13:46.254806 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:46.254782    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c81bf1a-c25d-475c-9465-2d478a3ca486" containerName="revoke-keys"
Jul 24 20:13:46.254806 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:46.254795    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c81bf1a-c25d-475c-9465-2d478a3ca486" containerName="revoke-keys"
Jul 24 20:13:46.254879 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:46.254819    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0429727b-5d3e-40ce-b314-8b4b1809de78" containerName="payload-processing"
Jul 24 20:13:46.254879 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:46.254825    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0429727b-5d3e-40ce-b314-8b4b1809de78" containerName="payload-processing"
Jul 24 20:13:46.254947 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:46.254884    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c81bf1a-c25d-475c-9465-2d478a3ca486" containerName="revoke-keys"
Jul 24 20:13:46.254947 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:46.254895    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0429727b-5d3e-40ce-b314-8b4b1809de78" containerName="payload-processing"
Jul 24 20:13:46.259611 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:46.259591    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-11ccc9-kqxjv"
Jul 24 20:13:46.261912 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:46.261875    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gqw4p\""
Jul 24 20:13:46.262092 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:46.261972    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 20:13:46.266025 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:46.266000    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-11ccc9-kqxjv"]
Jul 24 20:13:46.320934 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:46.320902    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7362693-8007-4d7b-a4c9-eb17b88410a4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-11ccc9-kqxjv\" (UID: \"c7362693-8007-4d7b-a4c9-eb17b88410a4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-11ccc9-kqxjv"
Jul 24 20:13:46.421922 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:46.421887    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7362693-8007-4d7b-a4c9-eb17b88410a4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-11ccc9-kqxjv\" (UID: \"c7362693-8007-4d7b-a4c9-eb17b88410a4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-11ccc9-kqxjv"
Jul 24 20:13:46.422510 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:46.422464    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7362693-8007-4d7b-a4c9-eb17b88410a4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-11ccc9-kqxjv\" (UID: \"c7362693-8007-4d7b-a4c9-eb17b88410a4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-11ccc9-kqxjv"
Jul 24 20:13:46.576154 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:46.576061    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-11ccc9-kqxjv"
Jul 24 20:13:46.720344 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:46.720320    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-11ccc9-kqxjv"]
Jul 24 20:13:46.722728 ip-10-0-133-84 kubenswrapper[2567]: W0724 20:13:46.722695    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7362693_8007_4d7b_a4c9_eb17b88410a4.slice/crio-2c8d15b10c1fe0b0a5cc3781b30715be9960e3e5d360a91aa01ecd657c4562e1 WatchSource:0}: Error finding container 2c8d15b10c1fe0b0a5cc3781b30715be9960e3e5d360a91aa01ecd657c4562e1: Status 404 returned error can't find the container with id 2c8d15b10c1fe0b0a5cc3781b30715be9960e3e5d360a91aa01ecd657c4562e1
Jul 24 20:13:47.570039 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:47.570002    2567 generic.go:356] "Generic (PLEG): container finished" podID="c7362693-8007-4d7b-a4c9-eb17b88410a4" containerID="53ce5ec938087f818f0f12b06690d56ab3b825d9277ce911150b747f12951f17" exitCode=0
Jul 24 20:13:47.570468 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:47.570089    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-11ccc9-kqxjv" event={"ID":"c7362693-8007-4d7b-a4c9-eb17b88410a4","Type":"ContainerDied","Data":"53ce5ec938087f818f0f12b06690d56ab3b825d9277ce911150b747f12951f17"}
Jul 24 20:13:47.570468 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:47.570164    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-11ccc9-kqxjv" event={"ID":"c7362693-8007-4d7b-a4c9-eb17b88410a4","Type":"ContainerStarted","Data":"2c8d15b10c1fe0b0a5cc3781b30715be9960e3e5d360a91aa01ecd657c4562e1"}
Jul 24 20:13:48.715697 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:48.715673    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-11ccc9-kqxjv"
Jul 24 20:13:48.744762 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:48.744726    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7362693-8007-4d7b-a4c9-eb17b88410a4-maas-api-service-ca\") pod \"c7362693-8007-4d7b-a4c9-eb17b88410a4\" (UID: \"c7362693-8007-4d7b-a4c9-eb17b88410a4\") "
Jul 24 20:13:48.745065 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:48.745043    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7362693-8007-4d7b-a4c9-eb17b88410a4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c7362693-8007-4d7b-a4c9-eb17b88410a4" (UID: "c7362693-8007-4d7b-a4c9-eb17b88410a4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:13:48.845895 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:48.845819    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7362693-8007-4d7b-a4c9-eb17b88410a4-maas-api-service-ca\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:13:49.582184 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:49.582157    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-11ccc9-kqxjv"
Jul 24 20:13:49.582400 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:49.582193    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-11ccc9-kqxjv" event={"ID":"c7362693-8007-4d7b-a4c9-eb17b88410a4","Type":"ContainerDied","Data":"2c8d15b10c1fe0b0a5cc3781b30715be9960e3e5d360a91aa01ecd657c4562e1"}
Jul 24 20:13:49.582400 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:13:49.582244    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2c8d15b10c1fe0b0a5cc3781b30715be9960e3e5d360a91aa01ecd657c4562e1"
Jul 24 20:14:07.320903 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:14:07.320860    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-11ccc9-5d6b8d7486-9fs84"]
Jul 24 20:14:07.321514 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:14:07.321094    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-11ccc9-5d6b8d7486-9fs84" podUID="06338445-58c6-48e7-b221-dc274a95a237" containerName="payload-processing" containerID="cri-o://27dee13063ccea91a2107bd5231a3594e38eb95fd87862d0018b0597a75815ee" gracePeriod=30
Jul 24 20:14:07.334973 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:14:07.332452    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-11ccc9-5fd96b4544-vmfsn"]
Jul 24 20:14:07.334973 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:14:07.332782    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-11ccc9-5fd96b4544-vmfsn" podUID="3d1abee9-4fad-4dcc-9735-b6bb83c3f17a" containerName="payload-pre-processing" containerID="cri-o://40b1020d578b9efb6af973fc1a033259abf1db63031861576b61bd82209a8d67" gracePeriod=30
Jul 24 20:14:07.589993 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:14:07.589969    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-11ccc9-5d6b8d7486-9fs84"
Jul 24 20:14:07.621258 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:14:07.621233    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-11ccc9-5fd96b4544-vmfsn"
Jul 24 20:14:07.679062 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:14:07.679030    2567 generic.go:356] "Generic (PLEG): container finished" podID="06338445-58c6-48e7-b221-dc274a95a237" containerID="27dee13063ccea91a2107bd5231a3594e38eb95fd87862d0018b0597a75815ee" exitCode=0
Jul 24 20:14:07.679241 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:14:07.679075    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-11ccc9-5d6b8d7486-9fs84"
Jul 24 20:14:07.679241 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:14:07.679108    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-11ccc9-5d6b8d7486-9fs84" event={"ID":"06338445-58c6-48e7-b221-dc274a95a237","Type":"ContainerDied","Data":"27dee13063ccea91a2107bd5231a3594e38eb95fd87862d0018b0597a75815ee"}
Jul 24 20:14:07.679241 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:14:07.679175    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-11ccc9-5d6b8d7486-9fs84" event={"ID":"06338445-58c6-48e7-b221-dc274a95a237","Type":"ContainerDied","Data":"20a43d1d575d55fb7a277502d24e7b631f467a9887c09306e65ec72b1c81464f"}
Jul 24 20:14:07.679241 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:14:07.679210    2567 scope.go:117] "RemoveContainer" containerID="27dee13063ccea91a2107bd5231a3594e38eb95fd87862d0018b0597a75815ee"
Jul 24 20:14:07.680423 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:14:07.680402    2567 generic.go:356] "Generic (PLEG): container finished" podID="3d1abee9-4fad-4dcc-9735-b6bb83c3f17a" containerID="40b1020d578b9efb6af973fc1a033259abf1db63031861576b61bd82209a8d67" exitCode=0
Jul 24 20:14:07.680522 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:14:07.680433    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-11ccc9-5fd96b4544-vmfsn" event={"ID":"3d1abee9-4fad-4dcc-9735-b6bb83c3f17a","Type":"ContainerDied","Data":"40b1020d578b9efb6af973fc1a033259abf1db63031861576b61bd82209a8d67"}
Jul 24 20:14:07.680522 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:14:07.680454    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-11ccc9-5fd96b4544-vmfsn"
Jul 24 20:14:07.680522 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:14:07.680472    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-11ccc9-5fd96b4544-vmfsn" event={"ID":"3d1abee9-4fad-4dcc-9735-b6bb83c3f17a","Type":"ContainerDied","Data":"eb319bb0b2ed71e1186225527a31772072a9869ddc0f08e28a8c33688b654da2"}
Jul 24 20:14:07.687802 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:14:07.687785    2567 scope.go:117] "RemoveContainer" containerID="27dee13063ccea91a2107bd5231a3594e38eb95fd87862d0018b0597a75815ee"
Jul 24 20:14:07.688047 ip-10-0-133-84 kubenswrapper[2567]: E0724 20:14:07.688031    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27dee13063ccea91a2107bd5231a3594e38eb95fd87862d0018b0597a75815ee\": container with ID starting with 27dee13063ccea91a2107bd5231a3594e38eb95fd87862d0018b0597a75815ee not found: ID does not exist" containerID="27dee13063ccea91a2107bd5231a3594e38eb95fd87862d0018b0597a75815ee"
Jul 24 20:14:07.688119 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:14:07.688053    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27dee13063ccea91a2107bd5231a3594e38eb95fd87862d0018b0597a75815ee"} err="failed to get container status \"27dee13063ccea91a2107bd5231a3594e38eb95fd87862d0018b0597a75815ee\": rpc error: code = NotFound desc = could not find container \"27dee13063ccea91a2107bd5231a3594e38eb95fd87862d0018b0597a75815ee\": container with ID starting with 27dee13063ccea91a2107bd5231a3594e38eb95fd87862d0018b0597a75815ee not found: ID does not exist"
Jul 24 20:14:07.688119 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:14:07.688069    2567 scope.go:117] "RemoveContainer" containerID="40b1020d578b9efb6af973fc1a033259abf1db63031861576b61bd82209a8d67"
Jul 24 20:14:07.695845 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:14:07.695826    2567 scope.go:117] "RemoveContainer" containerID="40b1020d578b9efb6af973fc1a033259abf1db63031861576b61bd82209a8d67"
Jul 24 20:14:07.696077 ip-10-0-133-84 kubenswrapper[2567]: E0724 20:14:07.696061    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40b1020d578b9efb6af973fc1a033259abf1db63031861576b61bd82209a8d67\": container with ID starting with 40b1020d578b9efb6af973fc1a033259abf1db63031861576b61bd82209a8d67 not found: ID does not exist" containerID="40b1020d578b9efb6af973fc1a033259abf1db63031861576b61bd82209a8d67"
Jul 24 20:14:07.696126 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:14:07.696083    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40b1020d578b9efb6af973fc1a033259abf1db63031861576b61bd82209a8d67"} err="failed to get container status \"40b1020d578b9efb6af973fc1a033259abf1db63031861576b61bd82209a8d67\": rpc error: code = NotFound desc = could not find container \"40b1020d578b9efb6af973fc1a033259abf1db63031861576b61bd82209a8d67\": container with ID starting with 40b1020d578b9efb6af973fc1a033259abf1db63031861576b61bd82209a8d67 not found: ID does not exist"
Jul 24 20:14:07.717429 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:14:07.717405    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3d1abee9-4fad-4dcc-9735-b6bb83c3f17a-plugins-config-volume\") pod \"3d1abee9-4fad-4dcc-9735-b6bb83c3f17a\" (UID: \"3d1abee9-4fad-4dcc-9735-b6bb83c3f17a\") "
Jul 24 20:14:07.717537 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:14:07.717455    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ns9jb\" (UniqueName: \"kubernetes.io/projected/3d1abee9-4fad-4dcc-9735-b6bb83c3f17a-kube-api-access-ns9jb\") pod \"3d1abee9-4fad-4dcc-9735-b6bb83c3f17a\" (UID: \"3d1abee9-4fad-4dcc-9735-b6bb83c3f17a\") "
Jul 24 20:14:07.717537 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:14:07.717513    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06338445-58c6-48e7-b221-dc274a95a237-plugins-config-volume\") pod \"06338445-58c6-48e7-b221-dc274a95a237\" (UID: \"06338445-58c6-48e7-b221-dc274a95a237\") "
Jul 24 20:14:07.717626 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:14:07.717558    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjpld\" (UniqueName: \"kubernetes.io/projected/06338445-58c6-48e7-b221-dc274a95a237-kube-api-access-jjpld\") pod \"06338445-58c6-48e7-b221-dc274a95a237\" (UID: \"06338445-58c6-48e7-b221-dc274a95a237\") "
Jul 24 20:14:07.717860 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:14:07.717840    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d1abee9-4fad-4dcc-9735-b6bb83c3f17a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3d1abee9-4fad-4dcc-9735-b6bb83c3f17a" (UID: "3d1abee9-4fad-4dcc-9735-b6bb83c3f17a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:14:07.717927 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:14:07.717905    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06338445-58c6-48e7-b221-dc274a95a237-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "06338445-58c6-48e7-b221-dc274a95a237" (UID: "06338445-58c6-48e7-b221-dc274a95a237"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:14:07.719587 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:14:07.719567    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d1abee9-4fad-4dcc-9735-b6bb83c3f17a-kube-api-access-ns9jb" (OuterVolumeSpecName: "kube-api-access-ns9jb") pod "3d1abee9-4fad-4dcc-9735-b6bb83c3f17a" (UID: "3d1abee9-4fad-4dcc-9735-b6bb83c3f17a"). InnerVolumeSpecName "kube-api-access-ns9jb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:14:07.719672 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:14:07.719653    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06338445-58c6-48e7-b221-dc274a95a237-kube-api-access-jjpld" (OuterVolumeSpecName: "kube-api-access-jjpld") pod "06338445-58c6-48e7-b221-dc274a95a237" (UID: "06338445-58c6-48e7-b221-dc274a95a237"). InnerVolumeSpecName "kube-api-access-jjpld". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:14:07.818636 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:14:07.818603    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3d1abee9-4fad-4dcc-9735-b6bb83c3f17a-plugins-config-volume\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:14:07.818636 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:14:07.818629    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ns9jb\" (UniqueName: \"kubernetes.io/projected/3d1abee9-4fad-4dcc-9735-b6bb83c3f17a-kube-api-access-ns9jb\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:14:07.818636 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:14:07.818638    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06338445-58c6-48e7-b221-dc274a95a237-plugins-config-volume\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:14:07.818839 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:14:07.818651    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjpld\" (UniqueName: \"kubernetes.io/projected/06338445-58c6-48e7-b221-dc274a95a237-kube-api-access-jjpld\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:14:08.005780 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:14:08.005747    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-11ccc9-5d6b8d7486-9fs84"]
Jul 24 20:14:08.009674 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:14:08.009650    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-11ccc9-5d6b8d7486-9fs84"]
Jul 24 20:14:08.019337 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:14:08.019306    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-11ccc9-5fd96b4544-vmfsn"]
Jul 24 20:14:08.021413 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:14:08.021391    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-11ccc9-5fd96b4544-vmfsn"]
Jul 24 20:14:08.075446 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:14:08.075414    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06338445-58c6-48e7-b221-dc274a95a237" path="/var/lib/kubelet/pods/06338445-58c6-48e7-b221-dc274a95a237/volumes"
Jul 24 20:14:08.075808 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:14:08.075796    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d1abee9-4fad-4dcc-9735-b6bb83c3f17a" path="/var/lib/kubelet/pods/3d1abee9-4fad-4dcc-9735-b6bb83c3f17a/volumes"
Jul 24 20:14:11.341495 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:14:11.341444    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-11ccc9-kqxjv"]
Jul 24 20:14:11.343336 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:14:11.343311    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-11ccc9-kqxjv"]
Jul 24 20:14:12.072923 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:14:12.072883    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7362693-8007-4d7b-a4c9-eb17b88410a4" path="/var/lib/kubelet/pods/c7362693-8007-4d7b-a4c9-eb17b88410a4/volumes"
Jul 24 20:15:12.794987 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:12.794947    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-75b982-6b66f4b9d-gppkb"]
Jul 24 20:15:12.795537 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:12.795182    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-75b982-6b66f4b9d-gppkb" podUID="82f09e72-6966-40b5-a5c0-d7e3ea91387f" containerName="payload-processing" containerID="cri-o://5ab14b937224515ddb87297ca2e335cac1f3d9934256b92641e7caf04d07d79f" gracePeriod=30
Jul 24 20:15:12.805497 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:12.805448    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-75b982-f8d684f44-jc77b"]
Jul 24 20:15:12.805725 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:12.805701    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-75b982-f8d684f44-jc77b" podUID="c03627eb-9f45-4ceb-85fe-bfde55af4fe6" containerName="payload-pre-processing" containerID="cri-o://a7cb07b5df471928f875fb9db2d3fd875c4c98e00af14735b5cce577468f9cbd" gracePeriod=30
Jul 24 20:15:13.016419 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:13.016386    2567 generic.go:356] "Generic (PLEG): container finished" podID="82f09e72-6966-40b5-a5c0-d7e3ea91387f" containerID="5ab14b937224515ddb87297ca2e335cac1f3d9934256b92641e7caf04d07d79f" exitCode=0
Jul 24 20:15:13.016655 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:13.016467    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-75b982-6b66f4b9d-gppkb" event={"ID":"82f09e72-6966-40b5-a5c0-d7e3ea91387f","Type":"ContainerDied","Data":"5ab14b937224515ddb87297ca2e335cac1f3d9934256b92641e7caf04d07d79f"}
Jul 24 20:15:13.018171 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:13.018148    2567 generic.go:356] "Generic (PLEG): container finished" podID="c03627eb-9f45-4ceb-85fe-bfde55af4fe6" containerID="a7cb07b5df471928f875fb9db2d3fd875c4c98e00af14735b5cce577468f9cbd" exitCode=0
Jul 24 20:15:13.018285 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:13.018209    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-75b982-f8d684f44-jc77b" event={"ID":"c03627eb-9f45-4ceb-85fe-bfde55af4fe6","Type":"ContainerDied","Data":"a7cb07b5df471928f875fb9db2d3fd875c4c98e00af14735b5cce577468f9cbd"}
Jul 24 20:15:13.071063 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:13.071038    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-75b982-6b66f4b9d-gppkb"
Jul 24 20:15:13.096164 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:13.096142    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-75b982-f8d684f44-jc77b"
Jul 24 20:15:13.145881 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:13.145857    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c03627eb-9f45-4ceb-85fe-bfde55af4fe6-plugins-config-volume\") pod \"c03627eb-9f45-4ceb-85fe-bfde55af4fe6\" (UID: \"c03627eb-9f45-4ceb-85fe-bfde55af4fe6\") "
Jul 24 20:15:13.146069 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:13.145891    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zjh48\" (UniqueName: \"kubernetes.io/projected/82f09e72-6966-40b5-a5c0-d7e3ea91387f-kube-api-access-zjh48\") pod \"82f09e72-6966-40b5-a5c0-d7e3ea91387f\" (UID: \"82f09e72-6966-40b5-a5c0-d7e3ea91387f\") "
Jul 24 20:15:13.146069 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:13.145960    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qghx2\" (UniqueName: \"kubernetes.io/projected/c03627eb-9f45-4ceb-85fe-bfde55af4fe6-kube-api-access-qghx2\") pod \"c03627eb-9f45-4ceb-85fe-bfde55af4fe6\" (UID: \"c03627eb-9f45-4ceb-85fe-bfde55af4fe6\") "
Jul 24 20:15:13.146069 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:13.146031    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82f09e72-6966-40b5-a5c0-d7e3ea91387f-plugins-config-volume\") pod \"82f09e72-6966-40b5-a5c0-d7e3ea91387f\" (UID: \"82f09e72-6966-40b5-a5c0-d7e3ea91387f\") "
Jul 24 20:15:13.146383 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:13.146281    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c03627eb-9f45-4ceb-85fe-bfde55af4fe6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c03627eb-9f45-4ceb-85fe-bfde55af4fe6" (UID: "c03627eb-9f45-4ceb-85fe-bfde55af4fe6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:15:13.146503 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:13.146460    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82f09e72-6966-40b5-a5c0-d7e3ea91387f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "82f09e72-6966-40b5-a5c0-d7e3ea91387f" (UID: "82f09e72-6966-40b5-a5c0-d7e3ea91387f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:15:13.148275 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:13.148248    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82f09e72-6966-40b5-a5c0-d7e3ea91387f-kube-api-access-zjh48" (OuterVolumeSpecName: "kube-api-access-zjh48") pod "82f09e72-6966-40b5-a5c0-d7e3ea91387f" (UID: "82f09e72-6966-40b5-a5c0-d7e3ea91387f"). InnerVolumeSpecName "kube-api-access-zjh48". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:15:13.148384 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:13.148365    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c03627eb-9f45-4ceb-85fe-bfde55af4fe6-kube-api-access-qghx2" (OuterVolumeSpecName: "kube-api-access-qghx2") pod "c03627eb-9f45-4ceb-85fe-bfde55af4fe6" (UID: "c03627eb-9f45-4ceb-85fe-bfde55af4fe6"). InnerVolumeSpecName "kube-api-access-qghx2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:15:13.247061 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:13.247029    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qghx2\" (UniqueName: \"kubernetes.io/projected/c03627eb-9f45-4ceb-85fe-bfde55af4fe6-kube-api-access-qghx2\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:15:13.247061 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:13.247057    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82f09e72-6966-40b5-a5c0-d7e3ea91387f-plugins-config-volume\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:15:13.247247 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:13.247071    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c03627eb-9f45-4ceb-85fe-bfde55af4fe6-plugins-config-volume\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:15:13.247247 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:13.247083    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zjh48\" (UniqueName: \"kubernetes.io/projected/82f09e72-6966-40b5-a5c0-d7e3ea91387f-kube-api-access-zjh48\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:15:14.024243 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:14.024217    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-75b982-6b66f4b9d-gppkb"
Jul 24 20:15:14.024694 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:14.024253    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-75b982-6b66f4b9d-gppkb" event={"ID":"82f09e72-6966-40b5-a5c0-d7e3ea91387f","Type":"ContainerDied","Data":"53f81e93ce67114421b003229114aeaa45b91aefc8ccfccbdaa35ad69f6b2371"}
Jul 24 20:15:14.024694 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:14.024310    2567 scope.go:117] "RemoveContainer" containerID="5ab14b937224515ddb87297ca2e335cac1f3d9934256b92641e7caf04d07d79f"
Jul 24 20:15:14.025662 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:14.025557    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-75b982-f8d684f44-jc77b"
Jul 24 20:15:14.025662 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:14.025561    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-75b982-f8d684f44-jc77b" event={"ID":"c03627eb-9f45-4ceb-85fe-bfde55af4fe6","Type":"ContainerDied","Data":"047de1e72e3dcf2c780dd7e7dde754415e48b6567212c8794aafb5fdd3d4962b"}
Jul 24 20:15:14.034424 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:14.034403    2567 scope.go:117] "RemoveContainer" containerID="a7cb07b5df471928f875fb9db2d3fd875c4c98e00af14735b5cce577468f9cbd"
Jul 24 20:15:14.047442 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:14.047420    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-75b982-f8d684f44-jc77b"]
Jul 24 20:15:14.049689 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:14.049662    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-75b982-f8d684f44-jc77b"]
Jul 24 20:15:14.059406 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:14.059385    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-75b982-6b66f4b9d-gppkb"]
Jul 24 20:15:14.064609 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:14.064559    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-75b982-6b66f4b9d-gppkb"]
Jul 24 20:15:14.071619 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:14.071599    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82f09e72-6966-40b5-a5c0-d7e3ea91387f" path="/var/lib/kubelet/pods/82f09e72-6966-40b5-a5c0-d7e3ea91387f/volumes"
Jul 24 20:15:14.071967 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:14.071947    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c03627eb-9f45-4ceb-85fe-bfde55af4fe6" path="/var/lib/kubelet/pods/c03627eb-9f45-4ceb-85fe-bfde55af4fe6/volumes"
Jul 24 20:15:33.988591 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:33.988551    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-8abb86-644fcbcf66-gxgpt"]
Jul 24 20:15:33.989112 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:33.988815    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-8abb86-644fcbcf66-gxgpt" podUID="451b8933-4bb9-4295-ad1f-8c31ecfba634" containerName="payload-processing" containerID="cri-o://fb05b0c10425ef94b9ccec70259807e2f4cbef4276c878667de582904762a6a4" gracePeriod=30
Jul 24 20:15:33.997124 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:33.997061    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-8abb86-5b8d99466d-nglkh"]
Jul 24 20:15:33.997312 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:33.997286    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-8abb86-5b8d99466d-nglkh" podUID="69095654-3535-447c-b554-7fd6feadff1a" containerName="payload-pre-processing" containerID="cri-o://f77f4ea3d2a73ee20c6e520156c614ef2902ff90cbf7a7bab6facb2816404325" gracePeriod=30
Jul 24 20:15:34.128334 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:34.128302    2567 generic.go:356] "Generic (PLEG): container finished" podID="69095654-3535-447c-b554-7fd6feadff1a" containerID="f77f4ea3d2a73ee20c6e520156c614ef2902ff90cbf7a7bab6facb2816404325" exitCode=0
Jul 24 20:15:34.128523 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:34.128369    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-8abb86-5b8d99466d-nglkh" event={"ID":"69095654-3535-447c-b554-7fd6feadff1a","Type":"ContainerDied","Data":"f77f4ea3d2a73ee20c6e520156c614ef2902ff90cbf7a7bab6facb2816404325"}
Jul 24 20:15:34.130266 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:34.130242    2567 generic.go:356] "Generic (PLEG): container finished" podID="451b8933-4bb9-4295-ad1f-8c31ecfba634" containerID="fb05b0c10425ef94b9ccec70259807e2f4cbef4276c878667de582904762a6a4" exitCode=0
Jul 24 20:15:34.130391 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:34.130279    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-8abb86-644fcbcf66-gxgpt" event={"ID":"451b8933-4bb9-4295-ad1f-8c31ecfba634","Type":"ContainerDied","Data":"fb05b0c10425ef94b9ccec70259807e2f4cbef4276c878667de582904762a6a4"}
Jul 24 20:15:34.280863 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:34.280842    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-8abb86-644fcbcf66-gxgpt"
Jul 24 20:15:34.283769 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:34.283748    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-8abb86-5b8d99466d-nglkh"
Jul 24 20:15:34.350462 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:34.350431    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrbjx\" (UniqueName: \"kubernetes.io/projected/69095654-3535-447c-b554-7fd6feadff1a-kube-api-access-qrbjx\") pod \"69095654-3535-447c-b554-7fd6feadff1a\" (UID: \"69095654-3535-447c-b554-7fd6feadff1a\") "
Jul 24 20:15:34.350668 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:34.350534    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/69095654-3535-447c-b554-7fd6feadff1a-plugins-config-volume\") pod \"69095654-3535-447c-b554-7fd6feadff1a\" (UID: \"69095654-3535-447c-b554-7fd6feadff1a\") "
Jul 24 20:15:34.350668 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:34.350587    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g468p\" (UniqueName: \"kubernetes.io/projected/451b8933-4bb9-4295-ad1f-8c31ecfba634-kube-api-access-g468p\") pod \"451b8933-4bb9-4295-ad1f-8c31ecfba634\" (UID: \"451b8933-4bb9-4295-ad1f-8c31ecfba634\") "
Jul 24 20:15:34.350668 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:34.350623    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/451b8933-4bb9-4295-ad1f-8c31ecfba634-plugins-config-volume\") pod \"451b8933-4bb9-4295-ad1f-8c31ecfba634\" (UID: \"451b8933-4bb9-4295-ad1f-8c31ecfba634\") "
Jul 24 20:15:34.350919 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:34.350892    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69095654-3535-447c-b554-7fd6feadff1a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "69095654-3535-447c-b554-7fd6feadff1a" (UID: "69095654-3535-447c-b554-7fd6feadff1a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:15:34.351045 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:34.351025    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/451b8933-4bb9-4295-ad1f-8c31ecfba634-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "451b8933-4bb9-4295-ad1f-8c31ecfba634" (UID: "451b8933-4bb9-4295-ad1f-8c31ecfba634"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:15:34.352635 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:34.352612    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69095654-3535-447c-b554-7fd6feadff1a-kube-api-access-qrbjx" (OuterVolumeSpecName: "kube-api-access-qrbjx") pod "69095654-3535-447c-b554-7fd6feadff1a" (UID: "69095654-3535-447c-b554-7fd6feadff1a"). InnerVolumeSpecName "kube-api-access-qrbjx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:15:34.352740 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:34.352696    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/451b8933-4bb9-4295-ad1f-8c31ecfba634-kube-api-access-g468p" (OuterVolumeSpecName: "kube-api-access-g468p") pod "451b8933-4bb9-4295-ad1f-8c31ecfba634" (UID: "451b8933-4bb9-4295-ad1f-8c31ecfba634"). InnerVolumeSpecName "kube-api-access-g468p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:15:34.451717 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:34.451681    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/69095654-3535-447c-b554-7fd6feadff1a-plugins-config-volume\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:15:34.451717 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:34.451709    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g468p\" (UniqueName: \"kubernetes.io/projected/451b8933-4bb9-4295-ad1f-8c31ecfba634-kube-api-access-g468p\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:15:34.451717 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:34.451718    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/451b8933-4bb9-4295-ad1f-8c31ecfba634-plugins-config-volume\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:15:34.451939 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:34.451729    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrbjx\" (UniqueName: \"kubernetes.io/projected/69095654-3535-447c-b554-7fd6feadff1a-kube-api-access-qrbjx\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:15:35.136264 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:35.136238    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-8abb86-644fcbcf66-gxgpt"
Jul 24 20:15:35.136769 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:35.136268    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-8abb86-644fcbcf66-gxgpt" event={"ID":"451b8933-4bb9-4295-ad1f-8c31ecfba634","Type":"ContainerDied","Data":"3cbfae0f4d951a5ac9b333be5af05b217ded887007949d35ae8bc6734b3db76e"}
Jul 24 20:15:35.136769 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:35.136329    2567 scope.go:117] "RemoveContainer" containerID="fb05b0c10425ef94b9ccec70259807e2f4cbef4276c878667de582904762a6a4"
Jul 24 20:15:35.137744 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:35.137724    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-8abb86-5b8d99466d-nglkh" event={"ID":"69095654-3535-447c-b554-7fd6feadff1a","Type":"ContainerDied","Data":"a9ebb92c943eecb219aa788865a1caad21864c760c93a09984855f19fb37d65c"}
Jul 24 20:15:35.137823 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:35.137752    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-8abb86-5b8d99466d-nglkh"
Jul 24 20:15:35.145818 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:35.145802    2567 scope.go:117] "RemoveContainer" containerID="f77f4ea3d2a73ee20c6e520156c614ef2902ff90cbf7a7bab6facb2816404325"
Jul 24 20:15:35.161512 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:35.161468    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-8abb86-644fcbcf66-gxgpt"]
Jul 24 20:15:35.165097 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:35.165075    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-8abb86-644fcbcf66-gxgpt"]
Jul 24 20:15:35.177078 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:35.177055    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-8abb86-5b8d99466d-nglkh"]
Jul 24 20:15:35.181229 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:35.181208    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-8abb86-5b8d99466d-nglkh"]
Jul 24 20:15:36.073021 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:36.072988    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="451b8933-4bb9-4295-ad1f-8c31ecfba634" path="/var/lib/kubelet/pods/451b8933-4bb9-4295-ad1f-8c31ecfba634/volumes"
Jul 24 20:15:36.073371 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:36.073355    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69095654-3535-447c-b554-7fd6feadff1a" path="/var/lib/kubelet/pods/69095654-3535-447c-b554-7fd6feadff1a/volumes"
Jul 24 20:15:45.183029 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:45.182985    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq"]
Jul 24 20:15:45.187055 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:45.183192    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq" podUID="9214ccf1-343c-4837-85e6-8fa646722e2c" containerName="istio-proxy" containerID="cri-o://8e4b49fcfcf483389b6048c734ef1fd91f1f8a152206b1221ce7f3e7d708a67b" gracePeriod=30
Jul 24 20:15:46.927464 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:46.927422    2567 patch_prober.go:28] interesting pod/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 20:15:46.927866 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:46.927513    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq" podUID="9214ccf1-343c-4837-85e6-8fa646722e2c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 20:15:50.432667 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:50.432642    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq"
Jul 24 20:15:50.514827 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:50.514745    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9214ccf1-343c-4837-85e6-8fa646722e2c-istio-envoy\") pod \"9214ccf1-343c-4837-85e6-8fa646722e2c\" (UID: \"9214ccf1-343c-4837-85e6-8fa646722e2c\") "
Jul 24 20:15:50.514827 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:50.514782    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9214ccf1-343c-4837-85e6-8fa646722e2c-credential-socket\") pod \"9214ccf1-343c-4837-85e6-8fa646722e2c\" (UID: \"9214ccf1-343c-4837-85e6-8fa646722e2c\") "
Jul 24 20:15:50.514827 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:50.514818    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9214ccf1-343c-4837-85e6-8fa646722e2c-istiod-ca-cert\") pod \"9214ccf1-343c-4837-85e6-8fa646722e2c\" (UID: \"9214ccf1-343c-4837-85e6-8fa646722e2c\") "
Jul 24 20:15:50.515100 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:50.514849    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9214ccf1-343c-4837-85e6-8fa646722e2c-workload-certs\") pod \"9214ccf1-343c-4837-85e6-8fa646722e2c\" (UID: \"9214ccf1-343c-4837-85e6-8fa646722e2c\") "
Jul 24 20:15:50.515100 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:50.514878    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9214ccf1-343c-4837-85e6-8fa646722e2c-istio-data\") pod \"9214ccf1-343c-4837-85e6-8fa646722e2c\" (UID: \"9214ccf1-343c-4837-85e6-8fa646722e2c\") "
Jul 24 20:15:50.515100 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:50.514909    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hk66w\" (UniqueName: \"kubernetes.io/projected/9214ccf1-343c-4837-85e6-8fa646722e2c-kube-api-access-hk66w\") pod \"9214ccf1-343c-4837-85e6-8fa646722e2c\" (UID: \"9214ccf1-343c-4837-85e6-8fa646722e2c\") "
Jul 24 20:15:50.515100 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:50.514930    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9214ccf1-343c-4837-85e6-8fa646722e2c-istio-token\") pod \"9214ccf1-343c-4837-85e6-8fa646722e2c\" (UID: \"9214ccf1-343c-4837-85e6-8fa646722e2c\") "
Jul 24 20:15:50.515100 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:50.514960    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9214ccf1-343c-4837-85e6-8fa646722e2c-workload-socket\") pod \"9214ccf1-343c-4837-85e6-8fa646722e2c\" (UID: \"9214ccf1-343c-4837-85e6-8fa646722e2c\") "
Jul 24 20:15:50.515100 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:50.514982    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9214ccf1-343c-4837-85e6-8fa646722e2c-istio-podinfo\") pod \"9214ccf1-343c-4837-85e6-8fa646722e2c\" (UID: \"9214ccf1-343c-4837-85e6-8fa646722e2c\") "
Jul 24 20:15:50.515376 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:50.515225    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9214ccf1-343c-4837-85e6-8fa646722e2c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9214ccf1-343c-4837-85e6-8fa646722e2c" (UID: "9214ccf1-343c-4837-85e6-8fa646722e2c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:15:50.515376 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:50.515237    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9214ccf1-343c-4837-85e6-8fa646722e2c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9214ccf1-343c-4837-85e6-8fa646722e2c" (UID: "9214ccf1-343c-4837-85e6-8fa646722e2c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:15:50.515376 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:50.515306    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9214ccf1-343c-4837-85e6-8fa646722e2c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9214ccf1-343c-4837-85e6-8fa646722e2c" (UID: "9214ccf1-343c-4837-85e6-8fa646722e2c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:15:50.515558 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:50.515432    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9214ccf1-343c-4837-85e6-8fa646722e2c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9214ccf1-343c-4837-85e6-8fa646722e2c" (UID: "9214ccf1-343c-4837-85e6-8fa646722e2c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:15:50.515866 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:50.515833    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9214ccf1-343c-4837-85e6-8fa646722e2c-istio-data" (OuterVolumeSpecName: "istio-data") pod "9214ccf1-343c-4837-85e6-8fa646722e2c" (UID: "9214ccf1-343c-4837-85e6-8fa646722e2c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:15:50.517307 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:50.517282    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9214ccf1-343c-4837-85e6-8fa646722e2c-kube-api-access-hk66w" (OuterVolumeSpecName: "kube-api-access-hk66w") pod "9214ccf1-343c-4837-85e6-8fa646722e2c" (UID: "9214ccf1-343c-4837-85e6-8fa646722e2c"). InnerVolumeSpecName "kube-api-access-hk66w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:15:50.517422 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:50.517357    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9214ccf1-343c-4837-85e6-8fa646722e2c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9214ccf1-343c-4837-85e6-8fa646722e2c" (UID: "9214ccf1-343c-4837-85e6-8fa646722e2c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 20:15:50.517743 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:50.517710    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9214ccf1-343c-4837-85e6-8fa646722e2c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9214ccf1-343c-4837-85e6-8fa646722e2c" (UID: "9214ccf1-343c-4837-85e6-8fa646722e2c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:15:50.517836 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:50.517758    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9214ccf1-343c-4837-85e6-8fa646722e2c-istio-token" (OuterVolumeSpecName: "istio-token") pod "9214ccf1-343c-4837-85e6-8fa646722e2c" (UID: "9214ccf1-343c-4837-85e6-8fa646722e2c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:15:50.616204 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:50.616171    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hk66w\" (UniqueName: \"kubernetes.io/projected/9214ccf1-343c-4837-85e6-8fa646722e2c-kube-api-access-hk66w\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:15:50.616204 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:50.616199    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9214ccf1-343c-4837-85e6-8fa646722e2c-istio-token\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:15:50.616204 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:50.616207    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9214ccf1-343c-4837-85e6-8fa646722e2c-workload-socket\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:15:50.616509 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:50.616217    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9214ccf1-343c-4837-85e6-8fa646722e2c-istio-podinfo\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:15:50.616509 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:50.616225    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9214ccf1-343c-4837-85e6-8fa646722e2c-istio-envoy\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:15:50.616509 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:50.616232    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9214ccf1-343c-4837-85e6-8fa646722e2c-credential-socket\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:15:50.616509 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:50.616240    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9214ccf1-343c-4837-85e6-8fa646722e2c-istiod-ca-cert\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:15:50.616509 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:50.616248    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9214ccf1-343c-4837-85e6-8fa646722e2c-workload-certs\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:15:50.616509 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:50.616258    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9214ccf1-343c-4837-85e6-8fa646722e2c-istio-data\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:15:51.218641 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:51.218607    2567 generic.go:356] "Generic (PLEG): container finished" podID="9214ccf1-343c-4837-85e6-8fa646722e2c" containerID="8e4b49fcfcf483389b6048c734ef1fd91f1f8a152206b1221ce7f3e7d708a67b" exitCode=0
Jul 24 20:15:51.218807 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:51.218654    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq"
Jul 24 20:15:51.218807 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:51.218684    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq" event={"ID":"9214ccf1-343c-4837-85e6-8fa646722e2c","Type":"ContainerDied","Data":"8e4b49fcfcf483389b6048c734ef1fd91f1f8a152206b1221ce7f3e7d708a67b"}
Jul 24 20:15:51.218807 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:51.218731    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq" event={"ID":"9214ccf1-343c-4837-85e6-8fa646722e2c","Type":"ContainerDied","Data":"04f135bccc26d89a388b5981d8c6f6e6323582c55627cf3aa403072a5377e535"}
Jul 24 20:15:51.218807 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:51.218752    2567 scope.go:117] "RemoveContainer" containerID="8e4b49fcfcf483389b6048c734ef1fd91f1f8a152206b1221ce7f3e7d708a67b"
Jul 24 20:15:51.229953 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:51.229918    2567 scope.go:117] "RemoveContainer" containerID="639b60c946fefb2ae4ccd2df66824298b7a8ceabfbabcd771805f11c2878252f"
Jul 24 20:15:51.237708 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:51.237691    2567 scope.go:117] "RemoveContainer" containerID="8e4b49fcfcf483389b6048c734ef1fd91f1f8a152206b1221ce7f3e7d708a67b"
Jul 24 20:15:51.237960 ip-10-0-133-84 kubenswrapper[2567]: E0724 20:15:51.237941    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e4b49fcfcf483389b6048c734ef1fd91f1f8a152206b1221ce7f3e7d708a67b\": container with ID starting with 8e4b49fcfcf483389b6048c734ef1fd91f1f8a152206b1221ce7f3e7d708a67b not found: ID does not exist" containerID="8e4b49fcfcf483389b6048c734ef1fd91f1f8a152206b1221ce7f3e7d708a67b"
Jul 24 20:15:51.238042 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:51.237969    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e4b49fcfcf483389b6048c734ef1fd91f1f8a152206b1221ce7f3e7d708a67b"} err="failed to get container status \"8e4b49fcfcf483389b6048c734ef1fd91f1f8a152206b1221ce7f3e7d708a67b\": rpc error: code = NotFound desc = could not find container \"8e4b49fcfcf483389b6048c734ef1fd91f1f8a152206b1221ce7f3e7d708a67b\": container with ID starting with 8e4b49fcfcf483389b6048c734ef1fd91f1f8a152206b1221ce7f3e7d708a67b not found: ID does not exist"
Jul 24 20:15:51.238042 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:51.237988    2567 scope.go:117] "RemoveContainer" containerID="639b60c946fefb2ae4ccd2df66824298b7a8ceabfbabcd771805f11c2878252f"
Jul 24 20:15:51.238193 ip-10-0-133-84 kubenswrapper[2567]: E0724 20:15:51.238172    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"639b60c946fefb2ae4ccd2df66824298b7a8ceabfbabcd771805f11c2878252f\": container with ID starting with 639b60c946fefb2ae4ccd2df66824298b7a8ceabfbabcd771805f11c2878252f not found: ID does not exist" containerID="639b60c946fefb2ae4ccd2df66824298b7a8ceabfbabcd771805f11c2878252f"
Jul 24 20:15:51.238240 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:51.238199    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"639b60c946fefb2ae4ccd2df66824298b7a8ceabfbabcd771805f11c2878252f"} err="failed to get container status \"639b60c946fefb2ae4ccd2df66824298b7a8ceabfbabcd771805f11c2878252f\": rpc error: code = NotFound desc = could not find container \"639b60c946fefb2ae4ccd2df66824298b7a8ceabfbabcd771805f11c2878252f\": container with ID starting with 639b60c946fefb2ae4ccd2df66824298b7a8ceabfbabcd771805f11c2878252f not found: ID does not exist"
Jul 24 20:15:51.241231 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:51.241206    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq"]
Jul 24 20:15:51.244293 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:51.244274    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-8abb86-openshift-default-5584cd7b4-zfmgq"]
Jul 24 20:15:52.071816 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:52.071778    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9214ccf1-343c-4837-85e6-8fa646722e2c" path="/var/lib/kubelet/pods/9214ccf1-343c-4837-85e6-8fa646722e2c/volumes"
Jul 24 20:15:56.647008 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:56.646955    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-3e15b4-867bf66c4b-7gbpd"]
Jul 24 20:15:56.647543 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:56.647199    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-3e15b4-867bf66c4b-7gbpd" podUID="4bc146ff-e749-4624-ac0f-a732faea2119" containerName="payload-processing" containerID="cri-o://75a5742a6da1f6b6ff268ebee0ba82c21a73e9605114caca7c174e2eed3e6b3f" gracePeriod=30
Jul 24 20:15:56.658269 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:56.658239    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-3e15b4-64796bcfb4-xjgdv"]
Jul 24 20:15:56.658665 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:56.658632    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3e15b4-64796bcfb4-xjgdv" podUID="62263dbb-2ed0-4556-90af-152655d45374" containerName="payload-pre-processing" containerID="cri-o://9161d9cb482a660cb2e4234799244dc91b3f77d0b057b0d12022a10a8fb570c1" gracePeriod=30
Jul 24 20:15:56.942687 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:56.942663    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-3e15b4-867bf66c4b-7gbpd"
Jul 24 20:15:56.956000 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:56.955975    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3e15b4-64796bcfb4-xjgdv"
Jul 24 20:15:57.074611 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:57.074579    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62263dbb-2ed0-4556-90af-152655d45374-plugins-config-volume\") pod \"62263dbb-2ed0-4556-90af-152655d45374\" (UID: \"62263dbb-2ed0-4556-90af-152655d45374\") "
Jul 24 20:15:57.074877 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:57.074651    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9vlzk\" (UniqueName: \"kubernetes.io/projected/4bc146ff-e749-4624-ac0f-a732faea2119-kube-api-access-9vlzk\") pod \"4bc146ff-e749-4624-ac0f-a732faea2119\" (UID: \"4bc146ff-e749-4624-ac0f-a732faea2119\") "
Jul 24 20:15:57.074877 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:57.074679    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4bc146ff-e749-4624-ac0f-a732faea2119-plugins-config-volume\") pod \"4bc146ff-e749-4624-ac0f-a732faea2119\" (UID: \"4bc146ff-e749-4624-ac0f-a732faea2119\") "
Jul 24 20:15:57.074877 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:57.074781    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jb67\" (UniqueName: \"kubernetes.io/projected/62263dbb-2ed0-4556-90af-152655d45374-kube-api-access-8jb67\") pod \"62263dbb-2ed0-4556-90af-152655d45374\" (UID: \"62263dbb-2ed0-4556-90af-152655d45374\") "
Jul 24 20:15:57.075086 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:57.075047    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62263dbb-2ed0-4556-90af-152655d45374-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "62263dbb-2ed0-4556-90af-152655d45374" (UID: "62263dbb-2ed0-4556-90af-152655d45374"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:15:57.075086 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:57.075054    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bc146ff-e749-4624-ac0f-a732faea2119-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4bc146ff-e749-4624-ac0f-a732faea2119" (UID: "4bc146ff-e749-4624-ac0f-a732faea2119"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:15:57.075183 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:57.075134    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62263dbb-2ed0-4556-90af-152655d45374-plugins-config-volume\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:15:57.075183 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:57.075162    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4bc146ff-e749-4624-ac0f-a732faea2119-plugins-config-volume\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:15:57.076905 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:57.076880    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bc146ff-e749-4624-ac0f-a732faea2119-kube-api-access-9vlzk" (OuterVolumeSpecName: "kube-api-access-9vlzk") pod "4bc146ff-e749-4624-ac0f-a732faea2119" (UID: "4bc146ff-e749-4624-ac0f-a732faea2119"). InnerVolumeSpecName "kube-api-access-9vlzk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:15:57.076990 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:57.076946    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62263dbb-2ed0-4556-90af-152655d45374-kube-api-access-8jb67" (OuterVolumeSpecName: "kube-api-access-8jb67") pod "62263dbb-2ed0-4556-90af-152655d45374" (UID: "62263dbb-2ed0-4556-90af-152655d45374"). InnerVolumeSpecName "kube-api-access-8jb67". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:15:57.176632 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:57.176546    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vlzk\" (UniqueName: \"kubernetes.io/projected/4bc146ff-e749-4624-ac0f-a732faea2119-kube-api-access-9vlzk\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:15:57.176632 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:57.176574    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jb67\" (UniqueName: \"kubernetes.io/projected/62263dbb-2ed0-4556-90af-152655d45374-kube-api-access-8jb67\") on node \"ip-10-0-133-84.ec2.internal\" DevicePath \"\""
Jul 24 20:15:57.250223 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:57.250190    2567 generic.go:356] "Generic (PLEG): container finished" podID="62263dbb-2ed0-4556-90af-152655d45374" containerID="9161d9cb482a660cb2e4234799244dc91b3f77d0b057b0d12022a10a8fb570c1" exitCode=0
Jul 24 20:15:57.250467 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:57.250231    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3e15b4-64796bcfb4-xjgdv"
Jul 24 20:15:57.250467 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:57.250274    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3e15b4-64796bcfb4-xjgdv" event={"ID":"62263dbb-2ed0-4556-90af-152655d45374","Type":"ContainerDied","Data":"9161d9cb482a660cb2e4234799244dc91b3f77d0b057b0d12022a10a8fb570c1"}
Jul 24 20:15:57.250467 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:57.250321    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3e15b4-64796bcfb4-xjgdv" event={"ID":"62263dbb-2ed0-4556-90af-152655d45374","Type":"ContainerDied","Data":"bf014443200c5bc891a00ca51971e8b5e6184a96e33da9201a84a7e892aa5a04"}
Jul 24 20:15:57.250467 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:57.250347    2567 scope.go:117] "RemoveContainer" containerID="9161d9cb482a660cb2e4234799244dc91b3f77d0b057b0d12022a10a8fb570c1"
Jul 24 20:15:57.251874 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:57.251834    2567 generic.go:356] "Generic (PLEG): container finished" podID="4bc146ff-e749-4624-ac0f-a732faea2119" containerID="75a5742a6da1f6b6ff268ebee0ba82c21a73e9605114caca7c174e2eed3e6b3f" exitCode=0
Jul 24 20:15:57.252017 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:57.251891    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-3e15b4-867bf66c4b-7gbpd"
Jul 24 20:15:57.252017 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:57.251932    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-3e15b4-867bf66c4b-7gbpd" event={"ID":"4bc146ff-e749-4624-ac0f-a732faea2119","Type":"ContainerDied","Data":"75a5742a6da1f6b6ff268ebee0ba82c21a73e9605114caca7c174e2eed3e6b3f"}
Jul 24 20:15:57.252017 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:57.251970    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-3e15b4-867bf66c4b-7gbpd" event={"ID":"4bc146ff-e749-4624-ac0f-a732faea2119","Type":"ContainerDied","Data":"14de5bfddb6d525b0cf3414165d1aad7462e4920d6601433f73c4a5518e47541"}
Jul 24 20:15:57.260230 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:57.260212    2567 scope.go:117] "RemoveContainer" containerID="9161d9cb482a660cb2e4234799244dc91b3f77d0b057b0d12022a10a8fb570c1"
Jul 24 20:15:57.260533 ip-10-0-133-84 kubenswrapper[2567]: E0724 20:15:57.260508    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9161d9cb482a660cb2e4234799244dc91b3f77d0b057b0d12022a10a8fb570c1\": container with ID starting with 9161d9cb482a660cb2e4234799244dc91b3f77d0b057b0d12022a10a8fb570c1 not found: ID does not exist" containerID="9161d9cb482a660cb2e4234799244dc91b3f77d0b057b0d12022a10a8fb570c1"
Jul 24 20:15:57.260620 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:57.260540    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9161d9cb482a660cb2e4234799244dc91b3f77d0b057b0d12022a10a8fb570c1"} err="failed to get container status \"9161d9cb482a660cb2e4234799244dc91b3f77d0b057b0d12022a10a8fb570c1\": rpc error: code = NotFound desc = could not find container \"9161d9cb482a660cb2e4234799244dc91b3f77d0b057b0d12022a10a8fb570c1\": container with ID starting with 9161d9cb482a660cb2e4234799244dc91b3f77d0b057b0d12022a10a8fb570c1 not found: ID does not exist"
Jul 24 20:15:57.260620 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:57.260564    2567 scope.go:117] "RemoveContainer" containerID="75a5742a6da1f6b6ff268ebee0ba82c21a73e9605114caca7c174e2eed3e6b3f"
Jul 24 20:15:57.270155 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:57.270134    2567 scope.go:117] "RemoveContainer" containerID="75a5742a6da1f6b6ff268ebee0ba82c21a73e9605114caca7c174e2eed3e6b3f"
Jul 24 20:15:57.270409 ip-10-0-133-84 kubenswrapper[2567]: E0724 20:15:57.270384    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75a5742a6da1f6b6ff268ebee0ba82c21a73e9605114caca7c174e2eed3e6b3f\": container with ID starting with 75a5742a6da1f6b6ff268ebee0ba82c21a73e9605114caca7c174e2eed3e6b3f not found: ID does not exist" containerID="75a5742a6da1f6b6ff268ebee0ba82c21a73e9605114caca7c174e2eed3e6b3f"
Jul 24 20:15:57.270498 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:57.270417    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75a5742a6da1f6b6ff268ebee0ba82c21a73e9605114caca7c174e2eed3e6b3f"} err="failed to get container status \"75a5742a6da1f6b6ff268ebee0ba82c21a73e9605114caca7c174e2eed3e6b3f\": rpc error: code = NotFound desc = could not find container \"75a5742a6da1f6b6ff268ebee0ba82c21a73e9605114caca7c174e2eed3e6b3f\": container with ID starting with 75a5742a6da1f6b6ff268ebee0ba82c21a73e9605114caca7c174e2eed3e6b3f not found: ID does not exist"
Jul 24 20:15:57.274106 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:57.274084    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-3e15b4-867bf66c4b-7gbpd"]
Jul 24 20:15:57.278042 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:57.278021    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-3e15b4-867bf66c4b-7gbpd"]
Jul 24 20:15:57.291122 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:57.291102    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-3e15b4-64796bcfb4-xjgdv"]
Jul 24 20:15:57.294851 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:57.294830    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-3e15b4-64796bcfb4-xjgdv"]
Jul 24 20:15:58.071042 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:58.070962    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bc146ff-e749-4624-ac0f-a732faea2119" path="/var/lib/kubelet/pods/4bc146ff-e749-4624-ac0f-a732faea2119/volumes"
Jul 24 20:15:58.071378 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:15:58.071309    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62263dbb-2ed0-4556-90af-152655d45374" path="/var/lib/kubelet/pods/62263dbb-2ed0-4556-90af-152655d45374/volumes"
Jul 24 20:16:07.757420 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:07.757383    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-69fb4b8ffc-l4szx_fdf08bda-2b38-49ca-8e61-4d48246cdc4d/authorino/0.log"
Jul 24 20:16:13.388147 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:13.388070    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-58f4c4bc9c-rb9qc_4b22da0d-d471-44d6-826d-b1dab6226a54/manager/0.log"
Jul 24 20:16:13.755222 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:13.755138    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69f558d7f4-9c94j_be899b57-ba59-4869-bb22-d0f199b3446c/manager/0.log"
Jul 24 20:16:13.761264 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:13.761241    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69f558d7f4-9c94j_be899b57-ba59-4869-bb22-d0f199b3446c/copy-manifests/0.log"
Jul 24 20:16:14.485494 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:14.485456    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29748705-8tjvb_deaafe47-87fb-44d6-ae9f-fa267668ebb3/cleanup/0.log"
Jul 24 20:16:16.111430 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:16.111380    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-69fb4b8ffc-l4szx_fdf08bda-2b38-49ca-8e61-4d48246cdc4d/authorino/0.log"
Jul 24 20:16:16.232143 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:16.232089    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-jcgkt_b684bea0-d4e2-41ba-8654-b2aae209171d/manager/0.log"
Jul 24 20:16:16.687891 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:16.687862    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-mvq5p_6c41b55a-24fb-49f2-9cbf-48002b8acb9d/manager/0.log"
Jul 24 20:16:17.511839 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:17.511812    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cff79d5b6-fmmmp_5bb50866-390d-4d57-9eaa-592e1e9e11fa/kube-auth-proxy/0.log"
Jul 24 20:16:18.789453 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:18.789414    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5f48t_e636b6f8-a0ff-4c30-90ca-43f6d32bf501/main/0.log"
Jul 24 20:16:19.016215 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:19.016189    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-68pmw_a46ed62a-7ba9-4e14-9cd0-b1c93b56d18c/main/0.log"
Jul 24 20:16:24.045444 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:24.045408    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-g4kbv/must-gather-zhlsp"]
Jul 24 20:16:24.045842 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:24.045788    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06338445-58c6-48e7-b221-dc274a95a237" containerName="payload-processing"
Jul 24 20:16:24.045842 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:24.045799    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="06338445-58c6-48e7-b221-dc274a95a237" containerName="payload-processing"
Jul 24 20:16:24.045842 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:24.045813    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9214ccf1-343c-4837-85e6-8fa646722e2c" containerName="istio-proxy"
Jul 24 20:16:24.045842 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:24.045818    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9214ccf1-343c-4837-85e6-8fa646722e2c" containerName="istio-proxy"
Jul 24 20:16:24.045842 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:24.045825    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69095654-3535-447c-b554-7fd6feadff1a" containerName="payload-pre-processing"
Jul 24 20:16:24.045842 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:24.045830    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="69095654-3535-447c-b554-7fd6feadff1a" containerName="payload-pre-processing"
Jul 24 20:16:24.045842 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:24.045843    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9214ccf1-343c-4837-85e6-8fa646722e2c" containerName="istio-proxy"
Jul 24 20:16:24.046064 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:24.045849    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9214ccf1-343c-4837-85e6-8fa646722e2c" containerName="istio-proxy"
Jul 24 20:16:24.046064 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:24.045855    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="451b8933-4bb9-4295-ad1f-8c31ecfba634" containerName="payload-processing"
Jul 24 20:16:24.046064 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:24.045860    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="451b8933-4bb9-4295-ad1f-8c31ecfba634" containerName="payload-processing"
Jul 24 20:16:24.046064 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:24.045871    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bc146ff-e749-4624-ac0f-a732faea2119" containerName="payload-processing"
Jul 24 20:16:24.046064 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:24.045876    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bc146ff-e749-4624-ac0f-a732faea2119" containerName="payload-processing"
Jul 24 20:16:24.046064 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:24.045882    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c03627eb-9f45-4ceb-85fe-bfde55af4fe6" containerName="payload-pre-processing"
Jul 24 20:16:24.046064 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:24.045887    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c03627eb-9f45-4ceb-85fe-bfde55af4fe6" containerName="payload-pre-processing"
Jul 24 20:16:24.046064 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:24.045892    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82f09e72-6966-40b5-a5c0-d7e3ea91387f" containerName="payload-processing"
Jul 24 20:16:24.046064 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:24.045898    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="82f09e72-6966-40b5-a5c0-d7e3ea91387f" containerName="payload-processing"
Jul 24 20:16:24.046064 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:24.045904    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7362693-8007-4d7b-a4c9-eb17b88410a4" containerName="revoke-keys"
Jul 24 20:16:24.046064 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:24.045908    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7362693-8007-4d7b-a4c9-eb17b88410a4" containerName="revoke-keys"
Jul 24 20:16:24.046064 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:24.045919    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d1abee9-4fad-4dcc-9735-b6bb83c3f17a" containerName="payload-pre-processing"
Jul 24 20:16:24.046064 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:24.045924    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d1abee9-4fad-4dcc-9735-b6bb83c3f17a" containerName="payload-pre-processing"
Jul 24 20:16:24.046064 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:24.045933    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62263dbb-2ed0-4556-90af-152655d45374" containerName="payload-pre-processing"
Jul 24 20:16:24.046064 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:24.045938    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="62263dbb-2ed0-4556-90af-152655d45374" containerName="payload-pre-processing"
Jul 24 20:16:24.046064 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:24.045992    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d1abee9-4fad-4dcc-9735-b6bb83c3f17a" containerName="payload-pre-processing"
Jul 24 20:16:24.046064 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:24.046001    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="82f09e72-6966-40b5-a5c0-d7e3ea91387f" containerName="payload-processing"
Jul 24 20:16:24.046064 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:24.046006    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c03627eb-9f45-4ceb-85fe-bfde55af4fe6" containerName="payload-pre-processing"
Jul 24 20:16:24.046064 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:24.046013    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9214ccf1-343c-4837-85e6-8fa646722e2c" containerName="istio-proxy"
Jul 24 20:16:24.046064 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:24.046017    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="62263dbb-2ed0-4556-90af-152655d45374" containerName="payload-pre-processing"
Jul 24 20:16:24.046064 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:24.046022    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="06338445-58c6-48e7-b221-dc274a95a237" containerName="payload-processing"
Jul 24 20:16:24.046064 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:24.046027    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="69095654-3535-447c-b554-7fd6feadff1a" containerName="payload-pre-processing"
Jul 24 20:16:24.046064 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:24.046032    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9214ccf1-343c-4837-85e6-8fa646722e2c" containerName="istio-proxy"
Jul 24 20:16:24.046064 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:24.046038    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bc146ff-e749-4624-ac0f-a732faea2119" containerName="payload-processing"
Jul 24 20:16:24.046064 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:24.046043    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7362693-8007-4d7b-a4c9-eb17b88410a4" containerName="revoke-keys"
Jul 24 20:16:24.046064 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:24.046050    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="451b8933-4bb9-4295-ad1f-8c31ecfba634" containerName="payload-processing"
Jul 24 20:16:24.049670 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:24.049651    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g4kbv/must-gather-zhlsp"
Jul 24 20:16:24.052101 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:24.052080    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g4kbv\"/\"kube-root-ca.crt\""
Jul 24 20:16:24.052351 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:24.052334    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g4kbv\"/\"openshift-service-ca.crt\""
Jul 24 20:16:24.052417 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:24.052360    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-g4kbv\"/\"default-dockercfg-d5j6l\""
Jul 24 20:16:24.057152 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:24.057127    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g4kbv/must-gather-zhlsp"]
Jul 24 20:16:24.225164 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:24.225117    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52c5g\" (UniqueName: \"kubernetes.io/projected/05bc5fb8-549b-4f4d-88c6-ac061b43bdef-kube-api-access-52c5g\") pod \"must-gather-zhlsp\" (UID: \"05bc5fb8-549b-4f4d-88c6-ac061b43bdef\") " pod="openshift-must-gather-g4kbv/must-gather-zhlsp"
Jul 24 20:16:24.225383 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:24.225221    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/05bc5fb8-549b-4f4d-88c6-ac061b43bdef-must-gather-output\") pod \"must-gather-zhlsp\" (UID: \"05bc5fb8-549b-4f4d-88c6-ac061b43bdef\") " pod="openshift-must-gather-g4kbv/must-gather-zhlsp"
Jul 24 20:16:24.326368 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:24.326271    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/05bc5fb8-549b-4f4d-88c6-ac061b43bdef-must-gather-output\") pod \"must-gather-zhlsp\" (UID: \"05bc5fb8-549b-4f4d-88c6-ac061b43bdef\") " pod="openshift-must-gather-g4kbv/must-gather-zhlsp"
Jul 24 20:16:24.326576 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:24.326401    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52c5g\" (UniqueName: \"kubernetes.io/projected/05bc5fb8-549b-4f4d-88c6-ac061b43bdef-kube-api-access-52c5g\") pod \"must-gather-zhlsp\" (UID: \"05bc5fb8-549b-4f4d-88c6-ac061b43bdef\") " pod="openshift-must-gather-g4kbv/must-gather-zhlsp"
Jul 24 20:16:24.326646 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:24.326625    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/05bc5fb8-549b-4f4d-88c6-ac061b43bdef-must-gather-output\") pod \"must-gather-zhlsp\" (UID: \"05bc5fb8-549b-4f4d-88c6-ac061b43bdef\") " pod="openshift-must-gather-g4kbv/must-gather-zhlsp"
Jul 24 20:16:24.337232 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:24.337198    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52c5g\" (UniqueName: \"kubernetes.io/projected/05bc5fb8-549b-4f4d-88c6-ac061b43bdef-kube-api-access-52c5g\") pod \"must-gather-zhlsp\" (UID: \"05bc5fb8-549b-4f4d-88c6-ac061b43bdef\") " pod="openshift-must-gather-g4kbv/must-gather-zhlsp"
Jul 24 20:16:24.360195 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:24.360162    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g4kbv/must-gather-zhlsp"
Jul 24 20:16:24.500245 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:24.500204    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g4kbv/must-gather-zhlsp"]
Jul 24 20:16:24.502730 ip-10-0-133-84 kubenswrapper[2567]: W0724 20:16:24.502703    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod05bc5fb8_549b_4f4d_88c6_ac061b43bdef.slice/crio-f308b4c56cf992c236a50804fd92a83f903f85f59e3809dc1f600993e3187fd3 WatchSource:0}: Error finding container f308b4c56cf992c236a50804fd92a83f903f85f59e3809dc1f600993e3187fd3: Status 404 returned error can't find the container with id f308b4c56cf992c236a50804fd92a83f903f85f59e3809dc1f600993e3187fd3
Jul 24 20:16:24.504574 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:24.504553    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 20:16:25.389916 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:25.389866    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g4kbv/must-gather-zhlsp" event={"ID":"05bc5fb8-549b-4f4d-88c6-ac061b43bdef","Type":"ContainerStarted","Data":"80dd6b69263b8cd4bbc02e969afde7c7975161fb93ae8230eade5f8298a7c365"}
Jul 24 20:16:25.390329 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:25.389925    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g4kbv/must-gather-zhlsp" event={"ID":"05bc5fb8-549b-4f4d-88c6-ac061b43bdef","Type":"ContainerStarted","Data":"f308b4c56cf992c236a50804fd92a83f903f85f59e3809dc1f600993e3187fd3"}
Jul 24 20:16:26.397075 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:26.397037    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g4kbv/must-gather-zhlsp" event={"ID":"05bc5fb8-549b-4f4d-88c6-ac061b43bdef","Type":"ContainerStarted","Data":"7ca05eae9595116eaa8a50fb6d8d4bd20b0cddc7b6d7b47bbcb26a802c9add7d"}
Jul 24 20:16:26.413758 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:26.413709    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-g4kbv/must-gather-zhlsp" podStartSLOduration=1.6612245909999999 podStartE2EDuration="2.413688324s" totalImagesPullingTime="752.463733ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:16:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:16:26.412389738 +0000 UTC m=+2974.931009778" watchObservedRunningTime="2026-07-24 20:16:26.413688324 +0000 UTC m=+2974.932308366"
Jul 24 20:16:26.838088 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:26.837998    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-gvbbc_94868cfc-85a8-4310-a339-2c4b44da043b/global-pull-secret-syncer/0.log"
Jul 24 20:16:26.963556 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:26.963527    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-v2l9c_75378781-af5d-4b0c-a6a5-3176b16700c7/konnectivity-agent/0.log"
Jul 24 20:16:27.044760 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:27.044718    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-84.ec2.internal_8560c43657f7ea2f80765f41474cfd07/haproxy/0.log"
Jul 24 20:16:32.402802 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:32.402760    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-69fb4b8ffc-l4szx_fdf08bda-2b38-49ca-8e61-4d48246cdc4d/authorino/0.log"
Jul 24 20:16:32.441705 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:32.441600    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-jcgkt_b684bea0-d4e2-41ba-8654-b2aae209171d/manager/0.log"
Jul 24 20:16:32.739516 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:32.738094    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-mvq5p_6c41b55a-24fb-49f2-9cbf-48002b8acb9d/manager/0.log"
Jul 24 20:16:34.476318 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:34.476282    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3376df31-f289-4905-85b5-0fb505b04806/alertmanager/0.log"
Jul 24 20:16:34.518033 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:34.518007    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3376df31-f289-4905-85b5-0fb505b04806/config-reloader/0.log"
Jul 24 20:16:34.543300 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:34.543269    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3376df31-f289-4905-85b5-0fb505b04806/kube-rbac-proxy-web/0.log"
Jul 24 20:16:34.579750 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:34.579718    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3376df31-f289-4905-85b5-0fb505b04806/kube-rbac-proxy/0.log"
Jul 24 20:16:34.606778 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:34.606745    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3376df31-f289-4905-85b5-0fb505b04806/kube-rbac-proxy-metric/0.log"
Jul 24 20:16:34.631264 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:34.631225    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3376df31-f289-4905-85b5-0fb505b04806/prom-label-proxy/0.log"
Jul 24 20:16:34.656532 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:34.656442    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3376df31-f289-4905-85b5-0fb505b04806/init-config-reloader/0.log"
Jul 24 20:16:34.722223 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:34.722194    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-qxvdt_d54290e4-ffa8-4f6a-a15b-a811e3ea2259/kube-state-metrics/0.log"
Jul 24 20:16:34.744366 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:34.744330    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-qxvdt_d54290e4-ffa8-4f6a-a15b-a811e3ea2259/kube-rbac-proxy-main/0.log"
Jul 24 20:16:34.765903 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:34.765861    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-qxvdt_d54290e4-ffa8-4f6a-a15b-a811e3ea2259/kube-rbac-proxy-self/0.log"
Jul 24 20:16:34.945903 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:34.945815    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fm6w8_5ed1b7c2-570b-4919-a766-c7c87e46aeb9/node-exporter/0.log"
Jul 24 20:16:34.969163 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:34.969132    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fm6w8_5ed1b7c2-570b-4919-a766-c7c87e46aeb9/kube-rbac-proxy/0.log"
Jul 24 20:16:34.990270 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:34.990240    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fm6w8_5ed1b7c2-570b-4919-a766-c7c87e46aeb9/init-textfile/0.log"
Jul 24 20:16:35.180467 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:35.180436    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_86a1e9a2-e57f-4061-afee-f5718c31069c/prometheus/0.log"
Jul 24 20:16:35.218166 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:35.218067    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_86a1e9a2-e57f-4061-afee-f5718c31069c/config-reloader/0.log"
Jul 24 20:16:35.242723 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:35.242695    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_86a1e9a2-e57f-4061-afee-f5718c31069c/thanos-sidecar/0.log"
Jul 24 20:16:35.265371 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:35.265323    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_86a1e9a2-e57f-4061-afee-f5718c31069c/kube-rbac-proxy-web/0.log"
Jul 24 20:16:35.291259 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:35.291233    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_86a1e9a2-e57f-4061-afee-f5718c31069c/kube-rbac-proxy/0.log"
Jul 24 20:16:35.311952 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:35.311925    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_86a1e9a2-e57f-4061-afee-f5718c31069c/kube-rbac-proxy-thanos/0.log"
Jul 24 20:16:35.333518 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:35.333461    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_86a1e9a2-e57f-4061-afee-f5718c31069c/init-config-reloader/0.log"
Jul 24 20:16:35.362637 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:35.362606    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-m2z6d_6a45f826-8752-4af6-892d-7377b8a979af/prometheus-operator/0.log"
Jul 24 20:16:35.384911 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:35.384880    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-m2z6d_6a45f826-8752-4af6-892d-7377b8a979af/kube-rbac-proxy/0.log"
Jul 24 20:16:35.412672 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:35.412645    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-h44dq_29aa9285-1752-42ab-8e2e-b65ba53abdb9/prometheus-operator-admission-webhook/0.log"
Jul 24 20:16:35.444068 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:35.444029    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-79d5bdb8f7-stmxp_c34ea396-859c-4f2d-b878-897380961784/telemeter-client/0.log"
Jul 24 20:16:35.466401 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:35.466379    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-79d5bdb8f7-stmxp_c34ea396-859c-4f2d-b878-897380961784/reload/0.log"
Jul 24 20:16:35.487888 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:35.487813    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-79d5bdb8f7-stmxp_c34ea396-859c-4f2d-b878-897380961784/kube-rbac-proxy/0.log"
Jul 24 20:16:36.743509 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:36.743459    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-g4kbv/perf-node-gather-daemonset-dh997"]
Jul 24 20:16:36.748256 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:36.748222    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g4kbv/perf-node-gather-daemonset-dh997"
Jul 24 20:16:36.757466 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:36.757432    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g4kbv/perf-node-gather-daemonset-dh997"]
Jul 24 20:16:36.862851 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:36.862788    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e65f474-1edb-4439-abbf-e0574f155782-lib-modules\") pod \"perf-node-gather-daemonset-dh997\" (UID: \"8e65f474-1edb-4439-abbf-e0574f155782\") " pod="openshift-must-gather-g4kbv/perf-node-gather-daemonset-dh997"
Jul 24 20:16:36.863057 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:36.862973    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e65f474-1edb-4439-abbf-e0574f155782-sys\") pod \"perf-node-gather-daemonset-dh997\" (UID: \"8e65f474-1edb-4439-abbf-e0574f155782\") " pod="openshift-must-gather-g4kbv/perf-node-gather-daemonset-dh997"
Jul 24 20:16:36.863057 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:36.863001    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8e65f474-1edb-4439-abbf-e0574f155782-proc\") pod \"perf-node-gather-daemonset-dh997\" (UID: \"8e65f474-1edb-4439-abbf-e0574f155782\") " pod="openshift-must-gather-g4kbv/perf-node-gather-daemonset-dh997"
Jul 24 20:16:36.863194 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:36.863072    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdvb6\" (UniqueName: \"kubernetes.io/projected/8e65f474-1edb-4439-abbf-e0574f155782-kube-api-access-bdvb6\") pod \"perf-node-gather-daemonset-dh997\" (UID: \"8e65f474-1edb-4439-abbf-e0574f155782\") " pod="openshift-must-gather-g4kbv/perf-node-gather-daemonset-dh997"
Jul 24 20:16:36.863259 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:36.863201    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8e65f474-1edb-4439-abbf-e0574f155782-podres\") pod \"perf-node-gather-daemonset-dh997\" (UID: \"8e65f474-1edb-4439-abbf-e0574f155782\") " pod="openshift-must-gather-g4kbv/perf-node-gather-daemonset-dh997"
Jul 24 20:16:36.963928 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:36.963891    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8e65f474-1edb-4439-abbf-e0574f155782-podres\") pod \"perf-node-gather-daemonset-dh997\" (UID: \"8e65f474-1edb-4439-abbf-e0574f155782\") " pod="openshift-must-gather-g4kbv/perf-node-gather-daemonset-dh997"
Jul 24 20:16:36.964131 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:36.963950    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e65f474-1edb-4439-abbf-e0574f155782-lib-modules\") pod \"perf-node-gather-daemonset-dh997\" (UID: \"8e65f474-1edb-4439-abbf-e0574f155782\") " pod="openshift-must-gather-g4kbv/perf-node-gather-daemonset-dh997"
Jul 24 20:16:36.964131 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:36.964016    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e65f474-1edb-4439-abbf-e0574f155782-sys\") pod \"perf-node-gather-daemonset-dh997\" (UID: \"8e65f474-1edb-4439-abbf-e0574f155782\") " pod="openshift-must-gather-g4kbv/perf-node-gather-daemonset-dh997"
Jul 24 20:16:36.964131 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:36.964037    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8e65f474-1edb-4439-abbf-e0574f155782-proc\") pod \"perf-node-gather-daemonset-dh997\" (UID: \"8e65f474-1edb-4439-abbf-e0574f155782\") " pod="openshift-must-gather-g4kbv/perf-node-gather-daemonset-dh997"
Jul 24 20:16:36.964131 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:36.964085    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8e65f474-1edb-4439-abbf-e0574f155782-podres\") pod \"perf-node-gather-daemonset-dh997\" (UID: \"8e65f474-1edb-4439-abbf-e0574f155782\") " pod="openshift-must-gather-g4kbv/perf-node-gather-daemonset-dh997"
Jul 24 20:16:36.964131 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:36.964087    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdvb6\" (UniqueName: \"kubernetes.io/projected/8e65f474-1edb-4439-abbf-e0574f155782-kube-api-access-bdvb6\") pod \"perf-node-gather-daemonset-dh997\" (UID: \"8e65f474-1edb-4439-abbf-e0574f155782\") " pod="openshift-must-gather-g4kbv/perf-node-gather-daemonset-dh997"
Jul 24 20:16:36.964131 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:36.964121    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e65f474-1edb-4439-abbf-e0574f155782-sys\") pod \"perf-node-gather-daemonset-dh997\" (UID: \"8e65f474-1edb-4439-abbf-e0574f155782\") " pod="openshift-must-gather-g4kbv/perf-node-gather-daemonset-dh997"
Jul 24 20:16:36.964476 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:36.964181    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e65f474-1edb-4439-abbf-e0574f155782-lib-modules\") pod \"perf-node-gather-daemonset-dh997\" (UID: \"8e65f474-1edb-4439-abbf-e0574f155782\") " pod="openshift-must-gather-g4kbv/perf-node-gather-daemonset-dh997"
Jul 24 20:16:36.964476 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:36.964203    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8e65f474-1edb-4439-abbf-e0574f155782-proc\") pod \"perf-node-gather-daemonset-dh997\" (UID: \"8e65f474-1edb-4439-abbf-e0574f155782\") " pod="openshift-must-gather-g4kbv/perf-node-gather-daemonset-dh997"
Jul 24 20:16:36.972996 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:36.972964    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdvb6\" (UniqueName: \"kubernetes.io/projected/8e65f474-1edb-4439-abbf-e0574f155782-kube-api-access-bdvb6\") pod \"perf-node-gather-daemonset-dh997\" (UID: \"8e65f474-1edb-4439-abbf-e0574f155782\") " pod="openshift-must-gather-g4kbv/perf-node-gather-daemonset-dh997"
Jul 24 20:16:37.068718 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:37.068625    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g4kbv/perf-node-gather-daemonset-dh997"
Jul 24 20:16:37.260735 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:37.259367    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g4kbv/perf-node-gather-daemonset-dh997"]
Jul 24 20:16:37.477517 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:37.477447    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g4kbv/perf-node-gather-daemonset-dh997" event={"ID":"8e65f474-1edb-4439-abbf-e0574f155782","Type":"ContainerStarted","Data":"3d5b7fb8cd58c09c8d365b90294d80fcfafb7b647829ab272922a53ac4956f68"}
Jul 24 20:16:37.477720 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:37.477548    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g4kbv/perf-node-gather-daemonset-dh997" event={"ID":"8e65f474-1edb-4439-abbf-e0574f155782","Type":"ContainerStarted","Data":"af5fb6f5e73acd06447d8dea6a36d1990b3742e5cd797d133dd7a4e9214812e2"}
Jul 24 20:16:37.478344 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:37.478321    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-g4kbv/perf-node-gather-daemonset-dh997"
Jul 24 20:16:37.495834 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:37.495775    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-g4kbv/perf-node-gather-daemonset-dh997" podStartSLOduration=1.495753152 podStartE2EDuration="1.495753152s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 20:16:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:16:37.494814724 +0000 UTC m=+2986.013434768" watchObservedRunningTime="2026-07-24 20:16:37.495753152 +0000 UTC m=+2986.014373193"
Jul 24 20:16:39.565789 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:39.565762    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lbpc2_25c81c8c-dcd3-46b8-a220-9d23d851271e/dns/0.log"
Jul 24 20:16:39.588162 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:39.588133    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lbpc2_25c81c8c-dcd3-46b8-a220-9d23d851271e/kube-rbac-proxy/0.log"
Jul 24 20:16:39.653253 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:39.653216    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-swjv4_d38eaa42-116b-4a94-92e2-a9806f4c0cb9/dns-node-resolver/0.log"
Jul 24 20:16:40.204333 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:40.204306    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2586j_0b4c1d88-b127-4f5a-985b-1eda0f9470fa/node-ca/0.log"
Jul 24 20:16:41.339813 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:41.339774    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cff79d5b6-fmmmp_5bb50866-390d-4d57-9eaa-592e1e9e11fa/kube-auth-proxy/0.log"
Jul 24 20:16:42.343118 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:42.343089    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ztc4c_e6fd444c-0fa9-4139-9f44-6e389728f05a/serve-healthcheck-canary/0.log"
Jul 24 20:16:42.967064 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:42.967030    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sgb8z_f301acb7-aeba-4a68-b491-8d926efaebd8/kube-rbac-proxy/0.log"
Jul 24 20:16:42.987064 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:42.987038    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sgb8z_f301acb7-aeba-4a68-b491-8d926efaebd8/exporter/0.log"
Jul 24 20:16:43.012614 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:43.012590    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sgb8z_f301acb7-aeba-4a68-b491-8d926efaebd8/extractor/0.log"
Jul 24 20:16:44.502107 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:44.502080    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-g4kbv/perf-node-gather-daemonset-dh997"
Jul 24 20:16:45.617934 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:45.617893    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-58f4c4bc9c-rb9qc_4b22da0d-d471-44d6-826d-b1dab6226a54/manager/0.log"
Jul 24 20:16:45.763908 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:45.763879    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69f558d7f4-9c94j_be899b57-ba59-4869-bb22-d0f199b3446c/manager/0.log"
Jul 24 20:16:45.784224 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:45.784203    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69f558d7f4-9c94j_be899b57-ba59-4869-bb22-d0f199b3446c/copy-manifests/0.log"
Jul 24 20:16:47.351418 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:47.351392    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-9ccbf6686-77llk_df4e9b78-80c9-463c-a20d-f017025b7187/manager/0.log"
Jul 24 20:16:48.055357 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:48.055314    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cff79d5b6-fmmmp_5bb50866-390d-4d57-9eaa-592e1e9e11fa/kube-auth-proxy/0.log"
Jul 24 20:16:49.663824 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:49.663796    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cff79d5b6-fmmmp_5bb50866-390d-4d57-9eaa-592e1e9e11fa/kube-auth-proxy/0.log"
Jul 24 20:16:52.191589 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:52.191556    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d87bq_72c2265c-f7f6-462a-bf46-eda3f35de953/ovn-acl-logging/0.log"
Jul 24 20:16:52.198949 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:52.198926    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d87bq_72c2265c-f7f6-462a-bf46-eda3f35de953/ovn-acl-logging/0.log"
Jul 24 20:16:53.819875 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:53.819850    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-77d9q_fb85497d-d7d8-484b-aef8-ad70ac0db182/kube-multus/0.log"
Jul 24 20:16:54.192910 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:54.192883    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wvbtg_7ba5baab-dd60-4a1f-bece-25c178dbe520/kube-multus-additional-cni-plugins/0.log"
Jul 24 20:16:54.215011 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:54.214976    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wvbtg_7ba5baab-dd60-4a1f-bece-25c178dbe520/egress-router-binary-copy/0.log"
Jul 24 20:16:54.236883 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:54.236853    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wvbtg_7ba5baab-dd60-4a1f-bece-25c178dbe520/cni-plugins/0.log"
Jul 24 20:16:54.262353 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:54.262310    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wvbtg_7ba5baab-dd60-4a1f-bece-25c178dbe520/bond-cni-plugin/0.log"
Jul 24 20:16:54.281944 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:54.281918    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wvbtg_7ba5baab-dd60-4a1f-bece-25c178dbe520/routeoverride-cni/0.log"
Jul 24 20:16:54.303195 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:54.303172    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wvbtg_7ba5baab-dd60-4a1f-bece-25c178dbe520/whereabouts-cni-bincopy/0.log"
Jul 24 20:16:54.324151 ip-10-0-133-84 kubenswrapper[2567]: I0724 20:16:54.324131    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wvbtg_7ba5baab-dd60-4a1f-bece-25c178dbe520/whereabouts-cni/0.log"