Jul 28 01:13:45.293919 ip-10-0-134-165 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 28 01:13:45.293934 ip-10-0-134-165 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 28 01:13:45.293943 ip-10-0-134-165 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 28 01:13:45.294231 ip-10-0-134-165 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 28 01:13:56.740457 ip-10-0-134-165 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 28 01:13:56.740476 ip-10-0-134-165 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 7864e100f8ca414bbacc1a599e21a42c --
Jul 28 01:15:29.377839 ip-10-0-134-165 systemd[1]: Starting Kubernetes Kubelet...
Jul 28 01:15:29.782523 ip-10-0-134-165 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 01:15:29.782523 ip-10-0-134-165 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 28 01:15:29.782523 ip-10-0-134-165 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 01:15:29.782523 ip-10-0-134-165 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 28 01:15:29.782523 ip-10-0-134-165 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 01:15:29.784467 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.784380    2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 28 01:15:29.792681 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792660    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 01:15:29.792681 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792680    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 01:15:29.792754 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792685    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 01:15:29.792754 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792688    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 01:15:29.792754 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792692    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 01:15:29.792754 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792695    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 01:15:29.792754 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792698    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 01:15:29.792754 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792701    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 01:15:29.792754 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792705    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 01:15:29.792754 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792707    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 01:15:29.792754 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792710    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 01:15:29.792754 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792713    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 01:15:29.792754 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792716    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 01:15:29.792754 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792719    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 01:15:29.792754 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792721    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 01:15:29.792754 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792724    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 01:15:29.792754 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792727    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 01:15:29.792754 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792729    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 01:15:29.792754 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792732    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 01:15:29.792754 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792735    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 01:15:29.792754 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792737    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 01:15:29.792754 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792740    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 01:15:29.793229 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792750    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 01:15:29.793229 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792754    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 01:15:29.793229 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792757    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 01:15:29.793229 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792760    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 01:15:29.793229 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792763    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 01:15:29.793229 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792766    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 01:15:29.793229 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792769    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 01:15:29.793229 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792771    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 01:15:29.793229 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792774    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 01:15:29.793229 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792776    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 01:15:29.793229 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792779    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 01:15:29.793229 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792782    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 01:15:29.793229 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792784    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 01:15:29.793229 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792787    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 01:15:29.793229 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792789    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 01:15:29.793229 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792792    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 01:15:29.793229 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792794    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 01:15:29.793229 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792797    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 01:15:29.793229 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792799    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 01:15:29.793229 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792802    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 01:15:29.793795 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792804    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 01:15:29.793795 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792809    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 01:15:29.793795 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792811    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 01:15:29.793795 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792814    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 01:15:29.793795 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792816    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 01:15:29.793795 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792819    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 01:15:29.793795 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792821    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 01:15:29.793795 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792824    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 01:15:29.793795 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792826    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 01:15:29.793795 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792829    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 01:15:29.793795 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792831    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 01:15:29.793795 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792834    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 01:15:29.793795 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792836    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 01:15:29.793795 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792840    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 01:15:29.793795 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792843    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 01:15:29.793795 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792846    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 01:15:29.793795 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792849    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 01:15:29.793795 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792851    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 01:15:29.793795 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792854    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 01:15:29.793795 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792857    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 01:15:29.794280 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792859    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 01:15:29.794280 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792861    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 01:15:29.794280 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792864    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 01:15:29.794280 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792866    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 01:15:29.794280 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792869    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 01:15:29.794280 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792871    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 01:15:29.794280 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792874    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 01:15:29.794280 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792876    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 01:15:29.794280 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792879    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 01:15:29.794280 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792883    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 01:15:29.794280 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792885    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 01:15:29.794280 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792890    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 01:15:29.794280 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792893    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 01:15:29.794280 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792896    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 01:15:29.794280 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792899    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 01:15:29.794280 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792902    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 01:15:29.794280 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792905    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 01:15:29.794280 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792908    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 01:15:29.794280 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792911    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 01:15:29.794755 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792915    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 01:15:29.794755 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792918    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 01:15:29.794755 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792920    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 01:15:29.794755 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792923    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 01:15:29.794755 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792925    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 01:15:29.794755 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792928    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 01:15:29.794755 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792931    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 01:15:29.794755 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792933    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 01:15:29.794755 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792936    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 01:15:29.794755 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792939    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 01:15:29.794755 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792941    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 01:15:29.794755 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792944    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 01:15:29.794755 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792947    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 01:15:29.794755 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792950    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 01:15:29.794755 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792953    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 01:15:29.794755 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792956    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 01:15:29.794755 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792958    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 01:15:29.794755 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.792961    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 01:15:29.794755 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793787    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 01:15:29.794755 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793795    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 01:15:29.795234 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793799    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 01:15:29.795234 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793802    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 01:15:29.795234 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793805    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 01:15:29.795234 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793809    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 01:15:29.795234 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793812    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 01:15:29.795234 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793815    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 01:15:29.795234 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793819    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 01:15:29.795234 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793821    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 01:15:29.795234 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793824    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 01:15:29.795234 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793827    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 01:15:29.795234 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793830    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 01:15:29.795234 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793832    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 01:15:29.795234 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793835    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 01:15:29.795234 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793837    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 01:15:29.795234 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793840    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 01:15:29.795234 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793842    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 01:15:29.795234 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793845    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 01:15:29.795234 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793848    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 01:15:29.795234 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793851    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 01:15:29.795234 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793853    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 01:15:29.795747 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793856    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 01:15:29.795747 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793859    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 01:15:29.795747 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793861    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 01:15:29.795747 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793864    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 01:15:29.795747 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793867    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 01:15:29.795747 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793870    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 01:15:29.795747 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793872    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 01:15:29.795747 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793875    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 01:15:29.795747 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793877    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 01:15:29.795747 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793880    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 01:15:29.795747 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793883    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 01:15:29.795747 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793885    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 01:15:29.795747 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793888    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 01:15:29.795747 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793890    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 01:15:29.795747 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793892    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 01:15:29.795747 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793895    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 01:15:29.795747 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793898    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 01:15:29.795747 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793900    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 01:15:29.795747 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793903    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 01:15:29.795747 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793905    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 01:15:29.796230 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793908    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 01:15:29.796230 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793911    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 01:15:29.796230 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793915    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 01:15:29.796230 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793918    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 01:15:29.796230 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793921    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 01:15:29.796230 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793924    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 01:15:29.796230 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793927    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 01:15:29.796230 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793929    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 01:15:29.796230 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793932    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 01:15:29.796230 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793936    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 01:15:29.796230 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793939    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 01:15:29.796230 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793941    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 01:15:29.796230 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793944    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 01:15:29.796230 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793946    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 01:15:29.796230 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793949    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 01:15:29.796230 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793951    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 01:15:29.796230 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793954    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 01:15:29.796230 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793957    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 01:15:29.796230 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793959    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 01:15:29.796724 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793961    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 01:15:29.796724 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793964    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 01:15:29.796724 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793966    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 01:15:29.796724 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793969    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 01:15:29.796724 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793971    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 01:15:29.796724 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793974    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 01:15:29.796724 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793976    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 01:15:29.796724 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793979    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 01:15:29.796724 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793981    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 01:15:29.796724 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793985    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 01:15:29.796724 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793989    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 01:15:29.796724 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793992    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 01:15:29.796724 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793994    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 01:15:29.796724 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.793997    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 01:15:29.796724 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794000    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 01:15:29.796724 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794003    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 01:15:29.796724 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794007    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 01:15:29.796724 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794009    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 01:15:29.796724 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794012    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 01:15:29.796724 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794015    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 01:15:29.797253 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794017    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 01:15:29.797253 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794022    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 01:15:29.797253 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794026    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 01:15:29.797253 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794031    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 01:15:29.797253 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794034    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 01:15:29.797253 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794036    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 01:15:29.797253 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794039    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 01:15:29.797253 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794042    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 01:15:29.797253 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794045    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 01:15:29.797253 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794047    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 01:15:29.797253 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794050    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 01:15:29.797253 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794053    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 01:15:29.797253 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794055    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 01:15:29.797253 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794057    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 01:15:29.797253 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794060    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 01:15:29.797253 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794062    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 01:15:29.797253 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794065    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 01:15:29.797253 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794067    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 01:15:29.797253 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794463    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 01:15:29.797804 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794468    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 01:15:29.797804 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794470    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 01:15:29.797804 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794473    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 01:15:29.797804 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794476    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 01:15:29.797804 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794478    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 01:15:29.797804 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794482    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 01:15:29.797804 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794484    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 01:15:29.797804 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794487    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 01:15:29.797804 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794490    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 01:15:29.797804 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794492    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 01:15:29.797804 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794495    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 01:15:29.797804 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794498    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 01:15:29.797804 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794501    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 01:15:29.797804 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794503    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 01:15:29.797804 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794507    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 01:15:29.797804 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794510    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 01:15:29.797804 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794513    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 01:15:29.797804 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794515    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 01:15:29.797804 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794518    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 01:15:29.797804 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794520    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 01:15:29.798348 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794523    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 01:15:29.798348 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794526    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 01:15:29.798348 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794528    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 01:15:29.798348 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794531    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 01:15:29.798348 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794533    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 01:15:29.798348 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794536    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 01:15:29.798348 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794538    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 01:15:29.798348 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794541    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 01:15:29.798348 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794543    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 01:15:29.798348 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794546    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 01:15:29.798348 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794548    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 01:15:29.798348 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794551    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 01:15:29.798348 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794572    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 01:15:29.798348 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794576    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 01:15:29.798348 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794579    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 01:15:29.798348 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794582    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 01:15:29.798348 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794592    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 01:15:29.798348 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794596    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 01:15:29.798348 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794600    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 01:15:29.798915 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794603    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 01:15:29.798915 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794606    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 01:15:29.798915 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794610    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 01:15:29.798915 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794614    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 01:15:29.798915 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794617    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 01:15:29.798915 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794621    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 01:15:29.798915 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794623    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 01:15:29.798915 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794626    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 01:15:29.798915 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794630    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 01:15:29.798915 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794632    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 01:15:29.798915 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794635    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 01:15:29.798915 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794637    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 01:15:29.798915 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794640    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 01:15:29.798915 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794642    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 01:15:29.798915 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794645    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 01:15:29.798915 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794647    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 01:15:29.798915 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794650    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 01:15:29.798915 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794652    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 01:15:29.798915 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794655    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 01:15:29.799427 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794657    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 01:15:29.799427 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794660    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 01:15:29.799427 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794662    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 01:15:29.799427 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794665    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 01:15:29.799427 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794668    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 01:15:29.799427 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794670    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 01:15:29.799427 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794673    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 01:15:29.799427 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794675    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 01:15:29.799427 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794678    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 01:15:29.799427 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794680    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 01:15:29.799427 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794683    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 01:15:29.799427 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794687    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 01:15:29.799427 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794689    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 01:15:29.799427 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794692    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 01:15:29.799427 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794694    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 01:15:29.799427 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794697    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 01:15:29.799427 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794699    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 01:15:29.799427 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794702    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 01:15:29.799427 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794705    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 01:15:29.799427 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794707    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 01:15:29.799975 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794710    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 01:15:29.799975 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794712    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 01:15:29.799975 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794715    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 01:15:29.799975 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794717    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 01:15:29.799975 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794720    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 01:15:29.799975 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794722    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 01:15:29.799975 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794725    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 01:15:29.799975 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794727    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 01:15:29.799975 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794730    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 01:15:29.799975 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794732    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 01:15:29.799975 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794735    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 01:15:29.799975 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794737    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 01:15:29.799975 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794740    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 01:15:29.799975 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794742    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 01:15:29.799975 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794745    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 01:15:29.799975 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794747    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 01:15:29.799975 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794750    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 01:15:29.799975 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794752    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 01:15:29.799975 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794755    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 01:15:29.800490 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.794757    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 01:15:29.800490 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.794835    2562 flags.go:64] FLAG: --address="0.0.0.0"
Jul 28 01:15:29.800490 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.794846    2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 28 01:15:29.800490 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.794862    2562 flags.go:64] FLAG: --anonymous-auth="true"
Jul 28 01:15:29.800490 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.794868    2562 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 28 01:15:29.800490 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.794876    2562 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 28 01:15:29.800490 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.794884    2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 28 01:15:29.800490 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.794893    2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 28 01:15:29.800490 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.794900    2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 28 01:15:29.800490 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.794903    2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 28 01:15:29.800490 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.794906    2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 28 01:15:29.800490 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.794910    2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 28 01:15:29.800490 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.794914    2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 28 01:15:29.800490 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.794917    2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 28 01:15:29.800490 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.794920    2562 flags.go:64] FLAG: --cgroup-root=""
Jul 28 01:15:29.800490 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.794923    2562 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 28 01:15:29.800490 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.794926    2562 flags.go:64] FLAG: --client-ca-file=""
Jul 28 01:15:29.800490 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.794929    2562 flags.go:64] FLAG: --cloud-provider="external"
Jul 28 01:15:29.800490 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.794932    2562 flags.go:64] FLAG: --cluster-dns="[]"
Jul 28 01:15:29.800490 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.794937    2562 flags.go:64] FLAG: --cluster-domain=""
Jul 28 01:15:29.800490 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.794940    2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 28 01:15:29.800490 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.794943    2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 28 01:15:29.800490 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.794946    2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 28 01:15:29.800490 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.794950    2562 flags.go:64] FLAG: --container-log-max-files="5"
Jul 28 01:15:29.801157 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.794958    2562 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 28 01:15:29.801157 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.794961    2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 28 01:15:29.801157 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.794964    2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 28 01:15:29.801157 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.794967    2562 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 28 01:15:29.801157 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.794971    2562 flags.go:64] FLAG: --contention-profiling="false"
Jul 28 01:15:29.801157 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.794976    2562 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 28 01:15:29.801157 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.794979    2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 28 01:15:29.801157 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.794982    2562 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 28 01:15:29.801157 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.794985    2562 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 28 01:15:29.801157 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.794989    2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 28 01:15:29.801157 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.794994    2562 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 28 01:15:29.801157 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.794997    2562 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 28 01:15:29.801157 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795000    2562 flags.go:64] FLAG: --enable-load-reader="false"
Jul 28 01:15:29.801157 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795002    2562 flags.go:64] FLAG: --enable-server="true"
Jul 28 01:15:29.801157 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795006    2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 28 01:15:29.801157 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795010    2562 flags.go:64] FLAG: --event-burst="100"
Jul 28 01:15:29.801157 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795013    2562 flags.go:64] FLAG: --event-qps="50"
Jul 28 01:15:29.801157 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795016    2562 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 28 01:15:29.801157 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795019    2562 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 28 01:15:29.801157 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795022    2562 flags.go:64] FLAG: --eviction-hard=""
Jul 28 01:15:29.801157 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795026    2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 28 01:15:29.801157 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795029    2562 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 28 01:15:29.801157 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795032    2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 28 01:15:29.801157 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795034    2562 flags.go:64] FLAG: --eviction-soft=""
Jul 28 01:15:29.801157 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795037    2562 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 28 01:15:29.801915 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795040    2562 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 28 01:15:29.801915 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795043    2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 28 01:15:29.801915 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795046    2562 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 28 01:15:29.801915 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795049    2562 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 28 01:15:29.801915 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795052    2562 flags.go:64] FLAG: --fail-swap-on="true"
Jul 28 01:15:29.801915 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795054    2562 flags.go:64] FLAG: --feature-gates=""
Jul 28 01:15:29.801915 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795058    2562 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 28 01:15:29.801915 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795061    2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 28 01:15:29.801915 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795065    2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 28 01:15:29.801915 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795068    2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 28 01:15:29.801915 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795071    2562 flags.go:64] FLAG: --healthz-port="10248"
Jul 28 01:15:29.801915 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795074    2562 flags.go:64] FLAG: --help="false"
Jul 28 01:15:29.801915 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795078    2562 flags.go:64] FLAG: --hostname-override="ip-10-0-134-165.ec2.internal"
Jul 28 01:15:29.801915 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795081    2562 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 28 01:15:29.801915 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795084    2562 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 28 01:15:29.801915 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795087    2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 28 01:15:29.801915 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795091    2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 28 01:15:29.801915 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795095    2562 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 28 01:15:29.801915 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795098    2562 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 28 01:15:29.801915 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795101    2562 flags.go:64] FLAG: --image-service-endpoint=""
Jul 28 01:15:29.801915 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795104    2562 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 28 01:15:29.801915 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795107    2562 flags.go:64] FLAG: --kube-api-burst="100"
Jul 28 01:15:29.801915 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795113    2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 28 01:15:29.802524 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795117    2562 flags.go:64] FLAG: --kube-api-qps="50"
Jul 28 01:15:29.802524 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795120    2562 flags.go:64] FLAG: --kube-reserved=""
Jul 28 01:15:29.802524 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795123    2562 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 28 01:15:29.802524 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795126    2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 28 01:15:29.802524 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795129    2562 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 28 01:15:29.802524 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795132    2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 28 01:15:29.802524 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795135    2562 flags.go:64] FLAG: --lock-file=""
Jul 28 01:15:29.802524 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795138    2562 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 28 01:15:29.802524 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795141    2562 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 28 01:15:29.802524 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795144    2562 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 28 01:15:29.802524 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795150    2562 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 28 01:15:29.802524 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795153    2562 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 28 01:15:29.802524 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795156    2562 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 28 01:15:29.802524 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795158    2562 flags.go:64] FLAG: --logging-format="text"
Jul 28 01:15:29.802524 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795161    2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 28 01:15:29.802524 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795165    2562 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 28 01:15:29.802524 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795168    2562 flags.go:64] FLAG: --manifest-url=""
Jul 28 01:15:29.802524 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795170    2562 flags.go:64] FLAG: --manifest-url-header=""
Jul 28 01:15:29.802524 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795175    2562 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 28 01:15:29.802524 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795178    2562 flags.go:64] FLAG: --max-open-files="1000000"
Jul 28 01:15:29.802524 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795182    2562 flags.go:64] FLAG: --max-pods="110"
Jul 28 01:15:29.802524 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795186    2562 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 28 01:15:29.802524 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795189    2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 28 01:15:29.802524 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795192    2562 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 28 01:15:29.802524 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795195    2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 28 01:15:29.803154 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795198    2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 28 01:15:29.803154 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795202    2562 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 28 01:15:29.803154 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795205    2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 28 01:15:29.803154 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795213    2562 flags.go:64] FLAG: --node-status-max-images="50"
Jul 28 01:15:29.803154 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795216    2562 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 28 01:15:29.803154 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795219    2562 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 28 01:15:29.803154 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795222    2562 flags.go:64] FLAG: --pod-cidr=""
Jul 28 01:15:29.803154 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795226    2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 28 01:15:29.803154 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795231    2562 flags.go:64] FLAG: --pod-manifest-path=""
Jul 28 01:15:29.803154 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795234    2562 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 28 01:15:29.803154 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795237    2562 flags.go:64] FLAG: --pods-per-core="0"
Jul 28 01:15:29.803154 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795240    2562 flags.go:64] FLAG: --port="10250"
Jul 28 01:15:29.803154 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795243    2562 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 28 01:15:29.803154 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795246    2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04fffac380009399b"
Jul 28 01:15:29.803154 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795250    2562 flags.go:64] FLAG: --qos-reserved=""
Jul 28 01:15:29.803154 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795253    2562 flags.go:64] FLAG: --read-only-port="10255"
Jul 28 01:15:29.803154 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795256    2562 flags.go:64] FLAG: --register-node="true"
Jul 28 01:15:29.803154 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795259    2562 flags.go:64] FLAG: --register-with-taints=""
Jul 28 01:15:29.803154 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795263    2562 flags.go:64] FLAG: --registry-burst="10"
Jul 28 01:15:29.803154 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795266    2562 flags.go:64] FLAG: --registry-qps="5"
Jul 28 01:15:29.803154 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795269    2562 flags.go:64] FLAG: --reserved-cpus=""
Jul 28 01:15:29.803154 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795272    2562 flags.go:64] FLAG: --reserved-memory=""
Jul 28 01:15:29.803154 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795276    2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 28 01:15:29.803154 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795279    2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 28 01:15:29.803154 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795282    2562 flags.go:64] FLAG: --rotate-certificates="false"
Jul 28 01:15:29.803924 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795285    2562 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 28 01:15:29.803924 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795288    2562 flags.go:64] FLAG: --runonce="false"
Jul 28 01:15:29.803924 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795290    2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 28 01:15:29.803924 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795294    2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 28 01:15:29.803924 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795298    2562 flags.go:64] FLAG: --seccomp-default="false"
Jul 28 01:15:29.803924 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795301    2562 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 28 01:15:29.803924 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795304    2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 28 01:15:29.803924 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795307    2562 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 28 01:15:29.803924 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795310    2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 28 01:15:29.803924 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795314    2562 flags.go:64] FLAG: --storage-driver-password="root"
Jul 28 01:15:29.803924 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795317    2562 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 28 01:15:29.803924 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795320    2562 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 28 01:15:29.803924 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795322    2562 flags.go:64] FLAG: --storage-driver-user="root"
Jul 28 01:15:29.803924 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795325    2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 28 01:15:29.803924 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795328    2562 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 28 01:15:29.803924 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795332    2562 flags.go:64] FLAG: --system-cgroups=""
Jul 28 01:15:29.803924 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795335    2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 28 01:15:29.803924 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795340    2562 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 28 01:15:29.803924 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795343    2562 flags.go:64] FLAG: --tls-cert-file=""
Jul 28 01:15:29.803924 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795346    2562 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 28 01:15:29.803924 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795350    2562 flags.go:64] FLAG: --tls-min-version=""
Jul 28 01:15:29.803924 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795353    2562 flags.go:64] FLAG: --tls-private-key-file=""
Jul 28 01:15:29.803924 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795356    2562 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 28 01:15:29.803924 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795359    2562 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 28 01:15:29.803924 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795361    2562 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 28 01:15:29.804530 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795364    2562 flags.go:64] FLAG: --v="2"
Jul 28 01:15:29.804530 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795368    2562 flags.go:64] FLAG: --version="false"
Jul 28 01:15:29.804530 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795372    2562 flags.go:64] FLAG: --vmodule=""
Jul 28 01:15:29.804530 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795376    2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 28 01:15:29.804530 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.795379    2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 28 01:15:29.804530 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795507    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 01:15:29.804530 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795512    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 01:15:29.804530 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795515    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 01:15:29.804530 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795518    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 01:15:29.804530 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795521    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 01:15:29.804530 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795525    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 01:15:29.804530 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795528    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 01:15:29.804530 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795531    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 01:15:29.804530 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795533    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 01:15:29.804530 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795536    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 01:15:29.804530 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795539    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 01:15:29.804530 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795542    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 01:15:29.804530 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795545    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 01:15:29.804530 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795548    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 01:15:29.804530 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795551    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 01:15:29.804530 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795553    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 01:15:29.805048 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795568    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 01:15:29.805048 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795571    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 01:15:29.805048 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795575    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 01:15:29.805048 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795577    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 01:15:29.805048 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795580    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 01:15:29.805048 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795583    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 01:15:29.805048 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795585    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 01:15:29.805048 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795590    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 01:15:29.805048 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795593    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 01:15:29.805048 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795596    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 01:15:29.805048 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795599    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 01:15:29.805048 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795602    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 01:15:29.805048 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795605    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 01:15:29.805048 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795608    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 01:15:29.805048 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795610    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 01:15:29.805048 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795613    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 01:15:29.805048 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795616    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 01:15:29.805048 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795618    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 01:15:29.805048 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795621    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 01:15:29.805506 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795623    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 01:15:29.805506 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795626    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 01:15:29.805506 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795630    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 01:15:29.805506 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795632    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 01:15:29.805506 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795635    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 01:15:29.805506 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795638    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 01:15:29.805506 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795640    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 01:15:29.805506 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795643    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 01:15:29.805506 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795646    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 01:15:29.805506 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795649    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 01:15:29.805506 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795652    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 01:15:29.805506 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795655    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 01:15:29.805506 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795657    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 01:15:29.805506 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795660    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 01:15:29.805506 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795663    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 01:15:29.805506 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795665    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 01:15:29.805506 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795668    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 01:15:29.805506 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795671    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 01:15:29.805506 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795674    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 01:15:29.805506 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795676    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 01:15:29.806019 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795679    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 01:15:29.806019 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795682    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 01:15:29.806019 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795684    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 01:15:29.806019 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795686    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 01:15:29.806019 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795689    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 01:15:29.806019 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795691    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 01:15:29.806019 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795694    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 01:15:29.806019 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795696    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 01:15:29.806019 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795699    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 01:15:29.806019 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795701    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 01:15:29.806019 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795704    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 01:15:29.806019 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795706    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 01:15:29.806019 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795709    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 01:15:29.806019 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795711    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 01:15:29.806019 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795716    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 01:15:29.806019 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795719    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 01:15:29.806019 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795721    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 01:15:29.806019 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795724    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 01:15:29.806019 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795726    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 01:15:29.806019 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795729    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 01:15:29.806521 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795734    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 01:15:29.806521 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795737    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 01:15:29.806521 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795740    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 01:15:29.806521 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795743    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 01:15:29.806521 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795746    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 01:15:29.806521 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795749    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 01:15:29.806521 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795752    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 01:15:29.806521 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795755    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 01:15:29.806521 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795758    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 01:15:29.806521 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795761    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 01:15:29.806521 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795763    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 01:15:29.806521 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795765    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 01:15:29.806521 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795768    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 01:15:29.806521 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795770    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 01:15:29.806521 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795773    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 01:15:29.806521 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795776    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 01:15:29.806521 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795778    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 01:15:29.806521 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795780    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 01:15:29.806521 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795783    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 01:15:29.806521 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795786    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 01:15:29.807020 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795789    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 01:15:29.807020 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795793    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 01:15:29.807020 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795796    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 01:15:29.807020 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.795798    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 01:15:29.807020 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.796361    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 01:15:29.807020 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.803170    2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 28 01:15:29.807020 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.803185    2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 28 01:15:29.807020 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.803977    2562 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 28 01:15:29.807020 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.803987    2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 28 01:15:29.807020 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804049    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 01:15:29.807020 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804055    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 01:15:29.807020 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804059    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 01:15:29.807020 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804062    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 01:15:29.807020 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804066    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 01:15:29.807020 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804069    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 01:15:29.807395 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804071    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 01:15:29.807395 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804075    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 01:15:29.807395 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804077    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 01:15:29.807395 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804080    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 01:15:29.807395 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804082    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 01:15:29.807395 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804085    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 01:15:29.807395 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804089    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 01:15:29.807395 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804092    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 01:15:29.807395 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804096    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 01:15:29.807395 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804100    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 01:15:29.807395 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804103    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 01:15:29.807395 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804107    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 01:15:29.807395 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804110    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 01:15:29.807395 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804113    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 01:15:29.807395 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804116    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 01:15:29.807395 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804119    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 01:15:29.807395 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804122    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 01:15:29.807395 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804124    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 01:15:29.807395 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804127    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 01:15:29.807966 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804130    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 01:15:29.807966 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804133    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 01:15:29.807966 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804136    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 01:15:29.807966 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804139    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 01:15:29.807966 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804142    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 01:15:29.807966 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804145    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 01:15:29.807966 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804148    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 01:15:29.807966 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804150    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 01:15:29.807966 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804153    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 01:15:29.807966 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804155    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 01:15:29.807966 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804158    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 01:15:29.807966 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804160    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 01:15:29.807966 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804163    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 01:15:29.807966 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804166    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 01:15:29.807966 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804169    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 01:15:29.807966 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804172    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 01:15:29.807966 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804174    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 01:15:29.807966 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804177    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 01:15:29.807966 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804180    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 01:15:29.807966 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804182    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 01:15:29.808482 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804185    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 01:15:29.808482 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804188    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 01:15:29.808482 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804190    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 01:15:29.808482 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804192    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 01:15:29.808482 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804195    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 01:15:29.808482 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804197    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 01:15:29.808482 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804200    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 01:15:29.808482 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804202    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 01:15:29.808482 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804205    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 01:15:29.808482 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804208    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 01:15:29.808482 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804212    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 01:15:29.808482 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804215    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 01:15:29.808482 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804218    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 01:15:29.808482 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804220    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 01:15:29.808482 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804223    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 01:15:29.808482 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804226    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 01:15:29.808482 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804229    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 01:15:29.808482 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804231    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 01:15:29.808482 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804234    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 01:15:29.808949 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804237    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 01:15:29.808949 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804239    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 01:15:29.808949 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804242    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 01:15:29.808949 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804244    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 01:15:29.808949 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804246    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 01:15:29.808949 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804249    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 01:15:29.808949 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804251    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 01:15:29.808949 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804254    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 01:15:29.808949 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804256    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 01:15:29.808949 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804258    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 01:15:29.808949 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804261    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 01:15:29.808949 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804264    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 01:15:29.808949 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804266    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 01:15:29.808949 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804268    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 01:15:29.808949 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804272    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 01:15:29.808949 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804275    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 01:15:29.808949 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804277    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 01:15:29.808949 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804280    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 01:15:29.808949 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804282    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 01:15:29.808949 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804285    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 01:15:29.809426 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804287    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 01:15:29.809426 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804290    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 01:15:29.809426 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804292    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 01:15:29.809426 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804294    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 01:15:29.809426 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804297    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 01:15:29.809426 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804299    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 01:15:29.809426 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804302    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 01:15:29.809426 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804304    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 01:15:29.809426 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804307    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 01:15:29.809426 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804310    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 01:15:29.809426 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804313    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 01:15:29.809426 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804315    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 01:15:29.809426 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804320    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 01:15:29.809426 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804323    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 01:15:29.809426 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804327    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 01:15:29.809810 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.804332    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 01:15:29.809810 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804452    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 01:15:29.809810 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804458    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 01:15:29.809810 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804460    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 01:15:29.809810 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804464    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 01:15:29.809810 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804466    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 01:15:29.809810 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804470    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 01:15:29.809810 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804475    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 01:15:29.809810 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804478    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 01:15:29.809810 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804481    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 01:15:29.809810 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804483    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 01:15:29.809810 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804486    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 01:15:29.809810 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804489    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 01:15:29.809810 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804492    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 01:15:29.810149 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804495    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 01:15:29.810149 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804498    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 01:15:29.810149 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804500    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 01:15:29.810149 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804504    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 01:15:29.810149 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804507    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 01:15:29.810149 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804510    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 01:15:29.810149 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804513    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 01:15:29.810149 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804516    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 01:15:29.810149 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804519    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 01:15:29.810149 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804521    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 01:15:29.810149 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804524    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 01:15:29.810149 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804527    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 01:15:29.810149 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804529    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 01:15:29.810149 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804532    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 01:15:29.810149 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804535    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 01:15:29.810149 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804538    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 01:15:29.810149 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804540    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 01:15:29.810149 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804543    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 01:15:29.810149 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804546    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 01:15:29.810615 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804548    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 01:15:29.810615 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804551    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 01:15:29.810615 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804553    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 01:15:29.810615 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804571    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 01:15:29.810615 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804574    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 01:15:29.810615 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804577    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 01:15:29.810615 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804580    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 01:15:29.810615 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804582    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 01:15:29.810615 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804585    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 01:15:29.810615 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804587    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 01:15:29.810615 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804590    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 01:15:29.810615 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804592    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 01:15:29.810615 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804596    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 01:15:29.810615 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804598    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 01:15:29.810615 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804601    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 01:15:29.810615 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804604    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 01:15:29.810615 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804606    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 01:15:29.810615 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804609    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 01:15:29.810615 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804611    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 01:15:29.810615 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804614    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 01:15:29.811085 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804618    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 01:15:29.811085 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804622    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 01:15:29.811085 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804624    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 01:15:29.811085 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804626    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 01:15:29.811085 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804629    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 01:15:29.811085 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804631    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 01:15:29.811085 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804634    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 01:15:29.811085 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804637    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 01:15:29.811085 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804639    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 01:15:29.811085 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804642    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 01:15:29.811085 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804645    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 01:15:29.811085 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804647    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 01:15:29.811085 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804650    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 01:15:29.811085 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804652    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 01:15:29.811085 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804655    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 01:15:29.811085 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804657    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 01:15:29.811085 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804660    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 01:15:29.811085 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804662    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 01:15:29.811085 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804665    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 01:15:29.811085 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804667    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 01:15:29.811552 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804670    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 01:15:29.811552 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804672    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 01:15:29.811552 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804675    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 01:15:29.811552 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804677    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 01:15:29.811552 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804680    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 01:15:29.811552 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804683    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 01:15:29.811552 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804686    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 01:15:29.811552 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804689    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 01:15:29.811552 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804691    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 01:15:29.811552 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804694    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 01:15:29.811552 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804696    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 01:15:29.811552 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804699    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 01:15:29.811552 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804701    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 01:15:29.811552 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804704    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 01:15:29.811552 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804706    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 01:15:29.811552 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804709    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 01:15:29.811552 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804711    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 01:15:29.811552 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804714    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 01:15:29.811552 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804717    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 01:15:29.811552 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804719    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 01:15:29.812088 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804721    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 01:15:29.812088 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804724    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 01:15:29.812088 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804726    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 01:15:29.812088 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804729    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 01:15:29.812088 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804731    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 01:15:29.812088 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804733    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 01:15:29.812088 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:29.804736    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 01:15:29.812088 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.804741    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 01:15:29.812088 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.804859    2562 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 28 01:15:29.812088 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.807141    2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 28 01:15:29.812088 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.808539    2562 server.go:1019] "Starting client certificate rotation"
Jul 28 01:15:29.812088 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.808654    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 01:15:29.812088 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.808693    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 01:15:29.812415 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.811935    2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 01:15:29.816022 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.816001    2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 01:15:29.825612 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.825590    2562 log.go:25] "Validated CRI v1 runtime API"
Jul 28 01:15:29.828780 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.828762    2562 log.go:25] "Validated CRI v1 image API"
Jul 28 01:15:29.830491 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.830473    2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 28 01:15:29.836570 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.836540    2562 fs.go:135] Filesystem UUIDs: map[085c5858-10c9-4033-beee-34e7719ab1d9:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b7842bc1-4972-4336-aeb3-25451c097479:/dev/nvme0n1p4]
Jul 28 01:15:29.836637 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.836573    2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 28 01:15:29.840141 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.840124    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 01:15:29.840776 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.840675    2562 manager.go:216] Machine: {Timestamp:2026-07-28 01:15:29.840182751 +0000 UTC m=+0.343944054 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3112269 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2073363144a1df544232486acf74d9 SystemUUID:ec207336-3144-a1df-5442-32486acf74d9 BootID:7864e100-f8ca-414b-bacc-1a599e21a42c Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:88:37:8c:d2:d1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:88:37:8c:d2:d1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5a:31:22:3a:9f:50 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 28 01:15:29.840776 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.840774    2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 28 01:15:29.840885 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.840872    2562 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 28 01:15:29.844825 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.844798    2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 28 01:15:29.844961 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.844827    2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-165.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 28 01:15:29.845790 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.845779    2562 topology_manager.go:138] "Creating topology manager with none policy"
Jul 28 01:15:29.845823 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.845792    2562 container_manager_linux.go:309] "Creating device plugin manager"
Jul 28 01:15:29.845823 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.845799    2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 01:15:29.845823 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.845812    2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 01:15:29.847453 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.847443    2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 28 01:15:29.851103 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.851090    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 01:15:29.851236 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.851226    2562 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 28 01:15:29.851284 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.851254    2562 kubelet.go:486] "Attempting to sync node with API server"
Jul 28 01:15:29.851284 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.851265    2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 28 01:15:29.851346 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.851286    2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 28 01:15:29.851346 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.851295    2562 kubelet.go:398] "Adding apiserver pod source"
Jul 28 01:15:29.851346 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.851310    2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 28 01:15:29.851698 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.851684    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 01:15:29.851760 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.851705    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 01:15:29.855636 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.855621    2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 28 01:15:29.857618 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.857604    2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 28 01:15:29.857666 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.857635    2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 28 01:15:29.858553 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.858543    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 28 01:15:29.858612 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.858576    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 28 01:15:29.858612 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.858583    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 28 01:15:29.858612 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.858589    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 28 01:15:29.858612 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.858612    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 28 01:15:29.858724 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.858618    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 28 01:15:29.859058 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.859048    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 28 01:15:29.859058 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.859058    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 28 01:15:29.859127 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.859066    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 28 01:15:29.859127 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.859072    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 28 01:15:29.859127 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.859086    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 28 01:15:29.859127 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.859093    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 28 01:15:29.860026 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.860014    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 28 01:15:29.860066 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.860030    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 28 01:15:29.860464 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:29.860386    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 28 01:15:29.860538 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:29.860406    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-165.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 28 01:15:29.863452 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.863427    2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-165.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 28 01:15:29.863519 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.863508    2562 server.go:1268] "Started kubelet"
Jul 28 01:15:29.863677 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.863640    2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 28 01:15:29.863744 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.863630    2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 28 01:15:29.863814 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.863801    2562 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 28 01:15:29.864335 ip-10-0-134-165 systemd[1]: Started Kubernetes Kubelet.
Jul 28 01:15:29.870997 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.870933    2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 28 01:15:29.873455 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.873438    2562 server.go:310] "Adding debug handlers to kubelet server"
Jul 28 01:15:29.876491 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:29.876472    2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 28 01:15:29.878309 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:29.877292    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-165.ec2.internal.18c64f26af115aee  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-165.ec2.internal,UID:ip-10-0-134-165.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-165.ec2.internal,},FirstTimestamp:2026-07-28 01:15:29.863482094 +0000 UTC m=+0.367243397,LastTimestamp:2026-07-28 01:15:29.863482094 +0000 UTC m=+0.367243397,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-165.ec2.internal,}"
Jul 28 01:15:29.882687 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.882660    2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 28 01:15:29.882687 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.882667    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 28 01:15:29.882824 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:29.882809    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-165.ec2.internal\" not found"
Jul 28 01:15:29.883430 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.883413    2562 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 28 01:15:29.883517 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.883475    2562 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 28 01:15:29.883517 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.883508    2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 28 01:15:29.883641 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.883611    2562 reconstruct.go:97] "Volume reconstruction finished"
Jul 28 01:15:29.883641 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.883619    2562 reconciler.go:29] "Reconciler: start to sync state"
Jul 28 01:15:29.883788 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.883761    2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 28 01:15:29.883788 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.883789    2562 factory.go:55] Registering systemd factory
Jul 28 01:15:29.883908 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.883796    2562 factory.go:223] Registration of the systemd container factory successfully
Jul 28 01:15:29.884008 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.883994    2562 factory.go:153] Registering CRI-O factory
Jul 28 01:15:29.884060 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.884011    2562 factory.go:223] Registration of the crio container factory successfully
Jul 28 01:15:29.884060 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.884033    2562 factory.go:103] Registering Raw factory
Jul 28 01:15:29.884060 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.884047    2562 manager.go:1196] Started watching for new ooms in manager
Jul 28 01:15:29.884578 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.884544    2562 manager.go:349] Starting recovery of all containers
Jul 28 01:15:29.884704 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:29.884668    2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-165.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 28 01:15:29.884908 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:29.884887    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 28 01:15:29.888266 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.888247    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f2nzx"
Jul 28 01:15:29.894626 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.894607    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f2nzx"
Jul 28 01:15:29.896571 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.896532    2562 manager.go:354] Recovery completed
Jul 28 01:15:29.900688 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.900675    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 01:15:29.903131 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.903113    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 01:15:29.903204 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.903140    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 01:15:29.903204 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.903153    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasSufficientPID"
Jul 28 01:15:29.904280 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.904266    2562 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 28 01:15:29.904280 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.904273    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 01:15:29.904280 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.904278    2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 28 01:15:29.904477 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.904296    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 01:15:29.905084 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.905069    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 01:15:29.905151 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.905099    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 01:15:29.905151 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.905116    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasSufficientPID"
Jul 28 01:15:29.905405 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.905391    2562 policy_none.go:49] "None policy: Start"
Jul 28 01:15:29.905445 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.905410    2562 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 28 01:15:29.905445 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.905421    2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 28 01:15:29.905798 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:29.905710    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-165.ec2.internal.18c64f26b16e5192  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-165.ec2.internal,UID:ip-10-0-134-165.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-165.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-165.ec2.internal,},FirstTimestamp:2026-07-28 01:15:29.903128978 +0000 UTC m=+0.406890283,LastTimestamp:2026-07-28 01:15:29.903128978 +0000 UTC m=+0.406890283,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-165.ec2.internal,}"
Jul 28 01:15:29.906359 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.906347    2562 policy_none.go:47] "Start"
Jul 28 01:15:29.943284 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.943126    2562 manager.go:337] "Starting Device Plugin manager"
Jul 28 01:15:29.943377 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:29.943306    2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 28 01:15:29.943377 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.943319    2562 server.go:87] "Starting device plugin registration server"
Jul 28 01:15:29.943570 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.943549    2562 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 28 01:15:29.943621 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.943576    2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 28 01:15:29.943712 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.943693    2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 28 01:15:29.943795 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.943776    2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 28 01:15:29.943795 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:29.943787    2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 28 01:15:29.944394 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:29.944376    2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 28 01:15:29.944470 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:29.944430    2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-165.ec2.internal\" not found"
Jul 28 01:15:30.005422 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:30.005391    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 28 01:15:30.006577 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:30.006546    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 28 01:15:30.006672 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:30.006596    2562 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 28 01:15:30.006672 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:30.006620    2562 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 28 01:15:30.006672 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:30.006651    2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 28 01:15:30.009203 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:30.009186    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 01:15:30.044607 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:30.044525    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 01:15:30.045616 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:30.045590    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 01:15:30.045713 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:30.045629    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 01:15:30.045713 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:30.045641    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasSufficientPID"
Jul 28 01:15:30.045713 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:30.045665    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-165.ec2.internal"
Jul 28 01:15:30.055017 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:30.054995    2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-165.ec2.internal"
Jul 28 01:15:30.055072 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:30.055019    2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-165.ec2.internal\": node \"ip-10-0-134-165.ec2.internal\" not found"
Jul 28 01:15:30.079653 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:30.079624    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-165.ec2.internal\" not found"
Jul 28 01:15:30.107475 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:30.107446    2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-165.ec2.internal"]
Jul 28 01:15:30.107621 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:30.107519    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 01:15:30.108470 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:30.108452    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 01:15:30.108541 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:30.108484    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 01:15:30.108541 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:30.108494    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasSufficientPID"
Jul 28 01:15:30.109796 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:30.109782    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 01:15:30.109932 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:30.109919    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal"
Jul 28 01:15:30.109965 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:30.109950    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 01:15:30.111768 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:30.111752    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 01:15:30.111848 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:30.111778    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 01:15:30.111848 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:30.111759    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 01:15:30.111848 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:30.111789    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasSufficientPID"
Jul 28 01:15:30.111848 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:30.111813    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 01:15:30.111848 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:30.111832    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasSufficientPID"
Jul 28 01:15:30.113290 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:30.113276    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-165.ec2.internal"
Jul 28 01:15:30.113376 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:30.113306    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 01:15:30.114384 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:30.114370    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 01:15:30.114444 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:30.114396    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 01:15:30.114444 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:30.114414    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasSufficientPID"
Jul 28 01:15:30.146135 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:30.146112    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-165.ec2.internal\" not found" node="ip-10-0-134-165.ec2.internal"
Jul 28 01:15:30.150469 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:30.150455    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-165.ec2.internal\" not found" node="ip-10-0-134-165.ec2.internal"
Jul 28 01:15:30.179945 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:30.179925    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-165.ec2.internal\" not found"
Jul 28 01:15:30.186025 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:30.186005    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/517b308401cec4c38c3b264aa00d7836-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal\" (UID: \"517b308401cec4c38c3b264aa00d7836\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal"
Jul 28 01:15:30.186115 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:30.186034    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/517b308401cec4c38c3b264aa00d7836-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal\" (UID: \"517b308401cec4c38c3b264aa00d7836\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal"
Jul 28 01:15:30.186115 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:30.186058    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/03bf1d8f9ce5d5c18bbead8a350817c2-config\") pod \"kube-apiserver-proxy-ip-10-0-134-165.ec2.internal\" (UID: \"03bf1d8f9ce5d5c18bbead8a350817c2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-165.ec2.internal"
Jul 28 01:15:30.280222 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:30.280182    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-165.ec2.internal\" not found"
Jul 28 01:15:30.286508 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:30.286481    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/517b308401cec4c38c3b264aa00d7836-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal\" (UID: \"517b308401cec4c38c3b264aa00d7836\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal"
Jul 28 01:15:30.286637 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:30.286516    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/517b308401cec4c38c3b264aa00d7836-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal\" (UID: \"517b308401cec4c38c3b264aa00d7836\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal"
Jul 28 01:15:30.286637 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:30.286554    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/03bf1d8f9ce5d5c18bbead8a350817c2-config\") pod \"kube-apiserver-proxy-ip-10-0-134-165.ec2.internal\" (UID: \"03bf1d8f9ce5d5c18bbead8a350817c2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-165.ec2.internal"
Jul 28 01:15:30.286637 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:30.286605    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/517b308401cec4c38c3b264aa00d7836-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal\" (UID: \"517b308401cec4c38c3b264aa00d7836\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal"
Jul 28 01:15:30.286637 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:30.286621    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/03bf1d8f9ce5d5c18bbead8a350817c2-config\") pod \"kube-apiserver-proxy-ip-10-0-134-165.ec2.internal\" (UID: \"03bf1d8f9ce5d5c18bbead8a350817c2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-165.ec2.internal"
Jul 28 01:15:30.286785 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:30.286607    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/517b308401cec4c38c3b264aa00d7836-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal\" (UID: \"517b308401cec4c38c3b264aa00d7836\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal"
Jul 28 01:15:30.380975 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:30.380904    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-165.ec2.internal\" not found"
Jul 28 01:15:30.448389 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:30.448360    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal"
Jul 28 01:15:30.453905 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:30.453887    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-165.ec2.internal"
Jul 28 01:15:30.481399 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:30.481374    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-165.ec2.internal\" not found"
Jul 28 01:15:30.581902 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:30.581858    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-165.ec2.internal\" not found"
Jul 28 01:15:30.682391 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:30.682327    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-165.ec2.internal\" not found"
Jul 28 01:15:30.782926 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:30.782894    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-165.ec2.internal\" not found"
Jul 28 01:15:30.808282 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:30.808261    2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 28 01:15:30.808414 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:30.808394    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 01:15:30.883870 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:30.883844    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-165.ec2.internal\" not found"
Jul 28 01:15:30.899968 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:30.899932    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 01:10:30 +0000 UTC" deadline="2028-02-06 14:44:45.068830164 +0000 UTC"
Jul 28 01:15:30.899968 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:30.899966    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13405h29m14.16886806s"
Jul 28 01:15:30.984699 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:30.984623    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-165.ec2.internal\" not found"
Jul 28 01:15:31.012847 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:31.012816    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod517b308401cec4c38c3b264aa00d7836.slice/crio-b56e60bf8af41f206ffd2fc6299ccb0bddc23a064a25a63c12947d56152726c1 WatchSource:0}: Error finding container b56e60bf8af41f206ffd2fc6299ccb0bddc23a064a25a63c12947d56152726c1: Status 404 returned error can't find the container with id b56e60bf8af41f206ffd2fc6299ccb0bddc23a064a25a63c12947d56152726c1
Jul 28 01:15:31.013444 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:31.013423    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03bf1d8f9ce5d5c18bbead8a350817c2.slice/crio-8d6a5b1afe53dbbab5d567617e95e5d518dd557f691d29987ccde776468ab8b7 WatchSource:0}: Error finding container 8d6a5b1afe53dbbab5d567617e95e5d518dd557f691d29987ccde776468ab8b7: Status 404 returned error can't find the container with id 8d6a5b1afe53dbbab5d567617e95e5d518dd557f691d29987ccde776468ab8b7
Jul 28 01:15:31.018052 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.018037    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 01:15:31.082615 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.082584    2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 01:15:31.085173 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:31.085158    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-165.ec2.internal\" not found"
Jul 28 01:15:31.189293 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:31.189260    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-165.ec2.internal\" not found"
Jul 28 01:15:31.290454 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:31.290381    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-165.ec2.internal\" not found"
Jul 28 01:15:31.391524 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:31.391494    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-165.ec2.internal\" not found"
Jul 28 01:15:31.423065 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.423041    2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 01:15:31.453479 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.453449    2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 01:15:31.483893 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.483864    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-165.ec2.internal"
Jul 28 01:15:31.493364 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.493342    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 01:15:31.494993 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.494973    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal"
Jul 28 01:15:31.506030 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.506008    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 01:15:31.852163 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.852129    2562 apiserver.go:52] "Watching apiserver"
Jul 28 01:15:31.859858 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.859824    2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 28 01:15:31.860334 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.860302    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-xvdx4","kube-system/kube-apiserver-proxy-ip-10-0-134-165.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctltm","openshift-dns/node-resolver-grq5v","openshift-image-registry/node-ca-8r6nb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal","openshift-multus/multus-additional-cni-plugins-ps5b9","openshift-network-operator/iptables-alerter-x92ts","kube-system/konnectivity-agent-vdcp5","openshift-cluster-node-tuning-operator/tuned-crd25","openshift-multus/multus-m5thg","openshift-multus/network-metrics-daemon-d4kjt","openshift-network-diagnostics/network-check-target-68l4f","openshift-ovn-kubernetes/ovnkube-node-rrlwz"]
Jul 28 01:15:31.862022 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.861999    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ps5b9"
Jul 28 01:15:31.863493 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.863467    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68l4f"
Jul 28 01:15:31.863603 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:31.863578    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68l4f" podUID="ddb225a7-f4d2-4295-8cce-d7d4a3d49955"
Jul 28 01:15:31.864160 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.864141    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 28 01:15:31.864407 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.864386    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 28 01:15:31.864499 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.864453    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 28 01:15:31.864499 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.864488    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 28 01:15:31.865191 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.864876    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 28 01:15:31.865191 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.864938    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-skb55\""
Jul 28 01:15:31.865191 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.865001    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctltm"
Jul 28 01:15:31.866519 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.866488    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-grq5v"
Jul 28 01:15:31.866982 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.866958    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 28 01:15:31.867108 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.867002    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 28 01:15:31.867277 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.867258    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 28 01:15:31.867379 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.867370    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pbrmg\""
Jul 28 01:15:31.868258 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.868237    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tfh7p\""
Jul 28 01:15:31.868359 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.868324    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8r6nb"
Jul 28 01:15:31.868442 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.868421    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 28 01:15:31.868849 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.868831    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 28 01:15:31.870002 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.869984    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:31.870476 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.870138    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-55544\""
Jul 28 01:15:31.870476 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.870381    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 28 01:15:31.870476 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.870380    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 28 01:15:31.870718 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.870694    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 28 01:15:31.871384 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.871362    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vdcp5"
Jul 28 01:15:31.872221 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.872205    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kct8j\""
Jul 28 01:15:31.872668 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.872454    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 28 01:15:31.872668 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.872585    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 28 01:15:31.873023 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.872830    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 28 01:15:31.873023 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.872831    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 28 01:15:31.873023 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.872880    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 28 01:15:31.873207 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.872457    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 28 01:15:31.873475 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.873448    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvdx4"
Jul 28 01:15:31.873475 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.873462    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 28 01:15:31.873748 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:31.873521    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvdx4" podUID="c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d"
Jul 28 01:15:31.873748 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.873648    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qzh6m\""
Jul 28 01:15:31.873879 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.873749    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 28 01:15:31.874686 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.874666    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x92ts"
Jul 28 01:15:31.878661 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.877317    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9l7l6\""
Jul 28 01:15:31.878661 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.877351    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 28 01:15:31.878661 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.877579    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-crd25"
Jul 28 01:15:31.878661 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.877673    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 28 01:15:31.878661 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.877791    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 28 01:15:31.879730 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.879709    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 28 01:15:31.879875 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.879855    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 28 01:15:31.880244 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.880147    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5b2mx\""
Jul 28 01:15:31.881828 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.881013    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-m5thg"
Jul 28 01:15:31.882753 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.882730    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4kjt"
Jul 28 01:15:31.882890 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:31.882807    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4kjt" podUID="0a43767a-926c-4dfa-8f67-cd932fa744b5"
Jul 28 01:15:31.883215 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.883193    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 28 01:15:31.883467 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.883449    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-nrm52\""
Jul 28 01:15:31.884752 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.884732    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 28 01:15:31.885664 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.885602    2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 28 01:15:31.893762 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.893743    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 01:15:31.895994 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.895971    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/862e4c58-dd64-47c1-8ad3-46d4340d7a83-var-lib-openvswitch\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:31.896163 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.896010    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/862e4c58-dd64-47c1-8ad3-46d4340d7a83-run-openvswitch\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:31.896163 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.896038    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f57dbd44-5277-461d-a38d-e6c394354c50-system-cni-dir\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:31.896163 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.896063    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f57dbd44-5277-461d-a38d-e6c394354c50-host-run-k8s-cni-cncf-io\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:31.896163 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.896089    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/862e4c58-dd64-47c1-8ad3-46d4340d7a83-host-cni-netd\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:31.896163 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.896113    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a6f3882a-6c12-4669-8e0e-642c8c692d6a-host\") pod \"tuned-crd25\" (UID: \"a6f3882a-6c12-4669-8e0e-642c8c692d6a\") " pod="openshift-cluster-node-tuning-operator/tuned-crd25"
Jul 28 01:15:31.896432 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.896199    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9e6d77bc-6fb4-4f91-bb89-084a03ee29df-host\") pod \"node-ca-8r6nb\" (UID: \"9e6d77bc-6fb4-4f91-bb89-084a03ee29df\") " pod="openshift-image-registry/node-ca-8r6nb"
Jul 28 01:15:31.896432 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.896236    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/434c722b-b620-42a0-972f-a2751b7198a7-socket-dir\") pod \"aws-ebs-csi-driver-node-ctltm\" (UID: \"434c722b-b620-42a0-972f-a2751b7198a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctltm"
Jul 28 01:15:31.896432 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.896262    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9e6d77bc-6fb4-4f91-bb89-084a03ee29df-serviceca\") pod \"node-ca-8r6nb\" (UID: \"9e6d77bc-6fb4-4f91-bb89-084a03ee29df\") " pod="openshift-image-registry/node-ca-8r6nb"
Jul 28 01:15:31.896432 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.896339    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f57dbd44-5277-461d-a38d-e6c394354c50-host-run-netns\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:31.896432 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.896367    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csrbc\" (UniqueName: \"kubernetes.io/projected/f57dbd44-5277-461d-a38d-e6c394354c50-kube-api-access-csrbc\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:31.896432 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.896409    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6f3882a-6c12-4669-8e0e-642c8c692d6a-tmp\") pod \"tuned-crd25\" (UID: \"a6f3882a-6c12-4669-8e0e-642c8c692d6a\") " pod="openshift-cluster-node-tuning-operator/tuned-crd25"
Jul 28 01:15:31.896754 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.896441    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/862e4c58-dd64-47c1-8ad3-46d4340d7a83-systemd-units\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:31.896754 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.896480    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/862e4c58-dd64-47c1-8ad3-46d4340d7a83-etc-openvswitch\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:31.896754 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.896519    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq595\" (UniqueName: \"kubernetes.io/projected/434c722b-b620-42a0-972f-a2751b7198a7-kube-api-access-zq595\") pod \"aws-ebs-csi-driver-node-ctltm\" (UID: \"434c722b-b620-42a0-972f-a2751b7198a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctltm"
Jul 28 01:15:31.896754 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.896584    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/434c722b-b620-42a0-972f-a2751b7198a7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ctltm\" (UID: \"434c722b-b620-42a0-972f-a2751b7198a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctltm"
Jul 28 01:15:31.896754 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.896617    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/434c722b-b620-42a0-972f-a2751b7198a7-device-dir\") pod \"aws-ebs-csi-driver-node-ctltm\" (UID: \"434c722b-b620-42a0-972f-a2751b7198a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctltm"
Jul 28 01:15:31.896754 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.896644    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/862e4c58-dd64-47c1-8ad3-46d4340d7a83-host-slash\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:31.896754 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.896668    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/862e4c58-dd64-47c1-8ad3-46d4340d7a83-host-cni-bin\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:31.896754 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.896692    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/43162e49-7fbb-42a7-9041-00ac2fbcd96d-konnectivity-ca\") pod \"konnectivity-agent-vdcp5\" (UID: \"43162e49-7fbb-42a7-9041-00ac2fbcd96d\") " pod="kube-system/konnectivity-agent-vdcp5"
Jul 28 01:15:31.896754 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.896718    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrswt\" (UniqueName: \"kubernetes.io/projected/9e6d77bc-6fb4-4f91-bb89-084a03ee29df-kube-api-access-hrswt\") pod \"node-ca-8r6nb\" (UID: \"9e6d77bc-6fb4-4f91-bb89-084a03ee29df\") " pod="openshift-image-registry/node-ca-8r6nb"
Jul 28 01:15:31.896754 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.896746    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/862e4c58-dd64-47c1-8ad3-46d4340d7a83-ovn-node-metrics-cert\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:31.897259 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.896773    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be2963da-12fb-4f56-8602-d54733af25e1-system-cni-dir\") pod \"multus-additional-cni-plugins-ps5b9\" (UID: \"be2963da-12fb-4f56-8602-d54733af25e1\") " pod="openshift-multus/multus-additional-cni-plugins-ps5b9"
Jul 28 01:15:31.897259 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.896798    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z9c2\" (UniqueName: \"kubernetes.io/projected/be2963da-12fb-4f56-8602-d54733af25e1-kube-api-access-2z9c2\") pod \"multus-additional-cni-plugins-ps5b9\" (UID: \"be2963da-12fb-4f56-8602-d54733af25e1\") " pod="openshift-multus/multus-additional-cni-plugins-ps5b9"
Jul 28 01:15:31.897259 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.896825    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a6f3882a-6c12-4669-8e0e-642c8c692d6a-etc-sysconfig\") pod \"tuned-crd25\" (UID: \"a6f3882a-6c12-4669-8e0e-642c8c692d6a\") " pod="openshift-cluster-node-tuning-operator/tuned-crd25"
Jul 28 01:15:31.897259 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.896849    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a6f3882a-6c12-4669-8e0e-642c8c692d6a-etc-sysctl-conf\") pod \"tuned-crd25\" (UID: \"a6f3882a-6c12-4669-8e0e-642c8c692d6a\") " pod="openshift-cluster-node-tuning-operator/tuned-crd25"
Jul 28 01:15:31.897259 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.896883    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a6f3882a-6c12-4669-8e0e-642c8c692d6a-sys\") pod \"tuned-crd25\" (UID: \"a6f3882a-6c12-4669-8e0e-642c8c692d6a\") " pod="openshift-cluster-node-tuning-operator/tuned-crd25"
Jul 28 01:15:31.897259 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.896906    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f57dbd44-5277-461d-a38d-e6c394354c50-multus-conf-dir\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:31.897259 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.896931    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22d49\" (UniqueName: \"kubernetes.io/projected/862e4c58-dd64-47c1-8ad3-46d4340d7a83-kube-api-access-22d49\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:31.897259 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.896956    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d-dbus\") pod \"global-pull-secret-syncer-xvdx4\" (UID: \"c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d\") " pod="kube-system/global-pull-secret-syncer-xvdx4"
Jul 28 01:15:31.897259 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.896983    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/be2963da-12fb-4f56-8602-d54733af25e1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ps5b9\" (UID: \"be2963da-12fb-4f56-8602-d54733af25e1\") " pod="openshift-multus/multus-additional-cni-plugins-ps5b9"
Jul 28 01:15:31.897259 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.897009    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmr6t\" (UniqueName: \"kubernetes.io/projected/4ce4a74c-58bc-476f-ba50-fe5e53e2fc84-kube-api-access-rmr6t\") pod \"node-resolver-grq5v\" (UID: \"4ce4a74c-58bc-476f-ba50-fe5e53e2fc84\") " pod="openshift-dns/node-resolver-grq5v"
Jul 28 01:15:31.897259 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.897032    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f57dbd44-5277-461d-a38d-e6c394354c50-cnibin\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:31.897259 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.897054    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f57dbd44-5277-461d-a38d-e6c394354c50-cni-binary-copy\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:31.897259 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.897078    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f57dbd44-5277-461d-a38d-e6c394354c50-host-run-multus-certs\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:31.897259 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.897122    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a43767a-926c-4dfa-8f67-cd932fa744b5-metrics-certs\") pod \"network-metrics-daemon-d4kjt\" (UID: \"0a43767a-926c-4dfa-8f67-cd932fa744b5\") " pod="openshift-multus/network-metrics-daemon-d4kjt"
Jul 28 01:15:31.897259 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.897150    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-799mj\" (UniqueName: \"kubernetes.io/projected/0a43767a-926c-4dfa-8f67-cd932fa744b5-kube-api-access-799mj\") pod \"network-metrics-daemon-d4kjt\" (UID: \"0a43767a-926c-4dfa-8f67-cd932fa744b5\") " pod="openshift-multus/network-metrics-daemon-d4kjt"
Jul 28 01:15:31.897259 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.897186    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a6f3882a-6c12-4669-8e0e-642c8c692d6a-etc-sysctl-d\") pod \"tuned-crd25\" (UID: \"a6f3882a-6c12-4669-8e0e-642c8c692d6a\") " pod="openshift-cluster-node-tuning-operator/tuned-crd25"
Jul 28 01:15:31.898061 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.897222    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f57dbd44-5277-461d-a38d-e6c394354c50-os-release\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:31.898061 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.897261    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f57dbd44-5277-461d-a38d-e6c394354c50-host-var-lib-cni-bin\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:31.898061 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.897286    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/862e4c58-dd64-47c1-8ad3-46d4340d7a83-ovnkube-config\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:31.898061 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.897311    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d-original-pull-secret\") pod \"global-pull-secret-syncer-xvdx4\" (UID: \"c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d\") " pod="kube-system/global-pull-secret-syncer-xvdx4"
Jul 28 01:15:31.898061 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.897349    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fc097e31-9dd5-41b8-911c-540d29ed52d3-host-slash\") pod \"iptables-alerter-x92ts\" (UID: \"fc097e31-9dd5-41b8-911c-540d29ed52d3\") " pod="openshift-network-operator/iptables-alerter-x92ts"
Jul 28 01:15:31.898061 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.897386    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/be2963da-12fb-4f56-8602-d54733af25e1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ps5b9\" (UID: \"be2963da-12fb-4f56-8602-d54733af25e1\") " pod="openshift-multus/multus-additional-cni-plugins-ps5b9"
Jul 28 01:15:31.898061 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.897416    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a6f3882a-6c12-4669-8e0e-642c8c692d6a-etc-modprobe-d\") pod \"tuned-crd25\" (UID: \"a6f3882a-6c12-4669-8e0e-642c8c692d6a\") " pod="openshift-cluster-node-tuning-operator/tuned-crd25"
Jul 28 01:15:31.898061 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.897513    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6f3882a-6c12-4669-8e0e-642c8c692d6a-etc-kubernetes\") pod \"tuned-crd25\" (UID: \"a6f3882a-6c12-4669-8e0e-642c8c692d6a\") " pod="openshift-cluster-node-tuning-operator/tuned-crd25"
Jul 28 01:15:31.898061 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.897549    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a6f3882a-6c12-4669-8e0e-642c8c692d6a-etc-tuned\") pod \"tuned-crd25\" (UID: \"a6f3882a-6c12-4669-8e0e-642c8c692d6a\") " pod="openshift-cluster-node-tuning-operator/tuned-crd25"
Jul 28 01:15:31.898061 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.897593    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f57dbd44-5277-461d-a38d-e6c394354c50-multus-socket-dir-parent\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:31.898061 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.897619    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f57dbd44-5277-461d-a38d-e6c394354c50-host-var-lib-kubelet\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:31.898061 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.897644    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/862e4c58-dd64-47c1-8ad3-46d4340d7a83-run-systemd\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:31.898061 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.897668    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/862e4c58-dd64-47c1-8ad3-46d4340d7a83-host-run-ovn-kubernetes\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:31.898061 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.897705    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/862e4c58-dd64-47c1-8ad3-46d4340d7a83-env-overrides\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:31.898061 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.897736    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/434c722b-b620-42a0-972f-a2751b7198a7-registration-dir\") pod \"aws-ebs-csi-driver-node-ctltm\" (UID: \"434c722b-b620-42a0-972f-a2751b7198a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctltm"
Jul 28 01:15:31.898061 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.897768    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/434c722b-b620-42a0-972f-a2751b7198a7-sys-fs\") pod \"aws-ebs-csi-driver-node-ctltm\" (UID: \"434c722b-b620-42a0-972f-a2751b7198a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctltm"
Jul 28 01:15:31.898856 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.897809    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6f3882a-6c12-4669-8e0e-642c8c692d6a-var-lib-kubelet\") pod \"tuned-crd25\" (UID: \"a6f3882a-6c12-4669-8e0e-642c8c692d6a\") " pod="openshift-cluster-node-tuning-operator/tuned-crd25"
Jul 28 01:15:31.898856 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.897842    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/862e4c58-dd64-47c1-8ad3-46d4340d7a83-host-run-netns\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:31.898856 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.897890    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be2963da-12fb-4f56-8602-d54733af25e1-os-release\") pod \"multus-additional-cni-plugins-ps5b9\" (UID: \"be2963da-12fb-4f56-8602-d54733af25e1\") " pod="openshift-multus/multus-additional-cni-plugins-ps5b9"
Jul 28 01:15:31.898856 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.897924    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/434c722b-b620-42a0-972f-a2751b7198a7-etc-selinux\") pod \"aws-ebs-csi-driver-node-ctltm\" (UID: \"434c722b-b620-42a0-972f-a2751b7198a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctltm"
Jul 28 01:15:31.898856 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.897952    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f57dbd44-5277-461d-a38d-e6c394354c50-multus-cni-dir\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:31.898856 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.897977    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fc097e31-9dd5-41b8-911c-540d29ed52d3-iptables-alerter-script\") pod \"iptables-alerter-x92ts\" (UID: \"fc097e31-9dd5-41b8-911c-540d29ed52d3\") " pod="openshift-network-operator/iptables-alerter-x92ts"
Jul 28 01:15:31.898856 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.898008    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxv57\" (UniqueName: \"kubernetes.io/projected/fc097e31-9dd5-41b8-911c-540d29ed52d3-kube-api-access-hxv57\") pod \"iptables-alerter-x92ts\" (UID: \"fc097e31-9dd5-41b8-911c-540d29ed52d3\") " pod="openshift-network-operator/iptables-alerter-x92ts"
Jul 28 01:15:31.898856 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.898032    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be2963da-12fb-4f56-8602-d54733af25e1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ps5b9\" (UID: \"be2963da-12fb-4f56-8602-d54733af25e1\") " pod="openshift-multus/multus-additional-cni-plugins-ps5b9"
Jul 28 01:15:31.898856 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.898055    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ce4a74c-58bc-476f-ba50-fe5e53e2fc84-tmp-dir\") pod \"node-resolver-grq5v\" (UID: \"4ce4a74c-58bc-476f-ba50-fe5e53e2fc84\") " pod="openshift-dns/node-resolver-grq5v"
Jul 28 01:15:31.898856 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.898087    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a6f3882a-6c12-4669-8e0e-642c8c692d6a-lib-modules\") pod \"tuned-crd25\" (UID: \"a6f3882a-6c12-4669-8e0e-642c8c692d6a\") " pod="openshift-cluster-node-tuning-operator/tuned-crd25"
Jul 28 01:15:31.898856 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.898130    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f57dbd44-5277-461d-a38d-e6c394354c50-host-var-lib-cni-multus\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:31.898856 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.898159    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/862e4c58-dd64-47c1-8ad3-46d4340d7a83-log-socket\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:31.898856 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.898183    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/862e4c58-dd64-47c1-8ad3-46d4340d7a83-ovnkube-script-lib\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:31.898856 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.898209    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be2963da-12fb-4f56-8602-d54733af25e1-cni-binary-copy\") pod \"multus-additional-cni-plugins-ps5b9\" (UID: \"be2963da-12fb-4f56-8602-d54733af25e1\") " pod="openshift-multus/multus-additional-cni-plugins-ps5b9"
Jul 28 01:15:31.898856 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.898233    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45fgh\" (UniqueName: \"kubernetes.io/projected/a6f3882a-6c12-4669-8e0e-642c8c692d6a-kube-api-access-45fgh\") pod \"tuned-crd25\" (UID: \"a6f3882a-6c12-4669-8e0e-642c8c692d6a\") " pod="openshift-cluster-node-tuning-operator/tuned-crd25"
Jul 28 01:15:31.898856 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.898279    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g5sm\" (UniqueName: \"kubernetes.io/projected/ddb225a7-f4d2-4295-8cce-d7d4a3d49955-kube-api-access-6g5sm\") pod \"network-check-target-68l4f\" (UID: \"ddb225a7-f4d2-4295-8cce-d7d4a3d49955\") " pod="openshift-network-diagnostics/network-check-target-68l4f"
Jul 28 01:15:31.899824 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.898306    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4ce4a74c-58bc-476f-ba50-fe5e53e2fc84-hosts-file\") pod \"node-resolver-grq5v\" (UID: \"4ce4a74c-58bc-476f-ba50-fe5e53e2fc84\") " pod="openshift-dns/node-resolver-grq5v"
Jul 28 01:15:31.899824 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.898334    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a6f3882a-6c12-4669-8e0e-642c8c692d6a-etc-systemd\") pod \"tuned-crd25\" (UID: \"a6f3882a-6c12-4669-8e0e-642c8c692d6a\") " pod="openshift-cluster-node-tuning-operator/tuned-crd25"
Jul 28 01:15:31.899824 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.898358    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a6f3882a-6c12-4669-8e0e-642c8c692d6a-run\") pod \"tuned-crd25\" (UID: \"a6f3882a-6c12-4669-8e0e-642c8c692d6a\") " pod="openshift-cluster-node-tuning-operator/tuned-crd25"
Jul 28 01:15:31.899824 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.898381    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/862e4c58-dd64-47c1-8ad3-46d4340d7a83-host-kubelet\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:31.899824 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.898406    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/43162e49-7fbb-42a7-9041-00ac2fbcd96d-agent-certs\") pod \"konnectivity-agent-vdcp5\" (UID: \"43162e49-7fbb-42a7-9041-00ac2fbcd96d\") " pod="kube-system/konnectivity-agent-vdcp5"
Jul 28 01:15:31.899824 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.898430    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be2963da-12fb-4f56-8602-d54733af25e1-cnibin\") pod \"multus-additional-cni-plugins-ps5b9\" (UID: \"be2963da-12fb-4f56-8602-d54733af25e1\") " pod="openshift-multus/multus-additional-cni-plugins-ps5b9"
Jul 28 01:15:31.899824 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.898462    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f57dbd44-5277-461d-a38d-e6c394354c50-hostroot\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:31.899824 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.898485    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f57dbd44-5277-461d-a38d-e6c394354c50-multus-daemon-config\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:31.899824 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.898521    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/862e4c58-dd64-47c1-8ad3-46d4340d7a83-run-ovn\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:31.899824 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.898606    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/862e4c58-dd64-47c1-8ad3-46d4340d7a83-node-log\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:31.899824 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.898652    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/862e4c58-dd64-47c1-8ad3-46d4340d7a83-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:31.899824 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.898684    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d-kubelet-config\") pod \"global-pull-secret-syncer-xvdx4\" (UID: \"c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d\") " pod="kube-system/global-pull-secret-syncer-xvdx4"
Jul 28 01:15:31.899824 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.898711    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f57dbd44-5277-461d-a38d-e6c394354c50-etc-kubernetes\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:31.918549 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.918526    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rtdx2"
Jul 28 01:15:31.924860 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.924839    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rtdx2"
Jul 28 01:15:31.991515 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.991482    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 01:15:31.999907 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.999875    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d-dbus\") pod \"global-pull-secret-syncer-xvdx4\" (UID: \"c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d\") " pod="kube-system/global-pull-secret-syncer-xvdx4"
Jul 28 01:15:32.000060 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.999919    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/be2963da-12fb-4f56-8602-d54733af25e1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ps5b9\" (UID: \"be2963da-12fb-4f56-8602-d54733af25e1\") " pod="openshift-multus/multus-additional-cni-plugins-ps5b9"
Jul 28 01:15:32.000060 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.999949    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmr6t\" (UniqueName: \"kubernetes.io/projected/4ce4a74c-58bc-476f-ba50-fe5e53e2fc84-kube-api-access-rmr6t\") pod \"node-resolver-grq5v\" (UID: \"4ce4a74c-58bc-476f-ba50-fe5e53e2fc84\") " pod="openshift-dns/node-resolver-grq5v"
Jul 28 01:15:32.000060 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.999979    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f57dbd44-5277-461d-a38d-e6c394354c50-cnibin\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:32.000060 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:31.999996    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f57dbd44-5277-461d-a38d-e6c394354c50-cni-binary-copy\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:32.000060 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.000012    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f57dbd44-5277-461d-a38d-e6c394354c50-host-run-multus-certs\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:32.000060 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.000037    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a43767a-926c-4dfa-8f67-cd932fa744b5-metrics-certs\") pod \"network-metrics-daemon-d4kjt\" (UID: \"0a43767a-926c-4dfa-8f67-cd932fa744b5\") " pod="openshift-multus/network-metrics-daemon-d4kjt"
Jul 28 01:15:32.000060 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.000056    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-799mj\" (UniqueName: \"kubernetes.io/projected/0a43767a-926c-4dfa-8f67-cd932fa744b5-kube-api-access-799mj\") pod \"network-metrics-daemon-d4kjt\" (UID: \"0a43767a-926c-4dfa-8f67-cd932fa744b5\") " pod="openshift-multus/network-metrics-daemon-d4kjt"
Jul 28 01:15:32.000416 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.000075    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a6f3882a-6c12-4669-8e0e-642c8c692d6a-etc-sysctl-d\") pod \"tuned-crd25\" (UID: \"a6f3882a-6c12-4669-8e0e-642c8c692d6a\") " pod="openshift-cluster-node-tuning-operator/tuned-crd25"
Jul 28 01:15:32.000416 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.000092    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f57dbd44-5277-461d-a38d-e6c394354c50-os-release\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:32.000416 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.000116    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f57dbd44-5277-461d-a38d-e6c394354c50-host-var-lib-cni-bin\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:32.000416 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.000135    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/862e4c58-dd64-47c1-8ad3-46d4340d7a83-ovnkube-config\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:32.000416 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.000166    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d-original-pull-secret\") pod \"global-pull-secret-syncer-xvdx4\" (UID: \"c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d\") " pod="kube-system/global-pull-secret-syncer-xvdx4"
Jul 28 01:15:32.000416 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.000198    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fc097e31-9dd5-41b8-911c-540d29ed52d3-host-slash\") pod \"iptables-alerter-x92ts\" (UID: \"fc097e31-9dd5-41b8-911c-540d29ed52d3\") " pod="openshift-network-operator/iptables-alerter-x92ts"
Jul 28 01:15:32.000416 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.000225    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/be2963da-12fb-4f56-8602-d54733af25e1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ps5b9\" (UID: \"be2963da-12fb-4f56-8602-d54733af25e1\") " pod="openshift-multus/multus-additional-cni-plugins-ps5b9"
Jul 28 01:15:32.000416 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.000243    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a6f3882a-6c12-4669-8e0e-642c8c692d6a-etc-modprobe-d\") pod \"tuned-crd25\" (UID: \"a6f3882a-6c12-4669-8e0e-642c8c692d6a\") " pod="openshift-cluster-node-tuning-operator/tuned-crd25"
Jul 28 01:15:32.000416 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.000258    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6f3882a-6c12-4669-8e0e-642c8c692d6a-etc-kubernetes\") pod \"tuned-crd25\" (UID: \"a6f3882a-6c12-4669-8e0e-642c8c692d6a\") " pod="openshift-cluster-node-tuning-operator/tuned-crd25"
Jul 28 01:15:32.000416 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.000281    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a6f3882a-6c12-4669-8e0e-642c8c692d6a-etc-tuned\") pod \"tuned-crd25\" (UID: \"a6f3882a-6c12-4669-8e0e-642c8c692d6a\") " pod="openshift-cluster-node-tuning-operator/tuned-crd25"
Jul 28 01:15:32.000416 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.000306    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f57dbd44-5277-461d-a38d-e6c394354c50-multus-socket-dir-parent\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:32.000416 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.000325    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f57dbd44-5277-461d-a38d-e6c394354c50-host-var-lib-kubelet\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:32.000416 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.000340    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/862e4c58-dd64-47c1-8ad3-46d4340d7a83-run-systemd\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:32.000416 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.000358    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/862e4c58-dd64-47c1-8ad3-46d4340d7a83-host-run-ovn-kubernetes\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:32.000416 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.000382    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/862e4c58-dd64-47c1-8ad3-46d4340d7a83-env-overrides\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:32.000416 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.000406    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/434c722b-b620-42a0-972f-a2751b7198a7-registration-dir\") pod \"aws-ebs-csi-driver-node-ctltm\" (UID: \"434c722b-b620-42a0-972f-a2751b7198a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctltm"
Jul 28 01:15:32.001153 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.000430    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/434c722b-b620-42a0-972f-a2751b7198a7-sys-fs\") pod \"aws-ebs-csi-driver-node-ctltm\" (UID: \"434c722b-b620-42a0-972f-a2751b7198a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctltm"
Jul 28 01:15:32.001153 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.000451    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6f3882a-6c12-4669-8e0e-642c8c692d6a-var-lib-kubelet\") pod \"tuned-crd25\" (UID: \"a6f3882a-6c12-4669-8e0e-642c8c692d6a\") " pod="openshift-cluster-node-tuning-operator/tuned-crd25"
Jul 28 01:15:32.001153 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.000472    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/862e4c58-dd64-47c1-8ad3-46d4340d7a83-host-run-netns\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:32.001153 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.000490    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be2963da-12fb-4f56-8602-d54733af25e1-os-release\") pod \"multus-additional-cni-plugins-ps5b9\" (UID: \"be2963da-12fb-4f56-8602-d54733af25e1\") " pod="openshift-multus/multus-additional-cni-plugins-ps5b9"
Jul 28 01:15:32.001153 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.000520    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/434c722b-b620-42a0-972f-a2751b7198a7-etc-selinux\") pod \"aws-ebs-csi-driver-node-ctltm\" (UID: \"434c722b-b620-42a0-972f-a2751b7198a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctltm"
Jul 28 01:15:32.001153 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.000545    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f57dbd44-5277-461d-a38d-e6c394354c50-multus-cni-dir\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:32.001153 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.000571    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fc097e31-9dd5-41b8-911c-540d29ed52d3-iptables-alerter-script\") pod \"iptables-alerter-x92ts\" (UID: \"fc097e31-9dd5-41b8-911c-540d29ed52d3\") " pod="openshift-network-operator/iptables-alerter-x92ts"
Jul 28 01:15:32.001153 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.000597    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxv57\" (UniqueName: \"kubernetes.io/projected/fc097e31-9dd5-41b8-911c-540d29ed52d3-kube-api-access-hxv57\") pod \"iptables-alerter-x92ts\" (UID: \"fc097e31-9dd5-41b8-911c-540d29ed52d3\") " pod="openshift-network-operator/iptables-alerter-x92ts"
Jul 28 01:15:32.001153 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.000638    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be2963da-12fb-4f56-8602-d54733af25e1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ps5b9\" (UID: \"be2963da-12fb-4f56-8602-d54733af25e1\") " pod="openshift-multus/multus-additional-cni-plugins-ps5b9"
Jul 28 01:15:32.001153 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.000667    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ce4a74c-58bc-476f-ba50-fe5e53e2fc84-tmp-dir\") pod \"node-resolver-grq5v\" (UID: \"4ce4a74c-58bc-476f-ba50-fe5e53e2fc84\") " pod="openshift-dns/node-resolver-grq5v"
Jul 28 01:15:32.001153 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.000709    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a6f3882a-6c12-4669-8e0e-642c8c692d6a-lib-modules\") pod \"tuned-crd25\" (UID: \"a6f3882a-6c12-4669-8e0e-642c8c692d6a\") " pod="openshift-cluster-node-tuning-operator/tuned-crd25"
Jul 28 01:15:32.001153 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.000738    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f57dbd44-5277-461d-a38d-e6c394354c50-host-var-lib-cni-multus\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:32.001153 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.000765    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/862e4c58-dd64-47c1-8ad3-46d4340d7a83-log-socket\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:32.001153 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.000790    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/862e4c58-dd64-47c1-8ad3-46d4340d7a83-ovnkube-script-lib\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:32.001153 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.000815    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be2963da-12fb-4f56-8602-d54733af25e1-cni-binary-copy\") pod \"multus-additional-cni-plugins-ps5b9\" (UID: \"be2963da-12fb-4f56-8602-d54733af25e1\") " pod="openshift-multus/multus-additional-cni-plugins-ps5b9"
Jul 28 01:15:32.001153 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.000839    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45fgh\" (UniqueName: \"kubernetes.io/projected/a6f3882a-6c12-4669-8e0e-642c8c692d6a-kube-api-access-45fgh\") pod \"tuned-crd25\" (UID: \"a6f3882a-6c12-4669-8e0e-642c8c692d6a\") " pod="openshift-cluster-node-tuning-operator/tuned-crd25"
Jul 28 01:15:32.001153 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.000856    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g5sm\" (UniqueName: \"kubernetes.io/projected/ddb225a7-f4d2-4295-8cce-d7d4a3d49955-kube-api-access-6g5sm\") pod \"network-check-target-68l4f\" (UID: \"ddb225a7-f4d2-4295-8cce-d7d4a3d49955\") " pod="openshift-network-diagnostics/network-check-target-68l4f"
Jul 28 01:15:32.001923 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.000908    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4ce4a74c-58bc-476f-ba50-fe5e53e2fc84-hosts-file\") pod \"node-resolver-grq5v\" (UID: \"4ce4a74c-58bc-476f-ba50-fe5e53e2fc84\") " pod="openshift-dns/node-resolver-grq5v"
Jul 28 01:15:32.001923 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.000959    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a6f3882a-6c12-4669-8e0e-642c8c692d6a-etc-systemd\") pod \"tuned-crd25\" (UID: \"a6f3882a-6c12-4669-8e0e-642c8c692d6a\") " pod="openshift-cluster-node-tuning-operator/tuned-crd25"
Jul 28 01:15:32.001923 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.000991    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a6f3882a-6c12-4669-8e0e-642c8c692d6a-run\") pod \"tuned-crd25\" (UID: \"a6f3882a-6c12-4669-8e0e-642c8c692d6a\") " pod="openshift-cluster-node-tuning-operator/tuned-crd25"
Jul 28 01:15:32.001923 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.001019    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/862e4c58-dd64-47c1-8ad3-46d4340d7a83-host-kubelet\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:32.001923 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.001047    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/43162e49-7fbb-42a7-9041-00ac2fbcd96d-agent-certs\") pod \"konnectivity-agent-vdcp5\" (UID: \"43162e49-7fbb-42a7-9041-00ac2fbcd96d\") " pod="kube-system/konnectivity-agent-vdcp5"
Jul 28 01:15:32.001923 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.001075    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be2963da-12fb-4f56-8602-d54733af25e1-cnibin\") pod \"multus-additional-cni-plugins-ps5b9\" (UID: \"be2963da-12fb-4f56-8602-d54733af25e1\") " pod="openshift-multus/multus-additional-cni-plugins-ps5b9"
Jul 28 01:15:32.001923 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.001100    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f57dbd44-5277-461d-a38d-e6c394354c50-hostroot\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:32.001923 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.001136    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f57dbd44-5277-461d-a38d-e6c394354c50-multus-daemon-config\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:32.001923 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.001164    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/862e4c58-dd64-47c1-8ad3-46d4340d7a83-run-ovn\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:32.001923 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.001172    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/862e4c58-dd64-47c1-8ad3-46d4340d7a83-run-systemd\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:32.001923 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.001195    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/862e4c58-dd64-47c1-8ad3-46d4340d7a83-node-log\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:32.001923 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.001217    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/862e4c58-dd64-47c1-8ad3-46d4340d7a83-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:32.001923 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.001243    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d-kubelet-config\") pod \"global-pull-secret-syncer-xvdx4\" (UID: \"c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d\") " pod="kube-system/global-pull-secret-syncer-xvdx4"
Jul 28 01:15:32.001923 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.001245    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/862e4c58-dd64-47c1-8ad3-46d4340d7a83-host-run-ovn-kubernetes\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:32.001923 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.001259    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f57dbd44-5277-461d-a38d-e6c394354c50-etc-kubernetes\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:32.001923 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.001279    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/862e4c58-dd64-47c1-8ad3-46d4340d7a83-var-lib-openvswitch\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:32.001923 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.001301    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/862e4c58-dd64-47c1-8ad3-46d4340d7a83-run-openvswitch\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:32.001923 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.001330    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f57dbd44-5277-461d-a38d-e6c394354c50-system-cni-dir\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:32.002802 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.001356    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f57dbd44-5277-461d-a38d-e6c394354c50-host-run-k8s-cni-cncf-io\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:32.002802 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.001376    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/862e4c58-dd64-47c1-8ad3-46d4340d7a83-host-cni-netd\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:32.002802 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.001391    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a6f3882a-6c12-4669-8e0e-642c8c692d6a-host\") pod \"tuned-crd25\" (UID: \"a6f3882a-6c12-4669-8e0e-642c8c692d6a\") " pod="openshift-cluster-node-tuning-operator/tuned-crd25"
Jul 28 01:15:32.002802 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.001416    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9e6d77bc-6fb4-4f91-bb89-084a03ee29df-host\") pod \"node-ca-8r6nb\" (UID: \"9e6d77bc-6fb4-4f91-bb89-084a03ee29df\") " pod="openshift-image-registry/node-ca-8r6nb"
Jul 28 01:15:32.002802 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.001452    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/434c722b-b620-42a0-972f-a2751b7198a7-socket-dir\") pod \"aws-ebs-csi-driver-node-ctltm\" (UID: \"434c722b-b620-42a0-972f-a2751b7198a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctltm"
Jul 28 01:15:32.002802 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.001468    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9e6d77bc-6fb4-4f91-bb89-084a03ee29df-serviceca\") pod \"node-ca-8r6nb\" (UID: \"9e6d77bc-6fb4-4f91-bb89-084a03ee29df\") " pod="openshift-image-registry/node-ca-8r6nb"
Jul 28 01:15:32.002802 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.001504    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f57dbd44-5277-461d-a38d-e6c394354c50-host-run-netns\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:32.002802 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.001531    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csrbc\" (UniqueName: \"kubernetes.io/projected/f57dbd44-5277-461d-a38d-e6c394354c50-kube-api-access-csrbc\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:32.002802 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.001547    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6f3882a-6c12-4669-8e0e-642c8c692d6a-tmp\") pod \"tuned-crd25\" (UID: \"a6f3882a-6c12-4669-8e0e-642c8c692d6a\") " pod="openshift-cluster-node-tuning-operator/tuned-crd25"
Jul 28 01:15:32.002802 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.001565    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/862e4c58-dd64-47c1-8ad3-46d4340d7a83-systemd-units\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:32.002802 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.001587    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/862e4c58-dd64-47c1-8ad3-46d4340d7a83-etc-openvswitch\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:32.002802 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.001611    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq595\" (UniqueName: \"kubernetes.io/projected/434c722b-b620-42a0-972f-a2751b7198a7-kube-api-access-zq595\") pod \"aws-ebs-csi-driver-node-ctltm\" (UID: \"434c722b-b620-42a0-972f-a2751b7198a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctltm"
Jul 28 01:15:32.002802 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.001646    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/434c722b-b620-42a0-972f-a2751b7198a7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ctltm\" (UID: \"434c722b-b620-42a0-972f-a2751b7198a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctltm"
Jul 28 01:15:32.002802 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.001668    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/434c722b-b620-42a0-972f-a2751b7198a7-device-dir\") pod \"aws-ebs-csi-driver-node-ctltm\" (UID: \"434c722b-b620-42a0-972f-a2751b7198a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctltm"
Jul 28 01:15:32.002802 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.001693    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/862e4c58-dd64-47c1-8ad3-46d4340d7a83-host-slash\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:32.002802 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.001724    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/862e4c58-dd64-47c1-8ad3-46d4340d7a83-host-cni-bin\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:32.002802 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.001756    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/43162e49-7fbb-42a7-9041-00ac2fbcd96d-konnectivity-ca\") pod \"konnectivity-agent-vdcp5\" (UID: \"43162e49-7fbb-42a7-9041-00ac2fbcd96d\") " pod="kube-system/konnectivity-agent-vdcp5"
Jul 28 01:15:32.003491 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.001785    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrswt\" (UniqueName: \"kubernetes.io/projected/9e6d77bc-6fb4-4f91-bb89-084a03ee29df-kube-api-access-hrswt\") pod \"node-ca-8r6nb\" (UID: \"9e6d77bc-6fb4-4f91-bb89-084a03ee29df\") " pod="openshift-image-registry/node-ca-8r6nb"
Jul 28 01:15:32.003491 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.001811    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/862e4c58-dd64-47c1-8ad3-46d4340d7a83-ovn-node-metrics-cert\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:32.003491 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.001820    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/862e4c58-dd64-47c1-8ad3-46d4340d7a83-env-overrides\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:32.003491 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.001853    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be2963da-12fb-4f56-8602-d54733af25e1-system-cni-dir\") pod \"multus-additional-cni-plugins-ps5b9\" (UID: \"be2963da-12fb-4f56-8602-d54733af25e1\") " pod="openshift-multus/multus-additional-cni-plugins-ps5b9"
Jul 28 01:15:32.003491 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.001883    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z9c2\" (UniqueName: \"kubernetes.io/projected/be2963da-12fb-4f56-8602-d54733af25e1-kube-api-access-2z9c2\") pod \"multus-additional-cni-plugins-ps5b9\" (UID: \"be2963da-12fb-4f56-8602-d54733af25e1\") " pod="openshift-multus/multus-additional-cni-plugins-ps5b9"
Jul 28 01:15:32.003491 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.001914    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a6f3882a-6c12-4669-8e0e-642c8c692d6a-etc-sysconfig\") pod \"tuned-crd25\" (UID: \"a6f3882a-6c12-4669-8e0e-642c8c692d6a\") " pod="openshift-cluster-node-tuning-operator/tuned-crd25"
Jul 28 01:15:32.003491 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.001945    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a6f3882a-6c12-4669-8e0e-642c8c692d6a-etc-sysctl-conf\") pod \"tuned-crd25\" (UID: \"a6f3882a-6c12-4669-8e0e-642c8c692d6a\") " pod="openshift-cluster-node-tuning-operator/tuned-crd25"
Jul 28 01:15:32.003491 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.001951    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/434c722b-b620-42a0-972f-a2751b7198a7-sys-fs\") pod \"aws-ebs-csi-driver-node-ctltm\" (UID: \"434c722b-b620-42a0-972f-a2751b7198a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctltm"
Jul 28 01:15:32.003491 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.001989    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a6f3882a-6c12-4669-8e0e-642c8c692d6a-sys\") pod \"tuned-crd25\" (UID: \"a6f3882a-6c12-4669-8e0e-642c8c692d6a\") " pod="openshift-cluster-node-tuning-operator/tuned-crd25"
Jul 28 01:15:32.003491 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.002023    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f57dbd44-5277-461d-a38d-e6c394354c50-multus-conf-dir\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:32.003491 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.002049    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22d49\" (UniqueName: \"kubernetes.io/projected/862e4c58-dd64-47c1-8ad3-46d4340d7a83-kube-api-access-22d49\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:32.003491 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.002157    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d-dbus\") pod \"global-pull-secret-syncer-xvdx4\" (UID: \"c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d\") " pod="kube-system/global-pull-secret-syncer-xvdx4"
Jul 28 01:15:32.003491 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.002350    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6f3882a-6c12-4669-8e0e-642c8c692d6a-var-lib-kubelet\") pod \"tuned-crd25\" (UID: \"a6f3882a-6c12-4669-8e0e-642c8c692d6a\") " pod="openshift-cluster-node-tuning-operator/tuned-crd25"
Jul 28 01:15:32.003491 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.002386    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/862e4c58-dd64-47c1-8ad3-46d4340d7a83-host-run-netns\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:32.003491 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.002444    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be2963da-12fb-4f56-8602-d54733af25e1-os-release\") pod \"multus-additional-cni-plugins-ps5b9\" (UID: \"be2963da-12fb-4f56-8602-d54733af25e1\") " pod="openshift-multus/multus-additional-cni-plugins-ps5b9"
Jul 28 01:15:32.003491 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.002487    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/434c722b-b620-42a0-972f-a2751b7198a7-etc-selinux\") pod \"aws-ebs-csi-driver-node-ctltm\" (UID: \"434c722b-b620-42a0-972f-a2751b7198a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctltm"
Jul 28 01:15:32.003491 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.002547    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f57dbd44-5277-461d-a38d-e6c394354c50-multus-cni-dir\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:32.004146 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.002716    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/862e4c58-dd64-47c1-8ad3-46d4340d7a83-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:32.004146 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.002768    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/be2963da-12fb-4f56-8602-d54733af25e1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ps5b9\" (UID: \"be2963da-12fb-4f56-8602-d54733af25e1\") " pod="openshift-multus/multus-additional-cni-plugins-ps5b9"
Jul 28 01:15:32.004146 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.002829    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d-kubelet-config\") pod \"global-pull-secret-syncer-xvdx4\" (UID: \"c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d\") " pod="kube-system/global-pull-secret-syncer-xvdx4"
Jul 28 01:15:32.004146 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.002880    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f57dbd44-5277-461d-a38d-e6c394354c50-etc-kubernetes\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:32.004146 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.002919    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/862e4c58-dd64-47c1-8ad3-46d4340d7a83-var-lib-openvswitch\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:32.004146 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.002955    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/862e4c58-dd64-47c1-8ad3-46d4340d7a83-run-openvswitch\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:32.004146 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.003000    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f57dbd44-5277-461d-a38d-e6c394354c50-system-cni-dir\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:32.004146 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.003034    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f57dbd44-5277-461d-a38d-e6c394354c50-cnibin\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:32.004146 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.003069    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f57dbd44-5277-461d-a38d-e6c394354c50-host-run-k8s-cni-cncf-io\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:32.004146 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.003072    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fc097e31-9dd5-41b8-911c-540d29ed52d3-iptables-alerter-script\") pod \"iptables-alerter-x92ts\" (UID: \"fc097e31-9dd5-41b8-911c-540d29ed52d3\") " pod="openshift-network-operator/iptables-alerter-x92ts"
Jul 28 01:15:32.004146 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.003096    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/862e4c58-dd64-47c1-8ad3-46d4340d7a83-host-cni-netd\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:32.004146 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.003129    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a6f3882a-6c12-4669-8e0e-642c8c692d6a-host\") pod \"tuned-crd25\" (UID: \"a6f3882a-6c12-4669-8e0e-642c8c692d6a\") " pod="openshift-cluster-node-tuning-operator/tuned-crd25"
Jul 28 01:15:32.004146 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.003155    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9e6d77bc-6fb4-4f91-bb89-084a03ee29df-host\") pod \"node-ca-8r6nb\" (UID: \"9e6d77bc-6fb4-4f91-bb89-084a03ee29df\") " pod="openshift-image-registry/node-ca-8r6nb"
Jul 28 01:15:32.004146 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.003230    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/434c722b-b620-42a0-972f-a2751b7198a7-socket-dir\") pod \"aws-ebs-csi-driver-node-ctltm\" (UID: \"434c722b-b620-42a0-972f-a2751b7198a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctltm"
Jul 28 01:15:32.004146 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.003428    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be2963da-12fb-4f56-8602-d54733af25e1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ps5b9\" (UID: \"be2963da-12fb-4f56-8602-d54733af25e1\") " pod="openshift-multus/multus-additional-cni-plugins-ps5b9"
Jul 28 01:15:32.004146 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.003522    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f57dbd44-5277-461d-a38d-e6c394354c50-cni-binary-copy\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:32.004146 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.003578    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f57dbd44-5277-461d-a38d-e6c394354c50-host-run-multus-certs\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:32.004146 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.003662    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9e6d77bc-6fb4-4f91-bb89-084a03ee29df-serviceca\") pod \"node-ca-8r6nb\" (UID: \"9e6d77bc-6fb4-4f91-bb89-084a03ee29df\") " pod="openshift-image-registry/node-ca-8r6nb"
Jul 28 01:15:32.005234 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:32.003699    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:15:32.005234 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.003709    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f57dbd44-5277-461d-a38d-e6c394354c50-host-run-netns\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:32.005234 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.003741    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ce4a74c-58bc-476f-ba50-fe5e53e2fc84-tmp-dir\") pod \"node-resolver-grq5v\" (UID: \"4ce4a74c-58bc-476f-ba50-fe5e53e2fc84\") " pod="openshift-dns/node-resolver-grq5v"
Jul 28 01:15:32.005234 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:32.003814    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a43767a-926c-4dfa-8f67-cd932fa744b5-metrics-certs podName:0a43767a-926c-4dfa-8f67-cd932fa744b5 nodeName:}" failed. No retries permitted until 2026-07-28 01:15:32.503786298 +0000 UTC m=+3.007547608 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a43767a-926c-4dfa-8f67-cd932fa744b5-metrics-certs") pod "network-metrics-daemon-d4kjt" (UID: "0a43767a-926c-4dfa-8f67-cd932fa744b5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:15:32.005234 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.003890    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a6f3882a-6c12-4669-8e0e-642c8c692d6a-lib-modules\") pod \"tuned-crd25\" (UID: \"a6f3882a-6c12-4669-8e0e-642c8c692d6a\") " pod="openshift-cluster-node-tuning-operator/tuned-crd25"
Jul 28 01:15:32.005234 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.003942    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f57dbd44-5277-461d-a38d-e6c394354c50-host-var-lib-cni-multus\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:32.005234 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.003965    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/862e4c58-dd64-47c1-8ad3-46d4340d7a83-host-cni-bin\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:32.005234 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.003990    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/862e4c58-dd64-47c1-8ad3-46d4340d7a83-log-socket\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:32.005234 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.004015    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/862e4c58-dd64-47c1-8ad3-46d4340d7a83-systemd-units\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:32.005234 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.004067    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/862e4c58-dd64-47c1-8ad3-46d4340d7a83-etc-openvswitch\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:32.005234 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.004096    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a6f3882a-6c12-4669-8e0e-642c8c692d6a-etc-sysctl-d\") pod \"tuned-crd25\" (UID: \"a6f3882a-6c12-4669-8e0e-642c8c692d6a\") " pod="openshift-cluster-node-tuning-operator/tuned-crd25"
Jul 28 01:15:32.005234 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.004162    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f57dbd44-5277-461d-a38d-e6c394354c50-os-release\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:32.005234 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.004172    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a6f3882a-6c12-4669-8e0e-642c8c692d6a-etc-sysctl-conf\") pod \"tuned-crd25\" (UID: \"a6f3882a-6c12-4669-8e0e-642c8c692d6a\") " pod="openshift-cluster-node-tuning-operator/tuned-crd25"
Jul 28 01:15:32.005234 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.004203    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f57dbd44-5277-461d-a38d-e6c394354c50-host-var-lib-cni-bin\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:32.005234 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.004443    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f57dbd44-5277-461d-a38d-e6c394354c50-host-var-lib-kubelet\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:32.005234 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.004511    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be2963da-12fb-4f56-8602-d54733af25e1-cni-binary-copy\") pod \"multus-additional-cni-plugins-ps5b9\" (UID: \"be2963da-12fb-4f56-8602-d54733af25e1\") " pod="openshift-multus/multus-additional-cni-plugins-ps5b9"
Jul 28 01:15:32.005234 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.004579    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a6f3882a-6c12-4669-8e0e-642c8c692d6a-sys\") pod \"tuned-crd25\" (UID: \"a6f3882a-6c12-4669-8e0e-642c8c692d6a\") " pod="openshift-cluster-node-tuning-operator/tuned-crd25"
Jul 28 01:15:32.005234 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.004625    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f57dbd44-5277-461d-a38d-e6c394354c50-multus-conf-dir\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:32.006136 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.004727    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/862e4c58-dd64-47c1-8ad3-46d4340d7a83-ovnkube-config\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:32.006136 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.004749    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/862e4c58-dd64-47c1-8ad3-46d4340d7a83-ovnkube-script-lib\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:32.006136 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.004734    2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 28 01:15:32.006136 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:32.004826    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 01:15:32.006136 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:32.004882    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d-original-pull-secret podName:c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d nodeName:}" failed. No retries permitted until 2026-07-28 01:15:32.50486635 +0000 UTC m=+3.008627644 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d-original-pull-secret") pod "global-pull-secret-syncer-xvdx4" (UID: "c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d") : object "kube-system"/"original-pull-secret" not registered
Jul 28 01:15:32.006136 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.004991    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a6f3882a-6c12-4669-8e0e-642c8c692d6a-run\") pod \"tuned-crd25\" (UID: \"a6f3882a-6c12-4669-8e0e-642c8c692d6a\") " pod="openshift-cluster-node-tuning-operator/tuned-crd25"
Jul 28 01:15:32.006136 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.005325    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/434c722b-b620-42a0-972f-a2751b7198a7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ctltm\" (UID: \"434c722b-b620-42a0-972f-a2751b7198a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctltm"
Jul 28 01:15:32.006136 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.005400    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/434c722b-b620-42a0-972f-a2751b7198a7-device-dir\") pod \"aws-ebs-csi-driver-node-ctltm\" (UID: \"434c722b-b620-42a0-972f-a2751b7198a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctltm"
Jul 28 01:15:32.006136 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.004753    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be2963da-12fb-4f56-8602-d54733af25e1-system-cni-dir\") pod \"multus-additional-cni-plugins-ps5b9\" (UID: \"be2963da-12fb-4f56-8602-d54733af25e1\") " pod="openshift-multus/multus-additional-cni-plugins-ps5b9"
Jul 28 01:15:32.006136 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.005461    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/be2963da-12fb-4f56-8602-d54733af25e1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ps5b9\" (UID: \"be2963da-12fb-4f56-8602-d54733af25e1\") " pod="openshift-multus/multus-additional-cni-plugins-ps5b9"
Jul 28 01:15:32.006136 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.005471    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/43162e49-7fbb-42a7-9041-00ac2fbcd96d-konnectivity-ca\") pod \"konnectivity-agent-vdcp5\" (UID: \"43162e49-7fbb-42a7-9041-00ac2fbcd96d\") " pod="kube-system/konnectivity-agent-vdcp5"
Jul 28 01:15:32.006136 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.005452    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/862e4c58-dd64-47c1-8ad3-46d4340d7a83-host-slash\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:32.006136 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.005492    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fc097e31-9dd5-41b8-911c-540d29ed52d3-host-slash\") pod \"iptables-alerter-x92ts\" (UID: \"fc097e31-9dd5-41b8-911c-540d29ed52d3\") " pod="openshift-network-operator/iptables-alerter-x92ts"
Jul 28 01:15:32.006136 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.005550    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f57dbd44-5277-461d-a38d-e6c394354c50-multus-socket-dir-parent\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:32.006136 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.005548    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a6f3882a-6c12-4669-8e0e-642c8c692d6a-etc-sysconfig\") pod \"tuned-crd25\" (UID: \"a6f3882a-6c12-4669-8e0e-642c8c692d6a\") " pod="openshift-cluster-node-tuning-operator/tuned-crd25"
Jul 28 01:15:32.006136 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.005603    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a6f3882a-6c12-4669-8e0e-642c8c692d6a-etc-modprobe-d\") pod \"tuned-crd25\" (UID: \"a6f3882a-6c12-4669-8e0e-642c8c692d6a\") " pod="openshift-cluster-node-tuning-operator/tuned-crd25"
Jul 28 01:15:32.006136 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.005605    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/862e4c58-dd64-47c1-8ad3-46d4340d7a83-host-kubelet\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:32.007092 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.005703    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4ce4a74c-58bc-476f-ba50-fe5e53e2fc84-hosts-file\") pod \"node-resolver-grq5v\" (UID: \"4ce4a74c-58bc-476f-ba50-fe5e53e2fc84\") " pod="openshift-dns/node-resolver-grq5v"
Jul 28 01:15:32.007092 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.005758    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a6f3882a-6c12-4669-8e0e-642c8c692d6a-etc-systemd\") pod \"tuned-crd25\" (UID: \"a6f3882a-6c12-4669-8e0e-642c8c692d6a\") " pod="openshift-cluster-node-tuning-operator/tuned-crd25"
Jul 28 01:15:32.007092 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.001914    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/434c722b-b620-42a0-972f-a2751b7198a7-registration-dir\") pod \"aws-ebs-csi-driver-node-ctltm\" (UID: \"434c722b-b620-42a0-972f-a2751b7198a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctltm"
Jul 28 01:15:32.007092 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.005970    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6f3882a-6c12-4669-8e0e-642c8c692d6a-etc-kubernetes\") pod \"tuned-crd25\" (UID: \"a6f3882a-6c12-4669-8e0e-642c8c692d6a\") " pod="openshift-cluster-node-tuning-operator/tuned-crd25"
Jul 28 01:15:32.007092 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.006289    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f57dbd44-5277-461d-a38d-e6c394354c50-multus-daemon-config\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:32.007092 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.006795    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be2963da-12fb-4f56-8602-d54733af25e1-cnibin\") pod \"multus-additional-cni-plugins-ps5b9\" (UID: \"be2963da-12fb-4f56-8602-d54733af25e1\") " pod="openshift-multus/multus-additional-cni-plugins-ps5b9"
Jul 28 01:15:32.007092 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.006897    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f57dbd44-5277-461d-a38d-e6c394354c50-hostroot\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:32.007092 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.006964    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/862e4c58-dd64-47c1-8ad3-46d4340d7a83-node-log\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:32.007092 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.007003    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/862e4c58-dd64-47c1-8ad3-46d4340d7a83-run-ovn\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:32.015033 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.009599    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a6f3882a-6c12-4669-8e0e-642c8c692d6a-etc-tuned\") pod \"tuned-crd25\" (UID: \"a6f3882a-6c12-4669-8e0e-642c8c692d6a\") " pod="openshift-cluster-node-tuning-operator/tuned-crd25"
Jul 28 01:15:32.015033 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.009880    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/862e4c58-dd64-47c1-8ad3-46d4340d7a83-ovn-node-metrics-cert\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:32.015033 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:32.010100    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 01:15:32.015033 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:32.010139    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 01:15:32.015033 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:32.010170    2562 projected.go:196] Error preparing data for projected volume kube-api-access-6g5sm for pod openshift-network-diagnostics/network-check-target-68l4f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:15:32.015033 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:32.010318    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddb225a7-f4d2-4295-8cce-d7d4a3d49955-kube-api-access-6g5sm podName:ddb225a7-f4d2-4295-8cce-d7d4a3d49955 nodeName:}" failed. No retries permitted until 2026-07-28 01:15:32.510288512 +0000 UTC m=+3.014049824 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6g5sm" (UniqueName: "kubernetes.io/projected/ddb225a7-f4d2-4295-8cce-d7d4a3d49955-kube-api-access-6g5sm") pod "network-check-target-68l4f" (UID: "ddb225a7-f4d2-4295-8cce-d7d4a3d49955") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:15:32.015033 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.011509    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/43162e49-7fbb-42a7-9041-00ac2fbcd96d-agent-certs\") pod \"konnectivity-agent-vdcp5\" (UID: \"43162e49-7fbb-42a7-9041-00ac2fbcd96d\") " pod="kube-system/konnectivity-agent-vdcp5"
Jul 28 01:15:32.015033 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.012398    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxv57\" (UniqueName: \"kubernetes.io/projected/fc097e31-9dd5-41b8-911c-540d29ed52d3-kube-api-access-hxv57\") pod \"iptables-alerter-x92ts\" (UID: \"fc097e31-9dd5-41b8-911c-540d29ed52d3\") " pod="openshift-network-operator/iptables-alerter-x92ts"
Jul 28 01:15:32.015033 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.014117    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csrbc\" (UniqueName: \"kubernetes.io/projected/f57dbd44-5277-461d-a38d-e6c394354c50-kube-api-access-csrbc\") pod \"multus-m5thg\" (UID: \"f57dbd44-5277-461d-a38d-e6c394354c50\") " pod="openshift-multus/multus-m5thg"
Jul 28 01:15:32.015033 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.014391    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6f3882a-6c12-4669-8e0e-642c8c692d6a-tmp\") pod \"tuned-crd25\" (UID: \"a6f3882a-6c12-4669-8e0e-642c8c692d6a\") " pod="openshift-cluster-node-tuning-operator/tuned-crd25"
Jul 28 01:15:32.016090 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.015876    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmr6t\" (UniqueName: \"kubernetes.io/projected/4ce4a74c-58bc-476f-ba50-fe5e53e2fc84-kube-api-access-rmr6t\") pod \"node-resolver-grq5v\" (UID: \"4ce4a74c-58bc-476f-ba50-fe5e53e2fc84\") " pod="openshift-dns/node-resolver-grq5v"
Jul 28 01:15:32.016090 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.015908    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrswt\" (UniqueName: \"kubernetes.io/projected/9e6d77bc-6fb4-4f91-bb89-084a03ee29df-kube-api-access-hrswt\") pod \"node-ca-8r6nb\" (UID: \"9e6d77bc-6fb4-4f91-bb89-084a03ee29df\") " pod="openshift-image-registry/node-ca-8r6nb"
Jul 28 01:15:32.016259 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.016167    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-165.ec2.internal" event={"ID":"03bf1d8f9ce5d5c18bbead8a350817c2","Type":"ContainerStarted","Data":"8d6a5b1afe53dbbab5d567617e95e5d518dd557f691d29987ccde776468ab8b7"}
Jul 28 01:15:32.017486 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.016546    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-799mj\" (UniqueName: \"kubernetes.io/projected/0a43767a-926c-4dfa-8f67-cd932fa744b5-kube-api-access-799mj\") pod \"network-metrics-daemon-d4kjt\" (UID: \"0a43767a-926c-4dfa-8f67-cd932fa744b5\") " pod="openshift-multus/network-metrics-daemon-d4kjt"
Jul 28 01:15:32.019252 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.019224    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22d49\" (UniqueName: \"kubernetes.io/projected/862e4c58-dd64-47c1-8ad3-46d4340d7a83-kube-api-access-22d49\") pod \"ovnkube-node-rrlwz\" (UID: \"862e4c58-dd64-47c1-8ad3-46d4340d7a83\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:32.019791 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.019574    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z9c2\" (UniqueName: \"kubernetes.io/projected/be2963da-12fb-4f56-8602-d54733af25e1-kube-api-access-2z9c2\") pod \"multus-additional-cni-plugins-ps5b9\" (UID: \"be2963da-12fb-4f56-8602-d54733af25e1\") " pod="openshift-multus/multus-additional-cni-plugins-ps5b9"
Jul 28 01:15:32.019791 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.019726    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq595\" (UniqueName: \"kubernetes.io/projected/434c722b-b620-42a0-972f-a2751b7198a7-kube-api-access-zq595\") pod \"aws-ebs-csi-driver-node-ctltm\" (UID: \"434c722b-b620-42a0-972f-a2751b7198a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctltm"
Jul 28 01:15:32.020585 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.020499    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal" event={"ID":"517b308401cec4c38c3b264aa00d7836","Type":"ContainerStarted","Data":"b56e60bf8af41f206ffd2fc6299ccb0bddc23a064a25a63c12947d56152726c1"}
Jul 28 01:15:32.020711 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.020592    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45fgh\" (UniqueName: \"kubernetes.io/projected/a6f3882a-6c12-4669-8e0e-642c8c692d6a-kube-api-access-45fgh\") pod \"tuned-crd25\" (UID: \"a6f3882a-6c12-4669-8e0e-642c8c692d6a\") " pod="openshift-cluster-node-tuning-operator/tuned-crd25"
Jul 28 01:15:32.177309 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.177223    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ps5b9"
Jul 28 01:15:32.185678 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.185651    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctltm"
Jul 28 01:15:32.194515 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.194494    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-grq5v"
Jul 28 01:15:32.203204 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.203186    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8r6nb"
Jul 28 01:15:32.212166 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.212146    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:32.221105 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.221087    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vdcp5"
Jul 28 01:15:32.229811 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.229790    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x92ts"
Jul 28 01:15:32.237686 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.237667    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-crd25"
Jul 28 01:15:32.245413 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.245392    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-m5thg"
Jul 28 01:15:32.506704 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.506617    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a43767a-926c-4dfa-8f67-cd932fa744b5-metrics-certs\") pod \"network-metrics-daemon-d4kjt\" (UID: \"0a43767a-926c-4dfa-8f67-cd932fa744b5\") " pod="openshift-multus/network-metrics-daemon-d4kjt"
Jul 28 01:15:32.506704 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.506659    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d-original-pull-secret\") pod \"global-pull-secret-syncer-xvdx4\" (UID: \"c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d\") " pod="kube-system/global-pull-secret-syncer-xvdx4"
Jul 28 01:15:32.506937 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:32.506794    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:15:32.506937 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:32.506861    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a43767a-926c-4dfa-8f67-cd932fa744b5-metrics-certs podName:0a43767a-926c-4dfa-8f67-cd932fa744b5 nodeName:}" failed. No retries permitted until 2026-07-28 01:15:33.506845408 +0000 UTC m=+4.010606703 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a43767a-926c-4dfa-8f67-cd932fa744b5-metrics-certs") pod "network-metrics-daemon-d4kjt" (UID: "0a43767a-926c-4dfa-8f67-cd932fa744b5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:15:32.506937 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:32.506794    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 01:15:32.506937 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:32.506933    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d-original-pull-secret podName:c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d nodeName:}" failed. No retries permitted until 2026-07-28 01:15:33.506920636 +0000 UTC m=+4.010681943 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d-original-pull-secret") pod "global-pull-secret-syncer-xvdx4" (UID: "c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d") : object "kube-system"/"original-pull-secret" not registered
Jul 28 01:15:32.607502 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.607465    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g5sm\" (UniqueName: \"kubernetes.io/projected/ddb225a7-f4d2-4295-8cce-d7d4a3d49955-kube-api-access-6g5sm\") pod \"network-check-target-68l4f\" (UID: \"ddb225a7-f4d2-4295-8cce-d7d4a3d49955\") " pod="openshift-network-diagnostics/network-check-target-68l4f"
Jul 28 01:15:32.607759 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:32.607720    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 01:15:32.607759 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:32.607757    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 01:15:32.608004 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:32.607775    2562 projected.go:196] Error preparing data for projected volume kube-api-access-6g5sm for pod openshift-network-diagnostics/network-check-target-68l4f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:15:32.608004 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:32.607848    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddb225a7-f4d2-4295-8cce-d7d4a3d49955-kube-api-access-6g5sm podName:ddb225a7-f4d2-4295-8cce-d7d4a3d49955 nodeName:}" failed. No retries permitted until 2026-07-28 01:15:33.60783268 +0000 UTC m=+4.111593992 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6g5sm" (UniqueName: "kubernetes.io/projected/ddb225a7-f4d2-4295-8cce-d7d4a3d49955-kube-api-access-6g5sm") pod "network-check-target-68l4f" (UID: "ddb225a7-f4d2-4295-8cce-d7d4a3d49955") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:15:32.927223 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.927128    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 01:10:32 +0000 UTC" deadline="2028-04-11 01:48:09.77172393 +0000 UTC"
Jul 28 01:15:32.927223 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:32.927169    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14952h32m36.844560428s"
Jul 28 01:15:33.007857 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:33.007816    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68l4f"
Jul 28 01:15:33.008038 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:33.007941    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68l4f" podUID="ddb225a7-f4d2-4295-8cce-d7d4a3d49955"
Jul 28 01:15:33.162422 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:33.162395    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc097e31_9dd5_41b8_911c_540d29ed52d3.slice/crio-9a1f20cb023ff8f253f061db1fa91e5f33cb94bb5356eab75a296049cf002fac WatchSource:0}: Error finding container 9a1f20cb023ff8f253f061db1fa91e5f33cb94bb5356eab75a296049cf002fac: Status 404 returned error can't find the container with id 9a1f20cb023ff8f253f061db1fa91e5f33cb94bb5356eab75a296049cf002fac
Jul 28 01:15:33.164123 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:33.164101    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf57dbd44_5277_461d_a38d_e6c394354c50.slice/crio-5505890ffc729ded04783ec69d7f96578a9aba673a533ff31dee2a52757faee7 WatchSource:0}: Error finding container 5505890ffc729ded04783ec69d7f96578a9aba673a533ff31dee2a52757faee7: Status 404 returned error can't find the container with id 5505890ffc729ded04783ec69d7f96578a9aba673a533ff31dee2a52757faee7
Jul 28 01:15:33.166739 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:33.166708    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe2963da_12fb_4f56_8602_d54733af25e1.slice/crio-7ec486fe5130ed52b992bf2e774a9e79bddba61c3b1b3a470c2d879d861deea2 WatchSource:0}: Error finding container 7ec486fe5130ed52b992bf2e774a9e79bddba61c3b1b3a470c2d879d861deea2: Status 404 returned error can't find the container with id 7ec486fe5130ed52b992bf2e774a9e79bddba61c3b1b3a470c2d879d861deea2
Jul 28 01:15:33.169295 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:33.169235    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43162e49_7fbb_42a7_9041_00ac2fbcd96d.slice/crio-a4aa5125404ecbeb8673003ef026136562a4907f890b9cb61abc1cefcd5e47ce WatchSource:0}: Error finding container a4aa5125404ecbeb8673003ef026136562a4907f890b9cb61abc1cefcd5e47ce: Status 404 returned error can't find the container with id a4aa5125404ecbeb8673003ef026136562a4907f890b9cb61abc1cefcd5e47ce
Jul 28 01:15:33.172333 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:33.171962    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6f3882a_6c12_4669_8e0e_642c8c692d6a.slice/crio-a9d4a4cc7e68a8fb0fc0e27efc9eb690723a4cf64f00f1fe0f31d8159d45b9f9 WatchSource:0}: Error finding container a9d4a4cc7e68a8fb0fc0e27efc9eb690723a4cf64f00f1fe0f31d8159d45b9f9: Status 404 returned error can't find the container with id a9d4a4cc7e68a8fb0fc0e27efc9eb690723a4cf64f00f1fe0f31d8159d45b9f9
Jul 28 01:15:33.172784 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:33.172680    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ce4a74c_58bc_476f_ba50_fe5e53e2fc84.slice/crio-5c9b13e0bee10da77b9fdce1b82c5f9c76265e3ea4f6665d110bed14464f915a WatchSource:0}: Error finding container 5c9b13e0bee10da77b9fdce1b82c5f9c76265e3ea4f6665d110bed14464f915a: Status 404 returned error can't find the container with id 5c9b13e0bee10da77b9fdce1b82c5f9c76265e3ea4f6665d110bed14464f915a
Jul 28 01:15:33.174573 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:33.174549    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e6d77bc_6fb4_4f91_bb89_084a03ee29df.slice/crio-b13898c644d790384d724d52be3f0f26e63598b154a7d1cdffcdbddc19e71205 WatchSource:0}: Error finding container b13898c644d790384d724d52be3f0f26e63598b154a7d1cdffcdbddc19e71205: Status 404 returned error can't find the container with id b13898c644d790384d724d52be3f0f26e63598b154a7d1cdffcdbddc19e71205
Jul 28 01:15:33.176059 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:15:33.175780    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod862e4c58_dd64_47c1_8ad3_46d4340d7a83.slice/crio-7ee9d5c85544cff21d77d0b1af39490ef18af2b31dd8ed0a80f9d978ae4f6f60 WatchSource:0}: Error finding container 7ee9d5c85544cff21d77d0b1af39490ef18af2b31dd8ed0a80f9d978ae4f6f60: Status 404 returned error can't find the container with id 7ee9d5c85544cff21d77d0b1af39490ef18af2b31dd8ed0a80f9d978ae4f6f60
Jul 28 01:15:33.515333 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:33.514790    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d-original-pull-secret\") pod \"global-pull-secret-syncer-xvdx4\" (UID: \"c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d\") " pod="kube-system/global-pull-secret-syncer-xvdx4"
Jul 28 01:15:33.515333 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:33.514912    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a43767a-926c-4dfa-8f67-cd932fa744b5-metrics-certs\") pod \"network-metrics-daemon-d4kjt\" (UID: \"0a43767a-926c-4dfa-8f67-cd932fa744b5\") " pod="openshift-multus/network-metrics-daemon-d4kjt"
Jul 28 01:15:33.515333 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:33.515035    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:15:33.515333 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:33.515109    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a43767a-926c-4dfa-8f67-cd932fa744b5-metrics-certs podName:0a43767a-926c-4dfa-8f67-cd932fa744b5 nodeName:}" failed. No retries permitted until 2026-07-28 01:15:35.515084418 +0000 UTC m=+6.018845712 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a43767a-926c-4dfa-8f67-cd932fa744b5-metrics-certs") pod "network-metrics-daemon-d4kjt" (UID: "0a43767a-926c-4dfa-8f67-cd932fa744b5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:15:33.515333 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:33.515125    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 01:15:33.515333 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:33.515170    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d-original-pull-secret podName:c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d nodeName:}" failed. No retries permitted until 2026-07-28 01:15:35.515156059 +0000 UTC m=+6.018917366 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d-original-pull-secret") pod "global-pull-secret-syncer-xvdx4" (UID: "c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d") : object "kube-system"/"original-pull-secret" not registered
Jul 28 01:15:33.616396 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:33.616342    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g5sm\" (UniqueName: \"kubernetes.io/projected/ddb225a7-f4d2-4295-8cce-d7d4a3d49955-kube-api-access-6g5sm\") pod \"network-check-target-68l4f\" (UID: \"ddb225a7-f4d2-4295-8cce-d7d4a3d49955\") " pod="openshift-network-diagnostics/network-check-target-68l4f"
Jul 28 01:15:33.616582 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:33.616525    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 01:15:33.616582 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:33.616547    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 01:15:33.616582 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:33.616559    2562 projected.go:196] Error preparing data for projected volume kube-api-access-6g5sm for pod openshift-network-diagnostics/network-check-target-68l4f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:15:33.616755 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:33.616640    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddb225a7-f4d2-4295-8cce-d7d4a3d49955-kube-api-access-6g5sm podName:ddb225a7-f4d2-4295-8cce-d7d4a3d49955 nodeName:}" failed. No retries permitted until 2026-07-28 01:15:35.616618192 +0000 UTC m=+6.120379505 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6g5sm" (UniqueName: "kubernetes.io/projected/ddb225a7-f4d2-4295-8cce-d7d4a3d49955-kube-api-access-6g5sm") pod "network-check-target-68l4f" (UID: "ddb225a7-f4d2-4295-8cce-d7d4a3d49955") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:15:33.928110 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:33.928014    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 01:10:32 +0000 UTC" deadline="2028-02-14 13:41:08.224660829 +0000 UTC"
Jul 28 01:15:33.928110 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:33.928060    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13596h25m34.296605556s"
Jul 28 01:15:34.009952 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:34.009002    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvdx4"
Jul 28 01:15:34.009952 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:34.009156    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvdx4" podUID="c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d"
Jul 28 01:15:34.009952 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:34.009767    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4kjt"
Jul 28 01:15:34.009952 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:34.009905    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4kjt" podUID="0a43767a-926c-4dfa-8f67-cd932fa744b5"
Jul 28 01:15:34.035398 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:34.035360    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ps5b9" event={"ID":"be2963da-12fb-4f56-8602-d54733af25e1","Type":"ContainerStarted","Data":"7ec486fe5130ed52b992bf2e774a9e79bddba61c3b1b3a470c2d879d861deea2"}
Jul 28 01:15:34.046508 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:34.046377    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x92ts" event={"ID":"fc097e31-9dd5-41b8-911c-540d29ed52d3","Type":"ContainerStarted","Data":"9a1f20cb023ff8f253f061db1fa91e5f33cb94bb5356eab75a296049cf002fac"}
Jul 28 01:15:34.056866 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:34.056831    2562 generic.go:356] "Generic (PLEG): container finished" podID="517b308401cec4c38c3b264aa00d7836" containerID="7de5590152e21d01a28c95f78d3a078f1fa261ee8b230779d3df9102ccf67c33" exitCode=0
Jul 28 01:15:34.057030 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:34.056944    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal" event={"ID":"517b308401cec4c38c3b264aa00d7836","Type":"ContainerDied","Data":"7de5590152e21d01a28c95f78d3a078f1fa261ee8b230779d3df9102ccf67c33"}
Jul 28 01:15:34.089653 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:34.085168    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctltm" event={"ID":"434c722b-b620-42a0-972f-a2751b7198a7","Type":"ContainerStarted","Data":"3cd82b1cd5a74f745ccc2cb028c3225634aa74fd82fd1f82e7a13df0d03e0d1c"}
Jul 28 01:15:34.096482 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:34.096445    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz" event={"ID":"862e4c58-dd64-47c1-8ad3-46d4340d7a83","Type":"ContainerStarted","Data":"7ee9d5c85544cff21d77d0b1af39490ef18af2b31dd8ed0a80f9d978ae4f6f60"}
Jul 28 01:15:34.112920 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:34.112845    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-crd25" event={"ID":"a6f3882a-6c12-4669-8e0e-642c8c692d6a","Type":"ContainerStarted","Data":"a9d4a4cc7e68a8fb0fc0e27efc9eb690723a4cf64f00f1fe0f31d8159d45b9f9"}
Jul 28 01:15:34.124673 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:34.124613    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vdcp5" event={"ID":"43162e49-7fbb-42a7-9041-00ac2fbcd96d","Type":"ContainerStarted","Data":"a4aa5125404ecbeb8673003ef026136562a4907f890b9cb61abc1cefcd5e47ce"}
Jul 28 01:15:34.130243 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:34.130209    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-m5thg" event={"ID":"f57dbd44-5277-461d-a38d-e6c394354c50","Type":"ContainerStarted","Data":"5505890ffc729ded04783ec69d7f96578a9aba673a533ff31dee2a52757faee7"}
Jul 28 01:15:34.137265 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:34.136557    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-165.ec2.internal" event={"ID":"03bf1d8f9ce5d5c18bbead8a350817c2","Type":"ContainerStarted","Data":"3a9825034f2e93bad8747c61a2504bf90eeb7e777f537bfd91e7b73631622e01"}
Jul 28 01:15:34.153023 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:34.152942    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8r6nb" event={"ID":"9e6d77bc-6fb4-4f91-bb89-084a03ee29df","Type":"ContainerStarted","Data":"b13898c644d790384d724d52be3f0f26e63598b154a7d1cdffcdbddc19e71205"}
Jul 28 01:15:34.171630 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:34.171568    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-grq5v" event={"ID":"4ce4a74c-58bc-476f-ba50-fe5e53e2fc84","Type":"ContainerStarted","Data":"5c9b13e0bee10da77b9fdce1b82c5f9c76265e3ea4f6665d110bed14464f915a"}
Jul 28 01:15:35.007682 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:35.007642    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68l4f"
Jul 28 01:15:35.008158 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:35.007786    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68l4f" podUID="ddb225a7-f4d2-4295-8cce-d7d4a3d49955"
Jul 28 01:15:35.217385 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:35.217257    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal" event={"ID":"517b308401cec4c38c3b264aa00d7836","Type":"ContainerStarted","Data":"634b72fe63074a75139246bd090845e0c84e2b2fee6f6f3635b0715433fc9616"}
Jul 28 01:15:35.232945 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:35.231674    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal" podStartSLOduration=3.231649524 podStartE2EDuration="3.231649524s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:15:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:15:35.231512107 +0000 UTC m=+5.735273423" watchObservedRunningTime="2026-07-28 01:15:35.231649524 +0000 UTC m=+5.735410859"
Jul 28 01:15:35.232945 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:35.232594    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-165.ec2.internal" podStartSLOduration=3.232582326 podStartE2EDuration="3.232582326s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:15:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:15:34.151806226 +0000 UTC m=+4.655567542" watchObservedRunningTime="2026-07-28 01:15:35.232582326 +0000 UTC m=+5.736343642"
Jul 28 01:15:35.531353 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:35.530558    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a43767a-926c-4dfa-8f67-cd932fa744b5-metrics-certs\") pod \"network-metrics-daemon-d4kjt\" (UID: \"0a43767a-926c-4dfa-8f67-cd932fa744b5\") " pod="openshift-multus/network-metrics-daemon-d4kjt"
Jul 28 01:15:35.531353 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:35.530623    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d-original-pull-secret\") pod \"global-pull-secret-syncer-xvdx4\" (UID: \"c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d\") " pod="kube-system/global-pull-secret-syncer-xvdx4"
Jul 28 01:15:35.531353 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:35.530760    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 01:15:35.531353 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:35.530831    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d-original-pull-secret podName:c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d nodeName:}" failed. No retries permitted until 2026-07-28 01:15:39.530810722 +0000 UTC m=+10.034572029 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d-original-pull-secret") pod "global-pull-secret-syncer-xvdx4" (UID: "c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d") : object "kube-system"/"original-pull-secret" not registered
Jul 28 01:15:35.531353 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:35.530900    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:15:35.531353 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:35.530936    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a43767a-926c-4dfa-8f67-cd932fa744b5-metrics-certs podName:0a43767a-926c-4dfa-8f67-cd932fa744b5 nodeName:}" failed. No retries permitted until 2026-07-28 01:15:39.530923385 +0000 UTC m=+10.034684692 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a43767a-926c-4dfa-8f67-cd932fa744b5-metrics-certs") pod "network-metrics-daemon-d4kjt" (UID: "0a43767a-926c-4dfa-8f67-cd932fa744b5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:15:35.631944 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:35.631247    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g5sm\" (UniqueName: \"kubernetes.io/projected/ddb225a7-f4d2-4295-8cce-d7d4a3d49955-kube-api-access-6g5sm\") pod \"network-check-target-68l4f\" (UID: \"ddb225a7-f4d2-4295-8cce-d7d4a3d49955\") " pod="openshift-network-diagnostics/network-check-target-68l4f"
Jul 28 01:15:35.631944 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:35.631442    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 01:15:35.631944 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:35.631470    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 01:15:35.631944 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:35.631484    2562 projected.go:196] Error preparing data for projected volume kube-api-access-6g5sm for pod openshift-network-diagnostics/network-check-target-68l4f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:15:35.631944 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:35.631545    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddb225a7-f4d2-4295-8cce-d7d4a3d49955-kube-api-access-6g5sm podName:ddb225a7-f4d2-4295-8cce-d7d4a3d49955 nodeName:}" failed. No retries permitted until 2026-07-28 01:15:39.631527064 +0000 UTC m=+10.135288372 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6g5sm" (UniqueName: "kubernetes.io/projected/ddb225a7-f4d2-4295-8cce-d7d4a3d49955-kube-api-access-6g5sm") pod "network-check-target-68l4f" (UID: "ddb225a7-f4d2-4295-8cce-d7d4a3d49955") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:15:36.007459 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:36.007377    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvdx4"
Jul 28 01:15:36.008865 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:36.007538    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvdx4" podUID="c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d"
Jul 28 01:15:36.008865 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:36.007981    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4kjt"
Jul 28 01:15:36.008865 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:36.008096    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4kjt" podUID="0a43767a-926c-4dfa-8f67-cd932fa744b5"
Jul 28 01:15:37.008187 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:37.007664    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68l4f"
Jul 28 01:15:37.008187 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:37.007802    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68l4f" podUID="ddb225a7-f4d2-4295-8cce-d7d4a3d49955"
Jul 28 01:15:38.007981 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:38.007936    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvdx4"
Jul 28 01:15:38.008476 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:38.007940    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4kjt"
Jul 28 01:15:38.008476 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:38.008073    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvdx4" podUID="c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d"
Jul 28 01:15:38.008476 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:38.008188    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4kjt" podUID="0a43767a-926c-4dfa-8f67-cd932fa744b5"
Jul 28 01:15:39.007775 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:39.007727    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68l4f"
Jul 28 01:15:39.007960 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:39.007869    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68l4f" podUID="ddb225a7-f4d2-4295-8cce-d7d4a3d49955"
Jul 28 01:15:39.564010 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:39.563965    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a43767a-926c-4dfa-8f67-cd932fa744b5-metrics-certs\") pod \"network-metrics-daemon-d4kjt\" (UID: \"0a43767a-926c-4dfa-8f67-cd932fa744b5\") " pod="openshift-multus/network-metrics-daemon-d4kjt"
Jul 28 01:15:39.564427 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:39.564023    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d-original-pull-secret\") pod \"global-pull-secret-syncer-xvdx4\" (UID: \"c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d\") " pod="kube-system/global-pull-secret-syncer-xvdx4"
Jul 28 01:15:39.564427 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:39.564137    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:15:39.564427 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:39.564164    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 01:15:39.564427 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:39.564223    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a43767a-926c-4dfa-8f67-cd932fa744b5-metrics-certs podName:0a43767a-926c-4dfa-8f67-cd932fa744b5 nodeName:}" failed. No retries permitted until 2026-07-28 01:15:47.564206353 +0000 UTC m=+18.067967668 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a43767a-926c-4dfa-8f67-cd932fa744b5-metrics-certs") pod "network-metrics-daemon-d4kjt" (UID: "0a43767a-926c-4dfa-8f67-cd932fa744b5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:15:39.564427 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:39.564240    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d-original-pull-secret podName:c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d nodeName:}" failed. No retries permitted until 2026-07-28 01:15:47.56423363 +0000 UTC m=+18.067994923 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d-original-pull-secret") pod "global-pull-secret-syncer-xvdx4" (UID: "c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d") : object "kube-system"/"original-pull-secret" not registered
Jul 28 01:15:39.665989 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:39.665102    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g5sm\" (UniqueName: \"kubernetes.io/projected/ddb225a7-f4d2-4295-8cce-d7d4a3d49955-kube-api-access-6g5sm\") pod \"network-check-target-68l4f\" (UID: \"ddb225a7-f4d2-4295-8cce-d7d4a3d49955\") " pod="openshift-network-diagnostics/network-check-target-68l4f"
Jul 28 01:15:39.665989 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:39.665344    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 01:15:39.665989 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:39.665365    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 01:15:39.665989 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:39.665378    2562 projected.go:196] Error preparing data for projected volume kube-api-access-6g5sm for pod openshift-network-diagnostics/network-check-target-68l4f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:15:39.665989 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:39.665438    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddb225a7-f4d2-4295-8cce-d7d4a3d49955-kube-api-access-6g5sm podName:ddb225a7-f4d2-4295-8cce-d7d4a3d49955 nodeName:}" failed. No retries permitted until 2026-07-28 01:15:47.665419442 +0000 UTC m=+18.169180751 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6g5sm" (UniqueName: "kubernetes.io/projected/ddb225a7-f4d2-4295-8cce-d7d4a3d49955-kube-api-access-6g5sm") pod "network-check-target-68l4f" (UID: "ddb225a7-f4d2-4295-8cce-d7d4a3d49955") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:15:40.008825 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:40.008178    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvdx4"
Jul 28 01:15:40.008825 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:40.008304    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvdx4" podUID="c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d"
Jul 28 01:15:40.008825 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:40.008701    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4kjt"
Jul 28 01:15:40.009142 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:40.008834    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4kjt" podUID="0a43767a-926c-4dfa-8f67-cd932fa744b5"
Jul 28 01:15:41.007805 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:41.007218    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68l4f"
Jul 28 01:15:41.007805 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:41.007340    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68l4f" podUID="ddb225a7-f4d2-4295-8cce-d7d4a3d49955"
Jul 28 01:15:42.007692 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:42.007654    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4kjt"
Jul 28 01:15:42.007889 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:42.007808    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4kjt" podUID="0a43767a-926c-4dfa-8f67-cd932fa744b5"
Jul 28 01:15:42.008292 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:42.007669    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvdx4"
Jul 28 01:15:42.008292 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:42.008047    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvdx4" podUID="c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d"
Jul 28 01:15:43.007340 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:43.007303    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68l4f"
Jul 28 01:15:43.007535 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:43.007441    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68l4f" podUID="ddb225a7-f4d2-4295-8cce-d7d4a3d49955"
Jul 28 01:15:44.007276 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:44.007237    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvdx4"
Jul 28 01:15:44.007781 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:44.007241    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4kjt"
Jul 28 01:15:44.007781 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:44.007403    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvdx4" podUID="c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d"
Jul 28 01:15:44.007781 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:44.007455    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4kjt" podUID="0a43767a-926c-4dfa-8f67-cd932fa744b5"
Jul 28 01:15:45.007330 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:45.007299    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68l4f"
Jul 28 01:15:45.007716 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:45.007422    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68l4f" podUID="ddb225a7-f4d2-4295-8cce-d7d4a3d49955"
Jul 28 01:15:46.007701 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:46.007666    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvdx4"
Jul 28 01:15:46.007701 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:46.007683    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4kjt"
Jul 28 01:15:46.008213 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:46.007788    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvdx4" podUID="c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d"
Jul 28 01:15:46.008213 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:46.007916    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4kjt" podUID="0a43767a-926c-4dfa-8f67-cd932fa744b5"
Jul 28 01:15:47.007600 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:47.007550    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68l4f"
Jul 28 01:15:47.007791 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:47.007695    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68l4f" podUID="ddb225a7-f4d2-4295-8cce-d7d4a3d49955"
Jul 28 01:15:47.631291 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:47.631250    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a43767a-926c-4dfa-8f67-cd932fa744b5-metrics-certs\") pod \"network-metrics-daemon-d4kjt\" (UID: \"0a43767a-926c-4dfa-8f67-cd932fa744b5\") " pod="openshift-multus/network-metrics-daemon-d4kjt"
Jul 28 01:15:47.631532 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:47.631299    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d-original-pull-secret\") pod \"global-pull-secret-syncer-xvdx4\" (UID: \"c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d\") " pod="kube-system/global-pull-secret-syncer-xvdx4"
Jul 28 01:15:47.631532 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:47.631407    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 01:15:47.631532 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:47.631470    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d-original-pull-secret podName:c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d nodeName:}" failed. No retries permitted until 2026-07-28 01:16:03.631451414 +0000 UTC m=+34.135212704 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d-original-pull-secret") pod "global-pull-secret-syncer-xvdx4" (UID: "c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d") : object "kube-system"/"original-pull-secret" not registered
Jul 28 01:15:47.631532 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:47.631407    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:15:47.631768 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:47.631577    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a43767a-926c-4dfa-8f67-cd932fa744b5-metrics-certs podName:0a43767a-926c-4dfa-8f67-cd932fa744b5 nodeName:}" failed. No retries permitted until 2026-07-28 01:16:03.631545748 +0000 UTC m=+34.135307041 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a43767a-926c-4dfa-8f67-cd932fa744b5-metrics-certs") pod "network-metrics-daemon-d4kjt" (UID: "0a43767a-926c-4dfa-8f67-cd932fa744b5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:15:47.731927 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:47.731884    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g5sm\" (UniqueName: \"kubernetes.io/projected/ddb225a7-f4d2-4295-8cce-d7d4a3d49955-kube-api-access-6g5sm\") pod \"network-check-target-68l4f\" (UID: \"ddb225a7-f4d2-4295-8cce-d7d4a3d49955\") " pod="openshift-network-diagnostics/network-check-target-68l4f"
Jul 28 01:15:47.732095 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:47.732053    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 01:15:47.732095 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:47.732078    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 01:15:47.732095 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:47.732092    2562 projected.go:196] Error preparing data for projected volume kube-api-access-6g5sm for pod openshift-network-diagnostics/network-check-target-68l4f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:15:47.732216 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:47.732149    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddb225a7-f4d2-4295-8cce-d7d4a3d49955-kube-api-access-6g5sm podName:ddb225a7-f4d2-4295-8cce-d7d4a3d49955 nodeName:}" failed. No retries permitted until 2026-07-28 01:16:03.732135789 +0000 UTC m=+34.235897079 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6g5sm" (UniqueName: "kubernetes.io/projected/ddb225a7-f4d2-4295-8cce-d7d4a3d49955-kube-api-access-6g5sm") pod "network-check-target-68l4f" (UID: "ddb225a7-f4d2-4295-8cce-d7d4a3d49955") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:15:48.007090 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:48.007010    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4kjt"
Jul 28 01:15:48.007238 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:48.007020    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvdx4"
Jul 28 01:15:48.007238 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:48.007167    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4kjt" podUID="0a43767a-926c-4dfa-8f67-cd932fa744b5"
Jul 28 01:15:48.007339 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:48.007249    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvdx4" podUID="c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d"
Jul 28 01:15:49.007573 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:49.007528    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68l4f"
Jul 28 01:15:49.008020 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:49.007665    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68l4f" podUID="ddb225a7-f4d2-4295-8cce-d7d4a3d49955"
Jul 28 01:15:50.008147 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:50.008116    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvdx4"
Jul 28 01:15:50.008513 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:50.008223    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvdx4" podUID="c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d"
Jul 28 01:15:50.008513 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:50.008281    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4kjt"
Jul 28 01:15:50.008513 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:50.008394    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4kjt" podUID="0a43767a-926c-4dfa-8f67-cd932fa744b5"
Jul 28 01:15:51.007649 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:51.007616    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68l4f"
Jul 28 01:15:51.007817 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:51.007725    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68l4f" podUID="ddb225a7-f4d2-4295-8cce-d7d4a3d49955"
Jul 28 01:15:52.007270 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:52.007238    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvdx4"
Jul 28 01:15:52.007843 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:52.007238    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4kjt"
Jul 28 01:15:52.007843 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:52.007369    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvdx4" podUID="c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d"
Jul 28 01:15:52.007843 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:52.007460    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4kjt" podUID="0a43767a-926c-4dfa-8f67-cd932fa744b5"
Jul 28 01:15:53.007530 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:53.007191    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68l4f"
Jul 28 01:15:53.008350 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:53.007649    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68l4f" podUID="ddb225a7-f4d2-4295-8cce-d7d4a3d49955"
Jul 28 01:15:53.265988 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:53.265956    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8r6nb" event={"ID":"9e6d77bc-6fb4-4f91-bb89-084a03ee29df","Type":"ContainerStarted","Data":"cc5439704d26df75a0ade5d5294478e539f08583671b2697eead8c6a24f8ecee"}
Jul 28 01:15:53.267252 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:53.267218    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-grq5v" event={"ID":"4ce4a74c-58bc-476f-ba50-fe5e53e2fc84","Type":"ContainerStarted","Data":"b481913aaa4b7f26ee81f4fb6d94e0f045050f1556e6df4c02165a5342ee7770"}
Jul 28 01:15:53.268608 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:53.268582    2562 generic.go:356] "Generic (PLEG): container finished" podID="be2963da-12fb-4f56-8602-d54733af25e1" containerID="987d1bf60b273970226388186075edae5e74b62b2d2d73b1df77041735633d3e" exitCode=0
Jul 28 01:15:53.268696 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:53.268661    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ps5b9" event={"ID":"be2963da-12fb-4f56-8602-d54733af25e1","Type":"ContainerDied","Data":"987d1bf60b273970226388186075edae5e74b62b2d2d73b1df77041735633d3e"}
Jul 28 01:15:53.270088 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:53.270067    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctltm" event={"ID":"434c722b-b620-42a0-972f-a2751b7198a7","Type":"ContainerStarted","Data":"9f5c8dfd8119ebee9863fe728105082acd0c9e3814fd5c65304d0c1df5ac0e78"}
Jul 28 01:15:53.272679 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:53.272660    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz" event={"ID":"862e4c58-dd64-47c1-8ad3-46d4340d7a83","Type":"ContainerStarted","Data":"dbe95324fa504f2471ddae61ef851175cbd3ee5b6d421c5d3c019f6bc1a3786c"}
Jul 28 01:15:53.272778 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:53.272718    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz" event={"ID":"862e4c58-dd64-47c1-8ad3-46d4340d7a83","Type":"ContainerStarted","Data":"300dd0ca2a886cec3d38597eef6d675b7e7e40b43982d7062061eb2cf02355b9"}
Jul 28 01:15:53.272778 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:53.272756    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz" event={"ID":"862e4c58-dd64-47c1-8ad3-46d4340d7a83","Type":"ContainerStarted","Data":"f38345d20c063f6ce84d3b491ed49b86d11cdbddbf65205187aa4035f945f63c"}
Jul 28 01:15:53.272863 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:53.272791    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz" event={"ID":"862e4c58-dd64-47c1-8ad3-46d4340d7a83","Type":"ContainerStarted","Data":"a97335ff0e813964b83d3aba1740901ab1d26f6f2eb0355b5461b92241493f27"}
Jul 28 01:15:53.272863 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:53.272825    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz" event={"ID":"862e4c58-dd64-47c1-8ad3-46d4340d7a83","Type":"ContainerStarted","Data":"a834f39d2d289fdba42071d122e1e43309c9381ac78bf1e27866379418852cb7"}
Jul 28 01:15:53.272863 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:53.272853    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz" event={"ID":"862e4c58-dd64-47c1-8ad3-46d4340d7a83","Type":"ContainerStarted","Data":"e3e74d9264e61ce78cd1c4971c49235adc629e33cd494ed7e7346a5ef1a74660"}
Jul 28 01:15:53.273846 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:53.273830    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-crd25" event={"ID":"a6f3882a-6c12-4669-8e0e-642c8c692d6a","Type":"ContainerStarted","Data":"26871d2975c7d1184ad1af0499f3126bdcdc524b987e5257e4f69cff05fb4989"}
Jul 28 01:15:53.275053 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:53.275035    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vdcp5" event={"ID":"43162e49-7fbb-42a7-9041-00ac2fbcd96d","Type":"ContainerStarted","Data":"9ec2dcb030f4220c996d7ff59946779dee2d2b2902993d3fbe693788149fb50b"}
Jul 28 01:15:53.276228 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:53.276209    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-m5thg" event={"ID":"f57dbd44-5277-461d-a38d-e6c394354c50","Type":"ContainerStarted","Data":"b94e6c272575e708ea440688a1563111a967ec379c67e55bad0982a009df4706"}
Jul 28 01:15:53.280360 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:53.280326    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8r6nb" podStartSLOduration=3.334277395 podStartE2EDuration="22.280315737s" totalImagesPullingTime="18.946038342s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:15:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:15:53.280067796 +0000 UTC m=+23.783829107" watchObservedRunningTime="2026-07-28 01:15:53.280315737 +0000 UTC m=+23.784077049"
Jul 28 01:15:53.312723 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:53.312675    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-grq5v" podStartSLOduration=3.332889571 podStartE2EDuration="22.312662256s" totalImagesPullingTime="18.979772685s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:15:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:15:53.312263645 +0000 UTC m=+23.816024957" watchObservedRunningTime="2026-07-28 01:15:53.312662256 +0000 UTC m=+23.816423567"
Jul 28 01:15:53.341455 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:53.341411    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-crd25" podStartSLOduration=3.353539089 podStartE2EDuration="22.341398289s" totalImagesPullingTime="18.9878592s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:15:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:15:53.329434501 +0000 UTC m=+23.833195812" watchObservedRunningTime="2026-07-28 01:15:53.341398289 +0000 UTC m=+23.845159601"
Jul 28 01:15:53.358852 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:53.358809    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-m5thg" podStartSLOduration=3.311418971 podStartE2EDuration="22.358798138s" totalImagesPullingTime="19.047379167s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:15:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:15:53.358585147 +0000 UTC m=+23.862346453" watchObservedRunningTime="2026-07-28 01:15:53.358798138 +0000 UTC m=+23.862559450"
Jul 28 01:15:53.359287 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:53.359267    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vdcp5" podStartSLOduration=3.38220096 podStartE2EDuration="22.35926135s" totalImagesPullingTime="18.97706039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:15:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:15:53.341520565 +0000 UTC m=+23.845281859" watchObservedRunningTime="2026-07-28 01:15:53.35926135 +0000 UTC m=+23.863022661"
Jul 28 01:15:53.558477 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:53.558436    2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 28 01:15:53.956847 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:53.956691    2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T01:15:53.558453404Z","UUID":"fb69080c-8334-4f3d-8b8e-0a15bc306da9","Handler":null,"Name":"","Endpoint":""}
Jul 28 01:15:53.958259 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:53.958236    2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 28 01:15:53.958398 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:53.958280    2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 28 01:15:54.007345 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:54.007311    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvdx4"
Jul 28 01:15:54.007507 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:54.007434    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvdx4" podUID="c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d"
Jul 28 01:15:54.007507 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:54.007493    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4kjt"
Jul 28 01:15:54.007994 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:54.007628    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4kjt" podUID="0a43767a-926c-4dfa-8f67-cd932fa744b5"
Jul 28 01:15:54.280338 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:54.280253    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x92ts" event={"ID":"fc097e31-9dd5-41b8-911c-540d29ed52d3","Type":"ContainerStarted","Data":"dbee409ba63dfc149b26af05cbb8c3b82a77377a85c283cc64351eea246d4b11"}
Jul 28 01:15:54.283640 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:54.283262    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctltm" event={"ID":"434c722b-b620-42a0-972f-a2751b7198a7","Type":"ContainerStarted","Data":"5ac6ff6a5ec6dc53f19a29ed8555b792f293b1731e4523dab2629d789f4dcdf2"}
Jul 28 01:15:54.292707 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:54.292668    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-x92ts" podStartSLOduration=4.301331137 podStartE2EDuration="23.292654053s" totalImagesPullingTime="18.991322916s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:15:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:15:54.292643561 +0000 UTC m=+24.796404873" watchObservedRunningTime="2026-07-28 01:15:54.292654053 +0000 UTC m=+24.796415368"
Jul 28 01:15:55.007953 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:55.007736    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68l4f"
Jul 28 01:15:55.008390 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:55.008007    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68l4f" podUID="ddb225a7-f4d2-4295-8cce-d7d4a3d49955"
Jul 28 01:15:55.288266 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:55.288173    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctltm" event={"ID":"434c722b-b620-42a0-972f-a2751b7198a7","Type":"ContainerStarted","Data":"c9c3716a872ab5da0902a2e6cada268a487f4fdaf0e85316a6449253f3fb425c"}
Jul 28 01:15:55.292251 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:55.292226    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz" event={"ID":"862e4c58-dd64-47c1-8ad3-46d4340d7a83","Type":"ContainerStarted","Data":"ef907fbb98141067f77086e1a3c8ffa9def0655619b5a28764509b5883a8f993"}
Jul 28 01:15:55.303352 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:55.303298    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctltm" podStartSLOduration=3.147984103 podStartE2EDuration="24.303279423s" totalImagesPullingTime="21.15529532s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:15:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:15:55.302722976 +0000 UTC m=+25.806484288" watchObservedRunningTime="2026-07-28 01:15:55.303279423 +0000 UTC m=+25.807040735"
Jul 28 01:15:56.007692 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:56.007657    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvdx4"
Jul 28 01:15:56.007917 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:56.007795    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvdx4" podUID="c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d"
Jul 28 01:15:56.007917 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:56.007842    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4kjt"
Jul 28 01:15:56.008317 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:56.007964    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4kjt" podUID="0a43767a-926c-4dfa-8f67-cd932fa744b5"
Jul 28 01:15:57.006848 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:57.006817    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68l4f"
Jul 28 01:15:57.007000 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:57.006947    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68l4f" podUID="ddb225a7-f4d2-4295-8cce-d7d4a3d49955"
Jul 28 01:15:57.725565 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:57.725351    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vdcp5"
Jul 28 01:15:57.726275 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:57.726244    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vdcp5"
Jul 28 01:15:58.006845 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:58.006824    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvdx4"
Jul 28 01:15:58.006974 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:58.006916    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvdx4" podUID="c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d"
Jul 28 01:15:58.007051 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:58.007001    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4kjt"
Jul 28 01:15:58.007112 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:58.007094    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4kjt" podUID="0a43767a-926c-4dfa-8f67-cd932fa744b5"
Jul 28 01:15:58.302011 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:58.301981    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz" event={"ID":"862e4c58-dd64-47c1-8ad3-46d4340d7a83","Type":"ContainerStarted","Data":"f1e1eb184d78f181b162e7bce098d7b53c8a84f8747d1edb560af0a05b26ef94"}
Jul 28 01:15:58.302298 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:58.302273    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:58.302437 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:58.302334    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:58.303863 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:58.303843    2562 generic.go:356] "Generic (PLEG): container finished" podID="be2963da-12fb-4f56-8602-d54733af25e1" containerID="400d959c6f29bf1c74dd9dbfe73c88d33cd053ea706e6708e22fc80d1ea328e4" exitCode=0
Jul 28 01:15:58.303985 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:58.303945    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ps5b9" event={"ID":"be2963da-12fb-4f56-8602-d54733af25e1","Type":"ContainerDied","Data":"400d959c6f29bf1c74dd9dbfe73c88d33cd053ea706e6708e22fc80d1ea328e4"}
Jul 28 01:15:58.304144 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:58.304125    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vdcp5"
Jul 28 01:15:58.305063 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:58.304549    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vdcp5"
Jul 28 01:15:58.318117 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:58.318097    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:58.324307 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:58.324272    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz" podStartSLOduration=8.28658824 podStartE2EDuration="27.324259281s" totalImagesPullingTime="19.037671041s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:15:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:15:58.32348368 +0000 UTC m=+28.827244992" watchObservedRunningTime="2026-07-28 01:15:58.324259281 +0000 UTC m=+28.828020593"
Jul 28 01:15:59.007138 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:59.007104    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68l4f"
Jul 28 01:15:59.007698 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:59.007213    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68l4f" podUID="ddb225a7-f4d2-4295-8cce-d7d4a3d49955"
Jul 28 01:15:59.307642 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:59.307471    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:59.326465 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:59.326435    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:15:59.599313 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:59.599236    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xvdx4"]
Jul 28 01:15:59.599444 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:59.599374    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvdx4"
Jul 28 01:15:59.599512 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:59.599487    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvdx4" podUID="c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d"
Jul 28 01:15:59.602265 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:59.602235    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-68l4f"]
Jul 28 01:15:59.602395 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:59.602313    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68l4f"
Jul 28 01:15:59.602547 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:59.602519    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68l4f" podUID="ddb225a7-f4d2-4295-8cce-d7d4a3d49955"
Jul 28 01:15:59.602939 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:59.602916    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d4kjt"]
Jul 28 01:15:59.603045 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:15:59.603016    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4kjt"
Jul 28 01:15:59.603151 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:15:59.603124    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4kjt" podUID="0a43767a-926c-4dfa-8f67-cd932fa744b5"
Jul 28 01:16:00.311012 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:00.310978    2562 generic.go:356] "Generic (PLEG): container finished" podID="be2963da-12fb-4f56-8602-d54733af25e1" containerID="675f520f72131295e304ae70eb8653e7ba8d093c3f3621a78cefd424cf9da03a" exitCode=0
Jul 28 01:16:00.311401 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:00.311063    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ps5b9" event={"ID":"be2963da-12fb-4f56-8602-d54733af25e1","Type":"ContainerDied","Data":"675f520f72131295e304ae70eb8653e7ba8d093c3f3621a78cefd424cf9da03a"}
Jul 28 01:16:01.007793 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:01.007570    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvdx4"
Jul 28 01:16:01.007975 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:01.007554    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68l4f"
Jul 28 01:16:01.007975 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:01.007890    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvdx4" podUID="c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d"
Jul 28 01:16:01.007975 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:01.007646    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4kjt"
Jul 28 01:16:01.008144 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:01.008005    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68l4f" podUID="ddb225a7-f4d2-4295-8cce-d7d4a3d49955"
Jul 28 01:16:01.008144 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:01.008036    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4kjt" podUID="0a43767a-926c-4dfa-8f67-cd932fa744b5"
Jul 28 01:16:02.317224 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:02.317192    2562 generic.go:356] "Generic (PLEG): container finished" podID="be2963da-12fb-4f56-8602-d54733af25e1" containerID="d26de7db392e56d8f869775d2ac7a5115126047562de1636b231d7c89ff9b6be" exitCode=0
Jul 28 01:16:02.317825 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:02.317233    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ps5b9" event={"ID":"be2963da-12fb-4f56-8602-d54733af25e1","Type":"ContainerDied","Data":"d26de7db392e56d8f869775d2ac7a5115126047562de1636b231d7c89ff9b6be"}
Jul 28 01:16:03.007282 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:03.007246    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4kjt"
Jul 28 01:16:03.007282 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:03.007272    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68l4f"
Jul 28 01:16:03.007513 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:03.007288    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvdx4"
Jul 28 01:16:03.007513 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:03.007369    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4kjt" podUID="0a43767a-926c-4dfa-8f67-cd932fa744b5"
Jul 28 01:16:03.007513 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:03.007423    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68l4f" podUID="ddb225a7-f4d2-4295-8cce-d7d4a3d49955"
Jul 28 01:16:03.007513 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:03.007489    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvdx4" podUID="c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d"
Jul 28 01:16:03.652801 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:03.652760    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a43767a-926c-4dfa-8f67-cd932fa744b5-metrics-certs\") pod \"network-metrics-daemon-d4kjt\" (UID: \"0a43767a-926c-4dfa-8f67-cd932fa744b5\") " pod="openshift-multus/network-metrics-daemon-d4kjt"
Jul 28 01:16:03.653339 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:03.652830    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d-original-pull-secret\") pod \"global-pull-secret-syncer-xvdx4\" (UID: \"c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d\") " pod="kube-system/global-pull-secret-syncer-xvdx4"
Jul 28 01:16:03.653339 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:03.652850    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:16:03.653339 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:03.652914    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a43767a-926c-4dfa-8f67-cd932fa744b5-metrics-certs podName:0a43767a-926c-4dfa-8f67-cd932fa744b5 nodeName:}" failed. No retries permitted until 2026-07-28 01:16:35.65289604 +0000 UTC m=+66.156657333 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a43767a-926c-4dfa-8f67-cd932fa744b5-metrics-certs") pod "network-metrics-daemon-d4kjt" (UID: "0a43767a-926c-4dfa-8f67-cd932fa744b5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:16:03.653339 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:03.652974    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 01:16:03.653339 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:03.653032    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d-original-pull-secret podName:c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d nodeName:}" failed. No retries permitted until 2026-07-28 01:16:35.653018371 +0000 UTC m=+66.156779665 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d-original-pull-secret") pod "global-pull-secret-syncer-xvdx4" (UID: "c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d") : object "kube-system"/"original-pull-secret" not registered
Jul 28 01:16:03.753420 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:03.753388    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g5sm\" (UniqueName: \"kubernetes.io/projected/ddb225a7-f4d2-4295-8cce-d7d4a3d49955-kube-api-access-6g5sm\") pod \"network-check-target-68l4f\" (UID: \"ddb225a7-f4d2-4295-8cce-d7d4a3d49955\") " pod="openshift-network-diagnostics/network-check-target-68l4f"
Jul 28 01:16:03.753604 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:03.753528    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 01:16:03.753604 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:03.753545    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 01:16:03.753604 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:03.753554    2562 projected.go:196] Error preparing data for projected volume kube-api-access-6g5sm for pod openshift-network-diagnostics/network-check-target-68l4f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:16:03.753831 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:03.753629    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddb225a7-f4d2-4295-8cce-d7d4a3d49955-kube-api-access-6g5sm podName:ddb225a7-f4d2-4295-8cce-d7d4a3d49955 nodeName:}" failed. No retries permitted until 2026-07-28 01:16:35.753610427 +0000 UTC m=+66.257371740 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6g5sm" (UniqueName: "kubernetes.io/projected/ddb225a7-f4d2-4295-8cce-d7d4a3d49955-kube-api-access-6g5sm") pod "network-check-target-68l4f" (UID: "ddb225a7-f4d2-4295-8cce-d7d4a3d49955") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:16:04.820904 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.820874    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeReady"
Jul 28 01:16:04.821242 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.821066    2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 28 01:16:04.854019 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.853991    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7ts22"]
Jul 28 01:16:04.855912 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.855869    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7ts22"
Jul 28 01:16:04.857418 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.857398    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7nlbl"]
Jul 28 01:16:04.858116 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.858092    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 28 01:16:04.858580 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.858536    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 28 01:16:04.858861 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.858841    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 28 01:16:04.858948 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.858912    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 28 01:16:04.858948 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.858936    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-6dxbt\""
Jul 28 01:16:04.859367 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.859351    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-865ff46f64-k9qw5"]
Jul 28 01:16:04.859508 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.859491    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7nlbl"
Jul 28 01:16:04.861322 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.861303    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 28 01:16:04.861509 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.861308    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-865ff46f64-k9qw5"
Jul 28 01:16:04.861603 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.861537    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 28 01:16:04.861711 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.861692    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 28 01:16:04.861939 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.861918    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-d8kfc\""
Jul 28 01:16:04.862023 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.861988    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 28 01:16:04.863491 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.863453    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 28 01:16:04.863750 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.863691    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 28 01:16:04.863879 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.863862    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-l2d29\""
Jul 28 01:16:04.864139 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.864112    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 28 01:16:04.869376 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.868841    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 28 01:16:04.869376 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.869012    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7ts22"]
Jul 28 01:16:04.875232 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.875209    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-lztg6"]
Jul 28 01:16:04.878169 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.877692    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-rqtjj"]
Jul 28 01:16:04.879676 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.879653    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-lztg6"
Jul 28 01:16:04.883533 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.883508    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 28 01:16:04.883706 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.883647    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 28 01:16:04.883706 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.883698    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-9wlxc\""
Jul 28 01:16:04.883962 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.883943    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7nlbl"]
Jul 28 01:16:04.884042 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.883982    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-865ff46f64-k9qw5"]
Jul 28 01:16:04.884042 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.884003    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-d4xnz"]
Jul 28 01:16:04.884134 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.884093    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-rqtjj"
Jul 28 01:16:04.886188 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.886170    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-46gx9"]
Jul 28 01:16:04.886313 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.886293    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d4xnz"
Jul 28 01:16:04.887352 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.887328    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 01:16:04.887489 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.887425    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-tg4cz\""
Jul 28 01:16:04.887765 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.887657    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 01:16:04.887889 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.887873    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 28 01:16:04.889773 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.888993    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 28 01:16:04.889773 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.889691    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zm2x9\""
Jul 28 01:16:04.889905 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.889822    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-lztg6"]
Jul 28 01:16:04.889905 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.889849    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-rqtjj"]
Jul 28 01:16:04.889905 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.889882    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d4xnz"]
Jul 28 01:16:04.890129 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.890112    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-46gx9"
Jul 28 01:16:04.890577 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.890286    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 28 01:16:04.892085 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.892065    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-46gx9"]
Jul 28 01:16:04.892526 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.892511    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-h7mrw\""
Jul 28 01:16:04.892833 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.892622    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 28 01:16:04.893542 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.893520    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 28 01:16:04.960794 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.960767    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fdc9c853-3bbb-4e92-8d4f-960c02d7a125-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-7nlbl\" (UID: \"fdc9c853-3bbb-4e92-8d4f-960c02d7a125\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7nlbl"
Jul 28 01:16:04.960919 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.960805    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d862dade-baa3-4c0c-8f7d-606d0664ec16-registry-certificates\") pod \"image-registry-865ff46f64-k9qw5\" (UID: \"d862dade-baa3-4c0c-8f7d-606d0664ec16\") " pod="openshift-image-registry/image-registry-865ff46f64-k9qw5"
Jul 28 01:16:04.960919 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.960829    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d862dade-baa3-4c0c-8f7d-606d0664ec16-trusted-ca\") pod \"image-registry-865ff46f64-k9qw5\" (UID: \"d862dade-baa3-4c0c-8f7d-606d0664ec16\") " pod="openshift-image-registry/image-registry-865ff46f64-k9qw5"
Jul 28 01:16:04.960919 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.960870    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/adf1e90a-9fdd-438a-857d-6a271dfd94c5-tmp-dir\") pod \"dns-default-46gx9\" (UID: \"adf1e90a-9fdd-438a-857d-6a271dfd94c5\") " pod="openshift-dns/dns-default-46gx9"
Jul 28 01:16:04.960919 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.960903    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d862dade-baa3-4c0c-8f7d-606d0664ec16-installation-pull-secrets\") pod \"image-registry-865ff46f64-k9qw5\" (UID: \"d862dade-baa3-4c0c-8f7d-606d0664ec16\") " pod="openshift-image-registry/image-registry-865ff46f64-k9qw5"
Jul 28 01:16:04.961074 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.960928    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f3813e32-ffca-4cbb-a86e-b8e33ca0f863-serving-cert\") pod \"service-ca-operator-5d6c75f84f-7ts22\" (UID: \"f3813e32-ffca-4cbb-a86e-b8e33ca0f863\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7ts22"
Jul 28 01:16:04.961074 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.960952    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f3813e32-ffca-4cbb-a86e-b8e33ca0f863-config\") pod \"service-ca-operator-5d6c75f84f-7ts22\" (UID: \"f3813e32-ffca-4cbb-a86e-b8e33ca0f863\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7ts22"
Jul 28 01:16:04.961074 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.960994    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjbck\" (UniqueName: \"kubernetes.io/projected/f3813e32-ffca-4cbb-a86e-b8e33ca0f863-kube-api-access-fjbck\") pod \"service-ca-operator-5d6c75f84f-7ts22\" (UID: \"f3813e32-ffca-4cbb-a86e-b8e33ca0f863\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7ts22"
Jul 28 01:16:04.961074 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.961027    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fdc9c853-3bbb-4e92-8d4f-960c02d7a125-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-7nlbl\" (UID: \"fdc9c853-3bbb-4e92-8d4f-960c02d7a125\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7nlbl"
Jul 28 01:16:04.961247 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.961070    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tfx4\" (UniqueName: \"kubernetes.io/projected/fdc9c853-3bbb-4e92-8d4f-960c02d7a125-kube-api-access-5tfx4\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-7nlbl\" (UID: \"fdc9c853-3bbb-4e92-8d4f-960c02d7a125\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7nlbl"
Jul 28 01:16:04.961247 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.961134    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d862dade-baa3-4c0c-8f7d-606d0664ec16-ca-trust-extracted\") pod \"image-registry-865ff46f64-k9qw5\" (UID: \"d862dade-baa3-4c0c-8f7d-606d0664ec16\") " pod="openshift-image-registry/image-registry-865ff46f64-k9qw5"
Jul 28 01:16:04.961247 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.961162    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9j9w\" (UniqueName: \"kubernetes.io/projected/d862dade-baa3-4c0c-8f7d-606d0664ec16-kube-api-access-r9j9w\") pod \"image-registry-865ff46f64-k9qw5\" (UID: \"d862dade-baa3-4c0c-8f7d-606d0664ec16\") " pod="openshift-image-registry/image-registry-865ff46f64-k9qw5"
Jul 28 01:16:04.961247 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.961180    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/acfd3678-0809-4d22-b8bf-16e381d8dbb6-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-lztg6\" (UID: \"acfd3678-0809-4d22-b8bf-16e381d8dbb6\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-lztg6"
Jul 28 01:16:04.961247 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.961210    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/adf1e90a-9fdd-438a-857d-6a271dfd94c5-config-volume\") pod \"dns-default-46gx9\" (UID: \"adf1e90a-9fdd-438a-857d-6a271dfd94c5\") " pod="openshift-dns/dns-default-46gx9"
Jul 28 01:16:04.961247 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.961242    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/acfd3678-0809-4d22-b8bf-16e381d8dbb6-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-lztg6\" (UID: \"acfd3678-0809-4d22-b8bf-16e381d8dbb6\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-lztg6"
Jul 28 01:16:04.961476 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.961289    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adf1e90a-9fdd-438a-857d-6a271dfd94c5-metrics-tls\") pod \"dns-default-46gx9\" (UID: \"adf1e90a-9fdd-438a-857d-6a271dfd94c5\") " pod="openshift-dns/dns-default-46gx9"
Jul 28 01:16:04.961476 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.961311    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf79q\" (UniqueName: \"kubernetes.io/projected/adf1e90a-9fdd-438a-857d-6a271dfd94c5-kube-api-access-cf79q\") pod \"dns-default-46gx9\" (UID: \"adf1e90a-9fdd-438a-857d-6a271dfd94c5\") " pod="openshift-dns/dns-default-46gx9"
Jul 28 01:16:04.961476 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.961355    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d862dade-baa3-4c0c-8f7d-606d0664ec16-registry-tls\") pod \"image-registry-865ff46f64-k9qw5\" (UID: \"d862dade-baa3-4c0c-8f7d-606d0664ec16\") " pod="openshift-image-registry/image-registry-865ff46f64-k9qw5"
Jul 28 01:16:04.961476 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.961447    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5bch\" (UniqueName: \"kubernetes.io/projected/aeb05ead-7e3e-4df0-b9f6-4ddd56833e54-kube-api-access-h5bch\") pod \"network-check-source-7d88cb55d8-rqtjj\" (UID: \"aeb05ead-7e3e-4df0-b9f6-4ddd56833e54\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-rqtjj"
Jul 28 01:16:04.961693 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.961483    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d010bf4e-4f54-4204-b1f3-8813b3a4a1de-cert\") pod \"ingress-canary-d4xnz\" (UID: \"d010bf4e-4f54-4204-b1f3-8813b3a4a1de\") " pod="openshift-ingress-canary/ingress-canary-d4xnz"
Jul 28 01:16:04.961693 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.961521    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wphdj\" (UniqueName: \"kubernetes.io/projected/d010bf4e-4f54-4204-b1f3-8813b3a4a1de-kube-api-access-wphdj\") pod \"ingress-canary-d4xnz\" (UID: \"d010bf4e-4f54-4204-b1f3-8813b3a4a1de\") " pod="openshift-ingress-canary/ingress-canary-d4xnz"
Jul 28 01:16:04.961693 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.961552    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d862dade-baa3-4c0c-8f7d-606d0664ec16-image-registry-private-configuration\") pod \"image-registry-865ff46f64-k9qw5\" (UID: \"d862dade-baa3-4c0c-8f7d-606d0664ec16\") " pod="openshift-image-registry/image-registry-865ff46f64-k9qw5"
Jul 28 01:16:04.961693 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:04.961604    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d862dade-baa3-4c0c-8f7d-606d0664ec16-bound-sa-token\") pod \"image-registry-865ff46f64-k9qw5\" (UID: \"d862dade-baa3-4c0c-8f7d-606d0664ec16\") " pod="openshift-image-registry/image-registry-865ff46f64-k9qw5"
Jul 28 01:16:05.007816 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.007789    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvdx4"
Jul 28 01:16:05.008077 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.007789    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68l4f"
Jul 28 01:16:05.008251 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.007834    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4kjt"
Jul 28 01:16:05.010300 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.010277    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 01:16:05.010420 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.010313    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j4n9n\""
Jul 28 01:16:05.010420 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.010393    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4m9v4\""
Jul 28 01:16:05.010526 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.010424    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 01:16:05.031271 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.031239    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vdcp5_43162e49-7fbb-42a7-9041-00ac2fbcd96d/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:05.062519 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.062487    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adf1e90a-9fdd-438a-857d-6a271dfd94c5-metrics-tls\") pod \"dns-default-46gx9\" (UID: \"adf1e90a-9fdd-438a-857d-6a271dfd94c5\") " pod="openshift-dns/dns-default-46gx9"
Jul 28 01:16:05.062643 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.062520    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cf79q\" (UniqueName: \"kubernetes.io/projected/adf1e90a-9fdd-438a-857d-6a271dfd94c5-kube-api-access-cf79q\") pod \"dns-default-46gx9\" (UID: \"adf1e90a-9fdd-438a-857d-6a271dfd94c5\") " pod="openshift-dns/dns-default-46gx9"
Jul 28 01:16:05.062643 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.062576    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d862dade-baa3-4c0c-8f7d-606d0664ec16-registry-tls\") pod \"image-registry-865ff46f64-k9qw5\" (UID: \"d862dade-baa3-4c0c-8f7d-606d0664ec16\") " pod="openshift-image-registry/image-registry-865ff46f64-k9qw5"
Jul 28 01:16:05.062643 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.062609    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5bch\" (UniqueName: \"kubernetes.io/projected/aeb05ead-7e3e-4df0-b9f6-4ddd56833e54-kube-api-access-h5bch\") pod \"network-check-source-7d88cb55d8-rqtjj\" (UID: \"aeb05ead-7e3e-4df0-b9f6-4ddd56833e54\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-rqtjj"
Jul 28 01:16:05.062643 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.062633    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d010bf4e-4f54-4204-b1f3-8813b3a4a1de-cert\") pod \"ingress-canary-d4xnz\" (UID: \"d010bf4e-4f54-4204-b1f3-8813b3a4a1de\") " pod="openshift-ingress-canary/ingress-canary-d4xnz"
Jul 28 01:16:05.062841 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:05.062644    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 01:16:05.062841 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.062655    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wphdj\" (UniqueName: \"kubernetes.io/projected/d010bf4e-4f54-4204-b1f3-8813b3a4a1de-kube-api-access-wphdj\") pod \"ingress-canary-d4xnz\" (UID: \"d010bf4e-4f54-4204-b1f3-8813b3a4a1de\") " pod="openshift-ingress-canary/ingress-canary-d4xnz"
Jul 28 01:16:05.062841 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.062682    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d862dade-baa3-4c0c-8f7d-606d0664ec16-image-registry-private-configuration\") pod \"image-registry-865ff46f64-k9qw5\" (UID: \"d862dade-baa3-4c0c-8f7d-606d0664ec16\") " pod="openshift-image-registry/image-registry-865ff46f64-k9qw5"
Jul 28 01:16:05.062841 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:05.062698    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adf1e90a-9fdd-438a-857d-6a271dfd94c5-metrics-tls podName:adf1e90a-9fdd-438a-857d-6a271dfd94c5 nodeName:}" failed. No retries permitted until 2026-07-28 01:16:05.562681142 +0000 UTC m=+36.066442447 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adf1e90a-9fdd-438a-857d-6a271dfd94c5-metrics-tls") pod "dns-default-46gx9" (UID: "adf1e90a-9fdd-438a-857d-6a271dfd94c5") : secret "dns-default-metrics-tls" not found
Jul 28 01:16:05.062841 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:05.062701    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 01:16:05.062841 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:05.062717    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-865ff46f64-k9qw5: secret "image-registry-tls" not found
Jul 28 01:16:05.062841 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.062726    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d862dade-baa3-4c0c-8f7d-606d0664ec16-bound-sa-token\") pod \"image-registry-865ff46f64-k9qw5\" (UID: \"d862dade-baa3-4c0c-8f7d-606d0664ec16\") " pod="openshift-image-registry/image-registry-865ff46f64-k9qw5"
Jul 28 01:16:05.062841 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.062751    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fdc9c853-3bbb-4e92-8d4f-960c02d7a125-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-7nlbl\" (UID: \"fdc9c853-3bbb-4e92-8d4f-960c02d7a125\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7nlbl"
Jul 28 01:16:05.062841 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:05.062766    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d862dade-baa3-4c0c-8f7d-606d0664ec16-registry-tls podName:d862dade-baa3-4c0c-8f7d-606d0664ec16 nodeName:}" failed. No retries permitted until 2026-07-28 01:16:05.562749146 +0000 UTC m=+36.066510450 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d862dade-baa3-4c0c-8f7d-606d0664ec16-registry-tls") pod "image-registry-865ff46f64-k9qw5" (UID: "d862dade-baa3-4c0c-8f7d-606d0664ec16") : secret "image-registry-tls" not found
Jul 28 01:16:05.062841 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.062807    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d862dade-baa3-4c0c-8f7d-606d0664ec16-registry-certificates\") pod \"image-registry-865ff46f64-k9qw5\" (UID: \"d862dade-baa3-4c0c-8f7d-606d0664ec16\") " pod="openshift-image-registry/image-registry-865ff46f64-k9qw5"
Jul 28 01:16:05.062841 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.062844    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d862dade-baa3-4c0c-8f7d-606d0664ec16-trusted-ca\") pod \"image-registry-865ff46f64-k9qw5\" (UID: \"d862dade-baa3-4c0c-8f7d-606d0664ec16\") " pod="openshift-image-registry/image-registry-865ff46f64-k9qw5"
Jul 28 01:16:05.063379 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.062880    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/adf1e90a-9fdd-438a-857d-6a271dfd94c5-tmp-dir\") pod \"dns-default-46gx9\" (UID: \"adf1e90a-9fdd-438a-857d-6a271dfd94c5\") " pod="openshift-dns/dns-default-46gx9"
Jul 28 01:16:05.063379 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.062938    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d862dade-baa3-4c0c-8f7d-606d0664ec16-installation-pull-secrets\") pod \"image-registry-865ff46f64-k9qw5\" (UID: \"d862dade-baa3-4c0c-8f7d-606d0664ec16\") " pod="openshift-image-registry/image-registry-865ff46f64-k9qw5"
Jul 28 01:16:05.063379 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.062982    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f3813e32-ffca-4cbb-a86e-b8e33ca0f863-serving-cert\") pod \"service-ca-operator-5d6c75f84f-7ts22\" (UID: \"f3813e32-ffca-4cbb-a86e-b8e33ca0f863\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7ts22"
Jul 28 01:16:05.063379 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.063010    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f3813e32-ffca-4cbb-a86e-b8e33ca0f863-config\") pod \"service-ca-operator-5d6c75f84f-7ts22\" (UID: \"f3813e32-ffca-4cbb-a86e-b8e33ca0f863\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7ts22"
Jul 28 01:16:05.063379 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.063035    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjbck\" (UniqueName: \"kubernetes.io/projected/f3813e32-ffca-4cbb-a86e-b8e33ca0f863-kube-api-access-fjbck\") pod \"service-ca-operator-5d6c75f84f-7ts22\" (UID: \"f3813e32-ffca-4cbb-a86e-b8e33ca0f863\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7ts22"
Jul 28 01:16:05.063379 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.063059    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fdc9c853-3bbb-4e92-8d4f-960c02d7a125-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-7nlbl\" (UID: \"fdc9c853-3bbb-4e92-8d4f-960c02d7a125\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7nlbl"
Jul 28 01:16:05.063379 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.063087    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tfx4\" (UniqueName: \"kubernetes.io/projected/fdc9c853-3bbb-4e92-8d4f-960c02d7a125-kube-api-access-5tfx4\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-7nlbl\" (UID: \"fdc9c853-3bbb-4e92-8d4f-960c02d7a125\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7nlbl"
Jul 28 01:16:05.063379 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.063118    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d862dade-baa3-4c0c-8f7d-606d0664ec16-ca-trust-extracted\") pod \"image-registry-865ff46f64-k9qw5\" (UID: \"d862dade-baa3-4c0c-8f7d-606d0664ec16\") " pod="openshift-image-registry/image-registry-865ff46f64-k9qw5"
Jul 28 01:16:05.063379 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.063145    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9j9w\" (UniqueName: \"kubernetes.io/projected/d862dade-baa3-4c0c-8f7d-606d0664ec16-kube-api-access-r9j9w\") pod \"image-registry-865ff46f64-k9qw5\" (UID: \"d862dade-baa3-4c0c-8f7d-606d0664ec16\") " pod="openshift-image-registry/image-registry-865ff46f64-k9qw5"
Jul 28 01:16:05.063379 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.063172    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/acfd3678-0809-4d22-b8bf-16e381d8dbb6-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-lztg6\" (UID: \"acfd3678-0809-4d22-b8bf-16e381d8dbb6\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-lztg6"
Jul 28 01:16:05.063379 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.063211    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/adf1e90a-9fdd-438a-857d-6a271dfd94c5-config-volume\") pod \"dns-default-46gx9\" (UID: \"adf1e90a-9fdd-438a-857d-6a271dfd94c5\") " pod="openshift-dns/dns-default-46gx9"
Jul 28 01:16:05.063379 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.063239    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/acfd3678-0809-4d22-b8bf-16e381d8dbb6-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-lztg6\" (UID: \"acfd3678-0809-4d22-b8bf-16e381d8dbb6\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-lztg6"
Jul 28 01:16:05.063379 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.063270    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fdc9c853-3bbb-4e92-8d4f-960c02d7a125-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-7nlbl\" (UID: \"fdc9c853-3bbb-4e92-8d4f-960c02d7a125\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7nlbl"
Jul 28 01:16:05.063379 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.063379    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d862dade-baa3-4c0c-8f7d-606d0664ec16-registry-certificates\") pod \"image-registry-865ff46f64-k9qw5\" (UID: \"d862dade-baa3-4c0c-8f7d-606d0664ec16\") " pod="openshift-image-registry/image-registry-865ff46f64-k9qw5"
Jul 28 01:16:05.064107 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.063750    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d862dade-baa3-4c0c-8f7d-606d0664ec16-trusted-ca\") pod \"image-registry-865ff46f64-k9qw5\" (UID: \"d862dade-baa3-4c0c-8f7d-606d0664ec16\") " pod="openshift-image-registry/image-registry-865ff46f64-k9qw5"
Jul 28 01:16:05.064107 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:05.063821    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 01:16:05.064107 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:05.063861    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acfd3678-0809-4d22-b8bf-16e381d8dbb6-networking-console-plugin-cert podName:acfd3678-0809-4d22-b8bf-16e381d8dbb6 nodeName:}" failed. No retries permitted until 2026-07-28 01:16:05.563849319 +0000 UTC m=+36.067610609 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/acfd3678-0809-4d22-b8bf-16e381d8dbb6-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-lztg6" (UID: "acfd3678-0809-4d22-b8bf-16e381d8dbb6") : secret "networking-console-plugin-cert" not found
Jul 28 01:16:05.064107 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.063952    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d862dade-baa3-4c0c-8f7d-606d0664ec16-ca-trust-extracted\") pod \"image-registry-865ff46f64-k9qw5\" (UID: \"d862dade-baa3-4c0c-8f7d-606d0664ec16\") " pod="openshift-image-registry/image-registry-865ff46f64-k9qw5"
Jul 28 01:16:05.064107 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.064009    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/acfd3678-0809-4d22-b8bf-16e381d8dbb6-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-lztg6\" (UID: \"acfd3678-0809-4d22-b8bf-16e381d8dbb6\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-lztg6"
Jul 28 01:16:05.064428 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.064201    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/adf1e90a-9fdd-438a-857d-6a271dfd94c5-tmp-dir\") pod \"dns-default-46gx9\" (UID: \"adf1e90a-9fdd-438a-857d-6a271dfd94c5\") " pod="openshift-dns/dns-default-46gx9"
Jul 28 01:16:05.064428 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.064307    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/adf1e90a-9fdd-438a-857d-6a271dfd94c5-config-volume\") pod \"dns-default-46gx9\" (UID: \"adf1e90a-9fdd-438a-857d-6a271dfd94c5\") " pod="openshift-dns/dns-default-46gx9"
Jul 28 01:16:05.064839 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.064769    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f3813e32-ffca-4cbb-a86e-b8e33ca0f863-config\") pod \"service-ca-operator-5d6c75f84f-7ts22\" (UID: \"f3813e32-ffca-4cbb-a86e-b8e33ca0f863\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7ts22"
Jul 28 01:16:05.067210 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.067186    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f3813e32-ffca-4cbb-a86e-b8e33ca0f863-serving-cert\") pod \"service-ca-operator-5d6c75f84f-7ts22\" (UID: \"f3813e32-ffca-4cbb-a86e-b8e33ca0f863\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7ts22"
Jul 28 01:16:05.067370 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.067350    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d862dade-baa3-4c0c-8f7d-606d0664ec16-installation-pull-secrets\") pod \"image-registry-865ff46f64-k9qw5\" (UID: \"d862dade-baa3-4c0c-8f7d-606d0664ec16\") " pod="openshift-image-registry/image-registry-865ff46f64-k9qw5"
Jul 28 01:16:05.067370 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.067358    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fdc9c853-3bbb-4e92-8d4f-960c02d7a125-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-7nlbl\" (UID: \"fdc9c853-3bbb-4e92-8d4f-960c02d7a125\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7nlbl"
Jul 28 01:16:05.067508 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.067395    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d862dade-baa3-4c0c-8f7d-606d0664ec16-image-registry-private-configuration\") pod \"image-registry-865ff46f64-k9qw5\" (UID: \"d862dade-baa3-4c0c-8f7d-606d0664ec16\") " pod="openshift-image-registry/image-registry-865ff46f64-k9qw5"
Jul 28 01:16:05.067508 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.067422    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d010bf4e-4f54-4204-b1f3-8813b3a4a1de-cert\") pod \"ingress-canary-d4xnz\" (UID: \"d010bf4e-4f54-4204-b1f3-8813b3a4a1de\") " pod="openshift-ingress-canary/ingress-canary-d4xnz"
Jul 28 01:16:05.072420 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.072378    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9j9w\" (UniqueName: \"kubernetes.io/projected/d862dade-baa3-4c0c-8f7d-606d0664ec16-kube-api-access-r9j9w\") pod \"image-registry-865ff46f64-k9qw5\" (UID: \"d862dade-baa3-4c0c-8f7d-606d0664ec16\") " pod="openshift-image-registry/image-registry-865ff46f64-k9qw5"
Jul 28 01:16:05.072705 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.072659    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d862dade-baa3-4c0c-8f7d-606d0664ec16-bound-sa-token\") pod \"image-registry-865ff46f64-k9qw5\" (UID: \"d862dade-baa3-4c0c-8f7d-606d0664ec16\") " pod="openshift-image-registry/image-registry-865ff46f64-k9qw5"
Jul 28 01:16:05.073498 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.073260    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjbck\" (UniqueName: \"kubernetes.io/projected/f3813e32-ffca-4cbb-a86e-b8e33ca0f863-kube-api-access-fjbck\") pod \"service-ca-operator-5d6c75f84f-7ts22\" (UID: \"f3813e32-ffca-4cbb-a86e-b8e33ca0f863\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7ts22"
Jul 28 01:16:05.073498 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.073426    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5bch\" (UniqueName: \"kubernetes.io/projected/aeb05ead-7e3e-4df0-b9f6-4ddd56833e54-kube-api-access-h5bch\") pod \"network-check-source-7d88cb55d8-rqtjj\" (UID: \"aeb05ead-7e3e-4df0-b9f6-4ddd56833e54\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-rqtjj"
Jul 28 01:16:05.073675 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.073650    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf79q\" (UniqueName: \"kubernetes.io/projected/adf1e90a-9fdd-438a-857d-6a271dfd94c5-kube-api-access-cf79q\") pod \"dns-default-46gx9\" (UID: \"adf1e90a-9fdd-438a-857d-6a271dfd94c5\") " pod="openshift-dns/dns-default-46gx9"
Jul 28 01:16:05.074053 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.074025    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wphdj\" (UniqueName: \"kubernetes.io/projected/d010bf4e-4f54-4204-b1f3-8813b3a4a1de-kube-api-access-wphdj\") pod \"ingress-canary-d4xnz\" (UID: \"d010bf4e-4f54-4204-b1f3-8813b3a4a1de\") " pod="openshift-ingress-canary/ingress-canary-d4xnz"
Jul 28 01:16:05.074630 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.074610    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tfx4\" (UniqueName: \"kubernetes.io/projected/fdc9c853-3bbb-4e92-8d4f-960c02d7a125-kube-api-access-5tfx4\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-7nlbl\" (UID: \"fdc9c853-3bbb-4e92-8d4f-960c02d7a125\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7nlbl"
Jul 28 01:16:05.131751 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.131690    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vdcp5_43162e49-7fbb-42a7-9041-00ac2fbcd96d/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:05.169642 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.169540    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7ts22"
Jul 28 01:16:05.181905 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.181872    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7nlbl"
Jul 28 01:16:05.207175 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.207139    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-rqtjj"
Jul 28 01:16:05.212949 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.212923    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d4xnz"
Jul 28 01:16:05.410802 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.410740    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vdcp5_43162e49-7fbb-42a7-9041-00ac2fbcd96d/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:05.509800 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.509712    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vdcp5_43162e49-7fbb-42a7-9041-00ac2fbcd96d/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:05.568294 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.568251    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/acfd3678-0809-4d22-b8bf-16e381d8dbb6-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-lztg6\" (UID: \"acfd3678-0809-4d22-b8bf-16e381d8dbb6\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-lztg6"
Jul 28 01:16:05.568492 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.568335    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adf1e90a-9fdd-438a-857d-6a271dfd94c5-metrics-tls\") pod \"dns-default-46gx9\" (UID: \"adf1e90a-9fdd-438a-857d-6a271dfd94c5\") " pod="openshift-dns/dns-default-46gx9"
Jul 28 01:16:05.568492 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:05.568378    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d862dade-baa3-4c0c-8f7d-606d0664ec16-registry-tls\") pod \"image-registry-865ff46f64-k9qw5\" (UID: \"d862dade-baa3-4c0c-8f7d-606d0664ec16\") " pod="openshift-image-registry/image-registry-865ff46f64-k9qw5"
Jul 28 01:16:05.568492 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:05.568427    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 01:16:05.568659 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:05.568507    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 01:16:05.568659 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:05.568523    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acfd3678-0809-4d22-b8bf-16e381d8dbb6-networking-console-plugin-cert podName:acfd3678-0809-4d22-b8bf-16e381d8dbb6 nodeName:}" failed. No retries permitted until 2026-07-28 01:16:06.568498184 +0000 UTC m=+37.072259493 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/acfd3678-0809-4d22-b8bf-16e381d8dbb6-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-lztg6" (UID: "acfd3678-0809-4d22-b8bf-16e381d8dbb6") : secret "networking-console-plugin-cert" not found
Jul 28 01:16:05.568659 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:05.568517    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 01:16:05.568659 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:05.568593    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-865ff46f64-k9qw5: secret "image-registry-tls" not found
Jul 28 01:16:05.568659 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:05.568598    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adf1e90a-9fdd-438a-857d-6a271dfd94c5-metrics-tls podName:adf1e90a-9fdd-438a-857d-6a271dfd94c5 nodeName:}" failed. No retries permitted until 2026-07-28 01:16:06.568579168 +0000 UTC m=+37.072340462 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adf1e90a-9fdd-438a-857d-6a271dfd94c5-metrics-tls") pod "dns-default-46gx9" (UID: "adf1e90a-9fdd-438a-857d-6a271dfd94c5") : secret "dns-default-metrics-tls" not found
Jul 28 01:16:05.568659 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:05.568646    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d862dade-baa3-4c0c-8f7d-606d0664ec16-registry-tls podName:d862dade-baa3-4c0c-8f7d-606d0664ec16 nodeName:}" failed. No retries permitted until 2026-07-28 01:16:06.568631473 +0000 UTC m=+37.072392779 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d862dade-baa3-4c0c-8f7d-606d0664ec16-registry-tls") pod "image-registry-865ff46f64-k9qw5" (UID: "d862dade-baa3-4c0c-8f7d-606d0664ec16") : secret "image-registry-tls" not found
Jul 28 01:16:06.513680 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:06.513483    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7ts22"]
Jul 28 01:16:06.515927 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:06.515885    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-rqtjj"]
Jul 28 01:16:06.517766 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:16:06.517741    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3813e32_ffca_4cbb_a86e_b8e33ca0f863.slice/crio-97f6d79b2996834d69a3cb55586b595cf3fc3a56a5006e49067a8b3c8be33380 WatchSource:0}: Error finding container 97f6d79b2996834d69a3cb55586b595cf3fc3a56a5006e49067a8b3c8be33380: Status 404 returned error can't find the container with id 97f6d79b2996834d69a3cb55586b595cf3fc3a56a5006e49067a8b3c8be33380
Jul 28 01:16:06.519759 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:06.519735    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d4xnz"]
Jul 28 01:16:06.520652 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:16:06.520531    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaeb05ead_7e3e_4df0_b9f6_4ddd56833e54.slice/crio-76afe41282443733fa0f7d237135ba0367a377fb495b38f3bd21373643459eba WatchSource:0}: Error finding container 76afe41282443733fa0f7d237135ba0367a377fb495b38f3bd21373643459eba: Status 404 returned error can't find the container with id 76afe41282443733fa0f7d237135ba0367a377fb495b38f3bd21373643459eba
Jul 28 01:16:06.524349 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:16:06.524325    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd010bf4e_4f54_4204_b1f3_8813b3a4a1de.slice/crio-626a55b4377928b9c184833f285f5a47fa6f24143e680f6691366d7494187ba1 WatchSource:0}: Error finding container 626a55b4377928b9c184833f285f5a47fa6f24143e680f6691366d7494187ba1: Status 404 returned error can't find the container with id 626a55b4377928b9c184833f285f5a47fa6f24143e680f6691366d7494187ba1
Jul 28 01:16:06.532829 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:06.532778    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7nlbl"]
Jul 28 01:16:06.536260 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:16:06.536230    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdc9c853_3bbb_4e92_8d4f_960c02d7a125.slice/crio-c7abb6fa78781e7d01f85ab14c72091d6d8874c4b23066719b229a89cdf21719 WatchSource:0}: Error finding container c7abb6fa78781e7d01f85ab14c72091d6d8874c4b23066719b229a89cdf21719: Status 404 returned error can't find the container with id c7abb6fa78781e7d01f85ab14c72091d6d8874c4b23066719b229a89cdf21719
Jul 28 01:16:06.579920 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:06.579809    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/acfd3678-0809-4d22-b8bf-16e381d8dbb6-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-lztg6\" (UID: \"acfd3678-0809-4d22-b8bf-16e381d8dbb6\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-lztg6"
Jul 28 01:16:06.579920 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:06.579868    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adf1e90a-9fdd-438a-857d-6a271dfd94c5-metrics-tls\") pod \"dns-default-46gx9\" (UID: \"adf1e90a-9fdd-438a-857d-6a271dfd94c5\") " pod="openshift-dns/dns-default-46gx9"
Jul 28 01:16:06.579920 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:06.579894    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d862dade-baa3-4c0c-8f7d-606d0664ec16-registry-tls\") pod \"image-registry-865ff46f64-k9qw5\" (UID: \"d862dade-baa3-4c0c-8f7d-606d0664ec16\") " pod="openshift-image-registry/image-registry-865ff46f64-k9qw5"
Jul 28 01:16:06.580126 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:06.579967    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 01:16:06.580126 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:06.580002    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 01:16:06.580126 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:06.580018    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 01:16:06.580126 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:06.580031    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-865ff46f64-k9qw5: secret "image-registry-tls" not found
Jul 28 01:16:06.580126 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:06.580042    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acfd3678-0809-4d22-b8bf-16e381d8dbb6-networking-console-plugin-cert podName:acfd3678-0809-4d22-b8bf-16e381d8dbb6 nodeName:}" failed. No retries permitted until 2026-07-28 01:16:08.580023845 +0000 UTC m=+39.083785135 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/acfd3678-0809-4d22-b8bf-16e381d8dbb6-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-lztg6" (UID: "acfd3678-0809-4d22-b8bf-16e381d8dbb6") : secret "networking-console-plugin-cert" not found
Jul 28 01:16:06.580126 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:06.580066    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adf1e90a-9fdd-438a-857d-6a271dfd94c5-metrics-tls podName:adf1e90a-9fdd-438a-857d-6a271dfd94c5 nodeName:}" failed. No retries permitted until 2026-07-28 01:16:08.580049042 +0000 UTC m=+39.083810335 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adf1e90a-9fdd-438a-857d-6a271dfd94c5-metrics-tls") pod "dns-default-46gx9" (UID: "adf1e90a-9fdd-438a-857d-6a271dfd94c5") : secret "dns-default-metrics-tls" not found
Jul 28 01:16:06.580126 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:06.580091    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d862dade-baa3-4c0c-8f7d-606d0664ec16-registry-tls podName:d862dade-baa3-4c0c-8f7d-606d0664ec16 nodeName:}" failed. No retries permitted until 2026-07-28 01:16:08.580079975 +0000 UTC m=+39.083841265 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d862dade-baa3-4c0c-8f7d-606d0664ec16-registry-tls") pod "image-registry-865ff46f64-k9qw5" (UID: "d862dade-baa3-4c0c-8f7d-606d0664ec16") : secret "image-registry-tls" not found
Jul 28 01:16:07.333003 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:07.332967    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-rqtjj" event={"ID":"aeb05ead-7e3e-4df0-b9f6-4ddd56833e54","Type":"ContainerStarted","Data":"76afe41282443733fa0f7d237135ba0367a377fb495b38f3bd21373643459eba"}
Jul 28 01:16:07.334919 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:07.334891    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7nlbl" event={"ID":"fdc9c853-3bbb-4e92-8d4f-960c02d7a125","Type":"ContainerStarted","Data":"c7abb6fa78781e7d01f85ab14c72091d6d8874c4b23066719b229a89cdf21719"}
Jul 28 01:16:07.340583 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:07.340426    2562 generic.go:356] "Generic (PLEG): container finished" podID="be2963da-12fb-4f56-8602-d54733af25e1" containerID="95f30ffcdbd9c27c45afb581a203caf68b9e89dc35268fa8527b96a721f68ad2" exitCode=0
Jul 28 01:16:07.340583 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:07.340506    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ps5b9" event={"ID":"be2963da-12fb-4f56-8602-d54733af25e1","Type":"ContainerDied","Data":"95f30ffcdbd9c27c45afb581a203caf68b9e89dc35268fa8527b96a721f68ad2"}
Jul 28 01:16:07.346590 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:07.346550    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7ts22" event={"ID":"f3813e32-ffca-4cbb-a86e-b8e33ca0f863","Type":"ContainerStarted","Data":"97f6d79b2996834d69a3cb55586b595cf3fc3a56a5006e49067a8b3c8be33380"}
Jul 28 01:16:07.348595 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:07.348551    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d4xnz" event={"ID":"d010bf4e-4f54-4204-b1f3-8813b3a4a1de","Type":"ContainerStarted","Data":"626a55b4377928b9c184833f285f5a47fa6f24143e680f6691366d7494187ba1"}
Jul 28 01:16:07.367006 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:07.363885    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vdcp5_43162e49-7fbb-42a7-9041-00ac2fbcd96d/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:07.467911 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:07.467882    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vdcp5_43162e49-7fbb-42a7-9041-00ac2fbcd96d/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:08.312420 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:08.312387    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vdcp5_43162e49-7fbb-42a7-9041-00ac2fbcd96d/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:08.356106 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:08.356073    2562 generic.go:356] "Generic (PLEG): container finished" podID="be2963da-12fb-4f56-8602-d54733af25e1" containerID="0a13cf2f7d95a219b4b550d1d4f2636b33285fba57b184c3c64b44edc8a96179" exitCode=0
Jul 28 01:16:08.356260 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:08.356149    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ps5b9" event={"ID":"be2963da-12fb-4f56-8602-d54733af25e1","Type":"ContainerDied","Data":"0a13cf2f7d95a219b4b550d1d4f2636b33285fba57b184c3c64b44edc8a96179"}
Jul 28 01:16:08.598958 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:08.598688    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adf1e90a-9fdd-438a-857d-6a271dfd94c5-metrics-tls\") pod \"dns-default-46gx9\" (UID: \"adf1e90a-9fdd-438a-857d-6a271dfd94c5\") " pod="openshift-dns/dns-default-46gx9"
Jul 28 01:16:08.599122 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:08.598958    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d862dade-baa3-4c0c-8f7d-606d0664ec16-registry-tls\") pod \"image-registry-865ff46f64-k9qw5\" (UID: \"d862dade-baa3-4c0c-8f7d-606d0664ec16\") " pod="openshift-image-registry/image-registry-865ff46f64-k9qw5"
Jul 28 01:16:08.599122 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:08.598840    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 01:16:08.599122 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:08.599090    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adf1e90a-9fdd-438a-857d-6a271dfd94c5-metrics-tls podName:adf1e90a-9fdd-438a-857d-6a271dfd94c5 nodeName:}" failed. No retries permitted until 2026-07-28 01:16:12.599031803 +0000 UTC m=+43.102793109 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adf1e90a-9fdd-438a-857d-6a271dfd94c5-metrics-tls") pod "dns-default-46gx9" (UID: "adf1e90a-9fdd-438a-857d-6a271dfd94c5") : secret "dns-default-metrics-tls" not found
Jul 28 01:16:08.599122 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:08.599114    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/acfd3678-0809-4d22-b8bf-16e381d8dbb6-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-lztg6\" (UID: \"acfd3678-0809-4d22-b8bf-16e381d8dbb6\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-lztg6"
Jul 28 01:16:08.599122 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:08.599122    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 01:16:08.599339 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:08.599136    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-865ff46f64-k9qw5: secret "image-registry-tls" not found
Jul 28 01:16:08.599339 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:08.599174    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d862dade-baa3-4c0c-8f7d-606d0664ec16-registry-tls podName:d862dade-baa3-4c0c-8f7d-606d0664ec16 nodeName:}" failed. No retries permitted until 2026-07-28 01:16:12.599162352 +0000 UTC m=+43.102923654 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d862dade-baa3-4c0c-8f7d-606d0664ec16-registry-tls") pod "image-registry-865ff46f64-k9qw5" (UID: "d862dade-baa3-4c0c-8f7d-606d0664ec16") : secret "image-registry-tls" not found
Jul 28 01:16:08.599339 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:08.599237    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 01:16:08.599339 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:08.599271    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acfd3678-0809-4d22-b8bf-16e381d8dbb6-networking-console-plugin-cert podName:acfd3678-0809-4d22-b8bf-16e381d8dbb6 nodeName:}" failed. No retries permitted until 2026-07-28 01:16:12.599263302 +0000 UTC m=+43.103024596 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/acfd3678-0809-4d22-b8bf-16e381d8dbb6-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-lztg6" (UID: "acfd3678-0809-4d22-b8bf-16e381d8dbb6") : secret "networking-console-plugin-cert" not found
Jul 28 01:16:09.362385 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:09.362352    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ps5b9" event={"ID":"be2963da-12fb-4f56-8602-d54733af25e1","Type":"ContainerStarted","Data":"6ecca0ab1c2be68c8b5a9720703a27e2b94553e912d2dd0405dff2059c1cadc6"}
Jul 28 01:16:09.382538 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:09.382490    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ps5b9" podStartSLOduration=8.869319792 podStartE2EDuration="38.382473881s" totalImagesPullingTime="29.513154089s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:15:31 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:16:09.381549907 +0000 UTC m=+39.885311219" watchObservedRunningTime="2026-07-28 01:16:09.382473881 +0000 UTC m=+39.886235194"
Jul 28 01:16:09.504354 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:09.504262    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vdcp5_43162e49-7fbb-42a7-9041-00ac2fbcd96d/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:09.558247 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:09.558221    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vdcp5_43162e49-7fbb-42a7-9041-00ac2fbcd96d/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:09.606767 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:09.606735    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vdcp5_43162e49-7fbb-42a7-9041-00ac2fbcd96d/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:10.010729 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:10.010689    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vdcp5_43162e49-7fbb-42a7-9041-00ac2fbcd96d/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:12.372776 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:12.372697    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-rqtjj" event={"ID":"aeb05ead-7e3e-4df0-b9f6-4ddd56833e54","Type":"ContainerStarted","Data":"8e94ada7724ea5b6a8c054ccee95abb06cc61543d10bb72b59beb830b7dddf54"}
Jul 28 01:16:12.374465 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:12.374437    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7nlbl" event={"ID":"fdc9c853-3bbb-4e92-8d4f-960c02d7a125","Type":"ContainerStarted","Data":"87c023e53d018e00d30042244317ee87124c6713048fa6a134b98ce587a61918"}
Jul 28 01:16:12.376713 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:12.376659    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7ts22" event={"ID":"f3813e32-ffca-4cbb-a86e-b8e33ca0f863","Type":"ContainerStarted","Data":"b3f141f9b07db34562a2726933200e9bcbd775be509a57fd16abab1d476b28d8"}
Jul 28 01:16:12.378305 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:12.378281    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d4xnz" event={"ID":"d010bf4e-4f54-4204-b1f3-8813b3a4a1de","Type":"ContainerStarted","Data":"8f9b2c1aaeb93476e2a0a9b39152a00f10e9223ebc88ee1c7a93917c2e53384e"}
Jul 28 01:16:12.399909 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:12.399852    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-rqtjj" podStartSLOduration=31.882643153 podStartE2EDuration="37.399833663s" totalImagesPullingTime="5.51719051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:15:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:16:12.38631307 +0000 UTC m=+42.890074383" watchObservedRunningTime="2026-07-28 01:16:12.399833663 +0000 UTC m=+42.903594977"
Jul 28 01:16:12.400205 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:12.400176    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7ts22" podStartSLOduration=33.880966617 podStartE2EDuration="39.400167248s" totalImagesPullingTime="5.519200631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:15:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:16:12.399981625 +0000 UTC m=+42.903742929" watchObservedRunningTime="2026-07-28 01:16:12.400167248 +0000 UTC m=+42.903928557"
Jul 28 01:16:12.421862 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:12.420815    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7nlbl" podStartSLOduration=34.919396423 podStartE2EDuration="40.420793686s" totalImagesPullingTime="5.501397263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:15:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:16:12.419356075 +0000 UTC m=+42.923117388" watchObservedRunningTime="2026-07-28 01:16:12.420793686 +0000 UTC m=+42.924554999"
Jul 28 01:16:12.433860 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:12.433801    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-d4xnz" podStartSLOduration=2.911912208 podStartE2EDuration="8.433778371s" totalImagesPullingTime="5.521866163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:16:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:16:12.433208283 +0000 UTC m=+42.936969595" watchObservedRunningTime="2026-07-28 01:16:12.433778371 +0000 UTC m=+42.937539687"
Jul 28 01:16:12.634671 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:12.634553    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/acfd3678-0809-4d22-b8bf-16e381d8dbb6-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-lztg6\" (UID: \"acfd3678-0809-4d22-b8bf-16e381d8dbb6\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-lztg6"
Jul 28 01:16:12.634855 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:12.634715    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adf1e90a-9fdd-438a-857d-6a271dfd94c5-metrics-tls\") pod \"dns-default-46gx9\" (UID: \"adf1e90a-9fdd-438a-857d-6a271dfd94c5\") " pod="openshift-dns/dns-default-46gx9"
Jul 28 01:16:12.634855 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:12.634759    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d862dade-baa3-4c0c-8f7d-606d0664ec16-registry-tls\") pod \"image-registry-865ff46f64-k9qw5\" (UID: \"d862dade-baa3-4c0c-8f7d-606d0664ec16\") " pod="openshift-image-registry/image-registry-865ff46f64-k9qw5"
Jul 28 01:16:12.634855 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:12.634716    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 01:16:12.634855 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:12.634764    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 01:16:12.634855 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:12.634831    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acfd3678-0809-4d22-b8bf-16e381d8dbb6-networking-console-plugin-cert podName:acfd3678-0809-4d22-b8bf-16e381d8dbb6 nodeName:}" failed. No retries permitted until 2026-07-28 01:16:20.634811102 +0000 UTC m=+51.138572392 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/acfd3678-0809-4d22-b8bf-16e381d8dbb6-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-lztg6" (UID: "acfd3678-0809-4d22-b8bf-16e381d8dbb6") : secret "networking-console-plugin-cert" not found
Jul 28 01:16:12.635097 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:12.634876    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 01:16:12.635097 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:12.634883    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adf1e90a-9fdd-438a-857d-6a271dfd94c5-metrics-tls podName:adf1e90a-9fdd-438a-857d-6a271dfd94c5 nodeName:}" failed. No retries permitted until 2026-07-28 01:16:20.634863851 +0000 UTC m=+51.138625166 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adf1e90a-9fdd-438a-857d-6a271dfd94c5-metrics-tls") pod "dns-default-46gx9" (UID: "adf1e90a-9fdd-438a-857d-6a271dfd94c5") : secret "dns-default-metrics-tls" not found
Jul 28 01:16:12.635097 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:12.634890    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-865ff46f64-k9qw5: secret "image-registry-tls" not found
Jul 28 01:16:12.635097 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:12.634934    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d862dade-baa3-4c0c-8f7d-606d0664ec16-registry-tls podName:d862dade-baa3-4c0c-8f7d-606d0664ec16 nodeName:}" failed. No retries permitted until 2026-07-28 01:16:20.634921366 +0000 UTC m=+51.138682657 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d862dade-baa3-4c0c-8f7d-606d0664ec16-registry-tls") pod "image-registry-865ff46f64-k9qw5" (UID: "d862dade-baa3-4c0c-8f7d-606d0664ec16") : secret "image-registry-tls" not found
Jul 28 01:16:14.076711 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:14.076676    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-268qq"]
Jul 28 01:16:14.108129 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:14.108094    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-268qq"]
Jul 28 01:16:14.108352 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:14.108227    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-268qq"
Jul 28 01:16:14.110406 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:14.110378    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 28 01:16:14.110551 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:14.110401    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 28 01:16:14.110944 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:14.110803    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-4dff8\""
Jul 28 01:16:14.247029 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:14.246987    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh6pz\" (UniqueName: \"kubernetes.io/projected/a56d4b0f-b38b-4606-b203-75dc17bf3086-kube-api-access-wh6pz\") pod \"migrator-6865c9967-268qq\" (UID: \"a56d4b0f-b38b-4606-b203-75dc17bf3086\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-268qq"
Jul 28 01:16:14.347885 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:14.347801    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh6pz\" (UniqueName: \"kubernetes.io/projected/a56d4b0f-b38b-4606-b203-75dc17bf3086-kube-api-access-wh6pz\") pod \"migrator-6865c9967-268qq\" (UID: \"a56d4b0f-b38b-4606-b203-75dc17bf3086\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-268qq"
Jul 28 01:16:14.356585 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:14.356546    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh6pz\" (UniqueName: \"kubernetes.io/projected/a56d4b0f-b38b-4606-b203-75dc17bf3086-kube-api-access-wh6pz\") pod \"migrator-6865c9967-268qq\" (UID: \"a56d4b0f-b38b-4606-b203-75dc17bf3086\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-268qq"
Jul 28 01:16:14.418190 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:14.418159    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-268qq"
Jul 28 01:16:14.550005 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:14.549973    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-268qq"]
Jul 28 01:16:14.552927 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:16:14.552901    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda56d4b0f_b38b_4606_b203_75dc17bf3086.slice/crio-073c0ce1c2253e03af7b3af6baae0eec2088a507592a4c44ad8539e332e3fcdb WatchSource:0}: Error finding container 073c0ce1c2253e03af7b3af6baae0eec2088a507592a4c44ad8539e332e3fcdb: Status 404 returned error can't find the container with id 073c0ce1c2253e03af7b3af6baae0eec2088a507592a4c44ad8539e332e3fcdb
Jul 28 01:16:15.387261 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:15.387216    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-268qq" event={"ID":"a56d4b0f-b38b-4606-b203-75dc17bf3086","Type":"ContainerStarted","Data":"073c0ce1c2253e03af7b3af6baae0eec2088a507592a4c44ad8539e332e3fcdb"}
Jul 28 01:16:15.717372 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:15.717299    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-5w7jb"]
Jul 28 01:16:15.739017 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:15.738992    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-5w7jb"]
Jul 28 01:16:15.739151 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:15.739100    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-5w7jb"
Jul 28 01:16:15.741292 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:15.741269    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 28 01:16:15.741429 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:15.741310    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 28 01:16:15.741429 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:15.741349    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 28 01:16:15.741429 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:15.741310    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 28 01:16:15.741826 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:15.741810    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-s9j7r\""
Jul 28 01:16:15.859158 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:15.859120    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2fe63b7e-fcf8-4661-a255-c1a6b5277b95-signing-key\") pod \"service-ca-658d7b7c78-5w7jb\" (UID: \"2fe63b7e-fcf8-4661-a255-c1a6b5277b95\") " pod="openshift-service-ca/service-ca-658d7b7c78-5w7jb"
Jul 28 01:16:15.859348 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:15.859200    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2fe63b7e-fcf8-4661-a255-c1a6b5277b95-signing-cabundle\") pod \"service-ca-658d7b7c78-5w7jb\" (UID: \"2fe63b7e-fcf8-4661-a255-c1a6b5277b95\") " pod="openshift-service-ca/service-ca-658d7b7c78-5w7jb"
Jul 28 01:16:15.859348 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:15.859235    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lx79n\" (UniqueName: \"kubernetes.io/projected/2fe63b7e-fcf8-4661-a255-c1a6b5277b95-kube-api-access-lx79n\") pod \"service-ca-658d7b7c78-5w7jb\" (UID: \"2fe63b7e-fcf8-4661-a255-c1a6b5277b95\") " pod="openshift-service-ca/service-ca-658d7b7c78-5w7jb"
Jul 28 01:16:15.959603 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:15.959550    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lx79n\" (UniqueName: \"kubernetes.io/projected/2fe63b7e-fcf8-4661-a255-c1a6b5277b95-kube-api-access-lx79n\") pod \"service-ca-658d7b7c78-5w7jb\" (UID: \"2fe63b7e-fcf8-4661-a255-c1a6b5277b95\") " pod="openshift-service-ca/service-ca-658d7b7c78-5w7jb"
Jul 28 01:16:15.959828 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:15.959800    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2fe63b7e-fcf8-4661-a255-c1a6b5277b95-signing-key\") pod \"service-ca-658d7b7c78-5w7jb\" (UID: \"2fe63b7e-fcf8-4661-a255-c1a6b5277b95\") " pod="openshift-service-ca/service-ca-658d7b7c78-5w7jb"
Jul 28 01:16:15.959933 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:15.959912    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2fe63b7e-fcf8-4661-a255-c1a6b5277b95-signing-cabundle\") pod \"service-ca-658d7b7c78-5w7jb\" (UID: \"2fe63b7e-fcf8-4661-a255-c1a6b5277b95\") " pod="openshift-service-ca/service-ca-658d7b7c78-5w7jb"
Jul 28 01:16:15.960710 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:15.960688    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2fe63b7e-fcf8-4661-a255-c1a6b5277b95-signing-cabundle\") pod \"service-ca-658d7b7c78-5w7jb\" (UID: \"2fe63b7e-fcf8-4661-a255-c1a6b5277b95\") " pod="openshift-service-ca/service-ca-658d7b7c78-5w7jb"
Jul 28 01:16:15.962582 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:15.962523    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2fe63b7e-fcf8-4661-a255-c1a6b5277b95-signing-key\") pod \"service-ca-658d7b7c78-5w7jb\" (UID: \"2fe63b7e-fcf8-4661-a255-c1a6b5277b95\") " pod="openshift-service-ca/service-ca-658d7b7c78-5w7jb"
Jul 28 01:16:15.967343 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:15.967319    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lx79n\" (UniqueName: \"kubernetes.io/projected/2fe63b7e-fcf8-4661-a255-c1a6b5277b95-kube-api-access-lx79n\") pod \"service-ca-658d7b7c78-5w7jb\" (UID: \"2fe63b7e-fcf8-4661-a255-c1a6b5277b95\") " pod="openshift-service-ca/service-ca-658d7b7c78-5w7jb"
Jul 28 01:16:16.047837 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:16.047775    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-5w7jb"
Jul 28 01:16:16.179726 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:16.179698    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-5w7jb"]
Jul 28 01:16:16.182527 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:16:16.182503    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fe63b7e_fcf8_4661_a255_c1a6b5277b95.slice/crio-3e37991a6ab5047953a38658faaaba7880c6e96056ea4171b6376cc2ac6caff0 WatchSource:0}: Error finding container 3e37991a6ab5047953a38658faaaba7880c6e96056ea4171b6376cc2ac6caff0: Status 404 returned error can't find the container with id 3e37991a6ab5047953a38658faaaba7880c6e96056ea4171b6376cc2ac6caff0
Jul 28 01:16:16.391455 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:16.391420    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-5w7jb" event={"ID":"2fe63b7e-fcf8-4661-a255-c1a6b5277b95","Type":"ContainerStarted","Data":"6627cecfd872ca76f877b8cfa6003544d19f96c884d9bf123ccd06857e6aecf1"}
Jul 28 01:16:16.391879 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:16.391468    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-5w7jb" event={"ID":"2fe63b7e-fcf8-4661-a255-c1a6b5277b95","Type":"ContainerStarted","Data":"3e37991a6ab5047953a38658faaaba7880c6e96056ea4171b6376cc2ac6caff0"}
Jul 28 01:16:16.408981 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:16.408933    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-5w7jb" podStartSLOduration=1.4089149650000001 podStartE2EDuration="1.408914965s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:16:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:16:16.407871326 +0000 UTC m=+46.911632638" watchObservedRunningTime="2026-07-28 01:16:16.408914965 +0000 UTC m=+46.912676278"
Jul 28 01:16:17.398064 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:17.398024    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-268qq" event={"ID":"a56d4b0f-b38b-4606-b203-75dc17bf3086","Type":"ContainerStarted","Data":"f8b12b93e7d97130f49214dae975d1f6c1bca5876f3d6bf35b67cb955464b18c"}
Jul 28 01:16:17.398531 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:17.398092    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-268qq" event={"ID":"a56d4b0f-b38b-4606-b203-75dc17bf3086","Type":"ContainerStarted","Data":"e3f735261efab6197511bf1a34564fb8c3993432d7f57fd06faae4caadeffda6"}
Jul 28 01:16:17.417842 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:17.417795    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-268qq" podStartSLOduration=1.527291332 podStartE2EDuration="3.417781036s" totalImagesPullingTime="1.890489704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:16:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:16:17.416947539 +0000 UTC m=+47.920708852" watchObservedRunningTime="2026-07-28 01:16:17.417781036 +0000 UTC m=+47.921542350"
Jul 28 01:16:20.701410 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:20.701369    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/acfd3678-0809-4d22-b8bf-16e381d8dbb6-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-lztg6\" (UID: \"acfd3678-0809-4d22-b8bf-16e381d8dbb6\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-lztg6"
Jul 28 01:16:20.701851 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:20.701423    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adf1e90a-9fdd-438a-857d-6a271dfd94c5-metrics-tls\") pod \"dns-default-46gx9\" (UID: \"adf1e90a-9fdd-438a-857d-6a271dfd94c5\") " pod="openshift-dns/dns-default-46gx9"
Jul 28 01:16:20.701851 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:20.701443    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d862dade-baa3-4c0c-8f7d-606d0664ec16-registry-tls\") pod \"image-registry-865ff46f64-k9qw5\" (UID: \"d862dade-baa3-4c0c-8f7d-606d0664ec16\") " pod="openshift-image-registry/image-registry-865ff46f64-k9qw5"
Jul 28 01:16:20.701851 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:20.701542    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 01:16:20.701851 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:20.701553    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-865ff46f64-k9qw5: secret "image-registry-tls" not found
Jul 28 01:16:20.701851 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:20.701551    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 01:16:20.701851 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:20.701591    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 01:16:20.701851 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:20.701626    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d862dade-baa3-4c0c-8f7d-606d0664ec16-registry-tls podName:d862dade-baa3-4c0c-8f7d-606d0664ec16 nodeName:}" failed. No retries permitted until 2026-07-28 01:16:36.701612921 +0000 UTC m=+67.205374215 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d862dade-baa3-4c0c-8f7d-606d0664ec16-registry-tls") pod "image-registry-865ff46f64-k9qw5" (UID: "d862dade-baa3-4c0c-8f7d-606d0664ec16") : secret "image-registry-tls" not found
Jul 28 01:16:20.701851 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:20.701638    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adf1e90a-9fdd-438a-857d-6a271dfd94c5-metrics-tls podName:adf1e90a-9fdd-438a-857d-6a271dfd94c5 nodeName:}" failed. No retries permitted until 2026-07-28 01:16:36.701632906 +0000 UTC m=+67.205394196 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adf1e90a-9fdd-438a-857d-6a271dfd94c5-metrics-tls") pod "dns-default-46gx9" (UID: "adf1e90a-9fdd-438a-857d-6a271dfd94c5") : secret "dns-default-metrics-tls" not found
Jul 28 01:16:20.701851 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:20.701649    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acfd3678-0809-4d22-b8bf-16e381d8dbb6-networking-console-plugin-cert podName:acfd3678-0809-4d22-b8bf-16e381d8dbb6 nodeName:}" failed. No retries permitted until 2026-07-28 01:16:36.70164258 +0000 UTC m=+67.205403871 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/acfd3678-0809-4d22-b8bf-16e381d8dbb6-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-lztg6" (UID: "acfd3678-0809-4d22-b8bf-16e381d8dbb6") : secret "networking-console-plugin-cert" not found
Jul 28 01:16:31.333022 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:31.332994    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rrlwz"
Jul 28 01:16:35.338903 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.338872    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-68846f4bbc-fggv8"]
Jul 28 01:16:35.341532 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.341510    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68846f4bbc-fggv8"
Jul 28 01:16:35.343363 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.343337    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-xpwwg"]
Jul 28 01:16:35.345172 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.345146    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 28 01:16:35.345445 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.345426    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 28 01:16:35.345710 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.345689    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 28 01:16:35.345974 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.345954    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 28 01:16:35.347306 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.347286    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-xpwwg"
Jul 28 01:16:35.350034 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.350013    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-7fwq6\""
Jul 28 01:16:35.350133 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.350033    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 28 01:16:35.350307 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.350291    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 28 01:16:35.350443 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.350428    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 28 01:16:35.358266 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.358246    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-68846f4bbc-fggv8"]
Jul 28 01:16:35.360897 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.360875    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-xpwwg"]
Jul 28 01:16:35.389395 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.389370    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c575c46d-7bccf"]
Jul 28 01:16:35.392441 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.392422    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c575c46d-7bccf"
Jul 28 01:16:35.394463 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.394447    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-pzkg4\""
Jul 28 01:16:35.394585 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.394569    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 28 01:16:35.405832 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.405815    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c575c46d-7bccf"]
Jul 28 01:16:35.416010 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.415986    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n8sw\" (UniqueName: \"kubernetes.io/projected/1b99408c-3436-4038-b350-302d39796be6-kube-api-access-5n8sw\") pod \"klusterlet-addon-workmgr-68846f4bbc-fggv8\" (UID: \"1b99408c-3436-4038-b350-302d39796be6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68846f4bbc-fggv8"
Jul 28 01:16:35.416090 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.416026    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1b99408c-3436-4038-b350-302d39796be6-tmp\") pod \"klusterlet-addon-workmgr-68846f4bbc-fggv8\" (UID: \"1b99408c-3436-4038-b350-302d39796be6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68846f4bbc-fggv8"
Jul 28 01:16:35.416130 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.416097    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1b99408c-3436-4038-b350-302d39796be6-klusterlet-config\") pod \"klusterlet-addon-workmgr-68846f4bbc-fggv8\" (UID: \"1b99408c-3436-4038-b350-302d39796be6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68846f4bbc-fggv8"
Jul 28 01:16:35.416168 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.416127    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw2sn\" (UniqueName: \"kubernetes.io/projected/b8f1acac-bed7-4134-952e-a8cd66f119f2-kube-api-access-gw2sn\") pod \"cluster-samples-operator-6748489656-xpwwg\" (UID: \"b8f1acac-bed7-4134-952e-a8cd66f119f2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-xpwwg"
Jul 28 01:16:35.416168 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.416159    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b8f1acac-bed7-4134-952e-a8cd66f119f2-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-xpwwg\" (UID: \"b8f1acac-bed7-4134-952e-a8cd66f119f2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-xpwwg"
Jul 28 01:16:35.430036 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.429999    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-bkmjd"]
Jul 28 01:16:35.431852 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.431835    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646db4fd47-8w5wr"]
Jul 28 01:16:35.432034 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.432017    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-bkmjd"
Jul 28 01:16:35.433701 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.433684    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-sdkzl"]
Jul 28 01:16:35.433880 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.433862    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646db4fd47-8w5wr"
Jul 28 01:16:35.434464 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.434445    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-v5wgh\""
Jul 28 01:16:35.434704 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.434688    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 28 01:16:35.435445 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.435426    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 28 01:16:35.435694 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.435678    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-dcb5f"]
Jul 28 01:16:35.435808 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.435790    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-sdkzl"
Jul 28 01:16:35.436158 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.436134    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 28 01:16:35.436824 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.436804    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 28 01:16:35.436914 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.436868    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 28 01:16:35.437142 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.437125    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 28 01:16:35.437496 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.437478    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6767b674f-cvttp"]
Jul 28 01:16:35.437622 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.437603    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-dcb5f"
Jul 28 01:16:35.440495 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.440478    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6767b674f-cvttp"
Jul 28 01:16:35.440598 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.440586    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 28 01:16:35.441119 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.441101    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 28 01:16:35.441204 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.441109    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 28 01:16:35.441278 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.441210    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 28 01:16:35.441278 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.441256    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rsd6g\""
Jul 28 01:16:35.442330 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.442306    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-2cb9c\""
Jul 28 01:16:35.442448 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.442382    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 28 01:16:35.442509 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.442453    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 28 01:16:35.442509 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.442381    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 28 01:16:35.442509 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.442481    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 28 01:16:35.442964 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.442942    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 28 01:16:35.443066 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.443052    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 28 01:16:35.443130 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.443105    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 28 01:16:35.445472 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.445455    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 28 01:16:35.445623 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.445607    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 28 01:16:35.445777 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.445742    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-hxb7l\""
Jul 28 01:16:35.446355 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.446337    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 28 01:16:35.450934 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.450698    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-bkmjd"]
Jul 28 01:16:35.452371 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.452347    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 28 01:16:35.452622 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.452501    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-sdkzl"]
Jul 28 01:16:35.454145 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.454123    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646db4fd47-8w5wr"]
Jul 28 01:16:35.455355 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.455335    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-dcb5f"]
Jul 28 01:16:35.456752 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.456728    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6767b674f-cvttp"]
Jul 28 01:16:35.517388 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.517345    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1b99408c-3436-4038-b350-302d39796be6-tmp\") pod \"klusterlet-addon-workmgr-68846f4bbc-fggv8\" (UID: \"1b99408c-3436-4038-b350-302d39796be6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68846f4bbc-fggv8"
Jul 28 01:16:35.517388 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.517379    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5hz2\" (UniqueName: \"kubernetes.io/projected/09603ca6-faf1-449e-b871-a9fe15fd6411-kube-api-access-x5hz2\") pod \"router-default-6767b674f-cvttp\" (UID: \"09603ca6-faf1-449e-b871-a9fe15fd6411\") " pod="openshift-ingress/router-default-6767b674f-cvttp"
Jul 28 01:16:35.517688 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.517426    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78fxs\" (UniqueName: \"kubernetes.io/projected/b470019c-195f-4424-b515-24221e2b6383-kube-api-access-78fxs\") pod \"managed-serviceaccount-addon-agent-65c575c46d-7bccf\" (UID: \"b470019c-195f-4424-b515-24221e2b6383\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c575c46d-7bccf"
Jul 28 01:16:35.517688 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.517451    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1a1b981c-e037-413c-93c0-de9a1678dbfa-ca\") pod \"cluster-proxy-proxy-agent-646db4fd47-8w5wr\" (UID: \"1a1b981c-e037-413c-93c0-de9a1678dbfa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646db4fd47-8w5wr"
Jul 28 01:16:35.517688 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.517468    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkgpq\" (UniqueName: \"kubernetes.io/projected/e47369d7-9c2f-44a0-a162-205a9cdea9ad-kube-api-access-qkgpq\") pod \"cluster-monitoring-operator-548b489cb8-sdkzl\" (UID: \"e47369d7-9c2f-44a0-a162-205a9cdea9ad\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-sdkzl"
Jul 28 01:16:35.517688 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.517488    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1b99408c-3436-4038-b350-302d39796be6-klusterlet-config\") pod \"klusterlet-addon-workmgr-68846f4bbc-fggv8\" (UID: \"1b99408c-3436-4038-b350-302d39796be6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68846f4bbc-fggv8"
Jul 28 01:16:35.517688 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.517512    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/889bce92-e710-4e62-8b8f-e2d78a8489a8-snapshots\") pod \"insights-operator-5885fdb759-dcb5f\" (UID: \"889bce92-e710-4e62-8b8f-e2d78a8489a8\") " pod="openshift-insights/insights-operator-5885fdb759-dcb5f"
Jul 28 01:16:35.517688 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.517667    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/889bce92-e710-4e62-8b8f-e2d78a8489a8-tmp\") pod \"insights-operator-5885fdb759-dcb5f\" (UID: \"889bce92-e710-4e62-8b8f-e2d78a8489a8\") " pod="openshift-insights/insights-operator-5885fdb759-dcb5f"
Jul 28 01:16:35.517974 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.517715    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/889bce92-e710-4e62-8b8f-e2d78a8489a8-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-dcb5f\" (UID: \"889bce92-e710-4e62-8b8f-e2d78a8489a8\") " pod="openshift-insights/insights-operator-5885fdb759-dcb5f"
Jul 28 01:16:35.517974 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.517763    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09603ca6-faf1-449e-b871-a9fe15fd6411-service-ca-bundle\") pod \"router-default-6767b674f-cvttp\" (UID: \"09603ca6-faf1-449e-b871-a9fe15fd6411\") " pod="openshift-ingress/router-default-6767b674f-cvttp"
Jul 28 01:16:35.517974 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.517780    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1b99408c-3436-4038-b350-302d39796be6-tmp\") pod \"klusterlet-addon-workmgr-68846f4bbc-fggv8\" (UID: \"1b99408c-3436-4038-b350-302d39796be6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68846f4bbc-fggv8"
Jul 28 01:16:35.517974 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.517808    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm8wm\" (UniqueName: \"kubernetes.io/projected/889bce92-e710-4e62-8b8f-e2d78a8489a8-kube-api-access-tm8wm\") pod \"insights-operator-5885fdb759-dcb5f\" (UID: \"889bce92-e710-4e62-8b8f-e2d78a8489a8\") " pod="openshift-insights/insights-operator-5885fdb759-dcb5f"
Jul 28 01:16:35.517974 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.517846    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m22t\" (UniqueName: \"kubernetes.io/projected/1a1b981c-e037-413c-93c0-de9a1678dbfa-kube-api-access-9m22t\") pod \"cluster-proxy-proxy-agent-646db4fd47-8w5wr\" (UID: \"1a1b981c-e037-413c-93c0-de9a1678dbfa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646db4fd47-8w5wr"
Jul 28 01:16:35.517974 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.517912    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1a1b981c-e037-413c-93c0-de9a1678dbfa-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-646db4fd47-8w5wr\" (UID: \"1a1b981c-e037-413c-93c0-de9a1678dbfa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646db4fd47-8w5wr"
Jul 28 01:16:35.517974 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.517949    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw2sn\" (UniqueName: \"kubernetes.io/projected/b8f1acac-bed7-4134-952e-a8cd66f119f2-kube-api-access-gw2sn\") pod \"cluster-samples-operator-6748489656-xpwwg\" (UID: \"b8f1acac-bed7-4134-952e-a8cd66f119f2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-xpwwg"
Jul 28 01:16:35.518263 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.517977    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e47369d7-9c2f-44a0-a162-205a9cdea9ad-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-sdkzl\" (UID: \"e47369d7-9c2f-44a0-a162-205a9cdea9ad\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-sdkzl"
Jul 28 01:16:35.518263 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.518016    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1a1b981c-e037-413c-93c0-de9a1678dbfa-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-646db4fd47-8w5wr\" (UID: \"1a1b981c-e037-413c-93c0-de9a1678dbfa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646db4fd47-8w5wr"
Jul 28 01:16:35.518263 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.518039    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09603ca6-faf1-449e-b871-a9fe15fd6411-metrics-certs\") pod \"router-default-6767b674f-cvttp\" (UID: \"09603ca6-faf1-449e-b871-a9fe15fd6411\") " pod="openshift-ingress/router-default-6767b674f-cvttp"
Jul 28 01:16:35.518263 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.518072    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b8f1acac-bed7-4134-952e-a8cd66f119f2-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-xpwwg\" (UID: \"b8f1acac-bed7-4134-952e-a8cd66f119f2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-xpwwg"
Jul 28 01:16:35.518263 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.518096    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/889bce92-e710-4e62-8b8f-e2d78a8489a8-serving-cert\") pod \"insights-operator-5885fdb759-dcb5f\" (UID: \"889bce92-e710-4e62-8b8f-e2d78a8489a8\") " pod="openshift-insights/insights-operator-5885fdb759-dcb5f"
Jul 28 01:16:35.518263 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.518165    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a1b981c-e037-413c-93c0-de9a1678dbfa-additional-service-ca\") pod \"cluster-proxy-proxy-agent-646db4fd47-8w5wr\" (UID: \"1a1b981c-e037-413c-93c0-de9a1678dbfa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646db4fd47-8w5wr"
Jul 28 01:16:35.518709 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.518288    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n8sw\" (UniqueName: \"kubernetes.io/projected/1b99408c-3436-4038-b350-302d39796be6-kube-api-access-5n8sw\") pod \"klusterlet-addon-workmgr-68846f4bbc-fggv8\" (UID: \"1b99408c-3436-4038-b350-302d39796be6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68846f4bbc-fggv8"
Jul 28 01:16:35.518709 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.518313    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/889bce92-e710-4e62-8b8f-e2d78a8489a8-service-ca-bundle\") pod \"insights-operator-5885fdb759-dcb5f\" (UID: \"889bce92-e710-4e62-8b8f-e2d78a8489a8\") " pod="openshift-insights/insights-operator-5885fdb759-dcb5f"
Jul 28 01:16:35.518709 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.518354    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e47369d7-9c2f-44a0-a162-205a9cdea9ad-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-sdkzl\" (UID: \"e47369d7-9c2f-44a0-a162-205a9cdea9ad\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-sdkzl"
Jul 28 01:16:35.518709 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.518395    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1a1b981c-e037-413c-93c0-de9a1678dbfa-hub\") pod \"cluster-proxy-proxy-agent-646db4fd47-8w5wr\" (UID: \"1a1b981c-e037-413c-93c0-de9a1678dbfa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646db4fd47-8w5wr"
Jul 28 01:16:35.518709 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.518447    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/09603ca6-faf1-449e-b871-a9fe15fd6411-stats-auth\") pod \"router-default-6767b674f-cvttp\" (UID: \"09603ca6-faf1-449e-b871-a9fe15fd6411\") " pod="openshift-ingress/router-default-6767b674f-cvttp"
Jul 28 01:16:35.518709 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.518497    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b470019c-195f-4424-b515-24221e2b6383-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-65c575c46d-7bccf\" (UID: \"b470019c-195f-4424-b515-24221e2b6383\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c575c46d-7bccf"
Jul 28 01:16:35.518709 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.518598    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9v6r\" (UniqueName: \"kubernetes.io/projected/14a474d7-483d-4aab-8115-37636c73d0fe-kube-api-access-c9v6r\") pod \"volume-data-source-validator-549c6d54cf-bkmjd\" (UID: \"14a474d7-483d-4aab-8115-37636c73d0fe\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-bkmjd"
Jul 28 01:16:35.518709 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.518636    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/09603ca6-faf1-449e-b871-a9fe15fd6411-default-certificate\") pod \"router-default-6767b674f-cvttp\" (UID: \"09603ca6-faf1-449e-b871-a9fe15fd6411\") " pod="openshift-ingress/router-default-6767b674f-cvttp"
Jul 28 01:16:35.519964 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.519943    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1b99408c-3436-4038-b350-302d39796be6-klusterlet-config\") pod \"klusterlet-addon-workmgr-68846f4bbc-fggv8\" (UID: \"1b99408c-3436-4038-b350-302d39796be6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68846f4bbc-fggv8"
Jul 28 01:16:35.520369 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.520352    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b8f1acac-bed7-4134-952e-a8cd66f119f2-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-xpwwg\" (UID: \"b8f1acac-bed7-4134-952e-a8cd66f119f2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-xpwwg"
Jul 28 01:16:35.533630 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.533603    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n8sw\" (UniqueName: \"kubernetes.io/projected/1b99408c-3436-4038-b350-302d39796be6-kube-api-access-5n8sw\") pod \"klusterlet-addon-workmgr-68846f4bbc-fggv8\" (UID: \"1b99408c-3436-4038-b350-302d39796be6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68846f4bbc-fggv8"
Jul 28 01:16:35.533709 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.533642    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw2sn\" (UniqueName: \"kubernetes.io/projected/b8f1acac-bed7-4134-952e-a8cd66f119f2-kube-api-access-gw2sn\") pod \"cluster-samples-operator-6748489656-xpwwg\" (UID: \"b8f1acac-bed7-4134-952e-a8cd66f119f2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-xpwwg"
Jul 28 01:16:35.618986 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.618953    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1a1b981c-e037-413c-93c0-de9a1678dbfa-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-646db4fd47-8w5wr\" (UID: \"1a1b981c-e037-413c-93c0-de9a1678dbfa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646db4fd47-8w5wr"
Jul 28 01:16:35.619120 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.618988    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09603ca6-faf1-449e-b871-a9fe15fd6411-metrics-certs\") pod \"router-default-6767b674f-cvttp\" (UID: \"09603ca6-faf1-449e-b871-a9fe15fd6411\") " pod="openshift-ingress/router-default-6767b674f-cvttp"
Jul 28 01:16:35.619120 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.619013    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/889bce92-e710-4e62-8b8f-e2d78a8489a8-serving-cert\") pod \"insights-operator-5885fdb759-dcb5f\" (UID: \"889bce92-e710-4e62-8b8f-e2d78a8489a8\") " pod="openshift-insights/insights-operator-5885fdb759-dcb5f"
Jul 28 01:16:35.619120 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.619086    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a1b981c-e037-413c-93c0-de9a1678dbfa-additional-service-ca\") pod \"cluster-proxy-proxy-agent-646db4fd47-8w5wr\" (UID: \"1a1b981c-e037-413c-93c0-de9a1678dbfa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646db4fd47-8w5wr"
Jul 28 01:16:35.619234 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.619140    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/889bce92-e710-4e62-8b8f-e2d78a8489a8-service-ca-bundle\") pod \"insights-operator-5885fdb759-dcb5f\" (UID: \"889bce92-e710-4e62-8b8f-e2d78a8489a8\") " pod="openshift-insights/insights-operator-5885fdb759-dcb5f"
Jul 28 01:16:35.619234 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.619182    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e47369d7-9c2f-44a0-a162-205a9cdea9ad-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-sdkzl\" (UID: \"e47369d7-9c2f-44a0-a162-205a9cdea9ad\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-sdkzl"
Jul 28 01:16:35.619332 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.619310    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1a1b981c-e037-413c-93c0-de9a1678dbfa-hub\") pod \"cluster-proxy-proxy-agent-646db4fd47-8w5wr\" (UID: \"1a1b981c-e037-413c-93c0-de9a1678dbfa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646db4fd47-8w5wr"
Jul 28 01:16:35.619384 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.619335    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/09603ca6-faf1-449e-b871-a9fe15fd6411-stats-auth\") pod \"router-default-6767b674f-cvttp\" (UID: \"09603ca6-faf1-449e-b871-a9fe15fd6411\") " pod="openshift-ingress/router-default-6767b674f-cvttp"
Jul 28 01:16:35.619384 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.619358    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b470019c-195f-4424-b515-24221e2b6383-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-65c575c46d-7bccf\" (UID: \"b470019c-195f-4424-b515-24221e2b6383\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c575c46d-7bccf"
Jul 28 01:16:35.619484 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.619383    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9v6r\" (UniqueName: \"kubernetes.io/projected/14a474d7-483d-4aab-8115-37636c73d0fe-kube-api-access-c9v6r\") pod \"volume-data-source-validator-549c6d54cf-bkmjd\" (UID: \"14a474d7-483d-4aab-8115-37636c73d0fe\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-bkmjd"
Jul 28 01:16:35.619484 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.619407    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/09603ca6-faf1-449e-b871-a9fe15fd6411-default-certificate\") pod \"router-default-6767b674f-cvttp\" (UID: \"09603ca6-faf1-449e-b871-a9fe15fd6411\") " pod="openshift-ingress/router-default-6767b674f-cvttp"
Jul 28 01:16:35.619484 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.619435    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5hz2\" (UniqueName: \"kubernetes.io/projected/09603ca6-faf1-449e-b871-a9fe15fd6411-kube-api-access-x5hz2\") pod \"router-default-6767b674f-cvttp\" (UID: \"09603ca6-faf1-449e-b871-a9fe15fd6411\") " pod="openshift-ingress/router-default-6767b674f-cvttp"
Jul 28 01:16:35.619676 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.619515    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78fxs\" (UniqueName: \"kubernetes.io/projected/b470019c-195f-4424-b515-24221e2b6383-kube-api-access-78fxs\") pod \"managed-serviceaccount-addon-agent-65c575c46d-7bccf\" (UID: \"b470019c-195f-4424-b515-24221e2b6383\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c575c46d-7bccf"
Jul 28 01:16:35.619676 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.619543    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1a1b981c-e037-413c-93c0-de9a1678dbfa-ca\") pod \"cluster-proxy-proxy-agent-646db4fd47-8w5wr\" (UID: \"1a1b981c-e037-413c-93c0-de9a1678dbfa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646db4fd47-8w5wr"
Jul 28 01:16:35.619676 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.619584    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkgpq\" (UniqueName: \"kubernetes.io/projected/e47369d7-9c2f-44a0-a162-205a9cdea9ad-kube-api-access-qkgpq\") pod \"cluster-monitoring-operator-548b489cb8-sdkzl\" (UID: \"e47369d7-9c2f-44a0-a162-205a9cdea9ad\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-sdkzl"
Jul 28 01:16:35.619676 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.619620    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/889bce92-e710-4e62-8b8f-e2d78a8489a8-snapshots\") pod \"insights-operator-5885fdb759-dcb5f\" (UID: \"889bce92-e710-4e62-8b8f-e2d78a8489a8\") " pod="openshift-insights/insights-operator-5885fdb759-dcb5f"
Jul 28 01:16:35.619676 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.619647    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/889bce92-e710-4e62-8b8f-e2d78a8489a8-tmp\") pod \"insights-operator-5885fdb759-dcb5f\" (UID: \"889bce92-e710-4e62-8b8f-e2d78a8489a8\") " pod="openshift-insights/insights-operator-5885fdb759-dcb5f"
Jul 28 01:16:35.619676 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.619671    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/889bce92-e710-4e62-8b8f-e2d78a8489a8-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-dcb5f\" (UID: \"889bce92-e710-4e62-8b8f-e2d78a8489a8\") " pod="openshift-insights/insights-operator-5885fdb759-dcb5f"
Jul 28 01:16:35.619961 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.619694    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09603ca6-faf1-449e-b871-a9fe15fd6411-service-ca-bundle\") pod \"router-default-6767b674f-cvttp\" (UID: \"09603ca6-faf1-449e-b871-a9fe15fd6411\") " pod="openshift-ingress/router-default-6767b674f-cvttp"
Jul 28 01:16:35.619961 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.619742    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm8wm\" (UniqueName: \"kubernetes.io/projected/889bce92-e710-4e62-8b8f-e2d78a8489a8-kube-api-access-tm8wm\") pod \"insights-operator-5885fdb759-dcb5f\" (UID: \"889bce92-e710-4e62-8b8f-e2d78a8489a8\") " pod="openshift-insights/insights-operator-5885fdb759-dcb5f"
Jul 28 01:16:35.619961 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.619770    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m22t\" (UniqueName: \"kubernetes.io/projected/1a1b981c-e037-413c-93c0-de9a1678dbfa-kube-api-access-9m22t\") pod \"cluster-proxy-proxy-agent-646db4fd47-8w5wr\" (UID: \"1a1b981c-e037-413c-93c0-de9a1678dbfa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646db4fd47-8w5wr"
Jul 28 01:16:35.619961 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.619803    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1a1b981c-e037-413c-93c0-de9a1678dbfa-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-646db4fd47-8w5wr\" (UID: \"1a1b981c-e037-413c-93c0-de9a1678dbfa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646db4fd47-8w5wr"
Jul 28 01:16:35.619961 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.619847    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e47369d7-9c2f-44a0-a162-205a9cdea9ad-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-sdkzl\" (UID: \"e47369d7-9c2f-44a0-a162-205a9cdea9ad\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-sdkzl"
Jul 28 01:16:35.619961 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.619895    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a1b981c-e037-413c-93c0-de9a1678dbfa-additional-service-ca\") pod \"cluster-proxy-proxy-agent-646db4fd47-8w5wr\" (UID: \"1a1b981c-e037-413c-93c0-de9a1678dbfa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646db4fd47-8w5wr"
Jul 28 01:16:35.620321 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.620283    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/889bce92-e710-4e62-8b8f-e2d78a8489a8-tmp\") pod \"insights-operator-5885fdb759-dcb5f\" (UID: \"889bce92-e710-4e62-8b8f-e2d78a8489a8\") " pod="openshift-insights/insights-operator-5885fdb759-dcb5f"
Jul 28 01:16:35.621701 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.621097    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/889bce92-e710-4e62-8b8f-e2d78a8489a8-service-ca-bundle\") pod \"insights-operator-5885fdb759-dcb5f\" (UID: \"889bce92-e710-4e62-8b8f-e2d78a8489a8\") " pod="openshift-insights/insights-operator-5885fdb759-dcb5f"
Jul 28 01:16:35.621701 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.621123    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/889bce92-e710-4e62-8b8f-e2d78a8489a8-snapshots\") pod \"insights-operator-5885fdb759-dcb5f\" (UID: \"889bce92-e710-4e62-8b8f-e2d78a8489a8\") " pod="openshift-insights/insights-operator-5885fdb759-dcb5f"
Jul 28 01:16:35.623773 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.621785    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09603ca6-faf1-449e-b871-a9fe15fd6411-service-ca-bundle\") pod \"router-default-6767b674f-cvttp\" (UID: \"09603ca6-faf1-449e-b871-a9fe15fd6411\") " pod="openshift-ingress/router-default-6767b674f-cvttp"
Jul 28 01:16:35.623773 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.622190    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/889bce92-e710-4e62-8b8f-e2d78a8489a8-serving-cert\") pod \"insights-operator-5885fdb759-dcb5f\" (UID: \"889bce92-e710-4e62-8b8f-e2d78a8489a8\") " pod="openshift-insights/insights-operator-5885fdb759-dcb5f"
Jul 28 01:16:35.623773 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.622656    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e47369d7-9c2f-44a0-a162-205a9cdea9ad-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-sdkzl\" (UID: \"e47369d7-9c2f-44a0-a162-205a9cdea9ad\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-sdkzl"
Jul 28 01:16:35.623773 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.623044    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e47369d7-9c2f-44a0-a162-205a9cdea9ad-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-sdkzl\" (UID: \"e47369d7-9c2f-44a0-a162-205a9cdea9ad\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-sdkzl"
Jul 28 01:16:35.623773 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.623087    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1a1b981c-e037-413c-93c0-de9a1678dbfa-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-646db4fd47-8w5wr\" (UID: \"1a1b981c-e037-413c-93c0-de9a1678dbfa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646db4fd47-8w5wr"
Jul 28 01:16:35.623773 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.623578    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09603ca6-faf1-449e-b871-a9fe15fd6411-metrics-certs\") pod \"router-default-6767b674f-cvttp\" (UID: \"09603ca6-faf1-449e-b871-a9fe15fd6411\") " pod="openshift-ingress/router-default-6767b674f-cvttp"
Jul 28 01:16:35.624054 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.623829    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1a1b981c-e037-413c-93c0-de9a1678dbfa-ca\") pod \"cluster-proxy-proxy-agent-646db4fd47-8w5wr\" (UID: \"1a1b981c-e037-413c-93c0-de9a1678dbfa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646db4fd47-8w5wr"
Jul 28 01:16:35.624177 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.624155    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/09603ca6-faf1-449e-b871-a9fe15fd6411-default-certificate\") pod \"router-default-6767b674f-cvttp\" (UID: \"09603ca6-faf1-449e-b871-a9fe15fd6411\") " pod="openshift-ingress/router-default-6767b674f-cvttp"
Jul 28 01:16:35.624279 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.624260    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1a1b981c-e037-413c-93c0-de9a1678dbfa-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-646db4fd47-8w5wr\" (UID: \"1a1b981c-e037-413c-93c0-de9a1678dbfa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646db4fd47-8w5wr"
Jul 28 01:16:35.624370 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.624349    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/889bce92-e710-4e62-8b8f-e2d78a8489a8-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-dcb5f\" (UID: \"889bce92-e710-4e62-8b8f-e2d78a8489a8\") " pod="openshift-insights/insights-operator-5885fdb759-dcb5f"
Jul 28 01:16:35.624506 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.624488    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b470019c-195f-4424-b515-24221e2b6383-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-65c575c46d-7bccf\" (UID: \"b470019c-195f-4424-b515-24221e2b6383\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c575c46d-7bccf"
Jul 28 01:16:35.624849 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.624830    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1a1b981c-e037-413c-93c0-de9a1678dbfa-hub\") pod \"cluster-proxy-proxy-agent-646db4fd47-8w5wr\" (UID: \"1a1b981c-e037-413c-93c0-de9a1678dbfa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646db4fd47-8w5wr"
Jul 28 01:16:35.625203 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.625184    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/09603ca6-faf1-449e-b871-a9fe15fd6411-stats-auth\") pod \"router-default-6767b674f-cvttp\" (UID: \"09603ca6-faf1-449e-b871-a9fe15fd6411\") " pod="openshift-ingress/router-default-6767b674f-cvttp"
Jul 28 01:16:35.633422 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.633402    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5hz2\" (UniqueName: \"kubernetes.io/projected/09603ca6-faf1-449e-b871-a9fe15fd6411-kube-api-access-x5hz2\") pod \"router-default-6767b674f-cvttp\" (UID: \"09603ca6-faf1-449e-b871-a9fe15fd6411\") " pod="openshift-ingress/router-default-6767b674f-cvttp"
Jul 28 01:16:35.642669 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.642641    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78fxs\" (UniqueName: \"kubernetes.io/projected/b470019c-195f-4424-b515-24221e2b6383-kube-api-access-78fxs\") pod \"managed-serviceaccount-addon-agent-65c575c46d-7bccf\" (UID: \"b470019c-195f-4424-b515-24221e2b6383\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c575c46d-7bccf"
Jul 28 01:16:35.643120 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.643101    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m22t\" (UniqueName: \"kubernetes.io/projected/1a1b981c-e037-413c-93c0-de9a1678dbfa-kube-api-access-9m22t\") pod \"cluster-proxy-proxy-agent-646db4fd47-8w5wr\" (UID: \"1a1b981c-e037-413c-93c0-de9a1678dbfa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646db4fd47-8w5wr"
Jul 28 01:16:35.643207 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.643160    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9v6r\" (UniqueName: \"kubernetes.io/projected/14a474d7-483d-4aab-8115-37636c73d0fe-kube-api-access-c9v6r\") pod \"volume-data-source-validator-549c6d54cf-bkmjd\" (UID: \"14a474d7-483d-4aab-8115-37636c73d0fe\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-bkmjd"
Jul 28 01:16:35.643389 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.643366    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm8wm\" (UniqueName: \"kubernetes.io/projected/889bce92-e710-4e62-8b8f-e2d78a8489a8-kube-api-access-tm8wm\") pod \"insights-operator-5885fdb759-dcb5f\" (UID: \"889bce92-e710-4e62-8b8f-e2d78a8489a8\") " pod="openshift-insights/insights-operator-5885fdb759-dcb5f"
Jul 28 01:16:35.643444 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.643368    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkgpq\" (UniqueName: \"kubernetes.io/projected/e47369d7-9c2f-44a0-a162-205a9cdea9ad-kube-api-access-qkgpq\") pod \"cluster-monitoring-operator-548b489cb8-sdkzl\" (UID: \"e47369d7-9c2f-44a0-a162-205a9cdea9ad\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-sdkzl"
Jul 28 01:16:35.652977 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.652959    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68846f4bbc-fggv8"
Jul 28 01:16:35.658588 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.658570    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-xpwwg"
Jul 28 01:16:35.712291 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.712261    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c575c46d-7bccf"
Jul 28 01:16:35.720965 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.720342    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d-original-pull-secret\") pod \"global-pull-secret-syncer-xvdx4\" (UID: \"c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d\") " pod="kube-system/global-pull-secret-syncer-xvdx4"
Jul 28 01:16:35.720965 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.720448    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a43767a-926c-4dfa-8f67-cd932fa744b5-metrics-certs\") pod \"network-metrics-daemon-d4kjt\" (UID: \"0a43767a-926c-4dfa-8f67-cd932fa744b5\") " pod="openshift-multus/network-metrics-daemon-d4kjt"
Jul 28 01:16:35.723046 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.722840    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 01:16:35.723155 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.723140    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 01:16:35.733699 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.733654    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d-original-pull-secret\") pod \"global-pull-secret-syncer-xvdx4\" (UID: \"c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d\") " pod="kube-system/global-pull-secret-syncer-xvdx4"
Jul 28 01:16:35.734428 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.734406    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a43767a-926c-4dfa-8f67-cd932fa744b5-metrics-certs\") pod \"network-metrics-daemon-d4kjt\" (UID: \"0a43767a-926c-4dfa-8f67-cd932fa744b5\") " pod="openshift-multus/network-metrics-daemon-d4kjt"
Jul 28 01:16:35.743983 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.743733    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-bkmjd"
Jul 28 01:16:35.752592 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.752550    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-sdkzl"
Jul 28 01:16:35.759156 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.758979    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646db4fd47-8w5wr"
Jul 28 01:16:35.768155 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.768017    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-dcb5f"
Jul 28 01:16:35.784660 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.784630    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6767b674f-cvttp"
Jul 28 01:16:35.802650 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.802512    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-68846f4bbc-fggv8"]
Jul 28 01:16:35.803885 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:16:35.803848    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b99408c_3436_4038_b350_302d39796be6.slice/crio-4656f970d9edfb8c9f2e939427df969d712b266606eec9694831d5cc41182f5b WatchSource:0}: Error finding container 4656f970d9edfb8c9f2e939427df969d712b266606eec9694831d5cc41182f5b: Status 404 returned error can't find the container with id 4656f970d9edfb8c9f2e939427df969d712b266606eec9694831d5cc41182f5b
Jul 28 01:16:35.818548 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.818346    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-xpwwg"]
Jul 28 01:16:35.823315 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.821887    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g5sm\" (UniqueName: \"kubernetes.io/projected/ddb225a7-f4d2-4295-8cce-d7d4a3d49955-kube-api-access-6g5sm\") pod \"network-check-target-68l4f\" (UID: \"ddb225a7-f4d2-4295-8cce-d7d4a3d49955\") " pod="openshift-network-diagnostics/network-check-target-68l4f"
Jul 28 01:16:35.825317 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.825263    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g5sm\" (UniqueName: \"kubernetes.io/projected/ddb225a7-f4d2-4295-8cce-d7d4a3d49955-kube-api-access-6g5sm\") pod \"network-check-target-68l4f\" (UID: \"ddb225a7-f4d2-4295-8cce-d7d4a3d49955\") " pod="openshift-network-diagnostics/network-check-target-68l4f"
Jul 28 01:16:35.904666 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.904585    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c575c46d-7bccf"]
Jul 28 01:16:35.913757 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:16:35.913409    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb470019c_195f_4424_b515_24221e2b6383.slice/crio-93a0aff6d3f77beb8c3e3fe3342dddcc8a5f85d3c58993751f45a914b9eb1d00 WatchSource:0}: Error finding container 93a0aff6d3f77beb8c3e3fe3342dddcc8a5f85d3c58993751f45a914b9eb1d00: Status 404 returned error can't find the container with id 93a0aff6d3f77beb8c3e3fe3342dddcc8a5f85d3c58993751f45a914b9eb1d00
Jul 28 01:16:35.921591 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.921277    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvdx4"
Jul 28 01:16:35.930646 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.930625    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4m9v4\""
Jul 28 01:16:35.934891 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.934667    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j4n9n\""
Jul 28 01:16:35.938247 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.938225    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68l4f"
Jul 28 01:16:35.943110 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.943060    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4kjt"
Jul 28 01:16:35.954971 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:35.954711    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-bkmjd"]
Jul 28 01:16:35.959150 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:16:35.959123    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14a474d7_483d_4aab_8115_37636c73d0fe.slice/crio-34f6eff56da03efc0064d222b509fa2b5d8de8dec36e4717c39153c70be5e436 WatchSource:0}: Error finding container 34f6eff56da03efc0064d222b509fa2b5d8de8dec36e4717c39153c70be5e436: Status 404 returned error can't find the container with id 34f6eff56da03efc0064d222b509fa2b5d8de8dec36e4717c39153c70be5e436
Jul 28 01:16:36.105313 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:36.105271    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xvdx4"]
Jul 28 01:16:36.109519 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:16:36.109488    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7994abb_0ef2_4c9c_8a5c_ce46fb1da68d.slice/crio-878f97d57dff5e33307c1a6c59a4b01bb2fa3732f980dd9424780a96c7777c94 WatchSource:0}: Error finding container 878f97d57dff5e33307c1a6c59a4b01bb2fa3732f980dd9424780a96c7777c94: Status 404 returned error can't find the container with id 878f97d57dff5e33307c1a6c59a4b01bb2fa3732f980dd9424780a96c7777c94
Jul 28 01:16:36.181531 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:36.181448    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-dcb5f"]
Jul 28 01:16:36.182847 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:36.182821    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-sdkzl"]
Jul 28 01:16:36.184869 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:16:36.184845    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode47369d7_9c2f_44a0_a162_205a9cdea9ad.slice/crio-0ab70a36a3d072624a185a94c6eec5a983d5bab2ab79fc4c6b6b463d32d85495 WatchSource:0}: Error finding container 0ab70a36a3d072624a185a94c6eec5a983d5bab2ab79fc4c6b6b463d32d85495: Status 404 returned error can't find the container with id 0ab70a36a3d072624a185a94c6eec5a983d5bab2ab79fc4c6b6b463d32d85495
Jul 28 01:16:36.185816 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:16:36.185779    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod889bce92_e710_4e62_8b8f_e2d78a8489a8.slice/crio-09216ec0bbfe9c158d63022c221aea2f705f6865a712c128fea8e46637fdd226 WatchSource:0}: Error finding container 09216ec0bbfe9c158d63022c221aea2f705f6865a712c128fea8e46637fdd226: Status 404 returned error can't find the container with id 09216ec0bbfe9c158d63022c221aea2f705f6865a712c128fea8e46637fdd226
Jul 28 01:16:36.226430 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:36.226368    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6767b674f-cvttp"]
Jul 28 01:16:36.228652 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:16:36.228621    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09603ca6_faf1_449e_b871_a9fe15fd6411.slice/crio-706ad83c99b46d0eb00f5cee8b994309627839a3bf3870d2d71ba468986a508f WatchSource:0}: Error finding container 706ad83c99b46d0eb00f5cee8b994309627839a3bf3870d2d71ba468986a508f: Status 404 returned error can't find the container with id 706ad83c99b46d0eb00f5cee8b994309627839a3bf3870d2d71ba468986a508f
Jul 28 01:16:36.231139 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:36.231116    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646db4fd47-8w5wr"]
Jul 28 01:16:36.233114 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:16:36.233093    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1a1b981c_e037_413c_93c0_de9a1678dbfa.slice/crio-ba91aa1a7f132fdbff3d0b7585d8e5f24915a1daa8fce5180586745f3c404691 WatchSource:0}: Error finding container ba91aa1a7f132fdbff3d0b7585d8e5f24915a1daa8fce5180586745f3c404691: Status 404 returned error can't find the container with id ba91aa1a7f132fdbff3d0b7585d8e5f24915a1daa8fce5180586745f3c404691
Jul 28 01:16:36.328655 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:36.328623    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-68l4f"]
Jul 28 01:16:36.331910 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:16:36.331886    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddb225a7_f4d2_4295_8cce_d7d4a3d49955.slice/crio-e97a1508f196fadd57cfcbf2c63514d467806d3389b66042014b94be8fb5ae0e WatchSource:0}: Error finding container e97a1508f196fadd57cfcbf2c63514d467806d3389b66042014b94be8fb5ae0e: Status 404 returned error can't find the container with id e97a1508f196fadd57cfcbf2c63514d467806d3389b66042014b94be8fb5ae0e
Jul 28 01:16:36.332074 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:36.332052    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d4kjt"]
Jul 28 01:16:36.335620 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:16:36.335596    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a43767a_926c_4dfa_8f67_cd932fa744b5.slice/crio-b9fb16ba0805e6a148c49e31d69de9cb29474e9d251e2d937cdd8cca74fcf8f1 WatchSource:0}: Error finding container b9fb16ba0805e6a148c49e31d69de9cb29474e9d251e2d937cdd8cca74fcf8f1: Status 404 returned error can't find the container with id b9fb16ba0805e6a148c49e31d69de9cb29474e9d251e2d937cdd8cca74fcf8f1
Jul 28 01:16:36.467682 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:36.467598    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d4kjt" event={"ID":"0a43767a-926c-4dfa-8f67-cd932fa744b5","Type":"ContainerStarted","Data":"b9fb16ba0805e6a148c49e31d69de9cb29474e9d251e2d937cdd8cca74fcf8f1"}
Jul 28 01:16:36.469690 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:36.469543    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-68l4f" event={"ID":"ddb225a7-f4d2-4295-8cce-d7d4a3d49955","Type":"ContainerStarted","Data":"8966cc593f20adaca79a1d2e1eed6c3da4492076377aedbf90149d71aeef9fe1"}
Jul 28 01:16:36.469690 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:36.469612    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-68l4f" event={"ID":"ddb225a7-f4d2-4295-8cce-d7d4a3d49955","Type":"ContainerStarted","Data":"e97a1508f196fadd57cfcbf2c63514d467806d3389b66042014b94be8fb5ae0e"}
Jul 28 01:16:36.469690 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:36.469653    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-68l4f"
Jul 28 01:16:36.471110 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:36.471046    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xvdx4" event={"ID":"c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d","Type":"ContainerStarted","Data":"878f97d57dff5e33307c1a6c59a4b01bb2fa3732f980dd9424780a96c7777c94"}
Jul 28 01:16:36.473119 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:36.473093    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-dcb5f" event={"ID":"889bce92-e710-4e62-8b8f-e2d78a8489a8","Type":"ContainerStarted","Data":"09216ec0bbfe9c158d63022c221aea2f705f6865a712c128fea8e46637fdd226"}
Jul 28 01:16:36.474512 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:36.474439    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-bkmjd" event={"ID":"14a474d7-483d-4aab-8115-37636c73d0fe","Type":"ContainerStarted","Data":"34f6eff56da03efc0064d222b509fa2b5d8de8dec36e4717c39153c70be5e436"}
Jul 28 01:16:36.475782 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:36.475755    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646db4fd47-8w5wr" event={"ID":"1a1b981c-e037-413c-93c0-de9a1678dbfa","Type":"ContainerStarted","Data":"ba91aa1a7f132fdbff3d0b7585d8e5f24915a1daa8fce5180586745f3c404691"}
Jul 28 01:16:36.477461 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:36.477436    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c575c46d-7bccf" event={"ID":"b470019c-195f-4424-b515-24221e2b6383","Type":"ContainerStarted","Data":"93a0aff6d3f77beb8c3e3fe3342dddcc8a5f85d3c58993751f45a914b9eb1d00"}
Jul 28 01:16:36.479585 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:36.479497    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6767b674f-cvttp" event={"ID":"09603ca6-faf1-449e-b871-a9fe15fd6411","Type":"ContainerStarted","Data":"6b37754fce5d0624a75517bc5b73557e293087ccae479dc018e8f4a44b0e1b0b"}
Jul 28 01:16:36.479585 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:36.479550    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6767b674f-cvttp" event={"ID":"09603ca6-faf1-449e-b871-a9fe15fd6411","Type":"ContainerStarted","Data":"706ad83c99b46d0eb00f5cee8b994309627839a3bf3870d2d71ba468986a508f"}
Jul 28 01:16:36.480934 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:36.480871    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-sdkzl" event={"ID":"e47369d7-9c2f-44a0-a162-205a9cdea9ad","Type":"ContainerStarted","Data":"0ab70a36a3d072624a185a94c6eec5a983d5bab2ab79fc4c6b6b463d32d85495"}
Jul 28 01:16:36.483362 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:36.482995    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68846f4bbc-fggv8" event={"ID":"1b99408c-3436-4038-b350-302d39796be6","Type":"ContainerStarted","Data":"4656f970d9edfb8c9f2e939427df969d712b266606eec9694831d5cc41182f5b"}
Jul 28 01:16:36.484275 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:36.484215    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-68l4f" podStartSLOduration=65.484199475 podStartE2EDuration="1m5.484199475s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:15:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:16:36.482744631 +0000 UTC m=+66.986505946" watchObservedRunningTime="2026-07-28 01:16:36.484199475 +0000 UTC m=+66.987960788"
Jul 28 01:16:36.485840 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:36.485817    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-xpwwg" event={"ID":"b8f1acac-bed7-4134-952e-a8cd66f119f2","Type":"ContainerStarted","Data":"c89b75386d9ba05a50e0c6794be686377f37efbd2c28dfeb64a16efe1d115431"}
Jul 28 01:16:36.501455 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:36.501415    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6767b674f-cvttp" podStartSLOduration=1.501401296 podStartE2EDuration="1.501401296s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:16:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:16:36.500332706 +0000 UTC m=+67.004094017" watchObservedRunningTime="2026-07-28 01:16:36.501401296 +0000 UTC m=+67.005162611"
Jul 28 01:16:36.731817 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:36.731726    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/acfd3678-0809-4d22-b8bf-16e381d8dbb6-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-lztg6\" (UID: \"acfd3678-0809-4d22-b8bf-16e381d8dbb6\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-lztg6"
Jul 28 01:16:36.732965 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:36.732258    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adf1e90a-9fdd-438a-857d-6a271dfd94c5-metrics-tls\") pod \"dns-default-46gx9\" (UID: \"adf1e90a-9fdd-438a-857d-6a271dfd94c5\") " pod="openshift-dns/dns-default-46gx9"
Jul 28 01:16:36.732965 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:36.732296    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d862dade-baa3-4c0c-8f7d-606d0664ec16-registry-tls\") pod \"image-registry-865ff46f64-k9qw5\" (UID: \"d862dade-baa3-4c0c-8f7d-606d0664ec16\") " pod="openshift-image-registry/image-registry-865ff46f64-k9qw5"
Jul 28 01:16:36.737799 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:36.737746    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/acfd3678-0809-4d22-b8bf-16e381d8dbb6-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-lztg6\" (UID: \"acfd3678-0809-4d22-b8bf-16e381d8dbb6\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-lztg6"
Jul 28 01:16:36.741023 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:36.740895    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d862dade-baa3-4c0c-8f7d-606d0664ec16-registry-tls\") pod \"image-registry-865ff46f64-k9qw5\" (UID: \"d862dade-baa3-4c0c-8f7d-606d0664ec16\") " pod="openshift-image-registry/image-registry-865ff46f64-k9qw5"
Jul 28 01:16:36.744707 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:36.744658    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adf1e90a-9fdd-438a-857d-6a271dfd94c5-metrics-tls\") pod \"dns-default-46gx9\" (UID: \"adf1e90a-9fdd-438a-857d-6a271dfd94c5\") " pod="openshift-dns/dns-default-46gx9"
Jul 28 01:16:36.785799 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:36.785714    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6767b674f-cvttp"
Jul 28 01:16:36.789009 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:36.788782    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6767b674f-cvttp"
Jul 28 01:16:36.996776 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:36.996490    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-l2d29\""
Jul 28 01:16:37.000373 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:37.000184    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-9wlxc\""
Jul 28 01:16:37.004145 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:37.003879    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-865ff46f64-k9qw5"
Jul 28 01:16:37.009046 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:37.008865    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-lztg6"
Jul 28 01:16:37.020221 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:37.020022    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-h7mrw\""
Jul 28 01:16:37.029144 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:37.028882    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-46gx9"
Jul 28 01:16:37.231009 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:37.230977    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-865ff46f64-k9qw5"]
Jul 28 01:16:37.275419 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:37.275339    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-lztg6"]
Jul 28 01:16:37.303029 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:37.302951    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-46gx9"]
Jul 28 01:16:37.498834 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:37.498686    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-lztg6" event={"ID":"acfd3678-0809-4d22-b8bf-16e381d8dbb6","Type":"ContainerStarted","Data":"ff8b42176c94646beb3fcaeb57f188a65ec3e6f7eaa37b8bb8eca8536c161499"}
Jul 28 01:16:37.506446 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:37.506412    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-865ff46f64-k9qw5" event={"ID":"d862dade-baa3-4c0c-8f7d-606d0664ec16","Type":"ContainerStarted","Data":"7e26c1d640d79a27b3cfe8f7a005e7a7d002db70a9d82b90224e9af067a35572"}
Jul 28 01:16:37.507486 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:37.507436    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6767b674f-cvttp"
Jul 28 01:16:37.508783 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:37.508761    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6767b674f-cvttp"
Jul 28 01:16:39.186948 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:16:39.185281    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadf1e90a_9fdd_438a_857d_6a271dfd94c5.slice/crio-bc62e1e0f9eb263f7c9556b242ae8083650143908c5730de1e11cdf01051788f WatchSource:0}: Error finding container bc62e1e0f9eb263f7c9556b242ae8083650143908c5730de1e11cdf01051788f: Status 404 returned error can't find the container with id bc62e1e0f9eb263f7c9556b242ae8083650143908c5730de1e11cdf01051788f
Jul 28 01:16:39.518528 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:39.518445    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-46gx9" event={"ID":"adf1e90a-9fdd-438a-857d-6a271dfd94c5","Type":"ContainerStarted","Data":"bc62e1e0f9eb263f7c9556b242ae8083650143908c5730de1e11cdf01051788f"}
Jul 28 01:16:39.520281 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:39.520233    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-865ff46f64-k9qw5" event={"ID":"d862dade-baa3-4c0c-8f7d-606d0664ec16","Type":"ContainerStarted","Data":"6788981e0f8da80dfd8e77c541e35663cbba017322c3a83f56a6a8aef2b6fb04"}
Jul 28 01:16:39.520414 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:39.520386    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-865ff46f64-k9qw5"
Jul 28 01:16:39.540446 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:39.540384    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-865ff46f64-k9qw5" podStartSLOduration=68.540365193 podStartE2EDuration="1m8.540365193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:15:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:16:39.537638085 +0000 UTC m=+70.041399400" watchObservedRunningTime="2026-07-28 01:16:39.540365193 +0000 UTC m=+70.044126510"
Jul 28 01:16:46.610088 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:46.609303    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-dcb5f" event={"ID":"889bce92-e710-4e62-8b8f-e2d78a8489a8","Type":"ContainerStarted","Data":"c9c7eb8afa0e7e585e86eb14baa243344c48783b5c89c54adff071c253b8b413"}
Jul 28 01:16:46.614062 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:46.612838    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-bkmjd" event={"ID":"14a474d7-483d-4aab-8115-37636c73d0fe","Type":"ContainerStarted","Data":"4ff07b4188840f715dcde8028182f8cac712332ddf73ad1b5a1be480785865f9"}
Jul 28 01:16:46.618875 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:46.618847    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c575c46d-7bccf" event={"ID":"b470019c-195f-4424-b515-24221e2b6383","Type":"ContainerStarted","Data":"0c89fc399d1e89d9e0b1c965e57c7e970ed2e02d82b51874222737f28809752f"}
Jul 28 01:16:46.628368 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:46.627892    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-sdkzl" event={"ID":"e47369d7-9c2f-44a0-a162-205a9cdea9ad","Type":"ContainerStarted","Data":"4db875de6a7fc1008e781f46eae9b587a7df50ed6231ce68742b8ed304436ac3"}
Jul 28 01:16:46.631514 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:46.629974    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-dcb5f" podStartSLOduration=1.446668717 podStartE2EDuration="11.629643517s" totalImagesPullingTime="10.1829748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:16:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:16:46.629178556 +0000 UTC m=+77.132939870" watchObservedRunningTime="2026-07-28 01:16:46.629643517 +0000 UTC m=+77.133404823"
Jul 28 01:16:46.653576 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:46.652252    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-xpwwg" event={"ID":"b8f1acac-bed7-4134-952e-a8cd66f119f2","Type":"ContainerStarted","Data":"eee24627bdb7e3dfce8657be913e5c016bcffe8acd2ea25540988a9d4e07118d"}
Jul 28 01:16:46.696177 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:46.672202    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-lztg6" event={"ID":"acfd3678-0809-4d22-b8bf-16e381d8dbb6","Type":"ContainerStarted","Data":"5b2c229beb3c2feb77e9c15859d83361c3c9eb42231f033b7f3f240b9e5f7065"}
Jul 28 01:16:46.696177 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:46.686753    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c575c46d-7bccf" podStartSLOduration=1.229913931 podStartE2EDuration="11.686730696s" totalImagesPullingTime="10.456816765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:16:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:16:46.681898945 +0000 UTC m=+77.185660257" watchObservedRunningTime="2026-07-28 01:16:46.686730696 +0000 UTC m=+77.190492010"
Jul 28 01:16:46.696177 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:46.687242    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-bkmjd" podStartSLOduration=1.309194843 podStartE2EDuration="11.68722407s" totalImagesPullingTime="10.378029227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:16:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:16:46.663794971 +0000 UTC m=+77.167556284" watchObservedRunningTime="2026-07-28 01:16:46.68722407 +0000 UTC m=+77.190985362"
Jul 28 01:16:46.709876 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:46.709820    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-sdkzl" podStartSLOduration=1.52214852 podStartE2EDuration="11.709798695s" totalImagesPullingTime="10.187650175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:16:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:16:46.706140354 +0000 UTC m=+77.209901665" watchObservedRunningTime="2026-07-28 01:16:46.709798695 +0000 UTC m=+77.213559990"
Jul 28 01:16:46.746014 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:46.745961    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-lztg6" podStartSLOduration=36.67804508 podStartE2EDuration="45.745938983s" totalImagesPullingTime="9.067893903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:16:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:16:46.744538226 +0000 UTC m=+77.248299539" watchObservedRunningTime="2026-07-28 01:16:46.745938983 +0000 UTC m=+77.249700298"
Jul 28 01:16:47.686346 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:47.685656    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-46gx9" event={"ID":"adf1e90a-9fdd-438a-857d-6a271dfd94c5","Type":"ContainerStarted","Data":"d2ace97da534a1c896c5434c8f21699a900b948a2dd0268d15d18a196d24365f"}
Jul 28 01:16:47.686346 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:47.685724    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-46gx9" event={"ID":"adf1e90a-9fdd-438a-857d-6a271dfd94c5","Type":"ContainerStarted","Data":"9cdd372b28c91e2b47fbd6399238b98fb652b75843f40bb3ec1cb0a6f2cb8396"}
Jul 28 01:16:47.686346 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:47.685950    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-46gx9"
Jul 28 01:16:47.691806 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:47.691084    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d4kjt" event={"ID":"0a43767a-926c-4dfa-8f67-cd932fa744b5","Type":"ContainerStarted","Data":"325c1d546595122da6f351d84480f884f240b035d5264502113c574a65b00bef"}
Jul 28 01:16:47.691806 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:47.691141    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d4kjt" event={"ID":"0a43767a-926c-4dfa-8f67-cd932fa744b5","Type":"ContainerStarted","Data":"a41decce6d0a1e4e7371ac6ae2d96e44521ee4c0a3648f494d709edd9b8b75b3"}
Jul 28 01:16:47.700637 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:47.700606    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68846f4bbc-fggv8" event={"ID":"1b99408c-3436-4038-b350-302d39796be6","Type":"ContainerStarted","Data":"e894b5aa9842ad81bb4fe44c0602c315d5e3e011da61112bb4685b872932a17e"}
Jul 28 01:16:47.701137 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:47.701100    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68846f4bbc-fggv8"
Jul 28 01:16:47.702754 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:47.702712    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68846f4bbc-fggv8"
Jul 28 01:16:47.704180 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:47.704159    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-xpwwg" event={"ID":"b8f1acac-bed7-4134-952e-a8cd66f119f2","Type":"ContainerStarted","Data":"b473d6e8f95d8e4916222e9b558182d68e28f451a350899a599fa86ab9ca3dcc"}
Jul 28 01:16:47.710134 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:47.709179    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-46gx9" podStartSLOduration=36.514739805 podStartE2EDuration="43.709156186s" totalImagesPullingTime="7.194416381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:16:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:16:47.707249519 +0000 UTC m=+78.211010832" watchObservedRunningTime="2026-07-28 01:16:47.709156186 +0000 UTC m=+78.212917499"
Jul 28 01:16:47.712377 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:47.712187    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-v6mhz"]
Jul 28 01:16:47.725539 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:47.725439    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xvdx4" event={"ID":"c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d","Type":"ContainerStarted","Data":"9ac8680cbbf1491d48c30005e9754b02a159309bcfd6012ba9fff0f4b9ea5cc4"}
Jul 28 01:16:47.725539 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:47.725489    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-v6mhz"]
Jul 28 01:16:47.725539 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:47.725522    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-v6mhz"
Jul 28 01:16:47.729508 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:47.729454    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-xpwwg" podStartSLOduration=3.914357309 podStartE2EDuration="12.729436334s" totalImagesPullingTime="8.815079025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:16:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:16:47.727976339 +0000 UTC m=+78.231737672" watchObservedRunningTime="2026-07-28 01:16:47.729436334 +0000 UTC m=+78.233197647"
Jul 28 01:16:47.729792 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:47.729769    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 28 01:16:47.730065 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:47.730045    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gz7nz\""
Jul 28 01:16:47.731116 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:47.730951    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 28 01:16:47.743295 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:47.743195    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68846f4bbc-fggv8" podStartSLOduration=2.144830205 podStartE2EDuration="12.743178418s" totalImagesPullingTime="10.598348213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:16:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:16:47.742710839 +0000 UTC m=+78.246472151" watchObservedRunningTime="2026-07-28 01:16:47.743178418 +0000 UTC m=+78.246939731"
Jul 28 01:16:47.762352 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:47.762286    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-d4kjt" podStartSLOduration=66.75892171 podStartE2EDuration="1m16.762268573s" totalImagesPullingTime="10.003346863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:15:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:16:47.761071563 +0000 UTC m=+78.264832899" watchObservedRunningTime="2026-07-28 01:16:47.762268573 +0000 UTC m=+78.266029886"
Jul 28 01:16:47.777106 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:47.777056    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xvdx4" podStartSLOduration=66.509279665 podStartE2EDuration="1m16.777038474s" totalImagesPullingTime="10.267758809s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:15:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:16:47.774887857 +0000 UTC m=+78.278649170" watchObservedRunningTime="2026-07-28 01:16:47.777038474 +0000 UTC m=+78.280799787"
Jul 28 01:16:47.846114 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:47.846075    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/872fcfeb-a64a-4749-b65c-89d38987befa-data-volume\") pod \"insights-runtime-extractor-v6mhz\" (UID: \"872fcfeb-a64a-4749-b65c-89d38987befa\") " pod="openshift-insights/insights-runtime-extractor-v6mhz"
Jul 28 01:16:47.846311 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:47.846143    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/872fcfeb-a64a-4749-b65c-89d38987befa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v6mhz\" (UID: \"872fcfeb-a64a-4749-b65c-89d38987befa\") " pod="openshift-insights/insights-runtime-extractor-v6mhz"
Jul 28 01:16:47.846381 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:47.846326    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/872fcfeb-a64a-4749-b65c-89d38987befa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v6mhz\" (UID: \"872fcfeb-a64a-4749-b65c-89d38987befa\") " pod="openshift-insights/insights-runtime-extractor-v6mhz"
Jul 28 01:16:47.846496 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:47.846476    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/872fcfeb-a64a-4749-b65c-89d38987befa-crio-socket\") pod \"insights-runtime-extractor-v6mhz\" (UID: \"872fcfeb-a64a-4749-b65c-89d38987befa\") " pod="openshift-insights/insights-runtime-extractor-v6mhz"
Jul 28 01:16:47.847128 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:47.847031    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sznxm\" (UniqueName: \"kubernetes.io/projected/872fcfeb-a64a-4749-b65c-89d38987befa-kube-api-access-sznxm\") pod \"insights-runtime-extractor-v6mhz\" (UID: \"872fcfeb-a64a-4749-b65c-89d38987befa\") " pod="openshift-insights/insights-runtime-extractor-v6mhz"
Jul 28 01:16:47.948142 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:47.948056    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/872fcfeb-a64a-4749-b65c-89d38987befa-data-volume\") pod \"insights-runtime-extractor-v6mhz\" (UID: \"872fcfeb-a64a-4749-b65c-89d38987befa\") " pod="openshift-insights/insights-runtime-extractor-v6mhz"
Jul 28 01:16:47.948142 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:47.948097    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/872fcfeb-a64a-4749-b65c-89d38987befa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v6mhz\" (UID: \"872fcfeb-a64a-4749-b65c-89d38987befa\") " pod="openshift-insights/insights-runtime-extractor-v6mhz"
Jul 28 01:16:47.948375 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:47.948142    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/872fcfeb-a64a-4749-b65c-89d38987befa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v6mhz\" (UID: \"872fcfeb-a64a-4749-b65c-89d38987befa\") " pod="openshift-insights/insights-runtime-extractor-v6mhz"
Jul 28 01:16:47.948375 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:47.948190    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/872fcfeb-a64a-4749-b65c-89d38987befa-crio-socket\") pod \"insights-runtime-extractor-v6mhz\" (UID: \"872fcfeb-a64a-4749-b65c-89d38987befa\") " pod="openshift-insights/insights-runtime-extractor-v6mhz"
Jul 28 01:16:47.948375 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:47.948241    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sznxm\" (UniqueName: \"kubernetes.io/projected/872fcfeb-a64a-4749-b65c-89d38987befa-kube-api-access-sznxm\") pod \"insights-runtime-extractor-v6mhz\" (UID: \"872fcfeb-a64a-4749-b65c-89d38987befa\") " pod="openshift-insights/insights-runtime-extractor-v6mhz"
Jul 28 01:16:47.948375 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:47.948278    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 01:16:47.948375 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:47.948314    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 01:16:47.948375 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:47.948373    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/872fcfeb-a64a-4749-b65c-89d38987befa-kube-rbac-proxy-cm podName:872fcfeb-a64a-4749-b65c-89d38987befa nodeName:}" failed. No retries permitted until 2026-07-28 01:16:48.448350916 +0000 UTC m=+78.952112211 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/872fcfeb-a64a-4749-b65c-89d38987befa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v6mhz" (UID: "872fcfeb-a64a-4749-b65c-89d38987befa") : configmap "kube-rbac-proxy" not found
Jul 28 01:16:47.948773 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:47.948391    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/872fcfeb-a64a-4749-b65c-89d38987befa-insights-runtime-extractor-tls podName:872fcfeb-a64a-4749-b65c-89d38987befa nodeName:}" failed. No retries permitted until 2026-07-28 01:16:48.448382203 +0000 UTC m=+78.952143499 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/872fcfeb-a64a-4749-b65c-89d38987befa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v6mhz" (UID: "872fcfeb-a64a-4749-b65c-89d38987befa") : secret "insights-runtime-extractor-tls" not found
Jul 28 01:16:47.948773 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:47.948422    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/872fcfeb-a64a-4749-b65c-89d38987befa-crio-socket\") pod \"insights-runtime-extractor-v6mhz\" (UID: \"872fcfeb-a64a-4749-b65c-89d38987befa\") " pod="openshift-insights/insights-runtime-extractor-v6mhz"
Jul 28 01:16:47.948773 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:47.948438    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/872fcfeb-a64a-4749-b65c-89d38987befa-data-volume\") pod \"insights-runtime-extractor-v6mhz\" (UID: \"872fcfeb-a64a-4749-b65c-89d38987befa\") " pod="openshift-insights/insights-runtime-extractor-v6mhz"
Jul 28 01:16:47.956694 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:47.956669    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sznxm\" (UniqueName: \"kubernetes.io/projected/872fcfeb-a64a-4749-b65c-89d38987befa-kube-api-access-sznxm\") pod \"insights-runtime-extractor-v6mhz\" (UID: \"872fcfeb-a64a-4749-b65c-89d38987befa\") " pod="openshift-insights/insights-runtime-extractor-v6mhz"
Jul 28 01:16:48.303702 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:48.303615    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-46gx9_adf1e90a-9fdd-438a-857d-6a271dfd94c5/dns/0.log"
Jul 28 01:16:48.453258 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:48.453221    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/872fcfeb-a64a-4749-b65c-89d38987befa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v6mhz\" (UID: \"872fcfeb-a64a-4749-b65c-89d38987befa\") " pod="openshift-insights/insights-runtime-extractor-v6mhz"
Jul 28 01:16:48.453429 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:48.453281    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/872fcfeb-a64a-4749-b65c-89d38987befa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v6mhz\" (UID: \"872fcfeb-a64a-4749-b65c-89d38987befa\") " pod="openshift-insights/insights-runtime-extractor-v6mhz"
Jul 28 01:16:48.453429 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:48.453370    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 01:16:48.453429 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:48.453392    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 01:16:48.453552 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:48.453462    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/872fcfeb-a64a-4749-b65c-89d38987befa-kube-rbac-proxy-cm podName:872fcfeb-a64a-4749-b65c-89d38987befa nodeName:}" failed. No retries permitted until 2026-07-28 01:16:49.453438403 +0000 UTC m=+79.957199715 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/872fcfeb-a64a-4749-b65c-89d38987befa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v6mhz" (UID: "872fcfeb-a64a-4749-b65c-89d38987befa") : configmap "kube-rbac-proxy" not found
Jul 28 01:16:48.453552 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:48.453478    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/872fcfeb-a64a-4749-b65c-89d38987befa-insights-runtime-extractor-tls podName:872fcfeb-a64a-4749-b65c-89d38987befa nodeName:}" failed. No retries permitted until 2026-07-28 01:16:49.453471599 +0000 UTC m=+79.957232889 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/872fcfeb-a64a-4749-b65c-89d38987befa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v6mhz" (UID: "872fcfeb-a64a-4749-b65c-89d38987befa") : secret "insights-runtime-extractor-tls" not found
Jul 28 01:16:48.505739 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:48.505705    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-46gx9_adf1e90a-9fdd-438a-857d-6a271dfd94c5/kube-rbac-proxy/0.log"
Jul 28 01:16:49.462645 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:49.462612    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/872fcfeb-a64a-4749-b65c-89d38987befa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v6mhz\" (UID: \"872fcfeb-a64a-4749-b65c-89d38987befa\") " pod="openshift-insights/insights-runtime-extractor-v6mhz"
Jul 28 01:16:49.462946 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:49.462667    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/872fcfeb-a64a-4749-b65c-89d38987befa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v6mhz\" (UID: \"872fcfeb-a64a-4749-b65c-89d38987befa\") " pod="openshift-insights/insights-runtime-extractor-v6mhz"
Jul 28 01:16:49.462946 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:49.462726    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 01:16:49.462946 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:49.462760    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 01:16:49.462946 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:49.462792    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/872fcfeb-a64a-4749-b65c-89d38987befa-kube-rbac-proxy-cm podName:872fcfeb-a64a-4749-b65c-89d38987befa nodeName:}" failed. No retries permitted until 2026-07-28 01:16:51.46277565 +0000 UTC m=+81.966536973 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/872fcfeb-a64a-4749-b65c-89d38987befa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v6mhz" (UID: "872fcfeb-a64a-4749-b65c-89d38987befa") : configmap "kube-rbac-proxy" not found
Jul 28 01:16:49.462946 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:49.462808    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/872fcfeb-a64a-4749-b65c-89d38987befa-insights-runtime-extractor-tls podName:872fcfeb-a64a-4749-b65c-89d38987befa nodeName:}" failed. No retries permitted until 2026-07-28 01:16:51.462801429 +0000 UTC m=+81.966562719 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/872fcfeb-a64a-4749-b65c-89d38987befa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v6mhz" (UID: "872fcfeb-a64a-4749-b65c-89d38987befa") : secret "insights-runtime-extractor-tls" not found
Jul 28 01:16:49.503017 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:49.502992    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-grq5v_4ce4a74c-58bc-476f-ba50-fe5e53e2fc84/dns-node-resolver/0.log"
Jul 28 01:16:49.723666 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:49.723629    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646db4fd47-8w5wr" event={"ID":"1a1b981c-e037-413c-93c0-de9a1678dbfa","Type":"ContainerStarted","Data":"25743755990fa09e7836f2fd58b598b976b6cdcb6a43a6518fed8d3381ab22b2"}
Jul 28 01:16:49.723815 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:49.723682    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646db4fd47-8w5wr" event={"ID":"1a1b981c-e037-413c-93c0-de9a1678dbfa","Type":"ContainerStarted","Data":"7ead1ead73bd7ba218cee7ad02a35f7caf8c496ceca7ce7e48f56501189d125a"}
Jul 28 01:16:49.723815 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:49.723700    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646db4fd47-8w5wr" event={"ID":"1a1b981c-e037-413c-93c0-de9a1678dbfa","Type":"ContainerStarted","Data":"d8f9a22a9a3c43c3ccb0ce6999ffab135da0aa78b5dab9040d7736a2eb465bc8"}
Jul 28 01:16:49.739549 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:49.739502    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646db4fd47-8w5wr" podStartSLOduration=1.717606269 podStartE2EDuration="14.739488159s" totalImagesPullingTime="13.02188189s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:16:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:16:49.73876436 +0000 UTC m=+80.242525673" watchObservedRunningTime="2026-07-28 01:16:49.739488159 +0000 UTC m=+80.243249487"
Jul 28 01:16:50.303612 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:50.303584    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-865ff46f64-k9qw5_d862dade-baa3-4c0c-8f7d-606d0664ec16/registry/0.log"
Jul 28 01:16:50.504331 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:50.504305    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8r6nb_9e6d77bc-6fb4-4f91-bb89-084a03ee29df/node-ca/0.log"
Jul 28 01:16:51.104098 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:51.104069    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6767b674f-cvttp_09603ca6-faf1-449e-b871-a9fe15fd6411/router/0.log"
Jul 28 01:16:51.479628 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:51.479521    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/872fcfeb-a64a-4749-b65c-89d38987befa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v6mhz\" (UID: \"872fcfeb-a64a-4749-b65c-89d38987befa\") " pod="openshift-insights/insights-runtime-extractor-v6mhz"
Jul 28 01:16:51.479628 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:51.479585    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/872fcfeb-a64a-4749-b65c-89d38987befa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v6mhz\" (UID: \"872fcfeb-a64a-4749-b65c-89d38987befa\") " pod="openshift-insights/insights-runtime-extractor-v6mhz"
Jul 28 01:16:51.479815 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:51.479649    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 01:16:51.479815 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:51.479675    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 01:16:51.479815 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:51.479719    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/872fcfeb-a64a-4749-b65c-89d38987befa-kube-rbac-proxy-cm podName:872fcfeb-a64a-4749-b65c-89d38987befa nodeName:}" failed. No retries permitted until 2026-07-28 01:16:55.479702514 +0000 UTC m=+85.983463809 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/872fcfeb-a64a-4749-b65c-89d38987befa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v6mhz" (UID: "872fcfeb-a64a-4749-b65c-89d38987befa") : configmap "kube-rbac-proxy" not found
Jul 28 01:16:51.479815 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:16:51.479735    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/872fcfeb-a64a-4749-b65c-89d38987befa-insights-runtime-extractor-tls podName:872fcfeb-a64a-4749-b65c-89d38987befa nodeName:}" failed. No retries permitted until 2026-07-28 01:16:55.479729207 +0000 UTC m=+85.983490497 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/872fcfeb-a64a-4749-b65c-89d38987befa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v6mhz" (UID: "872fcfeb-a64a-4749-b65c-89d38987befa") : secret "insights-runtime-extractor-tls" not found
Jul 28 01:16:51.503547 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:51.503521    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d4xnz_d010bf4e-4f54-4204-b1f3-8813b3a4a1de/serve-healthcheck-canary/0.log"
Jul 28 01:16:55.514640 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:55.514496    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/872fcfeb-a64a-4749-b65c-89d38987befa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v6mhz\" (UID: \"872fcfeb-a64a-4749-b65c-89d38987befa\") " pod="openshift-insights/insights-runtime-extractor-v6mhz"
Jul 28 01:16:55.514640 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:55.514546    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/872fcfeb-a64a-4749-b65c-89d38987befa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v6mhz\" (UID: \"872fcfeb-a64a-4749-b65c-89d38987befa\") " pod="openshift-insights/insights-runtime-extractor-v6mhz"
Jul 28 01:16:55.515073 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:55.515044    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/872fcfeb-a64a-4749-b65c-89d38987befa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v6mhz\" (UID: \"872fcfeb-a64a-4749-b65c-89d38987befa\") " pod="openshift-insights/insights-runtime-extractor-v6mhz"
Jul 28 01:16:55.516865 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:55.516845    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/872fcfeb-a64a-4749-b65c-89d38987befa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v6mhz\" (UID: \"872fcfeb-a64a-4749-b65c-89d38987befa\") " pod="openshift-insights/insights-runtime-extractor-v6mhz"
Jul 28 01:16:55.539856 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:55.539816    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-v6mhz"
Jul 28 01:16:55.666891 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:55.666866    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-v6mhz"]
Jul 28 01:16:55.668952 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:16:55.668926    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod872fcfeb_a64a_4749_b65c_89d38987befa.slice/crio-43807996aea2e5793a1445e55420271872fc5bfc0c4a28dec98e305590797aca WatchSource:0}: Error finding container 43807996aea2e5793a1445e55420271872fc5bfc0c4a28dec98e305590797aca: Status 404 returned error can't find the container with id 43807996aea2e5793a1445e55420271872fc5bfc0c4a28dec98e305590797aca
Jul 28 01:16:55.753516 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:55.753483    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v6mhz" event={"ID":"872fcfeb-a64a-4749-b65c-89d38987befa","Type":"ContainerStarted","Data":"43807996aea2e5793a1445e55420271872fc5bfc0c4a28dec98e305590797aca"}
Jul 28 01:16:57.009892 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:57.009853    2562 patch_prober.go:28] interesting pod/image-registry-865ff46f64-k9qw5 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 28 01:16:57.010344 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:57.009911    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-865ff46f64-k9qw5" podUID="d862dade-baa3-4c0c-8f7d-606d0664ec16" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 01:16:57.381439 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:57.381400    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-865ff46f64-k9qw5"]
Jul 28 01:16:57.386282 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:57.386246    2562 patch_prober.go:28] interesting pod/image-registry-865ff46f64-k9qw5 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 28 01:16:57.386436 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:57.386303    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-865ff46f64-k9qw5" podUID="d862dade-baa3-4c0c-8f7d-606d0664ec16" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 01:16:57.720729 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:16:57.720650    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-46gx9"
Jul 28 01:17:00.776302 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:00.776209    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v6mhz" event={"ID":"872fcfeb-a64a-4749-b65c-89d38987befa","Type":"ContainerStarted","Data":"0cd440816c28b0844c783ab4e61582ee5ee0a930ba43d9cb0222e136f2bd4172"}
Jul 28 01:17:04.795426 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:04.795391    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v6mhz" event={"ID":"872fcfeb-a64a-4749-b65c-89d38987befa","Type":"ContainerStarted","Data":"38f6f84351287f184b5d9466d3810e4735ec0ae0e8b03e9b3dfb98385ad34876"}
Jul 28 01:17:05.557410 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:05.557266    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2bdv4"]
Jul 28 01:17:05.561508 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:05.561479    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2bdv4"
Jul 28 01:17:05.564737 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:05.563774    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 28 01:17:05.564737 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:05.564110    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 28 01:17:05.564737 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:05.564299    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 28 01:17:05.564737 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:05.564504    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7fx46\""
Jul 28 01:17:05.564737 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:05.564697    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 28 01:17:05.706685 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:05.706302    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/65a1a259-27df-49c4-a300-4c21df5ae6c2-metrics-client-ca\") pod \"node-exporter-2bdv4\" (UID: \"65a1a259-27df-49c4-a300-4c21df5ae6c2\") " pod="openshift-monitoring/node-exporter-2bdv4"
Jul 28 01:17:05.706685 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:05.706352    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lwkx\" (UniqueName: \"kubernetes.io/projected/65a1a259-27df-49c4-a300-4c21df5ae6c2-kube-api-access-8lwkx\") pod \"node-exporter-2bdv4\" (UID: \"65a1a259-27df-49c4-a300-4c21df5ae6c2\") " pod="openshift-monitoring/node-exporter-2bdv4"
Jul 28 01:17:05.706685 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:05.706411    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/65a1a259-27df-49c4-a300-4c21df5ae6c2-node-exporter-textfile\") pod \"node-exporter-2bdv4\" (UID: \"65a1a259-27df-49c4-a300-4c21df5ae6c2\") " pod="openshift-monitoring/node-exporter-2bdv4"
Jul 28 01:17:05.706685 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:05.706435    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/65a1a259-27df-49c4-a300-4c21df5ae6c2-node-exporter-tls\") pod \"node-exporter-2bdv4\" (UID: \"65a1a259-27df-49c4-a300-4c21df5ae6c2\") " pod="openshift-monitoring/node-exporter-2bdv4"
Jul 28 01:17:05.706685 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:05.706456    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/65a1a259-27df-49c4-a300-4c21df5ae6c2-node-exporter-wtmp\") pod \"node-exporter-2bdv4\" (UID: \"65a1a259-27df-49c4-a300-4c21df5ae6c2\") " pod="openshift-monitoring/node-exporter-2bdv4"
Jul 28 01:17:05.706685 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:05.706496    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/65a1a259-27df-49c4-a300-4c21df5ae6c2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2bdv4\" (UID: \"65a1a259-27df-49c4-a300-4c21df5ae6c2\") " pod="openshift-monitoring/node-exporter-2bdv4"
Jul 28 01:17:05.706685 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:05.706535    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/65a1a259-27df-49c4-a300-4c21df5ae6c2-sys\") pod \"node-exporter-2bdv4\" (UID: \"65a1a259-27df-49c4-a300-4c21df5ae6c2\") " pod="openshift-monitoring/node-exporter-2bdv4"
Jul 28 01:17:05.706685 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:05.706572    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/65a1a259-27df-49c4-a300-4c21df5ae6c2-node-exporter-accelerators-collector-config\") pod \"node-exporter-2bdv4\" (UID: \"65a1a259-27df-49c4-a300-4c21df5ae6c2\") " pod="openshift-monitoring/node-exporter-2bdv4"
Jul 28 01:17:05.706685 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:05.706604    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/65a1a259-27df-49c4-a300-4c21df5ae6c2-root\") pod \"node-exporter-2bdv4\" (UID: \"65a1a259-27df-49c4-a300-4c21df5ae6c2\") " pod="openshift-monitoring/node-exporter-2bdv4"
Jul 28 01:17:05.809225 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:05.806999    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lwkx\" (UniqueName: \"kubernetes.io/projected/65a1a259-27df-49c4-a300-4c21df5ae6c2-kube-api-access-8lwkx\") pod \"node-exporter-2bdv4\" (UID: \"65a1a259-27df-49c4-a300-4c21df5ae6c2\") " pod="openshift-monitoring/node-exporter-2bdv4"
Jul 28 01:17:05.809225 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:05.807058    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/65a1a259-27df-49c4-a300-4c21df5ae6c2-node-exporter-textfile\") pod \"node-exporter-2bdv4\" (UID: \"65a1a259-27df-49c4-a300-4c21df5ae6c2\") " pod="openshift-monitoring/node-exporter-2bdv4"
Jul 28 01:17:05.809225 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:05.807088    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/65a1a259-27df-49c4-a300-4c21df5ae6c2-node-exporter-tls\") pod \"node-exporter-2bdv4\" (UID: \"65a1a259-27df-49c4-a300-4c21df5ae6c2\") " pod="openshift-monitoring/node-exporter-2bdv4"
Jul 28 01:17:05.809225 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:05.807112    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/65a1a259-27df-49c4-a300-4c21df5ae6c2-node-exporter-wtmp\") pod \"node-exporter-2bdv4\" (UID: \"65a1a259-27df-49c4-a300-4c21df5ae6c2\") " pod="openshift-monitoring/node-exporter-2bdv4"
Jul 28 01:17:05.809225 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:05.807139    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/65a1a259-27df-49c4-a300-4c21df5ae6c2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2bdv4\" (UID: \"65a1a259-27df-49c4-a300-4c21df5ae6c2\") " pod="openshift-monitoring/node-exporter-2bdv4"
Jul 28 01:17:05.809225 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:05.807175    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/65a1a259-27df-49c4-a300-4c21df5ae6c2-sys\") pod \"node-exporter-2bdv4\" (UID: \"65a1a259-27df-49c4-a300-4c21df5ae6c2\") " pod="openshift-monitoring/node-exporter-2bdv4"
Jul 28 01:17:05.809225 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:05.807200    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/65a1a259-27df-49c4-a300-4c21df5ae6c2-node-exporter-accelerators-collector-config\") pod \"node-exporter-2bdv4\" (UID: \"65a1a259-27df-49c4-a300-4c21df5ae6c2\") " pod="openshift-monitoring/node-exporter-2bdv4"
Jul 28 01:17:05.809225 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:05.807229    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/65a1a259-27df-49c4-a300-4c21df5ae6c2-root\") pod \"node-exporter-2bdv4\" (UID: \"65a1a259-27df-49c4-a300-4c21df5ae6c2\") " pod="openshift-monitoring/node-exporter-2bdv4"
Jul 28 01:17:05.809225 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:05.807272    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/65a1a259-27df-49c4-a300-4c21df5ae6c2-metrics-client-ca\") pod \"node-exporter-2bdv4\" (UID: \"65a1a259-27df-49c4-a300-4c21df5ae6c2\") " pod="openshift-monitoring/node-exporter-2bdv4"
Jul 28 01:17:05.809225 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:05.807918    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/65a1a259-27df-49c4-a300-4c21df5ae6c2-metrics-client-ca\") pod \"node-exporter-2bdv4\" (UID: \"65a1a259-27df-49c4-a300-4c21df5ae6c2\") " pod="openshift-monitoring/node-exporter-2bdv4"
Jul 28 01:17:05.809225 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:05.808418    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/65a1a259-27df-49c4-a300-4c21df5ae6c2-node-exporter-textfile\") pod \"node-exporter-2bdv4\" (UID: \"65a1a259-27df-49c4-a300-4c21df5ae6c2\") " pod="openshift-monitoring/node-exporter-2bdv4"
Jul 28 01:17:05.809225 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:17:05.808506    2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 28 01:17:05.809225 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:17:05.808574    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65a1a259-27df-49c4-a300-4c21df5ae6c2-node-exporter-tls podName:65a1a259-27df-49c4-a300-4c21df5ae6c2 nodeName:}" failed. No retries permitted until 2026-07-28 01:17:06.308538272 +0000 UTC m=+96.812299563 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/65a1a259-27df-49c4-a300-4c21df5ae6c2-node-exporter-tls") pod "node-exporter-2bdv4" (UID: "65a1a259-27df-49c4-a300-4c21df5ae6c2") : secret "node-exporter-tls" not found
Jul 28 01:17:05.809225 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:05.808833    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/65a1a259-27df-49c4-a300-4c21df5ae6c2-node-exporter-wtmp\") pod \"node-exporter-2bdv4\" (UID: \"65a1a259-27df-49c4-a300-4c21df5ae6c2\") " pod="openshift-monitoring/node-exporter-2bdv4"
Jul 28 01:17:05.810286 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:05.809668    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/65a1a259-27df-49c4-a300-4c21df5ae6c2-node-exporter-accelerators-collector-config\") pod \"node-exporter-2bdv4\" (UID: \"65a1a259-27df-49c4-a300-4c21df5ae6c2\") " pod="openshift-monitoring/node-exporter-2bdv4"
Jul 28 01:17:05.810286 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:05.809740    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/65a1a259-27df-49c4-a300-4c21df5ae6c2-sys\") pod \"node-exporter-2bdv4\" (UID: \"65a1a259-27df-49c4-a300-4c21df5ae6c2\") " pod="openshift-monitoring/node-exporter-2bdv4"
Jul 28 01:17:05.810286 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:05.809789    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/65a1a259-27df-49c4-a300-4c21df5ae6c2-root\") pod \"node-exporter-2bdv4\" (UID: \"65a1a259-27df-49c4-a300-4c21df5ae6c2\") " pod="openshift-monitoring/node-exporter-2bdv4"
Jul 28 01:17:05.822571 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:05.812199    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/65a1a259-27df-49c4-a300-4c21df5ae6c2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2bdv4\" (UID: \"65a1a259-27df-49c4-a300-4c21df5ae6c2\") " pod="openshift-monitoring/node-exporter-2bdv4"
Jul 28 01:17:05.824625 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:05.824406    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lwkx\" (UniqueName: \"kubernetes.io/projected/65a1a259-27df-49c4-a300-4c21df5ae6c2-kube-api-access-8lwkx\") pod \"node-exporter-2bdv4\" (UID: \"65a1a259-27df-49c4-a300-4c21df5ae6c2\") " pod="openshift-monitoring/node-exporter-2bdv4"
Jul 28 01:17:06.316617 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:06.316570    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/65a1a259-27df-49c4-a300-4c21df5ae6c2-node-exporter-tls\") pod \"node-exporter-2bdv4\" (UID: \"65a1a259-27df-49c4-a300-4c21df5ae6c2\") " pod="openshift-monitoring/node-exporter-2bdv4"
Jul 28 01:17:06.316799 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:17:06.316735    2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 28 01:17:06.316859 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:17:06.316814    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65a1a259-27df-49c4-a300-4c21df5ae6c2-node-exporter-tls podName:65a1a259-27df-49c4-a300-4c21df5ae6c2 nodeName:}" failed. No retries permitted until 2026-07-28 01:17:07.316798363 +0000 UTC m=+97.820559653 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/65a1a259-27df-49c4-a300-4c21df5ae6c2-node-exporter-tls") pod "node-exporter-2bdv4" (UID: "65a1a259-27df-49c4-a300-4c21df5ae6c2") : secret "node-exporter-tls" not found
Jul 28 01:17:07.325968 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:07.325867    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/65a1a259-27df-49c4-a300-4c21df5ae6c2-node-exporter-tls\") pod \"node-exporter-2bdv4\" (UID: \"65a1a259-27df-49c4-a300-4c21df5ae6c2\") " pod="openshift-monitoring/node-exporter-2bdv4"
Jul 28 01:17:07.328745 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:07.328717    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/65a1a259-27df-49c4-a300-4c21df5ae6c2-node-exporter-tls\") pod \"node-exporter-2bdv4\" (UID: \"65a1a259-27df-49c4-a300-4c21df5ae6c2\") " pod="openshift-monitoring/node-exporter-2bdv4"
Jul 28 01:17:07.374917 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:07.374882    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2bdv4"
Jul 28 01:17:07.386492 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:07.386464    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-865ff46f64-k9qw5"
Jul 28 01:17:07.509367 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:07.509329    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-68l4f"
Jul 28 01:17:07.907626 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:17:07.907600    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65a1a259_27df_49c4_a300_4c21df5ae6c2.slice/crio-e92293e31763a8b60c5041dfa6335b5de87cce4f1e245a1f7faf7d28f2878b6a WatchSource:0}: Error finding container e92293e31763a8b60c5041dfa6335b5de87cce4f1e245a1f7faf7d28f2878b6a: Status 404 returned error can't find the container with id e92293e31763a8b60c5041dfa6335b5de87cce4f1e245a1f7faf7d28f2878b6a
Jul 28 01:17:08.817628 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:08.817592    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v6mhz" event={"ID":"872fcfeb-a64a-4749-b65c-89d38987befa","Type":"ContainerStarted","Data":"4e1eeda6c529b0520f35ea241bf11bc7206ca17cbcf9114506719ee599497b92"}
Jul 28 01:17:08.819264 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:08.819234    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2bdv4" event={"ID":"65a1a259-27df-49c4-a300-4c21df5ae6c2","Type":"ContainerStarted","Data":"e92293e31763a8b60c5041dfa6335b5de87cce4f1e245a1f7faf7d28f2878b6a"}
Jul 28 01:17:08.834456 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:08.834390    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-v6mhz" podStartSLOduration=9.663633096 podStartE2EDuration="21.834372731s" totalImagesPullingTime="12.170739635s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:16:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:17:08.833059326 +0000 UTC m=+99.336820638" watchObservedRunningTime="2026-07-28 01:17:08.834372731 +0000 UTC m=+99.338134042"
Jul 28 01:17:09.826630 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:09.826595    2562 generic.go:356] "Generic (PLEG): container finished" podID="65a1a259-27df-49c4-a300-4c21df5ae6c2" containerID="ef2fc7d752df7f8e7d7650a3ffdb73606e31569c423982d8b384f3824dd57fd5" exitCode=0
Jul 28 01:17:09.827018 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:09.826680    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2bdv4" event={"ID":"65a1a259-27df-49c4-a300-4c21df5ae6c2","Type":"ContainerDied","Data":"ef2fc7d752df7f8e7d7650a3ffdb73606e31569c423982d8b384f3824dd57fd5"}
Jul 28 01:17:10.832298 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:10.832250    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2bdv4" event={"ID":"65a1a259-27df-49c4-a300-4c21df5ae6c2","Type":"ContainerStarted","Data":"f4a627640ae829343095d770530dbeaadd37c2bcd64c020ff3b9089708accddd"}
Jul 28 01:17:10.832697 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:10.832312    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2bdv4" event={"ID":"65a1a259-27df-49c4-a300-4c21df5ae6c2","Type":"ContainerStarted","Data":"7b11a0a787c375ee22e30215985084b57f1ad8f3e990f5a341f1e1476c0416ab"}
Jul 28 01:17:10.849667 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:10.849610    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2bdv4" podStartSLOduration=4.934264739 podStartE2EDuration="5.849594197s" totalImagesPullingTime="851.512385ms" totalInitContainerRuntime="63.817073ms" isStatefulPod=true podCreationTimestamp="2026-07-28 01:17:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:17:10.848306641 +0000 UTC m=+101.352067953" watchObservedRunningTime="2026-07-28 01:17:10.849594197 +0000 UTC m=+101.353355508"
Jul 28 01:17:17.859044 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:17.859010    2562 generic.go:356] "Generic (PLEG): container finished" podID="f3813e32-ffca-4cbb-a86e-b8e33ca0f863" containerID="b3f141f9b07db34562a2726933200e9bcbd775be509a57fd16abab1d476b28d8" exitCode=0
Jul 28 01:17:17.859458 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:17.859082    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7ts22" event={"ID":"f3813e32-ffca-4cbb-a86e-b8e33ca0f863","Type":"ContainerDied","Data":"b3f141f9b07db34562a2726933200e9bcbd775be509a57fd16abab1d476b28d8"}
Jul 28 01:17:17.859458 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:17.859409    2562 scope.go:117] "RemoveContainer" containerID="b3f141f9b07db34562a2726933200e9bcbd775be509a57fd16abab1d476b28d8"
Jul 28 01:17:18.865760 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:18.865722    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7ts22" event={"ID":"f3813e32-ffca-4cbb-a86e-b8e33ca0f863","Type":"ContainerStarted","Data":"09239f30ee758092bf050d1d263381bea3429c5c0f6b4023da2ad2b2315349de"}
Jul 28 01:17:22.401976 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:22.401908    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-865ff46f64-k9qw5" podUID="d862dade-baa3-4c0c-8f7d-606d0664ec16" containerName="registry" containerID="cri-o://6788981e0f8da80dfd8e77c541e35663cbba017322c3a83f56a6a8aef2b6fb04" gracePeriod=30
Jul 28 01:17:22.668184 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:22.668162    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-865ff46f64-k9qw5"
Jul 28 01:17:22.756408 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:22.756372    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d862dade-baa3-4c0c-8f7d-606d0664ec16-bound-sa-token\") pod \"d862dade-baa3-4c0c-8f7d-606d0664ec16\" (UID: \"d862dade-baa3-4c0c-8f7d-606d0664ec16\") "
Jul 28 01:17:22.756639 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:22.756422    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d862dade-baa3-4c0c-8f7d-606d0664ec16-registry-certificates\") pod \"d862dade-baa3-4c0c-8f7d-606d0664ec16\" (UID: \"d862dade-baa3-4c0c-8f7d-606d0664ec16\") "
Jul 28 01:17:22.756639 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:22.756447    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d862dade-baa3-4c0c-8f7d-606d0664ec16-registry-tls\") pod \"d862dade-baa3-4c0c-8f7d-606d0664ec16\" (UID: \"d862dade-baa3-4c0c-8f7d-606d0664ec16\") "
Jul 28 01:17:22.756639 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:22.756480    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d862dade-baa3-4c0c-8f7d-606d0664ec16-image-registry-private-configuration\") pod \"d862dade-baa3-4c0c-8f7d-606d0664ec16\" (UID: \"d862dade-baa3-4c0c-8f7d-606d0664ec16\") "
Jul 28 01:17:22.756639 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:22.756508    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d862dade-baa3-4c0c-8f7d-606d0664ec16-trusted-ca\") pod \"d862dade-baa3-4c0c-8f7d-606d0664ec16\" (UID: \"d862dade-baa3-4c0c-8f7d-606d0664ec16\") "
Jul 28 01:17:22.756639 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:22.756539    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9j9w\" (UniqueName: \"kubernetes.io/projected/d862dade-baa3-4c0c-8f7d-606d0664ec16-kube-api-access-r9j9w\") pod \"d862dade-baa3-4c0c-8f7d-606d0664ec16\" (UID: \"d862dade-baa3-4c0c-8f7d-606d0664ec16\") "
Jul 28 01:17:22.756639 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:22.756597    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d862dade-baa3-4c0c-8f7d-606d0664ec16-ca-trust-extracted\") pod \"d862dade-baa3-4c0c-8f7d-606d0664ec16\" (UID: \"d862dade-baa3-4c0c-8f7d-606d0664ec16\") "
Jul 28 01:17:22.756639 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:22.756636    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d862dade-baa3-4c0c-8f7d-606d0664ec16-installation-pull-secrets\") pod \"d862dade-baa3-4c0c-8f7d-606d0664ec16\" (UID: \"d862dade-baa3-4c0c-8f7d-606d0664ec16\") "
Jul 28 01:17:22.757006 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:22.756979    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d862dade-baa3-4c0c-8f7d-606d0664ec16-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d862dade-baa3-4c0c-8f7d-606d0664ec16" (UID: "d862dade-baa3-4c0c-8f7d-606d0664ec16"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:17:22.757181 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:22.757147    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d862dade-baa3-4c0c-8f7d-606d0664ec16-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d862dade-baa3-4c0c-8f7d-606d0664ec16" (UID: "d862dade-baa3-4c0c-8f7d-606d0664ec16"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:17:22.759071 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:22.759032    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d862dade-baa3-4c0c-8f7d-606d0664ec16-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d862dade-baa3-4c0c-8f7d-606d0664ec16" (UID: "d862dade-baa3-4c0c-8f7d-606d0664ec16"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:17:22.759071 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:22.759028    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d862dade-baa3-4c0c-8f7d-606d0664ec16-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d862dade-baa3-4c0c-8f7d-606d0664ec16" (UID: "d862dade-baa3-4c0c-8f7d-606d0664ec16"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:17:22.759299 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:22.759266    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d862dade-baa3-4c0c-8f7d-606d0664ec16-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d862dade-baa3-4c0c-8f7d-606d0664ec16" (UID: "d862dade-baa3-4c0c-8f7d-606d0664ec16"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:17:22.759398 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:22.759330    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d862dade-baa3-4c0c-8f7d-606d0664ec16-kube-api-access-r9j9w" (OuterVolumeSpecName: "kube-api-access-r9j9w") pod "d862dade-baa3-4c0c-8f7d-606d0664ec16" (UID: "d862dade-baa3-4c0c-8f7d-606d0664ec16"). InnerVolumeSpecName "kube-api-access-r9j9w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:17:22.759527 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:22.759507    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d862dade-baa3-4c0c-8f7d-606d0664ec16-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d862dade-baa3-4c0c-8f7d-606d0664ec16" (UID: "d862dade-baa3-4c0c-8f7d-606d0664ec16"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:17:22.765353 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:22.765327    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d862dade-baa3-4c0c-8f7d-606d0664ec16-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d862dade-baa3-4c0c-8f7d-606d0664ec16" (UID: "d862dade-baa3-4c0c-8f7d-606d0664ec16"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:17:22.857810 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:22.857778    2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d862dade-baa3-4c0c-8f7d-606d0664ec16-image-registry-private-configuration\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:17:22.857810 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:22.857805    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d862dade-baa3-4c0c-8f7d-606d0664ec16-trusted-ca\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:17:22.857810 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:22.857815    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9j9w\" (UniqueName: \"kubernetes.io/projected/d862dade-baa3-4c0c-8f7d-606d0664ec16-kube-api-access-r9j9w\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:17:22.858029 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:22.857824    2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d862dade-baa3-4c0c-8f7d-606d0664ec16-ca-trust-extracted\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:17:22.858029 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:22.857833    2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d862dade-baa3-4c0c-8f7d-606d0664ec16-installation-pull-secrets\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:17:22.858029 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:22.857841    2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d862dade-baa3-4c0c-8f7d-606d0664ec16-bound-sa-token\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:17:22.858029 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:22.857849    2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d862dade-baa3-4c0c-8f7d-606d0664ec16-registry-certificates\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:17:22.858029 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:22.857857    2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d862dade-baa3-4c0c-8f7d-606d0664ec16-registry-tls\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:17:22.883202 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:22.883169    2562 generic.go:356] "Generic (PLEG): container finished" podID="d862dade-baa3-4c0c-8f7d-606d0664ec16" containerID="6788981e0f8da80dfd8e77c541e35663cbba017322c3a83f56a6a8aef2b6fb04" exitCode=0
Jul 28 01:17:22.883372 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:22.883215    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-865ff46f64-k9qw5"
Jul 28 01:17:22.883372 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:22.883219    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-865ff46f64-k9qw5" event={"ID":"d862dade-baa3-4c0c-8f7d-606d0664ec16","Type":"ContainerDied","Data":"6788981e0f8da80dfd8e77c541e35663cbba017322c3a83f56a6a8aef2b6fb04"}
Jul 28 01:17:22.883372 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:22.883298    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-865ff46f64-k9qw5" event={"ID":"d862dade-baa3-4c0c-8f7d-606d0664ec16","Type":"ContainerDied","Data":"7e26c1d640d79a27b3cfe8f7a005e7a7d002db70a9d82b90224e9af067a35572"}
Jul 28 01:17:22.883372 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:22.883342    2562 scope.go:117] "RemoveContainer" containerID="6788981e0f8da80dfd8e77c541e35663cbba017322c3a83f56a6a8aef2b6fb04"
Jul 28 01:17:22.891630 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:22.891612    2562 scope.go:117] "RemoveContainer" containerID="6788981e0f8da80dfd8e77c541e35663cbba017322c3a83f56a6a8aef2b6fb04"
Jul 28 01:17:22.891917 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:17:22.891881    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6788981e0f8da80dfd8e77c541e35663cbba017322c3a83f56a6a8aef2b6fb04\": container with ID starting with 6788981e0f8da80dfd8e77c541e35663cbba017322c3a83f56a6a8aef2b6fb04 not found: ID does not exist" containerID="6788981e0f8da80dfd8e77c541e35663cbba017322c3a83f56a6a8aef2b6fb04"
Jul 28 01:17:22.891983 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:22.891925    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6788981e0f8da80dfd8e77c541e35663cbba017322c3a83f56a6a8aef2b6fb04"} err="failed to get container status \"6788981e0f8da80dfd8e77c541e35663cbba017322c3a83f56a6a8aef2b6fb04\": rpc error: code = NotFound desc = could not find container \"6788981e0f8da80dfd8e77c541e35663cbba017322c3a83f56a6a8aef2b6fb04\": container with ID starting with 6788981e0f8da80dfd8e77c541e35663cbba017322c3a83f56a6a8aef2b6fb04 not found: ID does not exist"
Jul 28 01:17:22.902538 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:22.902515    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-865ff46f64-k9qw5"]
Jul 28 01:17:22.905996 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:22.905948    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-865ff46f64-k9qw5"]
Jul 28 01:17:24.012534 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:24.012501    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d862dade-baa3-4c0c-8f7d-606d0664ec16" path="/var/lib/kubelet/pods/d862dade-baa3-4c0c-8f7d-606d0664ec16/volumes"
Jul 28 01:17:39.945794 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:39.945753    2562 generic.go:356] "Generic (PLEG): container finished" podID="fdc9c853-3bbb-4e92-8d4f-960c02d7a125" containerID="87c023e53d018e00d30042244317ee87124c6713048fa6a134b98ce587a61918" exitCode=0
Jul 28 01:17:39.946323 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:39.945804    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7nlbl" event={"ID":"fdc9c853-3bbb-4e92-8d4f-960c02d7a125","Type":"ContainerDied","Data":"87c023e53d018e00d30042244317ee87124c6713048fa6a134b98ce587a61918"}
Jul 28 01:17:39.946323 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:39.946213    2562 scope.go:117] "RemoveContainer" containerID="87c023e53d018e00d30042244317ee87124c6713048fa6a134b98ce587a61918"
Jul 28 01:17:40.950869 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:17:40.950834    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7nlbl" event={"ID":"fdc9c853-3bbb-4e92-8d4f-960c02d7a125","Type":"ContainerStarted","Data":"b0d4e361a020475eab2f2dfc0f31d3b005d2353ef4179f0a858ed5bded1c8381"}
Jul 28 01:20:29.902245 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:29.902204    2562 kubelet.go:1648] "Image garbage collection succeeded"
Jul 28 01:20:37.419027 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:37.418990    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-sdhrk"]
Jul 28 01:20:37.421346 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:37.419275    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d862dade-baa3-4c0c-8f7d-606d0664ec16" containerName="registry"
Jul 28 01:20:37.421346 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:37.419285    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d862dade-baa3-4c0c-8f7d-606d0664ec16" containerName="registry"
Jul 28 01:20:37.421346 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:37.419337    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d862dade-baa3-4c0c-8f7d-606d0664ec16" containerName="registry"
Jul 28 01:20:37.422286 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:37.422268    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-sdhrk"
Jul 28 01:20:37.424536 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:37.424514    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 28 01:20:37.424667 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:37.424533    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ndl4c\""
Jul 28 01:20:37.424667 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:37.424595    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 28 01:20:37.424785 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:37.424663    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 28 01:20:37.424897 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:37.424882    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 28 01:20:37.434752 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:37.434730    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-sdhrk"]
Jul 28 01:20:37.466283 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:37.466247    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4385af7d-5257-4f5b-b0fc-e9d1f4ba547a-tmp\") pod \"opendatahub-operator-controller-manager-8699bb9d7c-sdhrk\" (UID: \"4385af7d-5257-4f5b-b0fc-e9d1f4ba547a\") " pod="opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-sdhrk"
Jul 28 01:20:37.466416 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:37.466289    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4385af7d-5257-4f5b-b0fc-e9d1f4ba547a-webhook-cert\") pod \"opendatahub-operator-controller-manager-8699bb9d7c-sdhrk\" (UID: \"4385af7d-5257-4f5b-b0fc-e9d1f4ba547a\") " pod="opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-sdhrk"
Jul 28 01:20:37.466416 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:37.466308    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmk2q\" (UniqueName: \"kubernetes.io/projected/4385af7d-5257-4f5b-b0fc-e9d1f4ba547a-kube-api-access-hmk2q\") pod \"opendatahub-operator-controller-manager-8699bb9d7c-sdhrk\" (UID: \"4385af7d-5257-4f5b-b0fc-e9d1f4ba547a\") " pod="opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-sdhrk"
Jul 28 01:20:37.466508 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:37.466405    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4385af7d-5257-4f5b-b0fc-e9d1f4ba547a-manifests\") pod \"opendatahub-operator-controller-manager-8699bb9d7c-sdhrk\" (UID: \"4385af7d-5257-4f5b-b0fc-e9d1f4ba547a\") " pod="opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-sdhrk"
Jul 28 01:20:37.466508 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:37.466438    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4385af7d-5257-4f5b-b0fc-e9d1f4ba547a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8699bb9d7c-sdhrk\" (UID: \"4385af7d-5257-4f5b-b0fc-e9d1f4ba547a\") " pod="opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-sdhrk"
Jul 28 01:20:37.567700 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:37.567664    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4385af7d-5257-4f5b-b0fc-e9d1f4ba547a-tmp\") pod \"opendatahub-operator-controller-manager-8699bb9d7c-sdhrk\" (UID: \"4385af7d-5257-4f5b-b0fc-e9d1f4ba547a\") " pod="opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-sdhrk"
Jul 28 01:20:37.567885 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:37.567713    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4385af7d-5257-4f5b-b0fc-e9d1f4ba547a-webhook-cert\") pod \"opendatahub-operator-controller-manager-8699bb9d7c-sdhrk\" (UID: \"4385af7d-5257-4f5b-b0fc-e9d1f4ba547a\") " pod="opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-sdhrk"
Jul 28 01:20:37.567885 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:37.567737    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmk2q\" (UniqueName: \"kubernetes.io/projected/4385af7d-5257-4f5b-b0fc-e9d1f4ba547a-kube-api-access-hmk2q\") pod \"opendatahub-operator-controller-manager-8699bb9d7c-sdhrk\" (UID: \"4385af7d-5257-4f5b-b0fc-e9d1f4ba547a\") " pod="opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-sdhrk"
Jul 28 01:20:37.567885 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:37.567792    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4385af7d-5257-4f5b-b0fc-e9d1f4ba547a-manifests\") pod \"opendatahub-operator-controller-manager-8699bb9d7c-sdhrk\" (UID: \"4385af7d-5257-4f5b-b0fc-e9d1f4ba547a\") " pod="opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-sdhrk"
Jul 28 01:20:37.567885 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:37.567809    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4385af7d-5257-4f5b-b0fc-e9d1f4ba547a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8699bb9d7c-sdhrk\" (UID: \"4385af7d-5257-4f5b-b0fc-e9d1f4ba547a\") " pod="opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-sdhrk"
Jul 28 01:20:37.568198 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:37.568176    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4385af7d-5257-4f5b-b0fc-e9d1f4ba547a-manifests\") pod \"opendatahub-operator-controller-manager-8699bb9d7c-sdhrk\" (UID: \"4385af7d-5257-4f5b-b0fc-e9d1f4ba547a\") " pod="opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-sdhrk"
Jul 28 01:20:37.570037 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:37.570010    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4385af7d-5257-4f5b-b0fc-e9d1f4ba547a-tmp\") pod \"opendatahub-operator-controller-manager-8699bb9d7c-sdhrk\" (UID: \"4385af7d-5257-4f5b-b0fc-e9d1f4ba547a\") " pod="opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-sdhrk"
Jul 28 01:20:37.570151 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:37.570096    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4385af7d-5257-4f5b-b0fc-e9d1f4ba547a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8699bb9d7c-sdhrk\" (UID: \"4385af7d-5257-4f5b-b0fc-e9d1f4ba547a\") " pod="opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-sdhrk"
Jul 28 01:20:37.570304 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:37.570286    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4385af7d-5257-4f5b-b0fc-e9d1f4ba547a-webhook-cert\") pod \"opendatahub-operator-controller-manager-8699bb9d7c-sdhrk\" (UID: \"4385af7d-5257-4f5b-b0fc-e9d1f4ba547a\") " pod="opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-sdhrk"
Jul 28 01:20:37.574690 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:37.574665    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmk2q\" (UniqueName: \"kubernetes.io/projected/4385af7d-5257-4f5b-b0fc-e9d1f4ba547a-kube-api-access-hmk2q\") pod \"opendatahub-operator-controller-manager-8699bb9d7c-sdhrk\" (UID: \"4385af7d-5257-4f5b-b0fc-e9d1f4ba547a\") " pod="opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-sdhrk"
Jul 28 01:20:37.732141 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:37.732041    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-sdhrk"
Jul 28 01:20:37.886119 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:37.886095    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-sdhrk"]
Jul 28 01:20:37.888884 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:20:37.888858    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4385af7d_5257_4f5b_b0fc_e9d1f4ba547a.slice/crio-ff22d606f7dacf369401ba2c02a1f479550fb1fd23b3ce79b6803d506e24fc6f WatchSource:0}: Error finding container ff22d606f7dacf369401ba2c02a1f479550fb1fd23b3ce79b6803d506e24fc6f: Status 404 returned error can't find the container with id ff22d606f7dacf369401ba2c02a1f479550fb1fd23b3ce79b6803d506e24fc6f
Jul 28 01:20:37.890602 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:37.890585    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 01:20:38.599059 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:38.599015    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-sdhrk" event={"ID":"4385af7d-5257-4f5b-b0fc-e9d1f4ba547a","Type":"ContainerStarted","Data":"ff22d606f7dacf369401ba2c02a1f479550fb1fd23b3ce79b6803d506e24fc6f"}
Jul 28 01:20:41.613154 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:41.613117    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-sdhrk" event={"ID":"4385af7d-5257-4f5b-b0fc-e9d1f4ba547a","Type":"ContainerStarted","Data":"77aea34fb7e8a6ce65da5ea762865141a903c3b31f8c85f54326690f6e47361e"}
Jul 28 01:20:42.618254 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:42.618213    2562 generic.go:356] "Generic (PLEG): container finished" podID="4385af7d-5257-4f5b-b0fc-e9d1f4ba547a" containerID="77aea34fb7e8a6ce65da5ea762865141a903c3b31f8c85f54326690f6e47361e" exitCode=0
Jul 28 01:20:42.618743 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:42.618272    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-sdhrk" event={"ID":"4385af7d-5257-4f5b-b0fc-e9d1f4ba547a","Type":"ContainerDied","Data":"77aea34fb7e8a6ce65da5ea762865141a903c3b31f8c85f54326690f6e47361e"}
Jul 28 01:20:43.623982 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:43.623950    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-sdhrk" event={"ID":"4385af7d-5257-4f5b-b0fc-e9d1f4ba547a","Type":"ContainerStarted","Data":"95b4c106359fdb991eba75905e466b344a4999c2505ccf586d71a28c49629daa"}
Jul 28 01:20:43.624349 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:43.624083    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-sdhrk"
Jul 28 01:20:43.646509 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:43.646447    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-sdhrk" podStartSLOduration=2.372433192 podStartE2EDuration="6.646428397s" totalImagesPullingTime="3.197331003s" totalInitContainerRuntime="1.076664202s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:20:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:20:43.642760216 +0000 UTC m=+314.146521575" watchObservedRunningTime="2026-07-28 01:20:43.646428397 +0000 UTC m=+314.150189710"
Jul 28 01:20:54.631662 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:54.631627    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-sdhrk"
Jul 28 01:20:57.351970 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:57.351930    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-sbt5v"]
Jul 28 01:20:57.357633 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:57.357603    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-sbt5v"
Jul 28 01:20:57.359627 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:57.359601    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-dn8zl\""
Jul 28 01:20:57.359865 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:57.359662    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 28 01:20:57.366761 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:57.366739    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-sbt5v"]
Jul 28 01:20:57.430621 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:57.430586    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9qdh\" (UniqueName: \"kubernetes.io/projected/df40053d-df05-4109-b47b-be7f11bf16a6-kube-api-access-p9qdh\") pod \"odh-model-controller-7998c67dc4-sbt5v\" (UID: \"df40053d-df05-4109-b47b-be7f11bf16a6\") " pod="opendatahub/odh-model-controller-7998c67dc4-sbt5v"
Jul 28 01:20:57.430788 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:57.430641    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df40053d-df05-4109-b47b-be7f11bf16a6-cert\") pod \"odh-model-controller-7998c67dc4-sbt5v\" (UID: \"df40053d-df05-4109-b47b-be7f11bf16a6\") " pod="opendatahub/odh-model-controller-7998c67dc4-sbt5v"
Jul 28 01:20:57.531748 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:57.531707    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9qdh\" (UniqueName: \"kubernetes.io/projected/df40053d-df05-4109-b47b-be7f11bf16a6-kube-api-access-p9qdh\") pod \"odh-model-controller-7998c67dc4-sbt5v\" (UID: \"df40053d-df05-4109-b47b-be7f11bf16a6\") " pod="opendatahub/odh-model-controller-7998c67dc4-sbt5v"
Jul 28 01:20:57.531944 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:57.531762    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df40053d-df05-4109-b47b-be7f11bf16a6-cert\") pod \"odh-model-controller-7998c67dc4-sbt5v\" (UID: \"df40053d-df05-4109-b47b-be7f11bf16a6\") " pod="opendatahub/odh-model-controller-7998c67dc4-sbt5v"
Jul 28 01:20:57.531944 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:20:57.531864    2562 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 28 01:20:57.531944 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:20:57.531916    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df40053d-df05-4109-b47b-be7f11bf16a6-cert podName:df40053d-df05-4109-b47b-be7f11bf16a6 nodeName:}" failed. No retries permitted until 2026-07-28 01:20:58.03190056 +0000 UTC m=+328.535661850 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/df40053d-df05-4109-b47b-be7f11bf16a6-cert") pod "odh-model-controller-7998c67dc4-sbt5v" (UID: "df40053d-df05-4109-b47b-be7f11bf16a6") : secret "odh-model-controller-webhook-cert" not found
Jul 28 01:20:57.541967 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:57.541937    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9qdh\" (UniqueName: \"kubernetes.io/projected/df40053d-df05-4109-b47b-be7f11bf16a6-kube-api-access-p9qdh\") pod \"odh-model-controller-7998c67dc4-sbt5v\" (UID: \"df40053d-df05-4109-b47b-be7f11bf16a6\") " pod="opendatahub/odh-model-controller-7998c67dc4-sbt5v"
Jul 28 01:20:57.864473 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:57.864435    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-4jlg7"]
Jul 28 01:20:57.866696 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:57.866678    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-4jlg7"
Jul 28 01:20:57.868399 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:57.868380    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 28 01:20:57.868490 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:57.868382    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-x2ch8\""
Jul 28 01:20:57.877288 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:57.877258    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-4jlg7"]
Jul 28 01:20:57.935453 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:57.935415    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d509438d-c187-4bfb-ba75-e852edfbdb51-tls-certs\") pod \"model-serving-api-54d89bd5fc-4jlg7\" (UID: \"d509438d-c187-4bfb-ba75-e852edfbdb51\") " pod="opendatahub/model-serving-api-54d89bd5fc-4jlg7"
Jul 28 01:20:57.935643 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:57.935592    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp6vl\" (UniqueName: \"kubernetes.io/projected/d509438d-c187-4bfb-ba75-e852edfbdb51-kube-api-access-vp6vl\") pod \"model-serving-api-54d89bd5fc-4jlg7\" (UID: \"d509438d-c187-4bfb-ba75-e852edfbdb51\") " pod="opendatahub/model-serving-api-54d89bd5fc-4jlg7"
Jul 28 01:20:58.036759 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:58.036720    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d509438d-c187-4bfb-ba75-e852edfbdb51-tls-certs\") pod \"model-serving-api-54d89bd5fc-4jlg7\" (UID: \"d509438d-c187-4bfb-ba75-e852edfbdb51\") " pod="opendatahub/model-serving-api-54d89bd5fc-4jlg7"
Jul 28 01:20:58.036953 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:58.036774    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df40053d-df05-4109-b47b-be7f11bf16a6-cert\") pod \"odh-model-controller-7998c67dc4-sbt5v\" (UID: \"df40053d-df05-4109-b47b-be7f11bf16a6\") " pod="opendatahub/odh-model-controller-7998c67dc4-sbt5v"
Jul 28 01:20:58.036953 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:58.036810    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp6vl\" (UniqueName: \"kubernetes.io/projected/d509438d-c187-4bfb-ba75-e852edfbdb51-kube-api-access-vp6vl\") pod \"model-serving-api-54d89bd5fc-4jlg7\" (UID: \"d509438d-c187-4bfb-ba75-e852edfbdb51\") " pod="opendatahub/model-serving-api-54d89bd5fc-4jlg7"
Jul 28 01:20:58.039108 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:58.039085    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df40053d-df05-4109-b47b-be7f11bf16a6-cert\") pod \"odh-model-controller-7998c67dc4-sbt5v\" (UID: \"df40053d-df05-4109-b47b-be7f11bf16a6\") " pod="opendatahub/odh-model-controller-7998c67dc4-sbt5v"
Jul 28 01:20:58.039234 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:58.039187    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d509438d-c187-4bfb-ba75-e852edfbdb51-tls-certs\") pod \"model-serving-api-54d89bd5fc-4jlg7\" (UID: \"d509438d-c187-4bfb-ba75-e852edfbdb51\") " pod="opendatahub/model-serving-api-54d89bd5fc-4jlg7"
Jul 28 01:20:58.043935 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:58.043914    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp6vl\" (UniqueName: \"kubernetes.io/projected/d509438d-c187-4bfb-ba75-e852edfbdb51-kube-api-access-vp6vl\") pod \"model-serving-api-54d89bd5fc-4jlg7\" (UID: \"d509438d-c187-4bfb-ba75-e852edfbdb51\") " pod="opendatahub/model-serving-api-54d89bd5fc-4jlg7"
Jul 28 01:20:58.180268 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:58.180171    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-4jlg7"
Jul 28 01:20:58.270993 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:58.270965    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-sbt5v"
Jul 28 01:20:58.323387 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:58.322961    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-4jlg7"]
Jul 28 01:20:58.398798 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:58.398766    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-sbt5v"]
Jul 28 01:20:58.401829 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:20:58.401804    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf40053d_df05_4109_b47b_be7f11bf16a6.slice/crio-a8ce3107689878c496d986dcd4c2b329c4892bc66d3e16a3c27d60c9ba3c50db WatchSource:0}: Error finding container a8ce3107689878c496d986dcd4c2b329c4892bc66d3e16a3c27d60c9ba3c50db: Status 404 returned error can't find the container with id a8ce3107689878c496d986dcd4c2b329c4892bc66d3e16a3c27d60c9ba3c50db
Jul 28 01:20:58.685753 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:58.685722    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-sbt5v" event={"ID":"df40053d-df05-4109-b47b-be7f11bf16a6","Type":"ContainerStarted","Data":"a8ce3107689878c496d986dcd4c2b329c4892bc66d3e16a3c27d60c9ba3c50db"}
Jul 28 01:20:58.686791 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:20:58.686767    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-4jlg7" event={"ID":"d509438d-c187-4bfb-ba75-e852edfbdb51","Type":"ContainerStarted","Data":"bac567b0a7e383e11b32edf95e93593fab055ca43b8f787575646534b706e0ac"}
Jul 28 01:21:01.702392 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:01.702359    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-sbt5v" event={"ID":"df40053d-df05-4109-b47b-be7f11bf16a6","Type":"ContainerStarted","Data":"6b1327861d3cf4214f788e52953768a5b2526ab975dbb2e0f1bbce7c32958c6b"}
Jul 28 01:21:01.702847 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:01.702588    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-sbt5v"
Jul 28 01:21:01.704013 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:01.703991    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-4jlg7" event={"ID":"d509438d-c187-4bfb-ba75-e852edfbdb51","Type":"ContainerStarted","Data":"de038d99aff637d49abd863ca71d8546b893d1c1e6f314165d89fa29cfc49237"}
Jul 28 01:21:01.704118 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:01.704046    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-4jlg7"
Jul 28 01:21:01.718495 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:01.718458    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-sbt5v" podStartSLOduration=1.732482846 podStartE2EDuration="4.718446649s" totalImagesPullingTime="2.985963803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:20:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:21:01.717114687 +0000 UTC m=+332.220876063" watchObservedRunningTime="2026-07-28 01:21:01.718446649 +0000 UTC m=+332.222207960"
Jul 28 01:21:01.734136 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:01.734084    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-4jlg7" podStartSLOduration=1.722615869 podStartE2EDuration="4.734071902s" totalImagesPullingTime="3.011456033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:20:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:21:01.73325877 +0000 UTC m=+332.237020107" watchObservedRunningTime="2026-07-28 01:21:01.734071902 +0000 UTC m=+332.237833213"
Jul 28 01:21:02.477939 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:02.477900    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-78d7d88cc5-rhkkf"]
Jul 28 01:21:02.481338 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:02.481317    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-78d7d88cc5-rhkkf"
Jul 28 01:21:02.483132 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:02.483109    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 28 01:21:02.483132 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:02.483130    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-9wx22\""
Jul 28 01:21:02.483316 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:02.483119    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 28 01:21:02.491194 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:02.491173    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-78d7d88cc5-rhkkf"]
Jul 28 01:21:02.576676 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:02.576640    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxzb8\" (UniqueName: \"kubernetes.io/projected/2d033810-cbde-44be-a6f8-6dab6a46240a-kube-api-access-qxzb8\") pod \"kube-auth-proxy-78d7d88cc5-rhkkf\" (UID: \"2d033810-cbde-44be-a6f8-6dab6a46240a\") " pod="openshift-ingress/kube-auth-proxy-78d7d88cc5-rhkkf"
Jul 28 01:21:02.576865 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:02.576696    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d033810-cbde-44be-a6f8-6dab6a46240a-tmp\") pod \"kube-auth-proxy-78d7d88cc5-rhkkf\" (UID: \"2d033810-cbde-44be-a6f8-6dab6a46240a\") " pod="openshift-ingress/kube-auth-proxy-78d7d88cc5-rhkkf"
Jul 28 01:21:02.576865 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:02.576728    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d033810-cbde-44be-a6f8-6dab6a46240a-tls-certs\") pod \"kube-auth-proxy-78d7d88cc5-rhkkf\" (UID: \"2d033810-cbde-44be-a6f8-6dab6a46240a\") " pod="openshift-ingress/kube-auth-proxy-78d7d88cc5-rhkkf"
Jul 28 01:21:02.677756 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:02.677714    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d033810-cbde-44be-a6f8-6dab6a46240a-tmp\") pod \"kube-auth-proxy-78d7d88cc5-rhkkf\" (UID: \"2d033810-cbde-44be-a6f8-6dab6a46240a\") " pod="openshift-ingress/kube-auth-proxy-78d7d88cc5-rhkkf"
Jul 28 01:21:02.677756 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:02.677763    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d033810-cbde-44be-a6f8-6dab6a46240a-tls-certs\") pod \"kube-auth-proxy-78d7d88cc5-rhkkf\" (UID: \"2d033810-cbde-44be-a6f8-6dab6a46240a\") " pod="openshift-ingress/kube-auth-proxy-78d7d88cc5-rhkkf"
Jul 28 01:21:02.678001 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:02.677801    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxzb8\" (UniqueName: \"kubernetes.io/projected/2d033810-cbde-44be-a6f8-6dab6a46240a-kube-api-access-qxzb8\") pod \"kube-auth-proxy-78d7d88cc5-rhkkf\" (UID: \"2d033810-cbde-44be-a6f8-6dab6a46240a\") " pod="openshift-ingress/kube-auth-proxy-78d7d88cc5-rhkkf"
Jul 28 01:21:02.680574 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:02.680537    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d033810-cbde-44be-a6f8-6dab6a46240a-tmp\") pod \"kube-auth-proxy-78d7d88cc5-rhkkf\" (UID: \"2d033810-cbde-44be-a6f8-6dab6a46240a\") " pod="openshift-ingress/kube-auth-proxy-78d7d88cc5-rhkkf"
Jul 28 01:21:02.680683 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:02.680610    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d033810-cbde-44be-a6f8-6dab6a46240a-tls-certs\") pod \"kube-auth-proxy-78d7d88cc5-rhkkf\" (UID: \"2d033810-cbde-44be-a6f8-6dab6a46240a\") " pod="openshift-ingress/kube-auth-proxy-78d7d88cc5-rhkkf"
Jul 28 01:21:02.685006 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:02.684984    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxzb8\" (UniqueName: \"kubernetes.io/projected/2d033810-cbde-44be-a6f8-6dab6a46240a-kube-api-access-qxzb8\") pod \"kube-auth-proxy-78d7d88cc5-rhkkf\" (UID: \"2d033810-cbde-44be-a6f8-6dab6a46240a\") " pod="openshift-ingress/kube-auth-proxy-78d7d88cc5-rhkkf"
Jul 28 01:21:02.791814 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:02.791728    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-78d7d88cc5-rhkkf"
Jul 28 01:21:02.923815 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:02.923785    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-78d7d88cc5-rhkkf"]
Jul 28 01:21:02.927293 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:21:02.927264    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d033810_cbde_44be_a6f8_6dab6a46240a.slice/crio-3b60ee246cd4ea74c156f1711736c2318b6440e4ce9af31d69b43f0f7d7f2b09 WatchSource:0}: Error finding container 3b60ee246cd4ea74c156f1711736c2318b6440e4ce9af31d69b43f0f7d7f2b09: Status 404 returned error can't find the container with id 3b60ee246cd4ea74c156f1711736c2318b6440e4ce9af31d69b43f0f7d7f2b09
Jul 28 01:21:03.718013 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:03.717973    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-78d7d88cc5-rhkkf" event={"ID":"2d033810-cbde-44be-a6f8-6dab6a46240a","Type":"ContainerStarted","Data":"3b60ee246cd4ea74c156f1711736c2318b6440e4ce9af31d69b43f0f7d7f2b09"}
Jul 28 01:21:03.758657 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:03.758617    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wnwb5"]
Jul 28 01:21:03.762340 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:03.762316    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wnwb5"
Jul 28 01:21:03.764621 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:03.764430    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 28 01:21:03.764621 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:03.764462    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 28 01:21:03.764621 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:03.764468    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 28 01:21:03.764621 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:03.764536    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 28 01:21:03.764621 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:03.764537    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-cbtrp\""
Jul 28 01:21:03.774292 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:03.774270    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wnwb5"]
Jul 28 01:21:03.888915 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:03.888879    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b4ac99ee-01bc-4218-b76d-197257bdeb8c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-wnwb5\" (UID: \"b4ac99ee-01bc-4218-b76d-197257bdeb8c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wnwb5"
Jul 28 01:21:03.889366 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:03.888937    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4ac99ee-01bc-4218-b76d-197257bdeb8c-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-wnwb5\" (UID: \"b4ac99ee-01bc-4218-b76d-197257bdeb8c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wnwb5"
Jul 28 01:21:03.889366 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:03.888980    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b4ac99ee-01bc-4218-b76d-197257bdeb8c-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-wnwb5\" (UID: \"b4ac99ee-01bc-4218-b76d-197257bdeb8c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wnwb5"
Jul 28 01:21:03.889366 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:03.889002    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4ac99ee-01bc-4218-b76d-197257bdeb8c-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-wnwb5\" (UID: \"b4ac99ee-01bc-4218-b76d-197257bdeb8c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wnwb5"
Jul 28 01:21:03.889366 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:03.889077    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfvk9\" (UniqueName: \"kubernetes.io/projected/b4ac99ee-01bc-4218-b76d-197257bdeb8c-kube-api-access-gfvk9\") pod \"istiod-openshift-gateway-7b7995d5cd-wnwb5\" (UID: \"b4ac99ee-01bc-4218-b76d-197257bdeb8c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wnwb5"
Jul 28 01:21:03.889366 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:03.889128    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b4ac99ee-01bc-4218-b76d-197257bdeb8c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-wnwb5\" (UID: \"b4ac99ee-01bc-4218-b76d-197257bdeb8c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wnwb5"
Jul 28 01:21:03.889366 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:03.889164    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b4ac99ee-01bc-4218-b76d-197257bdeb8c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-wnwb5\" (UID: \"b4ac99ee-01bc-4218-b76d-197257bdeb8c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wnwb5"
Jul 28 01:21:03.990278 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:03.990186    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b4ac99ee-01bc-4218-b76d-197257bdeb8c-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-wnwb5\" (UID: \"b4ac99ee-01bc-4218-b76d-197257bdeb8c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wnwb5"
Jul 28 01:21:03.990278 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:03.990231    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4ac99ee-01bc-4218-b76d-197257bdeb8c-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-wnwb5\" (UID: \"b4ac99ee-01bc-4218-b76d-197257bdeb8c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wnwb5"
Jul 28 01:21:03.990278 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:03.990275    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfvk9\" (UniqueName: \"kubernetes.io/projected/b4ac99ee-01bc-4218-b76d-197257bdeb8c-kube-api-access-gfvk9\") pod \"istiod-openshift-gateway-7b7995d5cd-wnwb5\" (UID: \"b4ac99ee-01bc-4218-b76d-197257bdeb8c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wnwb5"
Jul 28 01:21:03.990541 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:03.990293    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b4ac99ee-01bc-4218-b76d-197257bdeb8c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-wnwb5\" (UID: \"b4ac99ee-01bc-4218-b76d-197257bdeb8c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wnwb5"
Jul 28 01:21:03.990541 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:03.990309    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b4ac99ee-01bc-4218-b76d-197257bdeb8c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-wnwb5\" (UID: \"b4ac99ee-01bc-4218-b76d-197257bdeb8c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wnwb5"
Jul 28 01:21:03.990699 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:03.990593    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b4ac99ee-01bc-4218-b76d-197257bdeb8c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-wnwb5\" (UID: \"b4ac99ee-01bc-4218-b76d-197257bdeb8c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wnwb5"
Jul 28 01:21:03.990699 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:03.990650    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4ac99ee-01bc-4218-b76d-197257bdeb8c-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-wnwb5\" (UID: \"b4ac99ee-01bc-4218-b76d-197257bdeb8c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wnwb5"
Jul 28 01:21:03.991116 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:03.991086    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b4ac99ee-01bc-4218-b76d-197257bdeb8c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-wnwb5\" (UID: \"b4ac99ee-01bc-4218-b76d-197257bdeb8c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wnwb5"
Jul 28 01:21:03.992721 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:03.992695    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4ac99ee-01bc-4218-b76d-197257bdeb8c-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-wnwb5\" (UID: \"b4ac99ee-01bc-4218-b76d-197257bdeb8c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wnwb5"
Jul 28 01:21:03.992721 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:03.992708    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b4ac99ee-01bc-4218-b76d-197257bdeb8c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-wnwb5\" (UID: \"b4ac99ee-01bc-4218-b76d-197257bdeb8c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wnwb5"
Jul 28 01:21:03.992850 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:03.992841    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b4ac99ee-01bc-4218-b76d-197257bdeb8c-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-wnwb5\" (UID: \"b4ac99ee-01bc-4218-b76d-197257bdeb8c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wnwb5"
Jul 28 01:21:03.992884 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:03.992865    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b4ac99ee-01bc-4218-b76d-197257bdeb8c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-wnwb5\" (UID: \"b4ac99ee-01bc-4218-b76d-197257bdeb8c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wnwb5"
Jul 28 01:21:04.002319 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:04.002292    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4ac99ee-01bc-4218-b76d-197257bdeb8c-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-wnwb5\" (UID: \"b4ac99ee-01bc-4218-b76d-197257bdeb8c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wnwb5"
Jul 28 01:21:04.003038 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:04.003014    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfvk9\" (UniqueName: \"kubernetes.io/projected/b4ac99ee-01bc-4218-b76d-197257bdeb8c-kube-api-access-gfvk9\") pod \"istiod-openshift-gateway-7b7995d5cd-wnwb5\" (UID: \"b4ac99ee-01bc-4218-b76d-197257bdeb8c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wnwb5"
Jul 28 01:21:04.074072 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:04.074024    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wnwb5"
Jul 28 01:21:04.205207 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:04.205175    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wnwb5"]
Jul 28 01:21:04.208762 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:21:04.208734    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4ac99ee_01bc_4218_b76d_197257bdeb8c.slice/crio-f219cd2eb9a17e15108e4a314fc58a0a83e9a3bea3bf75163d491dee1f5b8151 WatchSource:0}: Error finding container f219cd2eb9a17e15108e4a314fc58a0a83e9a3bea3bf75163d491dee1f5b8151: Status 404 returned error can't find the container with id f219cd2eb9a17e15108e4a314fc58a0a83e9a3bea3bf75163d491dee1f5b8151
Jul 28 01:21:04.724454 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:04.724418    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wnwb5" event={"ID":"b4ac99ee-01bc-4218-b76d-197257bdeb8c","Type":"ContainerStarted","Data":"f219cd2eb9a17e15108e4a314fc58a0a83e9a3bea3bf75163d491dee1f5b8151"}
Jul 28 01:21:05.738304 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:05.738256    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-78d7d88cc5-rhkkf" event={"ID":"2d033810-cbde-44be-a6f8-6dab6a46240a","Type":"ContainerStarted","Data":"36a94184a42cb158d46895f414a7091b40ffdf469621f101c5497f748a1857ea"}
Jul 28 01:21:07.028845 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:07.028777    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-78d7d88cc5-rhkkf" podStartSLOduration=2.350905835 podStartE2EDuration="5.028756655s" totalImagesPullingTime="2.67785082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:21:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:21:05.758865269 +0000 UTC m=+336.262626595" watchObservedRunningTime="2026-07-28 01:21:07.028756655 +0000 UTC m=+337.532517967"
Jul 28 01:21:07.031776 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:07.031746    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-fwgkq"]
Jul 28 01:21:07.038458 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:07.038435    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fwgkq"
Jul 28 01:21:07.041176 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:07.040988    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-tr5lb\""
Jul 28 01:21:07.041654 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:07.041478    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 28 01:21:07.043370 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:07.043345    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-fwgkq"]
Jul 28 01:21:07.049028 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:07.049006    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-xwr9q"]
Jul 28 01:21:07.052969 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:07.052950    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xwr9q"
Jul 28 01:21:07.055810 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:07.055662    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 28 01:21:07.055810 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:07.055773    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-27gl8\""
Jul 28 01:21:07.060404 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:07.060346    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-xwr9q"]
Jul 28 01:21:07.221487 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:07.221388    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qprs\" (UniqueName: \"kubernetes.io/projected/ec2ef917-0f37-45fb-abf6-34b159a17fd7-kube-api-access-4qprs\") pod \"kserve-controller-manager-d6f4b65b8-fwgkq\" (UID: \"ec2ef917-0f37-45fb-abf6-34b159a17fd7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fwgkq"
Jul 28 01:21:07.221706 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:07.221538    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q57f\" (UniqueName: \"kubernetes.io/projected/75fb6ceb-add9-4486-a051-8ccfdd160483-kube-api-access-5q57f\") pod \"llmisvc-controller-manager-777c6bd7d5-xwr9q\" (UID: \"75fb6ceb-add9-4486-a051-8ccfdd160483\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xwr9q"
Jul 28 01:21:07.221706 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:07.221614    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75fb6ceb-add9-4486-a051-8ccfdd160483-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-xwr9q\" (UID: \"75fb6ceb-add9-4486-a051-8ccfdd160483\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xwr9q"
Jul 28 01:21:07.221706 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:07.221641    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec2ef917-0f37-45fb-abf6-34b159a17fd7-cert\") pod \"kserve-controller-manager-d6f4b65b8-fwgkq\" (UID: \"ec2ef917-0f37-45fb-abf6-34b159a17fd7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fwgkq"
Jul 28 01:21:07.322907 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:07.322809    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qprs\" (UniqueName: \"kubernetes.io/projected/ec2ef917-0f37-45fb-abf6-34b159a17fd7-kube-api-access-4qprs\") pod \"kserve-controller-manager-d6f4b65b8-fwgkq\" (UID: \"ec2ef917-0f37-45fb-abf6-34b159a17fd7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fwgkq"
Jul 28 01:21:07.323059 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:07.322976    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5q57f\" (UniqueName: \"kubernetes.io/projected/75fb6ceb-add9-4486-a051-8ccfdd160483-kube-api-access-5q57f\") pod \"llmisvc-controller-manager-777c6bd7d5-xwr9q\" (UID: \"75fb6ceb-add9-4486-a051-8ccfdd160483\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xwr9q"
Jul 28 01:21:07.323059 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:07.323032    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75fb6ceb-add9-4486-a051-8ccfdd160483-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-xwr9q\" (UID: \"75fb6ceb-add9-4486-a051-8ccfdd160483\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xwr9q"
Jul 28 01:21:07.323059 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:07.323056    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec2ef917-0f37-45fb-abf6-34b159a17fd7-cert\") pod \"kserve-controller-manager-d6f4b65b8-fwgkq\" (UID: \"ec2ef917-0f37-45fb-abf6-34b159a17fd7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fwgkq"
Jul 28 01:21:07.323349 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:21:07.323318    2562 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 28 01:21:07.323488 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:21:07.323412    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75fb6ceb-add9-4486-a051-8ccfdd160483-cert podName:75fb6ceb-add9-4486-a051-8ccfdd160483 nodeName:}" failed. No retries permitted until 2026-07-28 01:21:07.823387993 +0000 UTC m=+338.327149284 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/75fb6ceb-add9-4486-a051-8ccfdd160483-cert") pod "llmisvc-controller-manager-777c6bd7d5-xwr9q" (UID: "75fb6ceb-add9-4486-a051-8ccfdd160483") : secret "llmisvc-webhook-server-cert" not found
Jul 28 01:21:07.326015 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:07.325987    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec2ef917-0f37-45fb-abf6-34b159a17fd7-cert\") pod \"kserve-controller-manager-d6f4b65b8-fwgkq\" (UID: \"ec2ef917-0f37-45fb-abf6-34b159a17fd7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fwgkq"
Jul 28 01:21:07.337449 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:07.337423    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q57f\" (UniqueName: \"kubernetes.io/projected/75fb6ceb-add9-4486-a051-8ccfdd160483-kube-api-access-5q57f\") pod \"llmisvc-controller-manager-777c6bd7d5-xwr9q\" (UID: \"75fb6ceb-add9-4486-a051-8ccfdd160483\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xwr9q"
Jul 28 01:21:07.341006 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:07.340980    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qprs\" (UniqueName: \"kubernetes.io/projected/ec2ef917-0f37-45fb-abf6-34b159a17fd7-kube-api-access-4qprs\") pod \"kserve-controller-manager-d6f4b65b8-fwgkq\" (UID: \"ec2ef917-0f37-45fb-abf6-34b159a17fd7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fwgkq"
Jul 28 01:21:07.352823 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:07.352796    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fwgkq"
Jul 28 01:21:07.535643 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:07.535599    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:21:07.535765 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:07.535686    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:21:07.598193 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:07.598164    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-fwgkq"]
Jul 28 01:21:07.601866 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:21:07.601841    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec2ef917_0f37_45fb_abf6_34b159a17fd7.slice/crio-e5b4d72401f7d20158f1188120c92a5f3c3c312df619f7689d798e00bdf7f58b WatchSource:0}: Error finding container e5b4d72401f7d20158f1188120c92a5f3c3c312df619f7689d798e00bdf7f58b: Status 404 returned error can't find the container with id e5b4d72401f7d20158f1188120c92a5f3c3c312df619f7689d798e00bdf7f58b
Jul 28 01:21:07.750636 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:07.750600    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wnwb5" event={"ID":"b4ac99ee-01bc-4218-b76d-197257bdeb8c","Type":"ContainerStarted","Data":"185f0cb41d455d00600159adc8537169bd599b50315565ee1015e65519c35f64"}
Jul 28 01:21:07.750821 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:07.750720    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wnwb5"
Jul 28 01:21:07.751913 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:07.751889    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fwgkq" event={"ID":"ec2ef917-0f37-45fb-abf6-34b159a17fd7","Type":"ContainerStarted","Data":"e5b4d72401f7d20158f1188120c92a5f3c3c312df619f7689d798e00bdf7f58b"}
Jul 28 01:21:07.785532 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:07.785487    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wnwb5" podStartSLOduration=1.461120596 podStartE2EDuration="4.785472468s" totalImagesPullingTime="3.324351872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:21:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:21:07.783316402 +0000 UTC m=+338.287077717" watchObservedRunningTime="2026-07-28 01:21:07.785472468 +0000 UTC m=+338.289233779"
Jul 28 01:21:07.827640 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:07.827610    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75fb6ceb-add9-4486-a051-8ccfdd160483-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-xwr9q\" (UID: \"75fb6ceb-add9-4486-a051-8ccfdd160483\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xwr9q"
Jul 28 01:21:07.827814 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:21:07.827747    2562 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 28 01:21:07.827814 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:21:07.827807    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75fb6ceb-add9-4486-a051-8ccfdd160483-cert podName:75fb6ceb-add9-4486-a051-8ccfdd160483 nodeName:}" failed. No retries permitted until 2026-07-28 01:21:08.827791157 +0000 UTC m=+339.331552449 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/75fb6ceb-add9-4486-a051-8ccfdd160483-cert") pod "llmisvc-controller-manager-777c6bd7d5-xwr9q" (UID: "75fb6ceb-add9-4486-a051-8ccfdd160483") : secret "llmisvc-webhook-server-cert" not found
Jul 28 01:21:08.758686 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:08.758656    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wnwb5"
Jul 28 01:21:08.838869 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:08.838834    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75fb6ceb-add9-4486-a051-8ccfdd160483-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-xwr9q\" (UID: \"75fb6ceb-add9-4486-a051-8ccfdd160483\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xwr9q"
Jul 28 01:21:08.841828 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:08.841802    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75fb6ceb-add9-4486-a051-8ccfdd160483-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-xwr9q\" (UID: \"75fb6ceb-add9-4486-a051-8ccfdd160483\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xwr9q"
Jul 28 01:21:08.867696 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:08.867659    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xwr9q"
Jul 28 01:21:09.007553 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:09.007506    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-xwr9q"]
Jul 28 01:21:09.010635 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:21:09.010576    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod75fb6ceb_add9_4486_a051_8ccfdd160483.slice/crio-c6aae492a1f550b2169513ed0e7877fc0cc5565e8d1b9158db3f17bb38f69169 WatchSource:0}: Error finding container c6aae492a1f550b2169513ed0e7877fc0cc5565e8d1b9158db3f17bb38f69169: Status 404 returned error can't find the container with id c6aae492a1f550b2169513ed0e7877fc0cc5565e8d1b9158db3f17bb38f69169
Jul 28 01:21:09.556464 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:09.556427    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wnwb5"]
Jul 28 01:21:09.763316 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:09.763285    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xwr9q" event={"ID":"75fb6ceb-add9-4486-a051-8ccfdd160483","Type":"ContainerStarted","Data":"c6aae492a1f550b2169513ed0e7877fc0cc5565e8d1b9158db3f17bb38f69169"}
Jul 28 01:21:10.770094 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:10.770046    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fwgkq" event={"ID":"ec2ef917-0f37-45fb-abf6-34b159a17fd7","Type":"ContainerStarted","Data":"73834139ca479be01e2282dd127c2a3c4be231138e2a3d01c94e3bea82945443"}
Jul 28 01:21:10.770642 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:10.770132    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wnwb5" podUID="b4ac99ee-01bc-4218-b76d-197257bdeb8c" containerName="discovery" containerID="cri-o://185f0cb41d455d00600159adc8537169bd599b50315565ee1015e65519c35f64" gracePeriod=30
Jul 28 01:21:10.807681 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:10.807634    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fwgkq" podStartSLOduration=1.6111487869999999 podStartE2EDuration="3.807619622s" totalImagesPullingTime="2.196470835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:21:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:21:10.805966281 +0000 UTC m=+341.309727594" watchObservedRunningTime="2026-07-28 01:21:10.807619622 +0000 UTC m=+341.311380950"
Jul 28 01:21:11.037721 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:11.037696    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wnwb5"
Jul 28 01:21:11.071503 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:11.071467    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b4ac99ee-01bc-4218-b76d-197257bdeb8c-istio-csr-dns-cert\") pod \"b4ac99ee-01bc-4218-b76d-197257bdeb8c\" (UID: \"b4ac99ee-01bc-4218-b76d-197257bdeb8c\") "
Jul 28 01:21:11.071666 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:11.071533    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gfvk9\" (UniqueName: \"kubernetes.io/projected/b4ac99ee-01bc-4218-b76d-197257bdeb8c-kube-api-access-gfvk9\") pod \"b4ac99ee-01bc-4218-b76d-197257bdeb8c\" (UID: \"b4ac99ee-01bc-4218-b76d-197257bdeb8c\") "
Jul 28 01:21:11.071729 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:11.071673    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b4ac99ee-01bc-4218-b76d-197257bdeb8c-cacerts\") pod \"b4ac99ee-01bc-4218-b76d-197257bdeb8c\" (UID: \"b4ac99ee-01bc-4218-b76d-197257bdeb8c\") "
Jul 28 01:21:11.071729 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:11.071711    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4ac99ee-01bc-4218-b76d-197257bdeb8c-istio-token\") pod \"b4ac99ee-01bc-4218-b76d-197257bdeb8c\" (UID: \"b4ac99ee-01bc-4218-b76d-197257bdeb8c\") "
Jul 28 01:21:11.071823 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:11.071735    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b4ac99ee-01bc-4218-b76d-197257bdeb8c-istio-csr-ca-configmap\") pod \"b4ac99ee-01bc-4218-b76d-197257bdeb8c\" (UID: \"b4ac99ee-01bc-4218-b76d-197257bdeb8c\") "
Jul 28 01:21:11.071823 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:11.071791    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4ac99ee-01bc-4218-b76d-197257bdeb8c-local-certs\") pod \"b4ac99ee-01bc-4218-b76d-197257bdeb8c\" (UID: \"b4ac99ee-01bc-4218-b76d-197257bdeb8c\") "
Jul 28 01:21:11.071915 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:11.071838    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b4ac99ee-01bc-4218-b76d-197257bdeb8c-istio-kubeconfig\") pod \"b4ac99ee-01bc-4218-b76d-197257bdeb8c\" (UID: \"b4ac99ee-01bc-4218-b76d-197257bdeb8c\") "
Jul 28 01:21:11.072547 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:11.072486    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4ac99ee-01bc-4218-b76d-197257bdeb8c-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "b4ac99ee-01bc-4218-b76d-197257bdeb8c" (UID: "b4ac99ee-01bc-4218-b76d-197257bdeb8c"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:21:11.074497 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:11.074439    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4ac99ee-01bc-4218-b76d-197257bdeb8c-cacerts" (OuterVolumeSpecName: "cacerts") pod "b4ac99ee-01bc-4218-b76d-197257bdeb8c" (UID: "b4ac99ee-01bc-4218-b76d-197257bdeb8c"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:21:11.074623 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:11.074523    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4ac99ee-01bc-4218-b76d-197257bdeb8c-kube-api-access-gfvk9" (OuterVolumeSpecName: "kube-api-access-gfvk9") pod "b4ac99ee-01bc-4218-b76d-197257bdeb8c" (UID: "b4ac99ee-01bc-4218-b76d-197257bdeb8c"). InnerVolumeSpecName "kube-api-access-gfvk9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:21:11.074623 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:11.074546    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4ac99ee-01bc-4218-b76d-197257bdeb8c-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "b4ac99ee-01bc-4218-b76d-197257bdeb8c" (UID: "b4ac99ee-01bc-4218-b76d-197257bdeb8c"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:21:11.074623 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:11.074583    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4ac99ee-01bc-4218-b76d-197257bdeb8c-istio-token" (OuterVolumeSpecName: "istio-token") pod "b4ac99ee-01bc-4218-b76d-197257bdeb8c" (UID: "b4ac99ee-01bc-4218-b76d-197257bdeb8c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:21:11.074730 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:11.074619    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4ac99ee-01bc-4218-b76d-197257bdeb8c-local-certs" (OuterVolumeSpecName: "local-certs") pod "b4ac99ee-01bc-4218-b76d-197257bdeb8c" (UID: "b4ac99ee-01bc-4218-b76d-197257bdeb8c"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:21:11.074786 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:11.074763    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4ac99ee-01bc-4218-b76d-197257bdeb8c-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "b4ac99ee-01bc-4218-b76d-197257bdeb8c" (UID: "b4ac99ee-01bc-4218-b76d-197257bdeb8c"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:21:11.172646 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:11.172610    2562 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4ac99ee-01bc-4218-b76d-197257bdeb8c-local-certs\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:21:11.172646 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:11.172639    2562 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b4ac99ee-01bc-4218-b76d-197257bdeb8c-istio-kubeconfig\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:21:11.172646 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:11.172649    2562 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b4ac99ee-01bc-4218-b76d-197257bdeb8c-istio-csr-dns-cert\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:21:11.172862 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:11.172658    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfvk9\" (UniqueName: \"kubernetes.io/projected/b4ac99ee-01bc-4218-b76d-197257bdeb8c-kube-api-access-gfvk9\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:21:11.172862 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:11.172669    2562 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b4ac99ee-01bc-4218-b76d-197257bdeb8c-cacerts\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:21:11.172862 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:11.172677    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4ac99ee-01bc-4218-b76d-197257bdeb8c-istio-token\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:21:11.172862 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:11.172686    2562 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b4ac99ee-01bc-4218-b76d-197257bdeb8c-istio-csr-ca-configmap\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:21:11.776461 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:11.776427    2562 generic.go:356] "Generic (PLEG): container finished" podID="b4ac99ee-01bc-4218-b76d-197257bdeb8c" containerID="185f0cb41d455d00600159adc8537169bd599b50315565ee1015e65519c35f64" exitCode=0
Jul 28 01:21:11.776970 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:11.776474    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wnwb5"
Jul 28 01:21:11.776970 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:11.776483    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wnwb5" event={"ID":"b4ac99ee-01bc-4218-b76d-197257bdeb8c","Type":"ContainerDied","Data":"185f0cb41d455d00600159adc8537169bd599b50315565ee1015e65519c35f64"}
Jul 28 01:21:11.776970 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:11.776542    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wnwb5" event={"ID":"b4ac99ee-01bc-4218-b76d-197257bdeb8c","Type":"ContainerDied","Data":"f219cd2eb9a17e15108e4a314fc58a0a83e9a3bea3bf75163d491dee1f5b8151"}
Jul 28 01:21:11.776970 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:11.776576    2562 scope.go:117] "RemoveContainer" containerID="185f0cb41d455d00600159adc8537169bd599b50315565ee1015e65519c35f64"
Jul 28 01:21:11.776970 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:11.776908    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fwgkq"
Jul 28 01:21:11.800198 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:11.800160    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wnwb5"]
Jul 28 01:21:11.803233 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:11.803205    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wnwb5"]
Jul 28 01:21:11.951885 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:11.951847    2562 scope.go:117] "RemoveContainer" containerID="185f0cb41d455d00600159adc8537169bd599b50315565ee1015e65519c35f64"
Jul 28 01:21:11.952240 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:21:11.952219    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"185f0cb41d455d00600159adc8537169bd599b50315565ee1015e65519c35f64\": container with ID starting with 185f0cb41d455d00600159adc8537169bd599b50315565ee1015e65519c35f64 not found: ID does not exist" containerID="185f0cb41d455d00600159adc8537169bd599b50315565ee1015e65519c35f64"
Jul 28 01:21:11.952293 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:11.952251    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"185f0cb41d455d00600159adc8537169bd599b50315565ee1015e65519c35f64"} err="failed to get container status \"185f0cb41d455d00600159adc8537169bd599b50315565ee1015e65519c35f64\": rpc error: code = NotFound desc = could not find container \"185f0cb41d455d00600159adc8537169bd599b50315565ee1015e65519c35f64\": container with ID starting with 185f0cb41d455d00600159adc8537169bd599b50315565ee1015e65519c35f64 not found: ID does not exist"
Jul 28 01:21:12.012968 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:12.012942    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4ac99ee-01bc-4218-b76d-197257bdeb8c" path="/var/lib/kubelet/pods/b4ac99ee-01bc-4218-b76d-197257bdeb8c/volumes"
Jul 28 01:21:12.710842 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:12.710816    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-sbt5v"
Jul 28 01:21:12.713105 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:12.713080    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-4jlg7"
Jul 28 01:21:12.784427 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:12.784395    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xwr9q" event={"ID":"75fb6ceb-add9-4486-a051-8ccfdd160483","Type":"ContainerStarted","Data":"bff927067efe4be7a7271f99ede670fc822a140c296a5b30fe25872738cc239b"}
Jul 28 01:21:12.784838 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:12.784490    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xwr9q"
Jul 28 01:21:12.799384 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:12.799328    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xwr9q" podStartSLOduration=2.810625274 podStartE2EDuration="5.799305974s" totalImagesPullingTime="2.9886807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:21:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:21:12.798829392 +0000 UTC m=+343.302590735" watchObservedRunningTime="2026-07-28 01:21:12.799305974 +0000 UTC m=+343.303067287"
Jul 28 01:21:42.790131 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:42.790095    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fwgkq"
Jul 28 01:21:43.791867 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:43.791830    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xwr9q"
Jul 28 01:21:58.354857 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:58.354818    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-x4xzx"]
Jul 28 01:21:58.355230 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:58.355141    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4ac99ee-01bc-4218-b76d-197257bdeb8c" containerName="discovery"
Jul 28 01:21:58.355230 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:58.355152    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4ac99ee-01bc-4218-b76d-197257bdeb8c" containerName="discovery"
Jul 28 01:21:58.355230 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:58.355210    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4ac99ee-01bc-4218-b76d-197257bdeb8c" containerName="discovery"
Jul 28 01:21:58.357539 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:58.357515    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-x4xzx"
Jul 28 01:21:58.359680 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:58.359653    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 28 01:21:58.360312 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:58.360288    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 28 01:21:58.360432 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:58.360321    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-prvm2\""
Jul 28 01:21:58.367084 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:58.367058    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-x4xzx"]
Jul 28 01:21:58.471789 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:58.471745    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wjfh\" (UniqueName: \"kubernetes.io/projected/4688d750-ad90-47c7-9988-431e427a6054-kube-api-access-7wjfh\") pod \"kuadrant-operator-catalog-x4xzx\" (UID: \"4688d750-ad90-47c7-9988-431e427a6054\") " pod="kuadrant-system/kuadrant-operator-catalog-x4xzx"
Jul 28 01:21:58.572252 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:58.572218    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wjfh\" (UniqueName: \"kubernetes.io/projected/4688d750-ad90-47c7-9988-431e427a6054-kube-api-access-7wjfh\") pod \"kuadrant-operator-catalog-x4xzx\" (UID: \"4688d750-ad90-47c7-9988-431e427a6054\") " pod="kuadrant-system/kuadrant-operator-catalog-x4xzx"
Jul 28 01:21:58.580913 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:58.580883    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wjfh\" (UniqueName: \"kubernetes.io/projected/4688d750-ad90-47c7-9988-431e427a6054-kube-api-access-7wjfh\") pod \"kuadrant-operator-catalog-x4xzx\" (UID: \"4688d750-ad90-47c7-9988-431e427a6054\") " pod="kuadrant-system/kuadrant-operator-catalog-x4xzx"
Jul 28 01:21:58.668954 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:58.668862    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-x4xzx"
Jul 28 01:21:58.721582 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:58.721537    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-x4xzx"]
Jul 28 01:21:58.798440 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:58.798415    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-x4xzx"]
Jul 28 01:21:58.800878 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:21:58.800854    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4688d750_ad90_47c7_9988_431e427a6054.slice/crio-587236d47da4b845e27330e5439e114b8f661d4c8559b89ae3ab1a107f463118 WatchSource:0}: Error finding container 587236d47da4b845e27330e5439e114b8f661d4c8559b89ae3ab1a107f463118: Status 404 returned error can't find the container with id 587236d47da4b845e27330e5439e114b8f661d4c8559b89ae3ab1a107f463118
Jul 28 01:21:58.931871 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:58.931787    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-shg77"]
Jul 28 01:21:58.934650 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:58.934634    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-shg77"
Jul 28 01:21:58.943078 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:58.943052    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-shg77"]
Jul 28 01:21:58.984224 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:58.984188    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-x4xzx" event={"ID":"4688d750-ad90-47c7-9988-431e427a6054","Type":"ContainerStarted","Data":"587236d47da4b845e27330e5439e114b8f661d4c8559b89ae3ab1a107f463118"}
Jul 28 01:21:59.076292 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:59.076255    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq4b8\" (UniqueName: \"kubernetes.io/projected/0947867b-744e-4b5a-b609-a7836b07d8af-kube-api-access-kq4b8\") pod \"kuadrant-operator-catalog-shg77\" (UID: \"0947867b-744e-4b5a-b609-a7836b07d8af\") " pod="kuadrant-system/kuadrant-operator-catalog-shg77"
Jul 28 01:21:59.177165 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:59.177131    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq4b8\" (UniqueName: \"kubernetes.io/projected/0947867b-744e-4b5a-b609-a7836b07d8af-kube-api-access-kq4b8\") pod \"kuadrant-operator-catalog-shg77\" (UID: \"0947867b-744e-4b5a-b609-a7836b07d8af\") " pod="kuadrant-system/kuadrant-operator-catalog-shg77"
Jul 28 01:21:59.189219 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:59.189152    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq4b8\" (UniqueName: \"kubernetes.io/projected/0947867b-744e-4b5a-b609-a7836b07d8af-kube-api-access-kq4b8\") pod \"kuadrant-operator-catalog-shg77\" (UID: \"0947867b-744e-4b5a-b609-a7836b07d8af\") " pod="kuadrant-system/kuadrant-operator-catalog-shg77"
Jul 28 01:21:59.245026 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:59.244991    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-shg77"
Jul 28 01:21:59.388897 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:59.388875    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-shg77"]
Jul 28 01:21:59.390942 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:21:59.390917    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0947867b_744e_4b5a_b609_a7836b07d8af.slice/crio-962cee006c69dc5ad992b083703dc08113ada286053d263820ca49621d1f57d9 WatchSource:0}: Error finding container 962cee006c69dc5ad992b083703dc08113ada286053d263820ca49621d1f57d9: Status 404 returned error can't find the container with id 962cee006c69dc5ad992b083703dc08113ada286053d263820ca49621d1f57d9
Jul 28 01:21:59.991494 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:21:59.991455    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-shg77" event={"ID":"0947867b-744e-4b5a-b609-a7836b07d8af","Type":"ContainerStarted","Data":"962cee006c69dc5ad992b083703dc08113ada286053d263820ca49621d1f57d9"}
Jul 28 01:22:00.997951 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:00.997914    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-x4xzx" event={"ID":"4688d750-ad90-47c7-9988-431e427a6054","Type":"ContainerStarted","Data":"b8ec2a7e1966bdeab1fa3c3dbe8b9826cac76e683147c7ad7312f08d80f93bc0"}
Jul 28 01:22:00.998434 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:00.997994    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-x4xzx" podUID="4688d750-ad90-47c7-9988-431e427a6054" containerName="registry-server" containerID="cri-o://b8ec2a7e1966bdeab1fa3c3dbe8b9826cac76e683147c7ad7312f08d80f93bc0" gracePeriod=2
Jul 28 01:22:00.999428 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:00.999404    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-shg77" event={"ID":"0947867b-744e-4b5a-b609-a7836b07d8af","Type":"ContainerStarted","Data":"c6d5650e2c8b2d7d7dcb7ce3c78dc3b2e3f603818b82426f3bd69cfc16ea7513"}
Jul 28 01:22:01.012819 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:01.012775    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-x4xzx" podStartSLOduration=1.045234924 podStartE2EDuration="3.012760577s" totalImagesPullingTime="1.967525653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:21:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:22:01.011195775 +0000 UTC m=+391.514957089" watchObservedRunningTime="2026-07-28 01:22:01.012760577 +0000 UTC m=+391.516521889"
Jul 28 01:22:01.027341 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:01.027263    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-shg77" podStartSLOduration=1.649423297 podStartE2EDuration="3.027247244s" totalImagesPullingTime="1.377823947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:21:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:22:01.025541144 +0000 UTC m=+391.529302458" watchObservedRunningTime="2026-07-28 01:22:01.027247244 +0000 UTC m=+391.531008563"
Jul 28 01:22:01.245658 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:01.245632    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-x4xzx"
Jul 28 01:22:01.305075 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:01.304985    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7wjfh\" (UniqueName: \"kubernetes.io/projected/4688d750-ad90-47c7-9988-431e427a6054-kube-api-access-7wjfh\") pod \"4688d750-ad90-47c7-9988-431e427a6054\" (UID: \"4688d750-ad90-47c7-9988-431e427a6054\") "
Jul 28 01:22:01.307164 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:01.307135    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4688d750-ad90-47c7-9988-431e427a6054-kube-api-access-7wjfh" (OuterVolumeSpecName: "kube-api-access-7wjfh") pod "4688d750-ad90-47c7-9988-431e427a6054" (UID: "4688d750-ad90-47c7-9988-431e427a6054"). InnerVolumeSpecName "kube-api-access-7wjfh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:22:01.406172 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:01.406135    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7wjfh\" (UniqueName: \"kubernetes.io/projected/4688d750-ad90-47c7-9988-431e427a6054-kube-api-access-7wjfh\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:22:02.005277 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:02.005241    2562 generic.go:356] "Generic (PLEG): container finished" podID="4688d750-ad90-47c7-9988-431e427a6054" containerID="b8ec2a7e1966bdeab1fa3c3dbe8b9826cac76e683147c7ad7312f08d80f93bc0" exitCode=0
Jul 28 01:22:02.005708 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:02.005287    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-x4xzx"
Jul 28 01:22:02.005708 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:02.005325    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-x4xzx" event={"ID":"4688d750-ad90-47c7-9988-431e427a6054","Type":"ContainerDied","Data":"b8ec2a7e1966bdeab1fa3c3dbe8b9826cac76e683147c7ad7312f08d80f93bc0"}
Jul 28 01:22:02.005708 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:02.005374    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-x4xzx" event={"ID":"4688d750-ad90-47c7-9988-431e427a6054","Type":"ContainerDied","Data":"587236d47da4b845e27330e5439e114b8f661d4c8559b89ae3ab1a107f463118"}
Jul 28 01:22:02.005708 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:02.005396    2562 scope.go:117] "RemoveContainer" containerID="b8ec2a7e1966bdeab1fa3c3dbe8b9826cac76e683147c7ad7312f08d80f93bc0"
Jul 28 01:22:02.015100 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:02.015083    2562 scope.go:117] "RemoveContainer" containerID="b8ec2a7e1966bdeab1fa3c3dbe8b9826cac76e683147c7ad7312f08d80f93bc0"
Jul 28 01:22:02.015378 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:22:02.015355    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8ec2a7e1966bdeab1fa3c3dbe8b9826cac76e683147c7ad7312f08d80f93bc0\": container with ID starting with b8ec2a7e1966bdeab1fa3c3dbe8b9826cac76e683147c7ad7312f08d80f93bc0 not found: ID does not exist" containerID="b8ec2a7e1966bdeab1fa3c3dbe8b9826cac76e683147c7ad7312f08d80f93bc0"
Jul 28 01:22:02.015477 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:02.015384    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8ec2a7e1966bdeab1fa3c3dbe8b9826cac76e683147c7ad7312f08d80f93bc0"} err="failed to get container status \"b8ec2a7e1966bdeab1fa3c3dbe8b9826cac76e683147c7ad7312f08d80f93bc0\": rpc error: code = NotFound desc = could not find container \"b8ec2a7e1966bdeab1fa3c3dbe8b9826cac76e683147c7ad7312f08d80f93bc0\": container with ID starting with b8ec2a7e1966bdeab1fa3c3dbe8b9826cac76e683147c7ad7312f08d80f93bc0 not found: ID does not exist"
Jul 28 01:22:02.024527 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:02.024505    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-x4xzx"]
Jul 28 01:22:02.027843 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:02.027824    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-x4xzx"]
Jul 28 01:22:04.013142 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:04.013106    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4688d750-ad90-47c7-9988-431e427a6054" path="/var/lib/kubelet/pods/4688d750-ad90-47c7-9988-431e427a6054/volumes"
Jul 28 01:22:09.245949 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:09.245912    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-shg77"
Jul 28 01:22:09.246358 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:09.245992    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-shg77"
Jul 28 01:22:09.267272 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:09.267246    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-shg77"
Jul 28 01:22:10.061051 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:10.061021    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-shg77"
Jul 28 01:22:30.794152 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:30.794108    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-skwf2"]
Jul 28 01:22:30.794898 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:30.794874    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4688d750-ad90-47c7-9988-431e427a6054" containerName="registry-server"
Jul 28 01:22:30.794981 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:30.794903    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4688d750-ad90-47c7-9988-431e427a6054" containerName="registry-server"
Jul 28 01:22:30.795076 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:30.795064    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4688d750-ad90-47c7-9988-431e427a6054" containerName="registry-server"
Jul 28 01:22:30.802744 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:30.802719    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-skwf2"
Jul 28 01:22:30.805008 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:30.804986    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-tgvqm\""
Jul 28 01:22:30.808649 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:30.808623    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-skwf2"]
Jul 28 01:22:30.942742 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:30.942704    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq4fx\" (UniqueName: \"kubernetes.io/projected/e6cce1ca-4f45-4f4b-8ad8-684eaf865ea7-kube-api-access-kq4fx\") pod \"authorino-operator-75cc8d5cb7-skwf2\" (UID: \"e6cce1ca-4f45-4f4b-8ad8-684eaf865ea7\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-skwf2"
Jul 28 01:22:31.043769 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:31.043737    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq4fx\" (UniqueName: \"kubernetes.io/projected/e6cce1ca-4f45-4f4b-8ad8-684eaf865ea7-kube-api-access-kq4fx\") pod \"authorino-operator-75cc8d5cb7-skwf2\" (UID: \"e6cce1ca-4f45-4f4b-8ad8-684eaf865ea7\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-skwf2"
Jul 28 01:22:31.060080 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:31.060031    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq4fx\" (UniqueName: \"kubernetes.io/projected/e6cce1ca-4f45-4f4b-8ad8-684eaf865ea7-kube-api-access-kq4fx\") pod \"authorino-operator-75cc8d5cb7-skwf2\" (UID: \"e6cce1ca-4f45-4f4b-8ad8-684eaf865ea7\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-skwf2"
Jul 28 01:22:31.113861 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:31.113829    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-skwf2"
Jul 28 01:22:31.240543 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:31.240477    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-skwf2"]
Jul 28 01:22:31.242948 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:22:31.242915    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6cce1ca_4f45_4f4b_8ad8_684eaf865ea7.slice/crio-b9a94850dcaef58f84987097622638d9a94d3c485cc2f439961b791eef756d0f WatchSource:0}: Error finding container b9a94850dcaef58f84987097622638d9a94d3c485cc2f439961b791eef756d0f: Status 404 returned error can't find the container with id b9a94850dcaef58f84987097622638d9a94d3c485cc2f439961b791eef756d0f
Jul 28 01:22:32.136233 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:32.136189    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-skwf2" event={"ID":"e6cce1ca-4f45-4f4b-8ad8-684eaf865ea7","Type":"ContainerStarted","Data":"b9a94850dcaef58f84987097622638d9a94d3c485cc2f439961b791eef756d0f"}
Jul 28 01:22:34.025159 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:34.025078    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7ffrv"]
Jul 28 01:22:34.028479 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:34.028457    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7ffrv"
Jul 28 01:22:34.030451 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:34.030428    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 28 01:22:34.030579 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:34.030545    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-2jtbx\""
Jul 28 01:22:34.037685 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:34.037661    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7ffrv"]
Jul 28 01:22:34.147179 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:34.147147    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-skwf2" event={"ID":"e6cce1ca-4f45-4f4b-8ad8-684eaf865ea7","Type":"ContainerStarted","Data":"4e41c15e93cf91e261ee591551bab9adc746b1040cfb0dfe9e647248fdf533dc"}
Jul 28 01:22:34.147338 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:34.147199    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-skwf2"
Jul 28 01:22:34.166694 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:34.166645    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-skwf2" podStartSLOduration=1.720526407 podStartE2EDuration="4.166631077s" totalImagesPullingTime="2.44610467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:22:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:22:34.165476743 +0000 UTC m=+424.669238079" watchObservedRunningTime="2026-07-28 01:22:34.166631077 +0000 UTC m=+424.670392388"
Jul 28 01:22:34.170826 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:34.170793    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gljdz\" (UniqueName: \"kubernetes.io/projected/fcfa3b03-06a0-46c8-8351-f7d8378bd6e2-kube-api-access-gljdz\") pod \"dns-operator-controller-manager-864dd78c4c-7ffrv\" (UID: \"fcfa3b03-06a0-46c8-8351-f7d8378bd6e2\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7ffrv"
Jul 28 01:22:34.271579 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:34.271526    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gljdz\" (UniqueName: \"kubernetes.io/projected/fcfa3b03-06a0-46c8-8351-f7d8378bd6e2-kube-api-access-gljdz\") pod \"dns-operator-controller-manager-864dd78c4c-7ffrv\" (UID: \"fcfa3b03-06a0-46c8-8351-f7d8378bd6e2\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7ffrv"
Jul 28 01:22:34.279778 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:34.279716    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gljdz\" (UniqueName: \"kubernetes.io/projected/fcfa3b03-06a0-46c8-8351-f7d8378bd6e2-kube-api-access-gljdz\") pod \"dns-operator-controller-manager-864dd78c4c-7ffrv\" (UID: \"fcfa3b03-06a0-46c8-8351-f7d8378bd6e2\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7ffrv"
Jul 28 01:22:34.340285 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:34.340255    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7ffrv"
Jul 28 01:22:34.498660 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:34.498637    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7ffrv"]
Jul 28 01:22:34.500723 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:22:34.500693    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcfa3b03_06a0_46c8_8351_f7d8378bd6e2.slice/crio-04177327b980a7439f3b63a846105b7c3d975c7f2120fc3bdf1a0465353f6580 WatchSource:0}: Error finding container 04177327b980a7439f3b63a846105b7c3d975c7f2120fc3bdf1a0465353f6580: Status 404 returned error can't find the container with id 04177327b980a7439f3b63a846105b7c3d975c7f2120fc3bdf1a0465353f6580
Jul 28 01:22:35.153006 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:35.152964    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7ffrv" event={"ID":"fcfa3b03-06a0-46c8-8351-f7d8378bd6e2","Type":"ContainerStarted","Data":"04177327b980a7439f3b63a846105b7c3d975c7f2120fc3bdf1a0465353f6580"}
Jul 28 01:22:37.163956 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:37.163920    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7ffrv" event={"ID":"fcfa3b03-06a0-46c8-8351-f7d8378bd6e2","Type":"ContainerStarted","Data":"21ecc86d95de0cfb803fa238e145a195d8166a8d20aa928af6143bf87c431a79"}
Jul 28 01:22:37.164527 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:37.164049    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7ffrv"
Jul 28 01:22:37.191194 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:37.191142    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7ffrv" podStartSLOduration=1.388313273 podStartE2EDuration="3.191126424s" totalImagesPullingTime="1.802813151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:22:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:22:37.188960787 +0000 UTC m=+427.692722100" watchObservedRunningTime="2026-07-28 01:22:37.191126424 +0000 UTC m=+427.694887740"
Jul 28 01:22:38.769272 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:38.769235    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-759p6"]
Jul 28 01:22:38.772796 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:38.772774    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-759p6"
Jul 28 01:22:38.775211 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:38.775191    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-lxpxk\""
Jul 28 01:22:38.787710 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:38.787687    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-759p6"]
Jul 28 01:22:38.913099 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:38.913057    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/678d37a2-8360-41f2-b523-35f2085dba3a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-759p6\" (UID: \"678d37a2-8360-41f2-b523-35f2085dba3a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-759p6"
Jul 28 01:22:38.913272 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:38.913108    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6h5h\" (UniqueName: \"kubernetes.io/projected/678d37a2-8360-41f2-b523-35f2085dba3a-kube-api-access-z6h5h\") pod \"kuadrant-operator-controller-manager-8684c9ff49-759p6\" (UID: \"678d37a2-8360-41f2-b523-35f2085dba3a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-759p6"
Jul 28 01:22:39.014599 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:39.014531    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/678d37a2-8360-41f2-b523-35f2085dba3a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-759p6\" (UID: \"678d37a2-8360-41f2-b523-35f2085dba3a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-759p6"
Jul 28 01:22:39.014800 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:39.014619    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6h5h\" (UniqueName: \"kubernetes.io/projected/678d37a2-8360-41f2-b523-35f2085dba3a-kube-api-access-z6h5h\") pod \"kuadrant-operator-controller-manager-8684c9ff49-759p6\" (UID: \"678d37a2-8360-41f2-b523-35f2085dba3a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-759p6"
Jul 28 01:22:39.014928 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:39.014907    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/678d37a2-8360-41f2-b523-35f2085dba3a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-759p6\" (UID: \"678d37a2-8360-41f2-b523-35f2085dba3a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-759p6"
Jul 28 01:22:39.024855 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:39.024792    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6h5h\" (UniqueName: \"kubernetes.io/projected/678d37a2-8360-41f2-b523-35f2085dba3a-kube-api-access-z6h5h\") pod \"kuadrant-operator-controller-manager-8684c9ff49-759p6\" (UID: \"678d37a2-8360-41f2-b523-35f2085dba3a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-759p6"
Jul 28 01:22:39.083435 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:39.083398    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-759p6"
Jul 28 01:22:39.218094 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:39.218070    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-759p6"]
Jul 28 01:22:39.220495 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:22:39.220464    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod678d37a2_8360_41f2_b523_35f2085dba3a.slice/crio-67b8a9e85c378daf091ef9006ae265d190be2011605f7041d4f842a630b96aa2 WatchSource:0}: Error finding container 67b8a9e85c378daf091ef9006ae265d190be2011605f7041d4f842a630b96aa2: Status 404 returned error can't find the container with id 67b8a9e85c378daf091ef9006ae265d190be2011605f7041d4f842a630b96aa2
Jul 28 01:22:40.183220 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:40.183180    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-759p6" event={"ID":"678d37a2-8360-41f2-b523-35f2085dba3a","Type":"ContainerStarted","Data":"67b8a9e85c378daf091ef9006ae265d190be2011605f7041d4f842a630b96aa2"}
Jul 28 01:22:40.904504 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:40.904469    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wg69t"]
Jul 28 01:22:40.907905 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:40.907885    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wg69t"
Jul 28 01:22:40.909930 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:40.909910    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-bxzdn\""
Jul 28 01:22:40.919360 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:40.919325    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wg69t"]
Jul 28 01:22:41.029107 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:41.029068    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hpzk\" (UniqueName: \"kubernetes.io/projected/934e767e-d319-4b39-9320-45ec0a00696e-kube-api-access-9hpzk\") pod \"limitador-operator-controller-manager-859d7b78bd-wg69t\" (UID: \"934e767e-d319-4b39-9320-45ec0a00696e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wg69t"
Jul 28 01:22:41.129741 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:41.129708    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hpzk\" (UniqueName: \"kubernetes.io/projected/934e767e-d319-4b39-9320-45ec0a00696e-kube-api-access-9hpzk\") pod \"limitador-operator-controller-manager-859d7b78bd-wg69t\" (UID: \"934e767e-d319-4b39-9320-45ec0a00696e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wg69t"
Jul 28 01:22:41.140221 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:41.140187    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hpzk\" (UniqueName: \"kubernetes.io/projected/934e767e-d319-4b39-9320-45ec0a00696e-kube-api-access-9hpzk\") pod \"limitador-operator-controller-manager-859d7b78bd-wg69t\" (UID: \"934e767e-d319-4b39-9320-45ec0a00696e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wg69t"
Jul 28 01:22:41.219066 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:41.218971    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wg69t"
Jul 28 01:22:41.374145 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:41.374090    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wg69t"]
Jul 28 01:22:41.377531 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:22:41.377506    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod934e767e_d319_4b39_9320_45ec0a00696e.slice/crio-acd995ae9eb1c82c39bd406b9e1b31bf3c74d8ad0bf70165536daedae058a6a0 WatchSource:0}: Error finding container acd995ae9eb1c82c39bd406b9e1b31bf3c74d8ad0bf70165536daedae058a6a0: Status 404 returned error can't find the container with id acd995ae9eb1c82c39bd406b9e1b31bf3c74d8ad0bf70165536daedae058a6a0
Jul 28 01:22:42.195270 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:42.195224    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wg69t" event={"ID":"934e767e-d319-4b39-9320-45ec0a00696e","Type":"ContainerStarted","Data":"acd995ae9eb1c82c39bd406b9e1b31bf3c74d8ad0bf70165536daedae058a6a0"}
Jul 28 01:22:43.201656 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:43.201614    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wg69t" event={"ID":"934e767e-d319-4b39-9320-45ec0a00696e","Type":"ContainerStarted","Data":"f2ab9d5f60d5b7f4da94aa0f579fa2649bd11420007a44e2ce4bf40884ad0365"}
Jul 28 01:22:43.202034 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:43.201745    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wg69t"
Jul 28 01:22:43.217047 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:43.217001    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wg69t" podStartSLOduration=1.583088051 podStartE2EDuration="3.216987166s" totalImagesPullingTime="1.633899115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:22:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:22:43.215405948 +0000 UTC m=+433.719167260" watchObservedRunningTime="2026-07-28 01:22:43.216987166 +0000 UTC m=+433.720748478"
Jul 28 01:22:45.155189 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:45.155157    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-skwf2"
Jul 28 01:22:45.212208 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:45.212176    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-759p6" event={"ID":"678d37a2-8360-41f2-b523-35f2085dba3a","Type":"ContainerStarted","Data":"aa8dd6ad0c684bc4b30cfe6d0acf74f7d6d82824494e6ce33ddf5f1b674c53e6"}
Jul 28 01:22:45.212375 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:45.212278    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-759p6"
Jul 28 01:22:45.230552 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:45.230493    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-759p6" podStartSLOduration=1.910084755 podStartE2EDuration="7.230473586s" totalImagesPullingTime="5.320388831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:22:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:22:45.229410795 +0000 UTC m=+435.733172122" watchObservedRunningTime="2026-07-28 01:22:45.230473586 +0000 UTC m=+435.734234899"
Jul 28 01:22:48.170381 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:48.170354    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7ffrv"
Jul 28 01:22:54.209025 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:54.208949    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wg69t"
Jul 28 01:22:56.219550 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:56.219519    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-759p6"
Jul 28 01:22:57.954519 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:57.954486    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-759p6"]
Jul 28 01:22:57.954929 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:57.954670    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-759p6" podUID="678d37a2-8360-41f2-b523-35f2085dba3a" containerName="manager" containerID="cri-o://aa8dd6ad0c684bc4b30cfe6d0acf74f7d6d82824494e6ce33ddf5f1b674c53e6" gracePeriod=2
Jul 28 01:22:57.968195 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:57.968168    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-759p6"]
Jul 28 01:22:57.969264 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:22:57.969230    2562 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"678d37a2-8360-41f2-b523-35f2085dba3a\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-759p6\": pods \"kuadrant-operator-controller-manager-8684c9ff49-759p6\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-759p6"
Jul 28 01:22:57.982574 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:57.982529    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w86hn"]
Jul 28 01:22:57.983117 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:57.983095    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="678d37a2-8360-41f2-b523-35f2085dba3a" containerName="manager"
Jul 28 01:22:57.983117 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:57.983119    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="678d37a2-8360-41f2-b523-35f2085dba3a" containerName="manager"
Jul 28 01:22:57.983280 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:57.983230    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="678d37a2-8360-41f2-b523-35f2085dba3a" containerName="manager"
Jul 28 01:22:57.985837 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:57.985815    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wg69t"]
Jul 28 01:22:57.985940 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:57.985910    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w86hn"
Jul 28 01:22:57.986007 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:57.985977    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wg69t" podUID="934e767e-d319-4b39-9320-45ec0a00696e" containerName="manager" containerID="cri-o://f2ab9d5f60d5b7f4da94aa0f579fa2649bd11420007a44e2ce4bf40884ad0365" gracePeriod=2
Jul 28 01:22:57.999407 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:57.999382    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w86hn"]
Jul 28 01:22:58.003850 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:22:58.003387    2562 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod678d37a2_8360_41f2_b523_35f2085dba3a.slice/crio-aa8dd6ad0c684bc4b30cfe6d0acf74f7d6d82824494e6ce33ddf5f1b674c53e6.scope\": RecentStats: unable to find data in memory cache]"
Jul 28 01:22:58.005296 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:58.005268    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wg69t"]
Jul 28 01:22:58.019499 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:22:58.019463    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-759p6\" is forbidden: User \"system:node:ip-10-0-134-165.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-165.ec2.internal' and this object" podUID="678d37a2-8360-41f2-b523-35f2085dba3a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-759p6"
Jul 28 01:22:58.021316 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:22:58.021280    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-wg69t\" is forbidden: User \"system:node:ip-10-0-134-165.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-165.ec2.internal' and this object" podUID="934e767e-d319-4b39-9320-45ec0a00696e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wg69t"
Jul 28 01:22:58.184342 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:58.184304    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f62fcfa-5371-4dab-b2d0-db250498399b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-w86hn\" (UID: \"3f62fcfa-5371-4dab-b2d0-db250498399b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w86hn"
Jul 28 01:22:58.184523 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:58.184479    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rktzx\" (UniqueName: \"kubernetes.io/projected/3f62fcfa-5371-4dab-b2d0-db250498399b-kube-api-access-rktzx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-w86hn\" (UID: \"3f62fcfa-5371-4dab-b2d0-db250498399b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w86hn"
Jul 28 01:22:58.225345 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:58.225322    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-759p6"
Jul 28 01:22:58.245248 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:58.245225    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wg69t"
Jul 28 01:22:58.278473 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:58.278444    2562 generic.go:356] "Generic (PLEG): container finished" podID="934e767e-d319-4b39-9320-45ec0a00696e" containerID="f2ab9d5f60d5b7f4da94aa0f579fa2649bd11420007a44e2ce4bf40884ad0365" exitCode=0
Jul 28 01:22:58.278631 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:58.278492    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wg69t"
Jul 28 01:22:58.278631 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:58.278532    2562 scope.go:117] "RemoveContainer" containerID="f2ab9d5f60d5b7f4da94aa0f579fa2649bd11420007a44e2ce4bf40884ad0365"
Jul 28 01:22:58.279836 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:58.279810    2562 generic.go:356] "Generic (PLEG): container finished" podID="678d37a2-8360-41f2-b523-35f2085dba3a" containerID="aa8dd6ad0c684bc4b30cfe6d0acf74f7d6d82824494e6ce33ddf5f1b674c53e6" exitCode=0
Jul 28 01:22:58.279928 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:58.279850    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-759p6"
Jul 28 01:22:58.285121 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:58.285100    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f62fcfa-5371-4dab-b2d0-db250498399b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-w86hn\" (UID: \"3f62fcfa-5371-4dab-b2d0-db250498399b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w86hn"
Jul 28 01:22:58.285209 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:58.285154    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rktzx\" (UniqueName: \"kubernetes.io/projected/3f62fcfa-5371-4dab-b2d0-db250498399b-kube-api-access-rktzx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-w86hn\" (UID: \"3f62fcfa-5371-4dab-b2d0-db250498399b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w86hn"
Jul 28 01:22:58.285466 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:58.285445    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f62fcfa-5371-4dab-b2d0-db250498399b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-w86hn\" (UID: \"3f62fcfa-5371-4dab-b2d0-db250498399b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w86hn"
Jul 28 01:22:58.287863 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:58.287848    2562 scope.go:117] "RemoveContainer" containerID="f2ab9d5f60d5b7f4da94aa0f579fa2649bd11420007a44e2ce4bf40884ad0365"
Jul 28 01:22:58.288169 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:22:58.288143    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2ab9d5f60d5b7f4da94aa0f579fa2649bd11420007a44e2ce4bf40884ad0365\": container with ID starting with f2ab9d5f60d5b7f4da94aa0f579fa2649bd11420007a44e2ce4bf40884ad0365 not found: ID does not exist" containerID="f2ab9d5f60d5b7f4da94aa0f579fa2649bd11420007a44e2ce4bf40884ad0365"
Jul 28 01:22:58.288215 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:58.288177    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2ab9d5f60d5b7f4da94aa0f579fa2649bd11420007a44e2ce4bf40884ad0365"} err="failed to get container status \"f2ab9d5f60d5b7f4da94aa0f579fa2649bd11420007a44e2ce4bf40884ad0365\": rpc error: code = NotFound desc = could not find container \"f2ab9d5f60d5b7f4da94aa0f579fa2649bd11420007a44e2ce4bf40884ad0365\": container with ID starting with f2ab9d5f60d5b7f4da94aa0f579fa2649bd11420007a44e2ce4bf40884ad0365 not found: ID does not exist"
Jul 28 01:22:58.288215 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:58.288194    2562 scope.go:117] "RemoveContainer" containerID="aa8dd6ad0c684bc4b30cfe6d0acf74f7d6d82824494e6ce33ddf5f1b674c53e6"
Jul 28 01:22:58.293856 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:58.293836    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rktzx\" (UniqueName: \"kubernetes.io/projected/3f62fcfa-5371-4dab-b2d0-db250498399b-kube-api-access-rktzx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-w86hn\" (UID: \"3f62fcfa-5371-4dab-b2d0-db250498399b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w86hn"
Jul 28 01:22:58.297859 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:58.297841    2562 scope.go:117] "RemoveContainer" containerID="aa8dd6ad0c684bc4b30cfe6d0acf74f7d6d82824494e6ce33ddf5f1b674c53e6"
Jul 28 01:22:58.298109 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:22:58.298090    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa8dd6ad0c684bc4b30cfe6d0acf74f7d6d82824494e6ce33ddf5f1b674c53e6\": container with ID starting with aa8dd6ad0c684bc4b30cfe6d0acf74f7d6d82824494e6ce33ddf5f1b674c53e6 not found: ID does not exist" containerID="aa8dd6ad0c684bc4b30cfe6d0acf74f7d6d82824494e6ce33ddf5f1b674c53e6"
Jul 28 01:22:58.298148 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:58.298117    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa8dd6ad0c684bc4b30cfe6d0acf74f7d6d82824494e6ce33ddf5f1b674c53e6"} err="failed to get container status \"aa8dd6ad0c684bc4b30cfe6d0acf74f7d6d82824494e6ce33ddf5f1b674c53e6\": rpc error: code = NotFound desc = could not find container \"aa8dd6ad0c684bc4b30cfe6d0acf74f7d6d82824494e6ce33ddf5f1b674c53e6\": container with ID starting with aa8dd6ad0c684bc4b30cfe6d0acf74f7d6d82824494e6ce33ddf5f1b674c53e6 not found: ID does not exist"
Jul 28 01:22:58.386074 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:58.386036    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9hpzk\" (UniqueName: \"kubernetes.io/projected/934e767e-d319-4b39-9320-45ec0a00696e-kube-api-access-9hpzk\") pod \"934e767e-d319-4b39-9320-45ec0a00696e\" (UID: \"934e767e-d319-4b39-9320-45ec0a00696e\") "
Jul 28 01:22:58.386247 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:58.386122    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/678d37a2-8360-41f2-b523-35f2085dba3a-extensions-socket-volume\") pod \"678d37a2-8360-41f2-b523-35f2085dba3a\" (UID: \"678d37a2-8360-41f2-b523-35f2085dba3a\") "
Jul 28 01:22:58.386247 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:58.386149    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6h5h\" (UniqueName: \"kubernetes.io/projected/678d37a2-8360-41f2-b523-35f2085dba3a-kube-api-access-z6h5h\") pod \"678d37a2-8360-41f2-b523-35f2085dba3a\" (UID: \"678d37a2-8360-41f2-b523-35f2085dba3a\") "
Jul 28 01:22:58.386624 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:58.386598    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/678d37a2-8360-41f2-b523-35f2085dba3a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "678d37a2-8360-41f2-b523-35f2085dba3a" (UID: "678d37a2-8360-41f2-b523-35f2085dba3a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:22:58.388238 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:58.388213    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/678d37a2-8360-41f2-b523-35f2085dba3a-kube-api-access-z6h5h" (OuterVolumeSpecName: "kube-api-access-z6h5h") pod "678d37a2-8360-41f2-b523-35f2085dba3a" (UID: "678d37a2-8360-41f2-b523-35f2085dba3a"). InnerVolumeSpecName "kube-api-access-z6h5h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:22:58.388332 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:58.388238    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/934e767e-d319-4b39-9320-45ec0a00696e-kube-api-access-9hpzk" (OuterVolumeSpecName: "kube-api-access-9hpzk") pod "934e767e-d319-4b39-9320-45ec0a00696e" (UID: "934e767e-d319-4b39-9320-45ec0a00696e"). InnerVolumeSpecName "kube-api-access-9hpzk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:22:58.399362 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:58.399344    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w86hn"
Jul 28 01:22:58.487143 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:58.487114    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hpzk\" (UniqueName: \"kubernetes.io/projected/934e767e-d319-4b39-9320-45ec0a00696e-kube-api-access-9hpzk\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:22:58.487143 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:58.487141    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/678d37a2-8360-41f2-b523-35f2085dba3a-extensions-socket-volume\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:22:58.487309 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:58.487154    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6h5h\" (UniqueName: \"kubernetes.io/projected/678d37a2-8360-41f2-b523-35f2085dba3a-kube-api-access-z6h5h\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:22:58.532125 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:58.532102    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w86hn"]
Jul 28 01:22:58.534823 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:22:58.534795    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f62fcfa_5371_4dab_b2d0_db250498399b.slice/crio-d67b5a030adc709a86c0217c0ed33edeff280d2a609b1b154c5f1ece41bc02f5 WatchSource:0}: Error finding container d67b5a030adc709a86c0217c0ed33edeff280d2a609b1b154c5f1ece41bc02f5: Status 404 returned error can't find the container with id d67b5a030adc709a86c0217c0ed33edeff280d2a609b1b154c5f1ece41bc02f5
Jul 28 01:22:59.288533 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:59.288443    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w86hn" event={"ID":"3f62fcfa-5371-4dab-b2d0-db250498399b","Type":"ContainerStarted","Data":"8e16e990caa0aa2aafc56e7e2e48007af02f15faff36129b5a1cdc3dd548d6df"}
Jul 28 01:22:59.288533 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:59.288513    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w86hn" event={"ID":"3f62fcfa-5371-4dab-b2d0-db250498399b","Type":"ContainerStarted","Data":"d67b5a030adc709a86c0217c0ed33edeff280d2a609b1b154c5f1ece41bc02f5"}
Jul 28 01:22:59.288969 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:59.288587    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w86hn"
Jul 28 01:22:59.311022 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:22:59.310977    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w86hn" podStartSLOduration=2.31096055 podStartE2EDuration="2.31096055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:22:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:22:59.308864216 +0000 UTC m=+449.812625579" watchObservedRunningTime="2026-07-28 01:22:59.31096055 +0000 UTC m=+449.814721862"
Jul 28 01:23:00.013479 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:00.013441    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="678d37a2-8360-41f2-b523-35f2085dba3a" path="/var/lib/kubelet/pods/678d37a2-8360-41f2-b523-35f2085dba3a/volumes"
Jul 28 01:23:00.013822 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:00.013806    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="934e767e-d319-4b39-9320-45ec0a00696e" path="/var/lib/kubelet/pods/934e767e-d319-4b39-9320-45ec0a00696e/volumes"
Jul 28 01:23:10.295894 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:10.295864    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w86hn"
Jul 28 01:23:27.569670 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:27.569635    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w86hn"]
Jul 28 01:23:27.570113 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:27.569833    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w86hn" podUID="3f62fcfa-5371-4dab-b2d0-db250498399b" containerName="manager" containerID="cri-o://8e16e990caa0aa2aafc56e7e2e48007af02f15faff36129b5a1cdc3dd548d6df" gracePeriod=10
Jul 28 01:23:27.824845 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:27.824792    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w86hn"
Jul 28 01:23:27.892366 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:27.892332    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2hlvl"]
Jul 28 01:23:27.892694 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:27.892681    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="934e767e-d319-4b39-9320-45ec0a00696e" containerName="manager"
Jul 28 01:23:27.892694 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:27.892695    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="934e767e-d319-4b39-9320-45ec0a00696e" containerName="manager"
Jul 28 01:23:27.892789 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:27.892715    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f62fcfa-5371-4dab-b2d0-db250498399b" containerName="manager"
Jul 28 01:23:27.892789 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:27.892722    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f62fcfa-5371-4dab-b2d0-db250498399b" containerName="manager"
Jul 28 01:23:27.892789 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:27.892783    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="934e767e-d319-4b39-9320-45ec0a00696e" containerName="manager"
Jul 28 01:23:27.892874 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:27.892791    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f62fcfa-5371-4dab-b2d0-db250498399b" containerName="manager"
Jul 28 01:23:27.894663 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:27.894648    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2hlvl"
Jul 28 01:23:27.908356 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:27.908330    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2hlvl"]
Jul 28 01:23:27.918450 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:27.918428    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f62fcfa-5371-4dab-b2d0-db250498399b-extensions-socket-volume\") pod \"3f62fcfa-5371-4dab-b2d0-db250498399b\" (UID: \"3f62fcfa-5371-4dab-b2d0-db250498399b\") "
Jul 28 01:23:27.918549 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:27.918461    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rktzx\" (UniqueName: \"kubernetes.io/projected/3f62fcfa-5371-4dab-b2d0-db250498399b-kube-api-access-rktzx\") pod \"3f62fcfa-5371-4dab-b2d0-db250498399b\" (UID: \"3f62fcfa-5371-4dab-b2d0-db250498399b\") "
Jul 28 01:23:27.918781 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:27.918759    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f62fcfa-5371-4dab-b2d0-db250498399b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3f62fcfa-5371-4dab-b2d0-db250498399b" (UID: "3f62fcfa-5371-4dab-b2d0-db250498399b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:23:27.920503 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:27.920481    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f62fcfa-5371-4dab-b2d0-db250498399b-kube-api-access-rktzx" (OuterVolumeSpecName: "kube-api-access-rktzx") pod "3f62fcfa-5371-4dab-b2d0-db250498399b" (UID: "3f62fcfa-5371-4dab-b2d0-db250498399b"). InnerVolumeSpecName "kube-api-access-rktzx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:23:28.019194 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:28.019162    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7ffl\" (UniqueName: \"kubernetes.io/projected/7a63d1a9-befe-4d02-b085-ded230fe433c-kube-api-access-j7ffl\") pod \"kuadrant-operator-controller-manager-86878c769f-2hlvl\" (UID: \"7a63d1a9-befe-4d02-b085-ded230fe433c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2hlvl"
Jul 28 01:23:28.019355 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:28.019286    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7a63d1a9-befe-4d02-b085-ded230fe433c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2hlvl\" (UID: \"7a63d1a9-befe-4d02-b085-ded230fe433c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2hlvl"
Jul 28 01:23:28.019355 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:28.019344    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f62fcfa-5371-4dab-b2d0-db250498399b-extensions-socket-volume\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:23:28.019355 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:28.019355    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rktzx\" (UniqueName: \"kubernetes.io/projected/3f62fcfa-5371-4dab-b2d0-db250498399b-kube-api-access-rktzx\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:23:28.120437 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:28.120404    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7a63d1a9-befe-4d02-b085-ded230fe433c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2hlvl\" (UID: \"7a63d1a9-befe-4d02-b085-ded230fe433c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2hlvl"
Jul 28 01:23:28.120629 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:28.120448    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7ffl\" (UniqueName: \"kubernetes.io/projected/7a63d1a9-befe-4d02-b085-ded230fe433c-kube-api-access-j7ffl\") pod \"kuadrant-operator-controller-manager-86878c769f-2hlvl\" (UID: \"7a63d1a9-befe-4d02-b085-ded230fe433c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2hlvl"
Jul 28 01:23:28.120812 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:28.120791    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7a63d1a9-befe-4d02-b085-ded230fe433c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2hlvl\" (UID: \"7a63d1a9-befe-4d02-b085-ded230fe433c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2hlvl"
Jul 28 01:23:28.128996 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:28.128974    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7ffl\" (UniqueName: \"kubernetes.io/projected/7a63d1a9-befe-4d02-b085-ded230fe433c-kube-api-access-j7ffl\") pod \"kuadrant-operator-controller-manager-86878c769f-2hlvl\" (UID: \"7a63d1a9-befe-4d02-b085-ded230fe433c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2hlvl"
Jul 28 01:23:28.204500 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:28.204470    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2hlvl"
Jul 28 01:23:28.333616 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:28.333506    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2hlvl"]
Jul 28 01:23:28.336533 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:23:28.336498    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a63d1a9_befe_4d02_b085_ded230fe433c.slice/crio-5deaa23b585eb2b979623fe418c9cb2476be3e87b865d72766c567f9589b18e6 WatchSource:0}: Error finding container 5deaa23b585eb2b979623fe418c9cb2476be3e87b865d72766c567f9589b18e6: Status 404 returned error can't find the container with id 5deaa23b585eb2b979623fe418c9cb2476be3e87b865d72766c567f9589b18e6
Jul 28 01:23:28.429152 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:28.429124    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2hlvl" event={"ID":"7a63d1a9-befe-4d02-b085-ded230fe433c","Type":"ContainerStarted","Data":"04bf04c3ec316914329d0c674ed8493051e90489bffa154ca0e870e52702cdcd"}
Jul 28 01:23:28.429278 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:28.429171    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2hlvl" event={"ID":"7a63d1a9-befe-4d02-b085-ded230fe433c","Type":"ContainerStarted","Data":"5deaa23b585eb2b979623fe418c9cb2476be3e87b865d72766c567f9589b18e6"}
Jul 28 01:23:28.429278 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:28.429222    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2hlvl"
Jul 28 01:23:28.430617 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:28.430592    2562 generic.go:356] "Generic (PLEG): container finished" podID="3f62fcfa-5371-4dab-b2d0-db250498399b" containerID="8e16e990caa0aa2aafc56e7e2e48007af02f15faff36129b5a1cdc3dd548d6df" exitCode=0
Jul 28 01:23:28.430722 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:28.430648    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w86hn"
Jul 28 01:23:28.430722 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:28.430682    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w86hn" event={"ID":"3f62fcfa-5371-4dab-b2d0-db250498399b","Type":"ContainerDied","Data":"8e16e990caa0aa2aafc56e7e2e48007af02f15faff36129b5a1cdc3dd548d6df"}
Jul 28 01:23:28.430833 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:28.430732    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w86hn" event={"ID":"3f62fcfa-5371-4dab-b2d0-db250498399b","Type":"ContainerDied","Data":"d67b5a030adc709a86c0217c0ed33edeff280d2a609b1b154c5f1ece41bc02f5"}
Jul 28 01:23:28.430833 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:28.430765    2562 scope.go:117] "RemoveContainer" containerID="8e16e990caa0aa2aafc56e7e2e48007af02f15faff36129b5a1cdc3dd548d6df"
Jul 28 01:23:28.439835 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:28.439816    2562 scope.go:117] "RemoveContainer" containerID="8e16e990caa0aa2aafc56e7e2e48007af02f15faff36129b5a1cdc3dd548d6df"
Jul 28 01:23:28.440091 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:23:28.440068    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e16e990caa0aa2aafc56e7e2e48007af02f15faff36129b5a1cdc3dd548d6df\": container with ID starting with 8e16e990caa0aa2aafc56e7e2e48007af02f15faff36129b5a1cdc3dd548d6df not found: ID does not exist" containerID="8e16e990caa0aa2aafc56e7e2e48007af02f15faff36129b5a1cdc3dd548d6df"
Jul 28 01:23:28.440150 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:28.440104    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e16e990caa0aa2aafc56e7e2e48007af02f15faff36129b5a1cdc3dd548d6df"} err="failed to get container status \"8e16e990caa0aa2aafc56e7e2e48007af02f15faff36129b5a1cdc3dd548d6df\": rpc error: code = NotFound desc = could not find container \"8e16e990caa0aa2aafc56e7e2e48007af02f15faff36129b5a1cdc3dd548d6df\": container with ID starting with 8e16e990caa0aa2aafc56e7e2e48007af02f15faff36129b5a1cdc3dd548d6df not found: ID does not exist"
Jul 28 01:23:28.447630 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:28.447583    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2hlvl" podStartSLOduration=1.447546311 podStartE2EDuration="1.447546311s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:23:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:23:28.446267049 +0000 UTC m=+478.950028358" watchObservedRunningTime="2026-07-28 01:23:28.447546311 +0000 UTC m=+478.951307623"
Jul 28 01:23:28.462356 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:28.462330    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w86hn"]
Jul 28 01:23:28.465779 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:28.465759    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w86hn"]
Jul 28 01:23:30.013337 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:30.013305    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f62fcfa-5371-4dab-b2d0-db250498399b" path="/var/lib/kubelet/pods/3f62fcfa-5371-4dab-b2d0-db250498399b/volumes"
Jul 28 01:23:39.439535 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:39.439504    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2hlvl"
Jul 28 01:23:43.962519 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:43.962486    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h"]
Jul 28 01:23:43.967302 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:43.967278    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h"
Jul 28 01:23:43.969153 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:43.969134    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 28 01:23:43.969257 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:43.969197    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-lgbtv\""
Jul 28 01:23:43.977396 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:43.977372    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h"]
Jul 28 01:23:44.056819 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:44.056781    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59e683f8-4134-4f09-aa4d-4159d59ca05b-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6lq2h\" (UID: \"59e683f8-4134-4f09-aa4d-4159d59ca05b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h"
Jul 28 01:23:44.056819 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:44.056822    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59e683f8-4134-4f09-aa4d-4159d59ca05b-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6lq2h\" (UID: \"59e683f8-4134-4f09-aa4d-4159d59ca05b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h"
Jul 28 01:23:44.057065 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:44.056840    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59e683f8-4134-4f09-aa4d-4159d59ca05b-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6lq2h\" (UID: \"59e683f8-4134-4f09-aa4d-4159d59ca05b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h"
Jul 28 01:23:44.057065 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:44.056889    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6tlw\" (UniqueName: \"kubernetes.io/projected/59e683f8-4134-4f09-aa4d-4159d59ca05b-kube-api-access-q6tlw\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6lq2h\" (UID: \"59e683f8-4134-4f09-aa4d-4159d59ca05b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h"
Jul 28 01:23:44.057065 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:44.056961    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59e683f8-4134-4f09-aa4d-4159d59ca05b-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6lq2h\" (UID: \"59e683f8-4134-4f09-aa4d-4159d59ca05b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h"
Jul 28 01:23:44.057065 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:44.056980    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59e683f8-4134-4f09-aa4d-4159d59ca05b-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6lq2h\" (UID: \"59e683f8-4134-4f09-aa4d-4159d59ca05b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h"
Jul 28 01:23:44.057065 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:44.057005    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59e683f8-4134-4f09-aa4d-4159d59ca05b-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6lq2h\" (UID: \"59e683f8-4134-4f09-aa4d-4159d59ca05b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h"
Jul 28 01:23:44.057065 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:44.057038    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59e683f8-4134-4f09-aa4d-4159d59ca05b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6lq2h\" (UID: \"59e683f8-4134-4f09-aa4d-4159d59ca05b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h"
Jul 28 01:23:44.057065 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:44.057057    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59e683f8-4134-4f09-aa4d-4159d59ca05b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6lq2h\" (UID: \"59e683f8-4134-4f09-aa4d-4159d59ca05b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h"
Jul 28 01:23:44.157834 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:44.157796    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6tlw\" (UniqueName: \"kubernetes.io/projected/59e683f8-4134-4f09-aa4d-4159d59ca05b-kube-api-access-q6tlw\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6lq2h\" (UID: \"59e683f8-4134-4f09-aa4d-4159d59ca05b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h"
Jul 28 01:23:44.158011 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:44.157848    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59e683f8-4134-4f09-aa4d-4159d59ca05b-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6lq2h\" (UID: \"59e683f8-4134-4f09-aa4d-4159d59ca05b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h"
Jul 28 01:23:44.158011 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:44.157876    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59e683f8-4134-4f09-aa4d-4159d59ca05b-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6lq2h\" (UID: \"59e683f8-4134-4f09-aa4d-4159d59ca05b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h"
Jul 28 01:23:44.158011 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:44.157931    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59e683f8-4134-4f09-aa4d-4159d59ca05b-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6lq2h\" (UID: \"59e683f8-4134-4f09-aa4d-4159d59ca05b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h"
Jul 28 01:23:44.158011 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:44.157977    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59e683f8-4134-4f09-aa4d-4159d59ca05b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6lq2h\" (UID: \"59e683f8-4134-4f09-aa4d-4159d59ca05b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h"
Jul 28 01:23:44.158011 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:44.157998    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59e683f8-4134-4f09-aa4d-4159d59ca05b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6lq2h\" (UID: \"59e683f8-4134-4f09-aa4d-4159d59ca05b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h"
Jul 28 01:23:44.158280 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:44.158058    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59e683f8-4134-4f09-aa4d-4159d59ca05b-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6lq2h\" (UID: \"59e683f8-4134-4f09-aa4d-4159d59ca05b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h"
Jul 28 01:23:44.158280 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:44.158094    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59e683f8-4134-4f09-aa4d-4159d59ca05b-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6lq2h\" (UID: \"59e683f8-4134-4f09-aa4d-4159d59ca05b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h"
Jul 28 01:23:44.158280 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:44.158115    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59e683f8-4134-4f09-aa4d-4159d59ca05b-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6lq2h\" (UID: \"59e683f8-4134-4f09-aa4d-4159d59ca05b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h"
Jul 28 01:23:44.158430 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:44.158278    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59e683f8-4134-4f09-aa4d-4159d59ca05b-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6lq2h\" (UID: \"59e683f8-4134-4f09-aa4d-4159d59ca05b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h"
Jul 28 01:23:44.158484 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:44.158455    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59e683f8-4134-4f09-aa4d-4159d59ca05b-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6lq2h\" (UID: \"59e683f8-4134-4f09-aa4d-4159d59ca05b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h"
Jul 28 01:23:44.158538 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:44.158493    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59e683f8-4134-4f09-aa4d-4159d59ca05b-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6lq2h\" (UID: \"59e683f8-4134-4f09-aa4d-4159d59ca05b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h"
Jul 28 01:23:44.158696 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:44.158676    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59e683f8-4134-4f09-aa4d-4159d59ca05b-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6lq2h\" (UID: \"59e683f8-4134-4f09-aa4d-4159d59ca05b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h"
Jul 28 01:23:44.159143 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:44.159120    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59e683f8-4134-4f09-aa4d-4159d59ca05b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6lq2h\" (UID: \"59e683f8-4134-4f09-aa4d-4159d59ca05b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h"
Jul 28 01:23:44.160257 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:44.160226    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59e683f8-4134-4f09-aa4d-4159d59ca05b-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6lq2h\" (UID: \"59e683f8-4134-4f09-aa4d-4159d59ca05b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h"
Jul 28 01:23:44.160372 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:44.160357    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59e683f8-4134-4f09-aa4d-4159d59ca05b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6lq2h\" (UID: \"59e683f8-4134-4f09-aa4d-4159d59ca05b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h"
Jul 28 01:23:44.164779 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:44.164752    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6tlw\" (UniqueName: \"kubernetes.io/projected/59e683f8-4134-4f09-aa4d-4159d59ca05b-kube-api-access-q6tlw\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6lq2h\" (UID: \"59e683f8-4134-4f09-aa4d-4159d59ca05b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h"
Jul 28 01:23:44.164877 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:44.164804    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59e683f8-4134-4f09-aa4d-4159d59ca05b-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6lq2h\" (UID: \"59e683f8-4134-4f09-aa4d-4159d59ca05b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h"
Jul 28 01:23:44.279005 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:44.278911    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h"
Jul 28 01:23:44.410834 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:44.410809    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h"]
Jul 28 01:23:44.412700 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:23:44.412675    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59e683f8_4134_4f09_aa4d_4159d59ca05b.slice/crio-a8f1afa4892a57d61692eb3b82bf679c0b0c45aaf0055668d026e618cb38b388 WatchSource:0}: Error finding container a8f1afa4892a57d61692eb3b82bf679c0b0c45aaf0055668d026e618cb38b388: Status 404 returned error can't find the container with id a8f1afa4892a57d61692eb3b82bf679c0b0c45aaf0055668d026e618cb38b388
Jul 28 01:23:44.507148 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:44.507108    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h" event={"ID":"59e683f8-4134-4f09-aa4d-4159d59ca05b","Type":"ContainerStarted","Data":"a8f1afa4892a57d61692eb3b82bf679c0b0c45aaf0055668d026e618cb38b388"}
Jul 28 01:23:48.420466 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:48.420424    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:23:48.420721 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:48.420504    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:23:48.420721 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:48.420534    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:23:48.528491 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:48.528456    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h" event={"ID":"59e683f8-4134-4f09-aa4d-4159d59ca05b","Type":"ContainerStarted","Data":"96f6473bdd07b149b2988691429d5be869865f801ad6f065130b8041cfa2e48b"}
Jul 28 01:23:48.547679 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:48.547620    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h" podStartSLOduration=1.5421345039999999 podStartE2EDuration="5.547598302s" totalImagesPullingTime="4.005463798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:23:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:23:48.544580457 +0000 UTC m=+499.048341763" watchObservedRunningTime="2026-07-28 01:23:48.547598302 +0000 UTC m=+499.051359615"
Jul 28 01:23:49.279216 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:49.279184    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h"
Jul 28 01:23:49.280533 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:49.280511    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-6lq2h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 28 01:23:49.280646 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:49.280579    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h" podUID="59e683f8-4134-4f09-aa4d-4159d59ca05b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 28 01:23:49.577620 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:49.577539    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l79p5"]
Jul 28 01:23:49.581258 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:49.581238    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-l79p5"
Jul 28 01:23:49.582980 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:49.582962    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 28 01:23:49.582980 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:49.582973    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-xgtzm\""
Jul 28 01:23:49.588274 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:49.588249    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l79p5"]
Jul 28 01:23:49.674235 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:49.674202    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l79p5"]
Jul 28 01:23:49.713504 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:49.713476    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4204cd3f-235d-458a-a96b-c2fcb02e6734-config-file\") pod \"limitador-limitador-64c94fd64f-l79p5\" (UID: \"4204cd3f-235d-458a-a96b-c2fcb02e6734\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l79p5"
Jul 28 01:23:49.713697 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:49.713514    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mztv\" (UniqueName: \"kubernetes.io/projected/4204cd3f-235d-458a-a96b-c2fcb02e6734-kube-api-access-7mztv\") pod \"limitador-limitador-64c94fd64f-l79p5\" (UID: \"4204cd3f-235d-458a-a96b-c2fcb02e6734\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l79p5"
Jul 28 01:23:49.814989 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:49.814953    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4204cd3f-235d-458a-a96b-c2fcb02e6734-config-file\") pod \"limitador-limitador-64c94fd64f-l79p5\" (UID: \"4204cd3f-235d-458a-a96b-c2fcb02e6734\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l79p5"
Jul 28 01:23:49.814989 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:49.814995    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mztv\" (UniqueName: \"kubernetes.io/projected/4204cd3f-235d-458a-a96b-c2fcb02e6734-kube-api-access-7mztv\") pod \"limitador-limitador-64c94fd64f-l79p5\" (UID: \"4204cd3f-235d-458a-a96b-c2fcb02e6734\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l79p5"
Jul 28 01:23:49.815629 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:49.815610    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4204cd3f-235d-458a-a96b-c2fcb02e6734-config-file\") pod \"limitador-limitador-64c94fd64f-l79p5\" (UID: \"4204cd3f-235d-458a-a96b-c2fcb02e6734\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l79p5"
Jul 28 01:23:49.821940 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:49.821913    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mztv\" (UniqueName: \"kubernetes.io/projected/4204cd3f-235d-458a-a96b-c2fcb02e6734-kube-api-access-7mztv\") pod \"limitador-limitador-64c94fd64f-l79p5\" (UID: \"4204cd3f-235d-458a-a96b-c2fcb02e6734\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l79p5"
Jul 28 01:23:49.893127 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:49.893098    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-l79p5"
Jul 28 01:23:50.045090 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:50.045067    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l79p5"]
Jul 28 01:23:50.046954 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:23:50.046926    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4204cd3f_235d_458a_a96b_c2fcb02e6734.slice/crio-c2f5c8a9a15125615a049198d53719945f22b746cc38a834b8a8e0be3722985e WatchSource:0}: Error finding container c2f5c8a9a15125615a049198d53719945f22b746cc38a834b8a8e0be3722985e: Status 404 returned error can't find the container with id c2f5c8a9a15125615a049198d53719945f22b746cc38a834b8a8e0be3722985e
Jul 28 01:23:50.283050 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:50.282976    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h"
Jul 28 01:23:50.365209 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:50.365178    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-sbllt"]
Jul 28 01:23:50.370648 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:50.370625    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-sbllt"
Jul 28 01:23:50.372862 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:50.372783    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-dmvq8\""
Jul 28 01:23:50.385629 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:50.385607    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-sbllt"]
Jul 28 01:23:50.520936 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:50.520899    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5dhb\" (UniqueName: \"kubernetes.io/projected/40160641-6049-4d0e-b909-b0fef56c0b71-kube-api-access-p5dhb\") pod \"authorino-58cd955675-sbllt\" (UID: \"40160641-6049-4d0e-b909-b0fef56c0b71\") " pod="kuadrant-system/authorino-58cd955675-sbllt"
Jul 28 01:23:50.538995 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:50.538912    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-l79p5" event={"ID":"4204cd3f-235d-458a-a96b-c2fcb02e6734","Type":"ContainerStarted","Data":"c2f5c8a9a15125615a049198d53719945f22b746cc38a834b8a8e0be3722985e"}
Jul 28 01:23:50.539123 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:50.539095    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h"
Jul 28 01:23:50.539980 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:50.539960    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h"
Jul 28 01:23:50.622011 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:50.621978    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5dhb\" (UniqueName: \"kubernetes.io/projected/40160641-6049-4d0e-b909-b0fef56c0b71-kube-api-access-p5dhb\") pod \"authorino-58cd955675-sbllt\" (UID: \"40160641-6049-4d0e-b909-b0fef56c0b71\") " pod="kuadrant-system/authorino-58cd955675-sbllt"
Jul 28 01:23:50.629173 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:50.629148    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5dhb\" (UniqueName: \"kubernetes.io/projected/40160641-6049-4d0e-b909-b0fef56c0b71-kube-api-access-p5dhb\") pod \"authorino-58cd955675-sbllt\" (UID: \"40160641-6049-4d0e-b909-b0fef56c0b71\") " pod="kuadrant-system/authorino-58cd955675-sbllt"
Jul 28 01:23:50.680824 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:50.680796    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-sbllt"
Jul 28 01:23:50.854030 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:50.853963    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-sbllt"]
Jul 28 01:23:50.855967 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:23:50.855939    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod40160641_6049_4d0e_b909_b0fef56c0b71.slice/crio-358dd04adf380edbfd5b06ed25a17954314b6a319ce86fa0e12ad9effed14c90 WatchSource:0}: Error finding container 358dd04adf380edbfd5b06ed25a17954314b6a319ce86fa0e12ad9effed14c90: Status 404 returned error can't find the container with id 358dd04adf380edbfd5b06ed25a17954314b6a319ce86fa0e12ad9effed14c90
Jul 28 01:23:51.547498 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:51.547439    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-sbllt" event={"ID":"40160641-6049-4d0e-b909-b0fef56c0b71","Type":"ContainerStarted","Data":"358dd04adf380edbfd5b06ed25a17954314b6a319ce86fa0e12ad9effed14c90"}
Jul 28 01:23:55.569111 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:55.569075    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-l79p5" event={"ID":"4204cd3f-235d-458a-a96b-c2fcb02e6734","Type":"ContainerStarted","Data":"9b98517d1020ff355d9bc169d7222d11b618a5040a4884a248b4527c2429cb2d"}
Jul 28 01:23:55.569528 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:55.569142    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-l79p5"
Jul 28 01:23:55.570493 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:55.570466    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-sbllt" event={"ID":"40160641-6049-4d0e-b909-b0fef56c0b71","Type":"ContainerStarted","Data":"b2eb1c76a2683929890e0531bec4756ce2390834d348850749e8b7d48b22bee5"}
Jul 28 01:23:55.584425 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:55.584382    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-l79p5" podStartSLOduration=2.022716216 podStartE2EDuration="6.58436705s" totalImagesPullingTime="4.561650834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:23:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:23:55.582748804 +0000 UTC m=+506.086510112" watchObservedRunningTime="2026-07-28 01:23:55.58436705 +0000 UTC m=+506.088128362"
Jul 28 01:23:55.595911 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:55.595868    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-sbllt" podStartSLOduration=1.836331676 podStartE2EDuration="5.595854238s" totalImagesPullingTime="3.759522562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:23:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:23:55.594707331 +0000 UTC m=+506.098468673" watchObservedRunningTime="2026-07-28 01:23:55.595854238 +0000 UTC m=+506.099615550"
Jul 28 01:23:55.767667 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:55.767633    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-sbllt"]
Jul 28 01:23:57.579738 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:57.579683    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-sbllt" podUID="40160641-6049-4d0e-b909-b0fef56c0b71" containerName="authorino" containerID="cri-o://b2eb1c76a2683929890e0531bec4756ce2390834d348850749e8b7d48b22bee5" gracePeriod=30
Jul 28 01:23:57.836911 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:57.836853    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-sbllt"
Jul 28 01:23:57.984787 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:57.984756    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p5dhb\" (UniqueName: \"kubernetes.io/projected/40160641-6049-4d0e-b909-b0fef56c0b71-kube-api-access-p5dhb\") pod \"40160641-6049-4d0e-b909-b0fef56c0b71\" (UID: \"40160641-6049-4d0e-b909-b0fef56c0b71\") "
Jul 28 01:23:57.986736 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:57.986710    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40160641-6049-4d0e-b909-b0fef56c0b71-kube-api-access-p5dhb" (OuterVolumeSpecName: "kube-api-access-p5dhb") pod "40160641-6049-4d0e-b909-b0fef56c0b71" (UID: "40160641-6049-4d0e-b909-b0fef56c0b71"). InnerVolumeSpecName "kube-api-access-p5dhb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:23:58.085959 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:58.085928    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5dhb\" (UniqueName: \"kubernetes.io/projected/40160641-6049-4d0e-b909-b0fef56c0b71-kube-api-access-p5dhb\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:23:58.584944 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:58.584906    2562 generic.go:356] "Generic (PLEG): container finished" podID="40160641-6049-4d0e-b909-b0fef56c0b71" containerID="b2eb1c76a2683929890e0531bec4756ce2390834d348850749e8b7d48b22bee5" exitCode=0
Jul 28 01:23:58.585425 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:58.584950    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-sbllt"
Jul 28 01:23:58.585425 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:58.584992    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-sbllt" event={"ID":"40160641-6049-4d0e-b909-b0fef56c0b71","Type":"ContainerDied","Data":"b2eb1c76a2683929890e0531bec4756ce2390834d348850749e8b7d48b22bee5"}
Jul 28 01:23:58.585425 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:58.585038    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-sbllt" event={"ID":"40160641-6049-4d0e-b909-b0fef56c0b71","Type":"ContainerDied","Data":"358dd04adf380edbfd5b06ed25a17954314b6a319ce86fa0e12ad9effed14c90"}
Jul 28 01:23:58.585425 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:58.585057    2562 scope.go:117] "RemoveContainer" containerID="b2eb1c76a2683929890e0531bec4756ce2390834d348850749e8b7d48b22bee5"
Jul 28 01:23:58.593318 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:58.593300    2562 scope.go:117] "RemoveContainer" containerID="b2eb1c76a2683929890e0531bec4756ce2390834d348850749e8b7d48b22bee5"
Jul 28 01:23:58.593606 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:23:58.593581    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2eb1c76a2683929890e0531bec4756ce2390834d348850749e8b7d48b22bee5\": container with ID starting with b2eb1c76a2683929890e0531bec4756ce2390834d348850749e8b7d48b22bee5 not found: ID does not exist" containerID="b2eb1c76a2683929890e0531bec4756ce2390834d348850749e8b7d48b22bee5"
Jul 28 01:23:58.593670 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:58.593620    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2eb1c76a2683929890e0531bec4756ce2390834d348850749e8b7d48b22bee5"} err="failed to get container status \"b2eb1c76a2683929890e0531bec4756ce2390834d348850749e8b7d48b22bee5\": rpc error: code = NotFound desc = could not find container \"b2eb1c76a2683929890e0531bec4756ce2390834d348850749e8b7d48b22bee5\": container with ID starting with b2eb1c76a2683929890e0531bec4756ce2390834d348850749e8b7d48b22bee5 not found: ID does not exist"
Jul 28 01:23:58.598489 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:58.598467    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-sbllt"]
Jul 28 01:23:58.601702 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:23:58.601682    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-sbllt"]
Jul 28 01:24:00.013058 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:00.013022    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40160641-6049-4d0e-b909-b0fef56c0b71" path="/var/lib/kubelet/pods/40160641-6049-4d0e-b909-b0fef56c0b71/volumes"
Jul 28 01:24:06.576248 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:06.576217    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-l79p5"
Jul 28 01:24:06.760926 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:06.760888    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l79p5"]
Jul 28 01:24:06.761098 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:06.761071    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-l79p5" podUID="4204cd3f-235d-458a-a96b-c2fcb02e6734" containerName="limitador" containerID="cri-o://9b98517d1020ff355d9bc169d7222d11b618a5040a4884a248b4527c2429cb2d" gracePeriod=30
Jul 28 01:24:07.635163 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:07.635132    2562 generic.go:356] "Generic (PLEG): container finished" podID="4204cd3f-235d-458a-a96b-c2fcb02e6734" containerID="9b98517d1020ff355d9bc169d7222d11b618a5040a4884a248b4527c2429cb2d" exitCode=0
Jul 28 01:24:07.635590 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:07.635206    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-l79p5" event={"ID":"4204cd3f-235d-458a-a96b-c2fcb02e6734","Type":"ContainerDied","Data":"9b98517d1020ff355d9bc169d7222d11b618a5040a4884a248b4527c2429cb2d"}
Jul 28 01:24:07.714691 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:07.714664    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-l79p5"
Jul 28 01:24:07.762022 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:07.761985    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mztv\" (UniqueName: \"kubernetes.io/projected/4204cd3f-235d-458a-a96b-c2fcb02e6734-kube-api-access-7mztv\") pod \"4204cd3f-235d-458a-a96b-c2fcb02e6734\" (UID: \"4204cd3f-235d-458a-a96b-c2fcb02e6734\") "
Jul 28 01:24:07.762176 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:07.762042    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4204cd3f-235d-458a-a96b-c2fcb02e6734-config-file\") pod \"4204cd3f-235d-458a-a96b-c2fcb02e6734\" (UID: \"4204cd3f-235d-458a-a96b-c2fcb02e6734\") "
Jul 28 01:24:07.762357 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:07.762335    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4204cd3f-235d-458a-a96b-c2fcb02e6734-config-file" (OuterVolumeSpecName: "config-file") pod "4204cd3f-235d-458a-a96b-c2fcb02e6734" (UID: "4204cd3f-235d-458a-a96b-c2fcb02e6734"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:24:07.763971 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:07.763952    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4204cd3f-235d-458a-a96b-c2fcb02e6734-kube-api-access-7mztv" (OuterVolumeSpecName: "kube-api-access-7mztv") pod "4204cd3f-235d-458a-a96b-c2fcb02e6734" (UID: "4204cd3f-235d-458a-a96b-c2fcb02e6734"). InnerVolumeSpecName "kube-api-access-7mztv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:24:07.863199 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:07.863165    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7mztv\" (UniqueName: \"kubernetes.io/projected/4204cd3f-235d-458a-a96b-c2fcb02e6734-kube-api-access-7mztv\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:24:07.863199 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:07.863196    2562 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4204cd3f-235d-458a-a96b-c2fcb02e6734-config-file\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:24:08.640798 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:08.640768    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-l79p5"
Jul 28 01:24:08.641258 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:08.640808    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-l79p5" event={"ID":"4204cd3f-235d-458a-a96b-c2fcb02e6734","Type":"ContainerDied","Data":"c2f5c8a9a15125615a049198d53719945f22b746cc38a834b8a8e0be3722985e"}
Jul 28 01:24:08.641258 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:08.640884    2562 scope.go:117] "RemoveContainer" containerID="9b98517d1020ff355d9bc169d7222d11b618a5040a4884a248b4527c2429cb2d"
Jul 28 01:24:08.654499 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:08.654477    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l79p5"]
Jul 28 01:24:08.658043 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:08.658023    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l79p5"]
Jul 28 01:24:10.013407 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:10.013376    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4204cd3f-235d-458a-a96b-c2fcb02e6734" path="/var/lib/kubelet/pods/4204cd3f-235d-458a-a96b-c2fcb02e6734/volumes"
Jul 28 01:24:11.261019 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:11.260980    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-9xwbt"]
Jul 28 01:24:11.261656 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:11.261634    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4204cd3f-235d-458a-a96b-c2fcb02e6734" containerName="limitador"
Jul 28 01:24:11.261809 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:11.261787    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4204cd3f-235d-458a-a96b-c2fcb02e6734" containerName="limitador"
Jul 28 01:24:11.261809 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:11.261813    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40160641-6049-4d0e-b909-b0fef56c0b71" containerName="authorino"
Jul 28 01:24:11.261809 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:11.261822    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="40160641-6049-4d0e-b909-b0fef56c0b71" containerName="authorino"
Jul 28 01:24:11.261998 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:11.261939    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="40160641-6049-4d0e-b909-b0fef56c0b71" containerName="authorino"
Jul 28 01:24:11.261998 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:11.261952    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4204cd3f-235d-458a-a96b-c2fcb02e6734" containerName="limitador"
Jul 28 01:24:11.266639 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:11.266616    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9xwbt"
Jul 28 01:24:11.268757 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:11.268730    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 28 01:24:11.268875 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:11.268739    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 28 01:24:11.269262 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:11.269242    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 01:24:11.269385 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:11.269266    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-x2s9p\""
Jul 28 01:24:11.272436 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:11.272413    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-9xwbt"]
Jul 28 01:24:11.288451 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:11.288421    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0b1c48a3-c13d-4940-8ba2-694c3bf0183a-data\") pod \"postgres-69fb4594cf-9xwbt\" (UID: \"0b1c48a3-c13d-4940-8ba2-694c3bf0183a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9xwbt"
Jul 28 01:24:11.288577 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:11.288486    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgmqv\" (UniqueName: \"kubernetes.io/projected/0b1c48a3-c13d-4940-8ba2-694c3bf0183a-kube-api-access-lgmqv\") pod \"postgres-69fb4594cf-9xwbt\" (UID: \"0b1c48a3-c13d-4940-8ba2-694c3bf0183a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9xwbt"
Jul 28 01:24:11.389270 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:11.389231    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgmqv\" (UniqueName: \"kubernetes.io/projected/0b1c48a3-c13d-4940-8ba2-694c3bf0183a-kube-api-access-lgmqv\") pod \"postgres-69fb4594cf-9xwbt\" (UID: \"0b1c48a3-c13d-4940-8ba2-694c3bf0183a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9xwbt"
Jul 28 01:24:11.389487 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:11.389337    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0b1c48a3-c13d-4940-8ba2-694c3bf0183a-data\") pod \"postgres-69fb4594cf-9xwbt\" (UID: \"0b1c48a3-c13d-4940-8ba2-694c3bf0183a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9xwbt"
Jul 28 01:24:11.389719 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:11.389703    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0b1c48a3-c13d-4940-8ba2-694c3bf0183a-data\") pod \"postgres-69fb4594cf-9xwbt\" (UID: \"0b1c48a3-c13d-4940-8ba2-694c3bf0183a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9xwbt"
Jul 28 01:24:11.396985 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:11.396963    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgmqv\" (UniqueName: \"kubernetes.io/projected/0b1c48a3-c13d-4940-8ba2-694c3bf0183a-kube-api-access-lgmqv\") pod \"postgres-69fb4594cf-9xwbt\" (UID: \"0b1c48a3-c13d-4940-8ba2-694c3bf0183a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9xwbt"
Jul 28 01:24:11.580956 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:11.580871    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9xwbt"
Jul 28 01:24:11.723228 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:11.723204    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-9xwbt"]
Jul 28 01:24:11.725195 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:24:11.725161    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b1c48a3_c13d_4940_8ba2_694c3bf0183a.slice/crio-d77024ea42e30ee4aa50966f7dc70d6f1b756830ffb1de78fb16576cd6f73259 WatchSource:0}: Error finding container d77024ea42e30ee4aa50966f7dc70d6f1b756830ffb1de78fb16576cd6f73259: Status 404 returned error can't find the container with id d77024ea42e30ee4aa50966f7dc70d6f1b756830ffb1de78fb16576cd6f73259
Jul 28 01:24:12.668258 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:12.668183    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9xwbt" event={"ID":"0b1c48a3-c13d-4940-8ba2-694c3bf0183a","Type":"ContainerStarted","Data":"d77024ea42e30ee4aa50966f7dc70d6f1b756830ffb1de78fb16576cd6f73259"}
Jul 28 01:24:16.689919 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:16.689883    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9xwbt" event={"ID":"0b1c48a3-c13d-4940-8ba2-694c3bf0183a","Type":"ContainerStarted","Data":"7ed638f876c707fefa4cc9416eca0f134122c97e3d1232b555019b432ab80be8"}
Jul 28 01:24:16.690303 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:16.689953    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9xwbt"
Jul 28 01:24:16.704431 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:16.704382    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9xwbt" podStartSLOduration=0.9516887 podStartE2EDuration="5.704366498s" totalImagesPullingTime="4.752677798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:24:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:24:16.703279484 +0000 UTC m=+527.207040798" watchObservedRunningTime="2026-07-28 01:24:16.704366498 +0000 UTC m=+527.208127809"
Jul 28 01:24:22.723788 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:22.723719    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9xwbt"
Jul 28 01:24:23.260540 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:23.260503    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-wbj74"]
Jul 28 01:24:23.263328 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:23.263309    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-wbj74"
Jul 28 01:24:23.265170 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:23.265154    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-dmvq8\""
Jul 28 01:24:23.269580 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:23.269539    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-wbj74"]
Jul 28 01:24:23.295922 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:23.295898    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4lwc\" (UniqueName: \"kubernetes.io/projected/07228bd3-dfc8-418d-9e9c-518909fb9199-kube-api-access-l4lwc\") pod \"authorino-5d4b67c446-wbj74\" (UID: \"07228bd3-dfc8-418d-9e9c-518909fb9199\") " pod="kuadrant-system/authorino-5d4b67c446-wbj74"
Jul 28 01:24:23.396698 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:23.396663    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4lwc\" (UniqueName: \"kubernetes.io/projected/07228bd3-dfc8-418d-9e9c-518909fb9199-kube-api-access-l4lwc\") pod \"authorino-5d4b67c446-wbj74\" (UID: \"07228bd3-dfc8-418d-9e9c-518909fb9199\") " pod="kuadrant-system/authorino-5d4b67c446-wbj74"
Jul 28 01:24:23.404008 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:23.403983    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4lwc\" (UniqueName: \"kubernetes.io/projected/07228bd3-dfc8-418d-9e9c-518909fb9199-kube-api-access-l4lwc\") pod \"authorino-5d4b67c446-wbj74\" (UID: \"07228bd3-dfc8-418d-9e9c-518909fb9199\") " pod="kuadrant-system/authorino-5d4b67c446-wbj74"
Jul 28 01:24:23.524157 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:23.524064    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-wbj74"]
Jul 28 01:24:23.524376 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:23.524359    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-wbj74"
Jul 28 01:24:23.546747 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:23.546717    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-777f854568-qgpx2"]
Jul 28 01:24:23.550646 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:23.550624    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-777f854568-qgpx2"
Jul 28 01:24:23.552382 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:23.552362    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 28 01:24:23.555655 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:23.555632    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-777f854568-qgpx2"]
Jul 28 01:24:23.598871 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:23.598845    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f74ce746-e205-4bee-b396-d3be4d2af2aa-tls-cert\") pod \"authorino-777f854568-qgpx2\" (UID: \"f74ce746-e205-4bee-b396-d3be4d2af2aa\") " pod="kuadrant-system/authorino-777f854568-qgpx2"
Jul 28 01:24:23.599008 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:23.598896    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55qrt\" (UniqueName: \"kubernetes.io/projected/f74ce746-e205-4bee-b396-d3be4d2af2aa-kube-api-access-55qrt\") pod \"authorino-777f854568-qgpx2\" (UID: \"f74ce746-e205-4bee-b396-d3be4d2af2aa\") " pod="kuadrant-system/authorino-777f854568-qgpx2"
Jul 28 01:24:23.657336 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:23.657311    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-wbj74"]
Jul 28 01:24:23.660164 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:24:23.660135    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod07228bd3_dfc8_418d_9e9c_518909fb9199.slice/crio-becea1a972a91dfe8996cc337f7e8be99063e99ec7ddf62b761333ebeb9f708f WatchSource:0}: Error finding container becea1a972a91dfe8996cc337f7e8be99063e99ec7ddf62b761333ebeb9f708f: Status 404 returned error can't find the container with id becea1a972a91dfe8996cc337f7e8be99063e99ec7ddf62b761333ebeb9f708f
Jul 28 01:24:23.699870 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:23.699844    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f74ce746-e205-4bee-b396-d3be4d2af2aa-tls-cert\") pod \"authorino-777f854568-qgpx2\" (UID: \"f74ce746-e205-4bee-b396-d3be4d2af2aa\") " pod="kuadrant-system/authorino-777f854568-qgpx2"
Jul 28 01:24:23.700043 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:23.699916    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55qrt\" (UniqueName: \"kubernetes.io/projected/f74ce746-e205-4bee-b396-d3be4d2af2aa-kube-api-access-55qrt\") pod \"authorino-777f854568-qgpx2\" (UID: \"f74ce746-e205-4bee-b396-d3be4d2af2aa\") " pod="kuadrant-system/authorino-777f854568-qgpx2"
Jul 28 01:24:23.702169 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:23.702148    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f74ce746-e205-4bee-b396-d3be4d2af2aa-tls-cert\") pod \"authorino-777f854568-qgpx2\" (UID: \"f74ce746-e205-4bee-b396-d3be4d2af2aa\") " pod="kuadrant-system/authorino-777f854568-qgpx2"
Jul 28 01:24:23.706779 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:23.706759    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55qrt\" (UniqueName: \"kubernetes.io/projected/f74ce746-e205-4bee-b396-d3be4d2af2aa-kube-api-access-55qrt\") pod \"authorino-777f854568-qgpx2\" (UID: \"f74ce746-e205-4bee-b396-d3be4d2af2aa\") " pod="kuadrant-system/authorino-777f854568-qgpx2"
Jul 28 01:24:23.726415 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:23.726384    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-wbj74" event={"ID":"07228bd3-dfc8-418d-9e9c-518909fb9199","Type":"ContainerStarted","Data":"becea1a972a91dfe8996cc337f7e8be99063e99ec7ddf62b761333ebeb9f708f"}
Jul 28 01:24:23.862932 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:23.862876    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-777f854568-qgpx2"
Jul 28 01:24:23.987498 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:23.987475    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-777f854568-qgpx2"]
Jul 28 01:24:23.989275 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:24:23.989255    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf74ce746_e205_4bee_b396_d3be4d2af2aa.slice/crio-7effdbb722977d1f063d9cac8f04a0452990cb04cc1d6601ea3a2a6315bf7012 WatchSource:0}: Error finding container 7effdbb722977d1f063d9cac8f04a0452990cb04cc1d6601ea3a2a6315bf7012: Status 404 returned error can't find the container with id 7effdbb722977d1f063d9cac8f04a0452990cb04cc1d6601ea3a2a6315bf7012
Jul 28 01:24:24.732261 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:24.732222    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-777f854568-qgpx2" event={"ID":"f74ce746-e205-4bee-b396-d3be4d2af2aa","Type":"ContainerStarted","Data":"ffd732d1af9e5458e4649ac61a1ff3c46eb937f57fe415e39def70cac8c1e2a9"}
Jul 28 01:24:24.732721 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:24.732268    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-777f854568-qgpx2" event={"ID":"f74ce746-e205-4bee-b396-d3be4d2af2aa","Type":"ContainerStarted","Data":"7effdbb722977d1f063d9cac8f04a0452990cb04cc1d6601ea3a2a6315bf7012"}
Jul 28 01:24:24.733676 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:24.733648    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-wbj74" event={"ID":"07228bd3-dfc8-418d-9e9c-518909fb9199","Type":"ContainerStarted","Data":"67ea01f9a6c17bd0e57cf8727598c7212b6eee604dd23a427a75f876988c17d1"}
Jul 28 01:24:24.733786 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:24.733711    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-wbj74" podUID="07228bd3-dfc8-418d-9e9c-518909fb9199" containerName="authorino" containerID="cri-o://67ea01f9a6c17bd0e57cf8727598c7212b6eee604dd23a427a75f876988c17d1" gracePeriod=30
Jul 28 01:24:24.746739 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:24.746692    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-777f854568-qgpx2" podStartSLOduration=1.387853599 podStartE2EDuration="1.746673979s" totalImagesPullingTime="358.82038ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:24:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:24:24.744915022 +0000 UTC m=+535.248676334" watchObservedRunningTime="2026-07-28 01:24:24.746673979 +0000 UTC m=+535.250435294"
Jul 28 01:24:24.758398 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:24.758349    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-wbj74" podStartSLOduration=1.437522287 podStartE2EDuration="1.758332128s" totalImagesPullingTime="320.809841ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:24:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:24:24.756757812 +0000 UTC m=+535.260519125" watchObservedRunningTime="2026-07-28 01:24:24.758332128 +0000 UTC m=+535.262093667"
Jul 28 01:24:24.993178 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:24.993112    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-wbj74"
Jul 28 01:24:25.111974 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:25.111938    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4lwc\" (UniqueName: \"kubernetes.io/projected/07228bd3-dfc8-418d-9e9c-518909fb9199-kube-api-access-l4lwc\") pod \"07228bd3-dfc8-418d-9e9c-518909fb9199\" (UID: \"07228bd3-dfc8-418d-9e9c-518909fb9199\") "
Jul 28 01:24:25.114006 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:25.113979    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07228bd3-dfc8-418d-9e9c-518909fb9199-kube-api-access-l4lwc" (OuterVolumeSpecName: "kube-api-access-l4lwc") pod "07228bd3-dfc8-418d-9e9c-518909fb9199" (UID: "07228bd3-dfc8-418d-9e9c-518909fb9199"). InnerVolumeSpecName "kube-api-access-l4lwc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:24:25.212698 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:25.212664    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4lwc\" (UniqueName: \"kubernetes.io/projected/07228bd3-dfc8-418d-9e9c-518909fb9199-kube-api-access-l4lwc\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:24:25.740445 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:25.740406    2562 generic.go:356] "Generic (PLEG): container finished" podID="07228bd3-dfc8-418d-9e9c-518909fb9199" containerID="67ea01f9a6c17bd0e57cf8727598c7212b6eee604dd23a427a75f876988c17d1" exitCode=0
Jul 28 01:24:25.740445 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:25.740449    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-wbj74"
Jul 28 01:24:25.740919 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:25.740492    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-wbj74" event={"ID":"07228bd3-dfc8-418d-9e9c-518909fb9199","Type":"ContainerDied","Data":"67ea01f9a6c17bd0e57cf8727598c7212b6eee604dd23a427a75f876988c17d1"}
Jul 28 01:24:25.740919 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:25.740532    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-wbj74" event={"ID":"07228bd3-dfc8-418d-9e9c-518909fb9199","Type":"ContainerDied","Data":"becea1a972a91dfe8996cc337f7e8be99063e99ec7ddf62b761333ebeb9f708f"}
Jul 28 01:24:25.740919 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:25.740549    2562 scope.go:117] "RemoveContainer" containerID="67ea01f9a6c17bd0e57cf8727598c7212b6eee604dd23a427a75f876988c17d1"
Jul 28 01:24:25.749191 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:25.749174    2562 scope.go:117] "RemoveContainer" containerID="67ea01f9a6c17bd0e57cf8727598c7212b6eee604dd23a427a75f876988c17d1"
Jul 28 01:24:25.749433 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:24:25.749417    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67ea01f9a6c17bd0e57cf8727598c7212b6eee604dd23a427a75f876988c17d1\": container with ID starting with 67ea01f9a6c17bd0e57cf8727598c7212b6eee604dd23a427a75f876988c17d1 not found: ID does not exist" containerID="67ea01f9a6c17bd0e57cf8727598c7212b6eee604dd23a427a75f876988c17d1"
Jul 28 01:24:25.749519 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:25.749439    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67ea01f9a6c17bd0e57cf8727598c7212b6eee604dd23a427a75f876988c17d1"} err="failed to get container status \"67ea01f9a6c17bd0e57cf8727598c7212b6eee604dd23a427a75f876988c17d1\": rpc error: code = NotFound desc = could not find container \"67ea01f9a6c17bd0e57cf8727598c7212b6eee604dd23a427a75f876988c17d1\": container with ID starting with 67ea01f9a6c17bd0e57cf8727598c7212b6eee604dd23a427a75f876988c17d1 not found: ID does not exist"
Jul 28 01:24:25.758624 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:25.758603    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-wbj74"]
Jul 28 01:24:25.761152 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:25.761132    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-wbj74"]
Jul 28 01:24:26.013670 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:26.013593    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07228bd3-dfc8-418d-9e9c-518909fb9199" path="/var/lib/kubelet/pods/07228bd3-dfc8-418d-9e9c-518909fb9199/volumes"
Jul 28 01:24:29.414465 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:29.414426    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7df845f5fc-lz9l2"]
Jul 28 01:24:29.415013 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:29.414977    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07228bd3-dfc8-418d-9e9c-518909fb9199" containerName="authorino"
Jul 28 01:24:29.415013 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:29.415001    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="07228bd3-dfc8-418d-9e9c-518909fb9199" containerName="authorino"
Jul 28 01:24:29.415205 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:29.415133    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="07228bd3-dfc8-418d-9e9c-518909fb9199" containerName="authorino"
Jul 28 01:24:29.419881 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:29.419859    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7df845f5fc-lz9l2"
Jul 28 01:24:29.422301 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:29.422278    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 28 01:24:29.422461 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:29.422444    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 28 01:24:29.422876 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:29.422861    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-52z9q\""
Jul 28 01:24:29.430441 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:29.430413    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7df845f5fc-lz9l2"]
Jul 28 01:24:29.451688 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:29.451659    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ff749bb4-39d0-48c7-92ea-bfe9ce03b334-webhook-cert\") pod \"maas-controller-7df845f5fc-lz9l2\" (UID: \"ff749bb4-39d0-48c7-92ea-bfe9ce03b334\") " pod="opendatahub/maas-controller-7df845f5fc-lz9l2"
Jul 28 01:24:29.451826 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:29.451693    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtll8\" (UniqueName: \"kubernetes.io/projected/ff749bb4-39d0-48c7-92ea-bfe9ce03b334-kube-api-access-vtll8\") pod \"maas-controller-7df845f5fc-lz9l2\" (UID: \"ff749bb4-39d0-48c7-92ea-bfe9ce03b334\") " pod="opendatahub/maas-controller-7df845f5fc-lz9l2"
Jul 28 01:24:29.552208 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:29.552169    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ff749bb4-39d0-48c7-92ea-bfe9ce03b334-webhook-cert\") pod \"maas-controller-7df845f5fc-lz9l2\" (UID: \"ff749bb4-39d0-48c7-92ea-bfe9ce03b334\") " pod="opendatahub/maas-controller-7df845f5fc-lz9l2"
Jul 28 01:24:29.552390 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:29.552212    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtll8\" (UniqueName: \"kubernetes.io/projected/ff749bb4-39d0-48c7-92ea-bfe9ce03b334-kube-api-access-vtll8\") pod \"maas-controller-7df845f5fc-lz9l2\" (UID: \"ff749bb4-39d0-48c7-92ea-bfe9ce03b334\") " pod="opendatahub/maas-controller-7df845f5fc-lz9l2"
Jul 28 01:24:29.552390 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:24:29.552324    2562 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 28 01:24:29.552483 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:24:29.552395    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff749bb4-39d0-48c7-92ea-bfe9ce03b334-webhook-cert podName:ff749bb4-39d0-48c7-92ea-bfe9ce03b334 nodeName:}" failed. No retries permitted until 2026-07-28 01:24:30.052372562 +0000 UTC m=+540.556133873 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/ff749bb4-39d0-48c7-92ea-bfe9ce03b334-webhook-cert") pod "maas-controller-7df845f5fc-lz9l2" (UID: "ff749bb4-39d0-48c7-92ea-bfe9ce03b334") : secret "maas-controller-webhook-cert" not found
Jul 28 01:24:29.566761 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:29.566726    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtll8\" (UniqueName: \"kubernetes.io/projected/ff749bb4-39d0-48c7-92ea-bfe9ce03b334-kube-api-access-vtll8\") pod \"maas-controller-7df845f5fc-lz9l2\" (UID: \"ff749bb4-39d0-48c7-92ea-bfe9ce03b334\") " pod="opendatahub/maas-controller-7df845f5fc-lz9l2"
Jul 28 01:24:29.598354 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:29.598319    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6864dfc7bf-kvx6c"]
Jul 28 01:24:29.601973 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:29.601957    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6864dfc7bf-kvx6c"
Jul 28 01:24:29.613422 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:29.613395    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6864dfc7bf-kvx6c"]
Jul 28 01:24:29.652936 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:29.652906    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2855\" (UniqueName: \"kubernetes.io/projected/9b37096f-81b3-4335-86ac-f2af3e7ef059-kube-api-access-f2855\") pod \"maas-controller-6864dfc7bf-kvx6c\" (UID: \"9b37096f-81b3-4335-86ac-f2af3e7ef059\") " pod="opendatahub/maas-controller-6864dfc7bf-kvx6c"
Jul 28 01:24:29.653122 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:29.653026    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9b37096f-81b3-4335-86ac-f2af3e7ef059-webhook-cert\") pod \"maas-controller-6864dfc7bf-kvx6c\" (UID: \"9b37096f-81b3-4335-86ac-f2af3e7ef059\") " pod="opendatahub/maas-controller-6864dfc7bf-kvx6c"
Jul 28 01:24:29.754116 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:29.754017    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9b37096f-81b3-4335-86ac-f2af3e7ef059-webhook-cert\") pod \"maas-controller-6864dfc7bf-kvx6c\" (UID: \"9b37096f-81b3-4335-86ac-f2af3e7ef059\") " pod="opendatahub/maas-controller-6864dfc7bf-kvx6c"
Jul 28 01:24:29.754116 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:29.754086    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2855\" (UniqueName: \"kubernetes.io/projected/9b37096f-81b3-4335-86ac-f2af3e7ef059-kube-api-access-f2855\") pod \"maas-controller-6864dfc7bf-kvx6c\" (UID: \"9b37096f-81b3-4335-86ac-f2af3e7ef059\") " pod="opendatahub/maas-controller-6864dfc7bf-kvx6c"
Jul 28 01:24:29.756538 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:29.756512    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9b37096f-81b3-4335-86ac-f2af3e7ef059-webhook-cert\") pod \"maas-controller-6864dfc7bf-kvx6c\" (UID: \"9b37096f-81b3-4335-86ac-f2af3e7ef059\") " pod="opendatahub/maas-controller-6864dfc7bf-kvx6c"
Jul 28 01:24:29.760904 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:29.760883    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2855\" (UniqueName: \"kubernetes.io/projected/9b37096f-81b3-4335-86ac-f2af3e7ef059-kube-api-access-f2855\") pod \"maas-controller-6864dfc7bf-kvx6c\" (UID: \"9b37096f-81b3-4335-86ac-f2af3e7ef059\") " pod="opendatahub/maas-controller-6864dfc7bf-kvx6c"
Jul 28 01:24:29.914516 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:29.914489    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-52z9q\""
Jul 28 01:24:29.923498 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:29.923477    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6864dfc7bf-kvx6c"
Jul 28 01:24:30.057682 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:30.057651    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6864dfc7bf-kvx6c"]
Jul 28 01:24:30.057825 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:30.057802    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ff749bb4-39d0-48c7-92ea-bfe9ce03b334-webhook-cert\") pod \"maas-controller-7df845f5fc-lz9l2\" (UID: \"ff749bb4-39d0-48c7-92ea-bfe9ce03b334\") " pod="opendatahub/maas-controller-7df845f5fc-lz9l2"
Jul 28 01:24:30.058941 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:24:30.058914    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b37096f_81b3_4335_86ac_f2af3e7ef059.slice/crio-32c0f9a0b79c56998d6ef0a2a27c041c059aed43ec675377c66ef9a0aedba310 WatchSource:0}: Error finding container 32c0f9a0b79c56998d6ef0a2a27c041c059aed43ec675377c66ef9a0aedba310: Status 404 returned error can't find the container with id 32c0f9a0b79c56998d6ef0a2a27c041c059aed43ec675377c66ef9a0aedba310
Jul 28 01:24:30.060344 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:30.060323    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ff749bb4-39d0-48c7-92ea-bfe9ce03b334-webhook-cert\") pod \"maas-controller-7df845f5fc-lz9l2\" (UID: \"ff749bb4-39d0-48c7-92ea-bfe9ce03b334\") " pod="opendatahub/maas-controller-7df845f5fc-lz9l2"
Jul 28 01:24:30.333707 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:30.333622    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7df845f5fc-lz9l2"
Jul 28 01:24:30.463643 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:30.463613    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7df845f5fc-lz9l2"]
Jul 28 01:24:30.466300 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:24:30.466274    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff749bb4_39d0_48c7_92ea_bfe9ce03b334.slice/crio-4f687d7e76457c64983baf907cd22bb09ada5c4cb97e2e57d6ff5877598268a1 WatchSource:0}: Error finding container 4f687d7e76457c64983baf907cd22bb09ada5c4cb97e2e57d6ff5877598268a1: Status 404 returned error can't find the container with id 4f687d7e76457c64983baf907cd22bb09ada5c4cb97e2e57d6ff5877598268a1
Jul 28 01:24:30.768419 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:30.768376    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7df845f5fc-lz9l2" event={"ID":"ff749bb4-39d0-48c7-92ea-bfe9ce03b334","Type":"ContainerStarted","Data":"4f687d7e76457c64983baf907cd22bb09ada5c4cb97e2e57d6ff5877598268a1"}
Jul 28 01:24:30.770026 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:30.769958    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6864dfc7bf-kvx6c" event={"ID":"9b37096f-81b3-4335-86ac-f2af3e7ef059","Type":"ContainerStarted","Data":"32c0f9a0b79c56998d6ef0a2a27c041c059aed43ec675377c66ef9a0aedba310"}
Jul 28 01:24:32.617779 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:32.617751    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 28 01:24:32.789666 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:32.789622    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7df845f5fc-lz9l2" event={"ID":"ff749bb4-39d0-48c7-92ea-bfe9ce03b334","Type":"ContainerStarted","Data":"2522905b33c4cea615d46119faf464fab5c0f42f7dfa62758765bdb6565ed753"}
Jul 28 01:24:32.789843 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:32.789771    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7df845f5fc-lz9l2"
Jul 28 01:24:32.791576 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:32.791538    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6864dfc7bf-kvx6c" event={"ID":"9b37096f-81b3-4335-86ac-f2af3e7ef059","Type":"ContainerStarted","Data":"f1e1f51b9062506dcbea7f5f3c09cb332d84b49e5739d8ea5014ddfaaeb4e406"}
Jul 28 01:24:32.791693 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:32.791601    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6864dfc7bf-kvx6c"
Jul 28 01:24:32.811388 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:32.811341    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7df845f5fc-lz9l2" podStartSLOduration=1.656704307 podStartE2EDuration="3.811327655s" totalImagesPullingTime="2.154623348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:24:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:24:32.809702213 +0000 UTC m=+543.313463838" watchObservedRunningTime="2026-07-28 01:24:32.811327655 +0000 UTC m=+543.315088969"
Jul 28 01:24:32.828290 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:32.828244    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6864dfc7bf-kvx6c" podStartSLOduration=1.2726931000000001 podStartE2EDuration="3.828230192s" totalImagesPullingTime="2.555537092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:24:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:24:32.827960196 +0000 UTC m=+543.331721508" watchObservedRunningTime="2026-07-28 01:24:32.828230192 +0000 UTC m=+543.331991503"
Jul 28 01:24:43.797908 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:43.797876    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6864dfc7bf-kvx6c"
Jul 28 01:24:43.798315 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:43.797953    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7df845f5fc-lz9l2"
Jul 28 01:24:43.852295 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:43.852258    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7df845f5fc-lz9l2"]
Jul 28 01:24:43.852746 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:43.852708    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7df845f5fc-lz9l2" podUID="ff749bb4-39d0-48c7-92ea-bfe9ce03b334" containerName="manager" containerID="cri-o://2522905b33c4cea615d46119faf464fab5c0f42f7dfa62758765bdb6565ed753" gracePeriod=30
Jul 28 01:24:44.096295 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:44.096268    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7df845f5fc-lz9l2"
Jul 28 01:24:44.186621 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:44.186588    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ff749bb4-39d0-48c7-92ea-bfe9ce03b334-webhook-cert\") pod \"ff749bb4-39d0-48c7-92ea-bfe9ce03b334\" (UID: \"ff749bb4-39d0-48c7-92ea-bfe9ce03b334\") "
Jul 28 01:24:44.186817 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:44.186674    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vtll8\" (UniqueName: \"kubernetes.io/projected/ff749bb4-39d0-48c7-92ea-bfe9ce03b334-kube-api-access-vtll8\") pod \"ff749bb4-39d0-48c7-92ea-bfe9ce03b334\" (UID: \"ff749bb4-39d0-48c7-92ea-bfe9ce03b334\") "
Jul 28 01:24:44.188834 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:44.188807    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff749bb4-39d0-48c7-92ea-bfe9ce03b334-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ff749bb4-39d0-48c7-92ea-bfe9ce03b334" (UID: "ff749bb4-39d0-48c7-92ea-bfe9ce03b334"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:24:44.188933 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:44.188808    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff749bb4-39d0-48c7-92ea-bfe9ce03b334-kube-api-access-vtll8" (OuterVolumeSpecName: "kube-api-access-vtll8") pod "ff749bb4-39d0-48c7-92ea-bfe9ce03b334" (UID: "ff749bb4-39d0-48c7-92ea-bfe9ce03b334"). InnerVolumeSpecName "kube-api-access-vtll8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:24:44.287951 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:44.287906    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vtll8\" (UniqueName: \"kubernetes.io/projected/ff749bb4-39d0-48c7-92ea-bfe9ce03b334-kube-api-access-vtll8\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:24:44.287951 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:44.287946    2562 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ff749bb4-39d0-48c7-92ea-bfe9ce03b334-webhook-cert\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:24:44.850149 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:44.850115    2562 generic.go:356] "Generic (PLEG): container finished" podID="ff749bb4-39d0-48c7-92ea-bfe9ce03b334" containerID="2522905b33c4cea615d46119faf464fab5c0f42f7dfa62758765bdb6565ed753" exitCode=0
Jul 28 01:24:44.850589 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:44.850161    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7df845f5fc-lz9l2"
Jul 28 01:24:44.850589 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:44.850198    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7df845f5fc-lz9l2" event={"ID":"ff749bb4-39d0-48c7-92ea-bfe9ce03b334","Type":"ContainerDied","Data":"2522905b33c4cea615d46119faf464fab5c0f42f7dfa62758765bdb6565ed753"}
Jul 28 01:24:44.850589 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:44.850262    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7df845f5fc-lz9l2" event={"ID":"ff749bb4-39d0-48c7-92ea-bfe9ce03b334","Type":"ContainerDied","Data":"4f687d7e76457c64983baf907cd22bb09ada5c4cb97e2e57d6ff5877598268a1"}
Jul 28 01:24:44.850589 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:44.850291    2562 scope.go:117] "RemoveContainer" containerID="2522905b33c4cea615d46119faf464fab5c0f42f7dfa62758765bdb6565ed753"
Jul 28 01:24:44.859546 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:44.859355    2562 scope.go:117] "RemoveContainer" containerID="2522905b33c4cea615d46119faf464fab5c0f42f7dfa62758765bdb6565ed753"
Jul 28 01:24:44.859660 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:24:44.859640    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2522905b33c4cea615d46119faf464fab5c0f42f7dfa62758765bdb6565ed753\": container with ID starting with 2522905b33c4cea615d46119faf464fab5c0f42f7dfa62758765bdb6565ed753 not found: ID does not exist" containerID="2522905b33c4cea615d46119faf464fab5c0f42f7dfa62758765bdb6565ed753"
Jul 28 01:24:44.859708 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:44.859670    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2522905b33c4cea615d46119faf464fab5c0f42f7dfa62758765bdb6565ed753"} err="failed to get container status \"2522905b33c4cea615d46119faf464fab5c0f42f7dfa62758765bdb6565ed753\": rpc error: code = NotFound desc = could not find container \"2522905b33c4cea615d46119faf464fab5c0f42f7dfa62758765bdb6565ed753\": container with ID starting with 2522905b33c4cea615d46119faf464fab5c0f42f7dfa62758765bdb6565ed753 not found: ID does not exist"
Jul 28 01:24:44.869164 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:44.869140    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7df845f5fc-lz9l2"]
Jul 28 01:24:44.872855 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:44.872834    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7df845f5fc-lz9l2"]
Jul 28 01:24:46.012531 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:24:46.012498    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff749bb4-39d0-48c7-92ea-bfe9ce03b334" path="/var/lib/kubelet/pods/ff749bb4-39d0-48c7-92ea-bfe9ce03b334/volumes"
Jul 28 01:25:02.567087 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:02.567050    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-77bdc77655-2vpcx"]
Jul 28 01:25:02.567529 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:02.567432    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff749bb4-39d0-48c7-92ea-bfe9ce03b334" containerName="manager"
Jul 28 01:25:02.567529 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:02.567442    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff749bb4-39d0-48c7-92ea-bfe9ce03b334" containerName="manager"
Jul 28 01:25:02.567529 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:02.567504    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff749bb4-39d0-48c7-92ea-bfe9ce03b334" containerName="manager"
Jul 28 01:25:02.570682 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:02.570665    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-77bdc77655-2vpcx"
Jul 28 01:25:02.573631 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:02.573609    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 28 01:25:02.573744 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:02.573669    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-62vvq\""
Jul 28 01:25:02.585727 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:02.585702    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-77bdc77655-2vpcx"]
Jul 28 01:25:02.646298 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:02.646263    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-st79q\" (UniqueName: \"kubernetes.io/projected/b688ae60-adfe-45ae-b342-59f0ca4a7fb3-kube-api-access-st79q\") pod \"maas-api-77bdc77655-2vpcx\" (UID: \"b688ae60-adfe-45ae-b342-59f0ca4a7fb3\") " pod="odh-ai-gateway-infra/maas-api-77bdc77655-2vpcx"
Jul 28 01:25:02.646470 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:02.646304    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b688ae60-adfe-45ae-b342-59f0ca4a7fb3-maas-api-tls\") pod \"maas-api-77bdc77655-2vpcx\" (UID: \"b688ae60-adfe-45ae-b342-59f0ca4a7fb3\") " pod="odh-ai-gateway-infra/maas-api-77bdc77655-2vpcx"
Jul 28 01:25:02.646470 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:02.646322    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b688ae60-adfe-45ae-b342-59f0ca4a7fb3-openshift-service-ca\") pod \"maas-api-77bdc77655-2vpcx\" (UID: \"b688ae60-adfe-45ae-b342-59f0ca4a7fb3\") " pod="odh-ai-gateway-infra/maas-api-77bdc77655-2vpcx"
Jul 28 01:25:02.746798 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:02.746763    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st79q\" (UniqueName: \"kubernetes.io/projected/b688ae60-adfe-45ae-b342-59f0ca4a7fb3-kube-api-access-st79q\") pod \"maas-api-77bdc77655-2vpcx\" (UID: \"b688ae60-adfe-45ae-b342-59f0ca4a7fb3\") " pod="odh-ai-gateway-infra/maas-api-77bdc77655-2vpcx"
Jul 28 01:25:02.746798 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:02.746802    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b688ae60-adfe-45ae-b342-59f0ca4a7fb3-maas-api-tls\") pod \"maas-api-77bdc77655-2vpcx\" (UID: \"b688ae60-adfe-45ae-b342-59f0ca4a7fb3\") " pod="odh-ai-gateway-infra/maas-api-77bdc77655-2vpcx"
Jul 28 01:25:02.747035 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:02.746820    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b688ae60-adfe-45ae-b342-59f0ca4a7fb3-openshift-service-ca\") pod \"maas-api-77bdc77655-2vpcx\" (UID: \"b688ae60-adfe-45ae-b342-59f0ca4a7fb3\") " pod="odh-ai-gateway-infra/maas-api-77bdc77655-2vpcx"
Jul 28 01:25:02.747383 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:02.747365    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b688ae60-adfe-45ae-b342-59f0ca4a7fb3-openshift-service-ca\") pod \"maas-api-77bdc77655-2vpcx\" (UID: \"b688ae60-adfe-45ae-b342-59f0ca4a7fb3\") " pod="odh-ai-gateway-infra/maas-api-77bdc77655-2vpcx"
Jul 28 01:25:02.749059 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:02.749036    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b688ae60-adfe-45ae-b342-59f0ca4a7fb3-maas-api-tls\") pod \"maas-api-77bdc77655-2vpcx\" (UID: \"b688ae60-adfe-45ae-b342-59f0ca4a7fb3\") " pod="odh-ai-gateway-infra/maas-api-77bdc77655-2vpcx"
Jul 28 01:25:02.753670 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:02.753645    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-st79q\" (UniqueName: \"kubernetes.io/projected/b688ae60-adfe-45ae-b342-59f0ca4a7fb3-kube-api-access-st79q\") pod \"maas-api-77bdc77655-2vpcx\" (UID: \"b688ae60-adfe-45ae-b342-59f0ca4a7fb3\") " pod="odh-ai-gateway-infra/maas-api-77bdc77655-2vpcx"
Jul 28 01:25:02.881032 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:02.881000    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-77bdc77655-2vpcx"
Jul 28 01:25:03.044064 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:03.044032    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-77bdc77655-2vpcx"]
Jul 28 01:25:03.045993 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:25:03.045966    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb688ae60_adfe_45ae_b342_59f0ca4a7fb3.slice/crio-22cb815e63fa4d3289e2be73752231111ebc08740bae0380960eb9893e06a77d WatchSource:0}: Error finding container 22cb815e63fa4d3289e2be73752231111ebc08740bae0380960eb9893e06a77d: Status 404 returned error can't find the container with id 22cb815e63fa4d3289e2be73752231111ebc08740bae0380960eb9893e06a77d
Jul 28 01:25:03.170930 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:03.170844    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-xmrps"]
Jul 28 01:25:03.175607 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:03.175584    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-xmrps"
Jul 28 01:25:03.177878 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:03.177857    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 28 01:25:03.188452 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:03.188421    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-xmrps"]
Jul 28 01:25:03.252724 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:03.252686    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/584f45b4-49b5-4983-a997-ea1fff7770a7-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-xmrps\" (UID: \"584f45b4-49b5-4983-a997-ea1fff7770a7\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-xmrps"
Jul 28 01:25:03.252906 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:03.252772    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhhdx\" (UniqueName: \"kubernetes.io/projected/584f45b4-49b5-4983-a997-ea1fff7770a7-kube-api-access-hhhdx\") pod \"payload-pre-processing-687dbb6cf6-xmrps\" (UID: \"584f45b4-49b5-4983-a997-ea1fff7770a7\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-xmrps"
Jul 28 01:25:03.354019 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:03.353982    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/584f45b4-49b5-4983-a997-ea1fff7770a7-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-xmrps\" (UID: \"584f45b4-49b5-4983-a997-ea1fff7770a7\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-xmrps"
Jul 28 01:25:03.354174 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:03.354046    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhhdx\" (UniqueName: \"kubernetes.io/projected/584f45b4-49b5-4983-a997-ea1fff7770a7-kube-api-access-hhhdx\") pod \"payload-pre-processing-687dbb6cf6-xmrps\" (UID: \"584f45b4-49b5-4983-a997-ea1fff7770a7\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-xmrps"
Jul 28 01:25:03.354800 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:03.354779    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/584f45b4-49b5-4983-a997-ea1fff7770a7-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-xmrps\" (UID: \"584f45b4-49b5-4983-a997-ea1fff7770a7\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-xmrps"
Jul 28 01:25:03.376290 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:03.376264    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhhdx\" (UniqueName: \"kubernetes.io/projected/584f45b4-49b5-4983-a997-ea1fff7770a7-kube-api-access-hhhdx\") pod \"payload-pre-processing-687dbb6cf6-xmrps\" (UID: \"584f45b4-49b5-4983-a997-ea1fff7770a7\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-xmrps"
Jul 28 01:25:03.490858 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:03.490769    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-xmrps"
Jul 28 01:25:03.630117 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:03.629945    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-xmrps"]
Jul 28 01:25:03.632944 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:25:03.632915    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod584f45b4_49b5_4983_a997_ea1fff7770a7.slice/crio-a7bf420ee0be60d2a16758d8f14c0cbd198d9803262f41bc7aa2ed79c1dd904f WatchSource:0}: Error finding container a7bf420ee0be60d2a16758d8f14c0cbd198d9803262f41bc7aa2ed79c1dd904f: Status 404 returned error can't find the container with id a7bf420ee0be60d2a16758d8f14c0cbd198d9803262f41bc7aa2ed79c1dd904f
Jul 28 01:25:03.946630 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:03.946582    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-77bdc77655-2vpcx" event={"ID":"b688ae60-adfe-45ae-b342-59f0ca4a7fb3","Type":"ContainerStarted","Data":"22cb815e63fa4d3289e2be73752231111ebc08740bae0380960eb9893e06a77d"}
Jul 28 01:25:03.948264 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:03.948232    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-xmrps" event={"ID":"584f45b4-49b5-4983-a997-ea1fff7770a7","Type":"ContainerStarted","Data":"a7bf420ee0be60d2a16758d8f14c0cbd198d9803262f41bc7aa2ed79c1dd904f"}
Jul 28 01:25:06.975303 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:06.975178    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-xmrps" event={"ID":"584f45b4-49b5-4983-a997-ea1fff7770a7","Type":"ContainerStarted","Data":"79e3d395edd6d4cf85d8f6d26f1cc99a5a4a593c320d05919c3c93240dc8a9af"}
Jul 28 01:25:06.975779 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:06.975333    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-xmrps"
Jul 28 01:25:06.977140 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:06.977109    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-77bdc77655-2vpcx" event={"ID":"b688ae60-adfe-45ae-b342-59f0ca4a7fb3","Type":"ContainerStarted","Data":"f53423a83b31fad69c5172bc87f7ef8eb3c7a55fe598021510ee468c5391a069"}
Jul 28 01:25:06.977263 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:06.977249    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-77bdc77655-2vpcx"
Jul 28 01:25:06.990554 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:06.990511    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-xmrps" podStartSLOduration=0.945702494 podStartE2EDuration="3.990496366s" totalImagesPullingTime="3.044793872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:25:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:25:06.988648199 +0000 UTC m=+577.492409510" watchObservedRunningTime="2026-07-28 01:25:06.990496366 +0000 UTC m=+577.494257692"
Jul 28 01:25:07.007153 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:07.007101    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-77bdc77655-2vpcx" podStartSLOduration=1.406885634 podStartE2EDuration="5.007085645s" totalImagesPullingTime="3.600200011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:25:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:25:07.005546977 +0000 UTC m=+577.509308314" watchObservedRunningTime="2026-07-28 01:25:07.007085645 +0000 UTC m=+577.510846956"
Jul 28 01:25:11.000204 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:11.000169    2562 generic.go:356] "Generic (PLEG): container finished" podID="59e683f8-4134-4f09-aa4d-4159d59ca05b" containerID="96f6473bdd07b149b2988691429d5be869865f801ad6f065130b8041cfa2e48b" exitCode=0
Jul 28 01:25:11.000629 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:11.000245    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h" event={"ID":"59e683f8-4134-4f09-aa4d-4159d59ca05b","Type":"ContainerDied","Data":"96f6473bdd07b149b2988691429d5be869865f801ad6f065130b8041cfa2e48b"}
Jul 28 01:25:11.000673 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:11.000653    2562 scope.go:117] "RemoveContainer" containerID="96f6473bdd07b149b2988691429d5be869865f801ad6f065130b8041cfa2e48b"
Jul 28 01:25:11.001641 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:11.001595    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:25:11.001735 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:11.001691    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:25:11.001735 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:11.001728    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:25:12.006617 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:12.006588    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h" event={"ID":"59e683f8-4134-4f09-aa4d-4159d59ca05b","Type":"ContainerStarted","Data":"8fda630e537c5de8a02e84f7d067c2736bf187f49d46436c90cc38cc93ef1e4c"}
Jul 28 01:25:12.279470 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:12.279373    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h"
Jul 28 01:25:12.279653 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:12.279610    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-6lq2h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 28 01:25:12.279699 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:12.279656    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h" podUID="59e683f8-4134-4f09-aa4d-4159d59ca05b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 28 01:25:12.987641 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:12.987614    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-77bdc77655-2vpcx"
Jul 28 01:25:13.280103 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:13.280014    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-6lq2h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 28 01:25:13.280103 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:13.280079    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h" podUID="59e683f8-4134-4f09-aa4d-4159d59ca05b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 28 01:25:14.279954 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:14.279915    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-6lq2h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 28 01:25:14.280156 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:14.279980    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h" podUID="59e683f8-4134-4f09-aa4d-4159d59ca05b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 28 01:25:15.280142 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:15.280103    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-6lq2h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 28 01:25:15.280511 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:15.280171    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h" podUID="59e683f8-4134-4f09-aa4d-4159d59ca05b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 28 01:25:16.283221 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:16.283189    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h"
Jul 28 01:25:16.283593 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:16.283448    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h"
Jul 28 01:25:16.284022 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:16.284006    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6lq2h"
Jul 28 01:25:17.985105 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:25:17.985076    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-xmrps"
Jul 28 01:26:03.393734 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:03.393656    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-9gbw8"]
Jul 28 01:26:03.397233 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:03.397218    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9gbw8"
Jul 28 01:26:03.399811 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:03.399768    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 28 01:26:03.399811 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:03.399772    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 28 01:26:03.400322 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:03.400289    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-rtwcb\""
Jul 28 01:26:03.400415 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:03.400339    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 28 01:26:03.406008 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:03.405986    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-9gbw8"]
Jul 28 01:26:03.504279 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:03.504244    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6962dfd3-d154-4410-81f0-7ba7618a74dc-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9gbw8\" (UID: \"6962dfd3-d154-4410-81f0-7ba7618a74dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9gbw8"
Jul 28 01:26:03.504455 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:03.504300    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6962dfd3-d154-4410-81f0-7ba7618a74dc-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9gbw8\" (UID: \"6962dfd3-d154-4410-81f0-7ba7618a74dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9gbw8"
Jul 28 01:26:03.504455 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:03.504338    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6962dfd3-d154-4410-81f0-7ba7618a74dc-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9gbw8\" (UID: \"6962dfd3-d154-4410-81f0-7ba7618a74dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9gbw8"
Jul 28 01:26:03.504455 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:03.504429    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6962dfd3-d154-4410-81f0-7ba7618a74dc-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9gbw8\" (UID: \"6962dfd3-d154-4410-81f0-7ba7618a74dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9gbw8"
Jul 28 01:26:03.504601 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:03.504460    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6962dfd3-d154-4410-81f0-7ba7618a74dc-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9gbw8\" (UID: \"6962dfd3-d154-4410-81f0-7ba7618a74dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9gbw8"
Jul 28 01:26:03.504601 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:03.504476    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4f66f\" (UniqueName: \"kubernetes.io/projected/6962dfd3-d154-4410-81f0-7ba7618a74dc-kube-api-access-4f66f\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9gbw8\" (UID: \"6962dfd3-d154-4410-81f0-7ba7618a74dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9gbw8"
Jul 28 01:26:03.605206 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:03.605167    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6962dfd3-d154-4410-81f0-7ba7618a74dc-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9gbw8\" (UID: \"6962dfd3-d154-4410-81f0-7ba7618a74dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9gbw8"
Jul 28 01:26:03.605387 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:03.605250    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6962dfd3-d154-4410-81f0-7ba7618a74dc-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9gbw8\" (UID: \"6962dfd3-d154-4410-81f0-7ba7618a74dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9gbw8"
Jul 28 01:26:03.605387 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:03.605273    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6962dfd3-d154-4410-81f0-7ba7618a74dc-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9gbw8\" (UID: \"6962dfd3-d154-4410-81f0-7ba7618a74dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9gbw8"
Jul 28 01:26:03.605387 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:03.605348    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6962dfd3-d154-4410-81f0-7ba7618a74dc-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9gbw8\" (UID: \"6962dfd3-d154-4410-81f0-7ba7618a74dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9gbw8"
Jul 28 01:26:03.605387 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:03.605381    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6962dfd3-d154-4410-81f0-7ba7618a74dc-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9gbw8\" (UID: \"6962dfd3-d154-4410-81f0-7ba7618a74dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9gbw8"
Jul 28 01:26:03.605633 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:03.605405    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4f66f\" (UniqueName: \"kubernetes.io/projected/6962dfd3-d154-4410-81f0-7ba7618a74dc-kube-api-access-4f66f\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9gbw8\" (UID: \"6962dfd3-d154-4410-81f0-7ba7618a74dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9gbw8"
Jul 28 01:26:03.605686 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:03.605639    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6962dfd3-d154-4410-81f0-7ba7618a74dc-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9gbw8\" (UID: \"6962dfd3-d154-4410-81f0-7ba7618a74dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9gbw8"
Jul 28 01:26:03.605738 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:03.605692    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6962dfd3-d154-4410-81f0-7ba7618a74dc-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9gbw8\" (UID: \"6962dfd3-d154-4410-81f0-7ba7618a74dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9gbw8"
Jul 28 01:26:03.605795 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:03.605772    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6962dfd3-d154-4410-81f0-7ba7618a74dc-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9gbw8\" (UID: \"6962dfd3-d154-4410-81f0-7ba7618a74dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9gbw8"
Jul 28 01:26:03.607644 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:03.607619    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6962dfd3-d154-4410-81f0-7ba7618a74dc-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9gbw8\" (UID: \"6962dfd3-d154-4410-81f0-7ba7618a74dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9gbw8"
Jul 28 01:26:03.608014 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:03.607994    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6962dfd3-d154-4410-81f0-7ba7618a74dc-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9gbw8\" (UID: \"6962dfd3-d154-4410-81f0-7ba7618a74dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9gbw8"
Jul 28 01:26:03.612059 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:03.612033    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4f66f\" (UniqueName: \"kubernetes.io/projected/6962dfd3-d154-4410-81f0-7ba7618a74dc-kube-api-access-4f66f\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9gbw8\" (UID: \"6962dfd3-d154-4410-81f0-7ba7618a74dc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9gbw8"
Jul 28 01:26:03.707933 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:03.707851    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9gbw8"
Jul 28 01:26:03.841971 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:03.841943    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-9gbw8"]
Jul 28 01:26:03.844011 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:26:03.843985    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6962dfd3_d154_4410_81f0_7ba7618a74dc.slice/crio-d93e586cd081f76e274e780583e4e9091a794fa9ec0c960750783350ec24aa92 WatchSource:0}: Error finding container d93e586cd081f76e274e780583e4e9091a794fa9ec0c960750783350ec24aa92: Status 404 returned error can't find the container with id d93e586cd081f76e274e780583e4e9091a794fa9ec0c960750783350ec24aa92
Jul 28 01:26:03.845841 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:03.845819    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 01:26:04.252885 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:04.252843    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9gbw8" event={"ID":"6962dfd3-d154-4410-81f0-7ba7618a74dc","Type":"ContainerStarted","Data":"d93e586cd081f76e274e780583e4e9091a794fa9ec0c960750783350ec24aa92"}
Jul 28 01:26:05.259108 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:05.259068    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9gbw8" event={"ID":"6962dfd3-d154-4410-81f0-7ba7618a74dc","Type":"ContainerStarted","Data":"f48c63256c005f9c054afeccae86f58647ac8bfab755b6650a762fba3d09815d"}
Jul 28 01:26:05.296710 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:05.296648    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9gbw8" podStartSLOduration=1.314342542 podStartE2EDuration="2.296627876s" totalImagesPullingTime="982.285334ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:26:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:26:05.293985401 +0000 UTC m=+635.797746737" watchObservedRunningTime="2026-07-28 01:26:05.296627876 +0000 UTC m=+635.800389188"
Jul 28 01:26:13.708625 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:13.708589    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9gbw8"
Jul 28 01:26:13.709039 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:13.708686    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9gbw8"
Jul 28 01:26:13.721202 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:13.721179    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9gbw8"
Jul 28 01:26:14.314540 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:14.314510    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9gbw8"
Jul 28 01:26:22.388550 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:22.388516    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6clxc"]
Jul 28 01:26:22.394279 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:22.394257    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6clxc"
Jul 28 01:26:22.396152 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:22.396127    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 28 01:26:22.400934 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:22.400912    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6clxc"]
Jul 28 01:26:22.474277 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:22.474239    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4826561-4c9d-4e49-8cca-1edeb9733324-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6clxc\" (UID: \"e4826561-4c9d-4e49-8cca-1edeb9733324\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6clxc"
Jul 28 01:26:22.474451 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:22.474281    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4826561-4c9d-4e49-8cca-1edeb9733324-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6clxc\" (UID: \"e4826561-4c9d-4e49-8cca-1edeb9733324\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6clxc"
Jul 28 01:26:22.474451 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:22.474313    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p5qt\" (UniqueName: \"kubernetes.io/projected/e4826561-4c9d-4e49-8cca-1edeb9733324-kube-api-access-9p5qt\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6clxc\" (UID: \"e4826561-4c9d-4e49-8cca-1edeb9733324\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6clxc"
Jul 28 01:26:22.474451 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:22.474342    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4826561-4c9d-4e49-8cca-1edeb9733324-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6clxc\" (UID: \"e4826561-4c9d-4e49-8cca-1edeb9733324\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6clxc"
Jul 28 01:26:22.474451 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:22.474387    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4826561-4c9d-4e49-8cca-1edeb9733324-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6clxc\" (UID: \"e4826561-4c9d-4e49-8cca-1edeb9733324\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6clxc"
Jul 28 01:26:22.474716 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:22.474502    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4826561-4c9d-4e49-8cca-1edeb9733324-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6clxc\" (UID: \"e4826561-4c9d-4e49-8cca-1edeb9733324\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6clxc"
Jul 28 01:26:22.575685 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:22.575645    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4826561-4c9d-4e49-8cca-1edeb9733324-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6clxc\" (UID: \"e4826561-4c9d-4e49-8cca-1edeb9733324\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6clxc"
Jul 28 01:26:22.575878 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:22.575692    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4826561-4c9d-4e49-8cca-1edeb9733324-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6clxc\" (UID: \"e4826561-4c9d-4e49-8cca-1edeb9733324\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6clxc"
Jul 28 01:26:22.575878 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:22.575722    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p5qt\" (UniqueName: \"kubernetes.io/projected/e4826561-4c9d-4e49-8cca-1edeb9733324-kube-api-access-9p5qt\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6clxc\" (UID: \"e4826561-4c9d-4e49-8cca-1edeb9733324\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6clxc"
Jul 28 01:26:22.575878 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:22.575753    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4826561-4c9d-4e49-8cca-1edeb9733324-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6clxc\" (UID: \"e4826561-4c9d-4e49-8cca-1edeb9733324\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6clxc"
Jul 28 01:26:22.575878 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:22.575809    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4826561-4c9d-4e49-8cca-1edeb9733324-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6clxc\" (UID: \"e4826561-4c9d-4e49-8cca-1edeb9733324\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6clxc"
Jul 28 01:26:22.576084 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:22.575892    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4826561-4c9d-4e49-8cca-1edeb9733324-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6clxc\" (UID: \"e4826561-4c9d-4e49-8cca-1edeb9733324\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6clxc"
Jul 28 01:26:22.576084 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:22.576014    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4826561-4c9d-4e49-8cca-1edeb9733324-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6clxc\" (UID: \"e4826561-4c9d-4e49-8cca-1edeb9733324\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6clxc"
Jul 28 01:26:22.576287 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:22.576261    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4826561-4c9d-4e49-8cca-1edeb9733324-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6clxc\" (UID: \"e4826561-4c9d-4e49-8cca-1edeb9733324\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6clxc"
Jul 28 01:26:22.576452 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:22.576328    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4826561-4c9d-4e49-8cca-1edeb9733324-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6clxc\" (UID: \"e4826561-4c9d-4e49-8cca-1edeb9733324\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6clxc"
Jul 28 01:26:22.578417 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:22.578396    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4826561-4c9d-4e49-8cca-1edeb9733324-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6clxc\" (UID: \"e4826561-4c9d-4e49-8cca-1edeb9733324\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6clxc"
Jul 28 01:26:22.578793 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:22.578771    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4826561-4c9d-4e49-8cca-1edeb9733324-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6clxc\" (UID: \"e4826561-4c9d-4e49-8cca-1edeb9733324\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6clxc"
Jul 28 01:26:22.583598 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:22.583572    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p5qt\" (UniqueName: \"kubernetes.io/projected/e4826561-4c9d-4e49-8cca-1edeb9733324-kube-api-access-9p5qt\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6clxc\" (UID: \"e4826561-4c9d-4e49-8cca-1edeb9733324\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6clxc"
Jul 28 01:26:22.706500 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:22.706420    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6clxc"
Jul 28 01:26:22.840402 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:22.840376    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6clxc"]
Jul 28 01:26:22.842511 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:26:22.842482    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4826561_4c9d_4e49_8cca_1edeb9733324.slice/crio-1e8241e59edf45450d8fa0760901701066fe7bd65b6028a43015f5e34142cd67 WatchSource:0}: Error finding container 1e8241e59edf45450d8fa0760901701066fe7bd65b6028a43015f5e34142cd67: Status 404 returned error can't find the container with id 1e8241e59edf45450d8fa0760901701066fe7bd65b6028a43015f5e34142cd67
Jul 28 01:26:23.348555 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:23.348453    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6clxc" event={"ID":"e4826561-4c9d-4e49-8cca-1edeb9733324","Type":"ContainerStarted","Data":"d57afd9d32d8395410a121400c6413e0f8857bc58363f0c88e910be2b11349d6"}
Jul 28 01:26:23.348745 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:23.348603    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6clxc" event={"ID":"e4826561-4c9d-4e49-8cca-1edeb9733324","Type":"ContainerStarted","Data":"1e8241e59edf45450d8fa0760901701066fe7bd65b6028a43015f5e34142cd67"}
Jul 28 01:26:23.365723 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:23.365671    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6clxc" podStartSLOduration=1.181015627 podStartE2EDuration="1.365653982s" totalImagesPullingTime="184.638355ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:26:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:26:23.36340265 +0000 UTC m=+653.867163963" watchObservedRunningTime="2026-07-28 01:26:23.365653982 +0000 UTC m=+653.869415294"
Jul 28 01:26:32.707586 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:32.707524    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6clxc"
Jul 28 01:26:32.707955 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:32.707610    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6clxc"
Jul 28 01:26:32.720622 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:32.720597    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6clxc"
Jul 28 01:26:33.412063 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:26:33.412036    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6clxc"
Jul 28 01:28:01.905682 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:28:01.905650    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-777f854568-qgpx2"]
Jul 28 01:28:01.906272 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:28:01.905875    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-777f854568-qgpx2" podUID="f74ce746-e205-4bee-b396-d3be4d2af2aa" containerName="authorino" containerID="cri-o://ffd732d1af9e5458e4649ac61a1ff3c46eb937f57fe415e39def70cac8c1e2a9" gracePeriod=30
Jul 28 01:28:02.171389 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:28:02.171324    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-777f854568-qgpx2"
Jul 28 01:28:02.240317 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:28:02.240283    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55qrt\" (UniqueName: \"kubernetes.io/projected/f74ce746-e205-4bee-b396-d3be4d2af2aa-kube-api-access-55qrt\") pod \"f74ce746-e205-4bee-b396-d3be4d2af2aa\" (UID: \"f74ce746-e205-4bee-b396-d3be4d2af2aa\") "
Jul 28 01:28:02.240501 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:28:02.240331    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f74ce746-e205-4bee-b396-d3be4d2af2aa-tls-cert\") pod \"f74ce746-e205-4bee-b396-d3be4d2af2aa\" (UID: \"f74ce746-e205-4bee-b396-d3be4d2af2aa\") "
Jul 28 01:28:02.242421 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:28:02.242387    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f74ce746-e205-4bee-b396-d3be4d2af2aa-kube-api-access-55qrt" (OuterVolumeSpecName: "kube-api-access-55qrt") pod "f74ce746-e205-4bee-b396-d3be4d2af2aa" (UID: "f74ce746-e205-4bee-b396-d3be4d2af2aa"). InnerVolumeSpecName "kube-api-access-55qrt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:28:02.250917 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:28:02.250889    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f74ce746-e205-4bee-b396-d3be4d2af2aa-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "f74ce746-e205-4bee-b396-d3be4d2af2aa" (UID: "f74ce746-e205-4bee-b396-d3be4d2af2aa"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:28:02.341438 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:28:02.341394    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55qrt\" (UniqueName: \"kubernetes.io/projected/f74ce746-e205-4bee-b396-d3be4d2af2aa-kube-api-access-55qrt\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:28:02.341438 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:28:02.341427    2562 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f74ce746-e205-4bee-b396-d3be4d2af2aa-tls-cert\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:28:02.853412 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:28:02.853381    2562 generic.go:356] "Generic (PLEG): container finished" podID="f74ce746-e205-4bee-b396-d3be4d2af2aa" containerID="ffd732d1af9e5458e4649ac61a1ff3c46eb937f57fe415e39def70cac8c1e2a9" exitCode=0
Jul 28 01:28:02.853613 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:28:02.853418    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-777f854568-qgpx2" event={"ID":"f74ce746-e205-4bee-b396-d3be4d2af2aa","Type":"ContainerDied","Data":"ffd732d1af9e5458e4649ac61a1ff3c46eb937f57fe415e39def70cac8c1e2a9"}
Jul 28 01:28:02.853613 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:28:02.853426    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-777f854568-qgpx2"
Jul 28 01:28:02.853613 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:28:02.853445    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-777f854568-qgpx2" event={"ID":"f74ce746-e205-4bee-b396-d3be4d2af2aa","Type":"ContainerDied","Data":"7effdbb722977d1f063d9cac8f04a0452990cb04cc1d6601ea3a2a6315bf7012"}
Jul 28 01:28:02.853613 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:28:02.853462    2562 scope.go:117] "RemoveContainer" containerID="ffd732d1af9e5458e4649ac61a1ff3c46eb937f57fe415e39def70cac8c1e2a9"
Jul 28 01:28:02.862514 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:28:02.862493    2562 scope.go:117] "RemoveContainer" containerID="ffd732d1af9e5458e4649ac61a1ff3c46eb937f57fe415e39def70cac8c1e2a9"
Jul 28 01:28:02.862864 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:28:02.862840    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffd732d1af9e5458e4649ac61a1ff3c46eb937f57fe415e39def70cac8c1e2a9\": container with ID starting with ffd732d1af9e5458e4649ac61a1ff3c46eb937f57fe415e39def70cac8c1e2a9 not found: ID does not exist" containerID="ffd732d1af9e5458e4649ac61a1ff3c46eb937f57fe415e39def70cac8c1e2a9"
Jul 28 01:28:02.862953 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:28:02.862872    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffd732d1af9e5458e4649ac61a1ff3c46eb937f57fe415e39def70cac8c1e2a9"} err="failed to get container status \"ffd732d1af9e5458e4649ac61a1ff3c46eb937f57fe415e39def70cac8c1e2a9\": rpc error: code = NotFound desc = could not find container \"ffd732d1af9e5458e4649ac61a1ff3c46eb937f57fe415e39def70cac8c1e2a9\": container with ID starting with ffd732d1af9e5458e4649ac61a1ff3c46eb937f57fe415e39def70cac8c1e2a9 not found: ID does not exist"
Jul 28 01:28:02.873906 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:28:02.873882    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-777f854568-qgpx2"]
Jul 28 01:28:02.877581 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:28:02.877548    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-777f854568-qgpx2"]
Jul 28 01:28:04.014274 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:28:04.014243    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f74ce746-e205-4bee-b396-d3be4d2af2aa" path="/var/lib/kubelet/pods/f74ce746-e205-4bee-b396-d3be4d2af2aa/volumes"
Jul 28 01:28:47.902019 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:28:47.901987    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6864dfc7bf-kvx6c"]
Jul 28 01:28:47.902653 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:28:47.902232    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6864dfc7bf-kvx6c" podUID="9b37096f-81b3-4335-86ac-f2af3e7ef059" containerName="manager" containerID="cri-o://f1e1f51b9062506dcbea7f5f3c09cb332d84b49e5739d8ea5014ddfaaeb4e406" gracePeriod=30
Jul 28 01:28:48.088833 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:28:48.088800    2562 generic.go:356] "Generic (PLEG): container finished" podID="9b37096f-81b3-4335-86ac-f2af3e7ef059" containerID="f1e1f51b9062506dcbea7f5f3c09cb332d84b49e5739d8ea5014ddfaaeb4e406" exitCode=0
Jul 28 01:28:48.088968 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:28:48.088833    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6864dfc7bf-kvx6c" event={"ID":"9b37096f-81b3-4335-86ac-f2af3e7ef059","Type":"ContainerDied","Data":"f1e1f51b9062506dcbea7f5f3c09cb332d84b49e5739d8ea5014ddfaaeb4e406"}
Jul 28 01:28:48.148614 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:28:48.148592    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6864dfc7bf-kvx6c"
Jul 28 01:28:48.264667 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:28:48.264588    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9b37096f-81b3-4335-86ac-f2af3e7ef059-webhook-cert\") pod \"9b37096f-81b3-4335-86ac-f2af3e7ef059\" (UID: \"9b37096f-81b3-4335-86ac-f2af3e7ef059\") "
Jul 28 01:28:48.264809 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:28:48.264683    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f2855\" (UniqueName: \"kubernetes.io/projected/9b37096f-81b3-4335-86ac-f2af3e7ef059-kube-api-access-f2855\") pod \"9b37096f-81b3-4335-86ac-f2af3e7ef059\" (UID: \"9b37096f-81b3-4335-86ac-f2af3e7ef059\") "
Jul 28 01:28:48.266620 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:28:48.266584    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b37096f-81b3-4335-86ac-f2af3e7ef059-kube-api-access-f2855" (OuterVolumeSpecName: "kube-api-access-f2855") pod "9b37096f-81b3-4335-86ac-f2af3e7ef059" (UID: "9b37096f-81b3-4335-86ac-f2af3e7ef059"). InnerVolumeSpecName "kube-api-access-f2855". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:28:48.266620 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:28:48.266600    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b37096f-81b3-4335-86ac-f2af3e7ef059-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "9b37096f-81b3-4335-86ac-f2af3e7ef059" (UID: "9b37096f-81b3-4335-86ac-f2af3e7ef059"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:28:48.365897 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:28:48.365862    2562 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9b37096f-81b3-4335-86ac-f2af3e7ef059-webhook-cert\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:28:48.365897 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:28:48.365889    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f2855\" (UniqueName: \"kubernetes.io/projected/9b37096f-81b3-4335-86ac-f2af3e7ef059-kube-api-access-f2855\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:28:49.095408 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:28:49.095380    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6864dfc7bf-kvx6c"
Jul 28 01:28:49.095845 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:28:49.095413    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6864dfc7bf-kvx6c" event={"ID":"9b37096f-81b3-4335-86ac-f2af3e7ef059","Type":"ContainerDied","Data":"32c0f9a0b79c56998d6ef0a2a27c041c059aed43ec675377c66ef9a0aedba310"}
Jul 28 01:28:49.095845 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:28:49.095468    2562 scope.go:117] "RemoveContainer" containerID="f1e1f51b9062506dcbea7f5f3c09cb332d84b49e5739d8ea5014ddfaaeb4e406"
Jul 28 01:28:49.116196 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:28:49.116173    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6864dfc7bf-kvx6c"]
Jul 28 01:28:49.120152 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:28:49.120126    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6864dfc7bf-kvx6c"]
Jul 28 01:28:50.013373 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:28:50.013341    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b37096f-81b3-4335-86ac-f2af3e7ef059" path="/var/lib/kubelet/pods/9b37096f-81b3-4335-86ac-f2af3e7ef059/volumes"
Jul 28 01:29:49.947624 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:29:49.947586    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6864dfc7bf-zjc82"]
Jul 28 01:29:49.948059 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:29:49.947978    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f74ce746-e205-4bee-b396-d3be4d2af2aa" containerName="authorino"
Jul 28 01:29:49.948059 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:29:49.947991    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f74ce746-e205-4bee-b396-d3be4d2af2aa" containerName="authorino"
Jul 28 01:29:49.948059 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:29:49.948012    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b37096f-81b3-4335-86ac-f2af3e7ef059" containerName="manager"
Jul 28 01:29:49.948059 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:29:49.948017    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b37096f-81b3-4335-86ac-f2af3e7ef059" containerName="manager"
Jul 28 01:29:49.948187 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:29:49.948074    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b37096f-81b3-4335-86ac-f2af3e7ef059" containerName="manager"
Jul 28 01:29:49.948187 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:29:49.948082    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f74ce746-e205-4bee-b396-d3be4d2af2aa" containerName="authorino"
Jul 28 01:29:49.951213 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:29:49.951196    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6864dfc7bf-zjc82"
Jul 28 01:29:49.952978 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:29:49.952952    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 28 01:29:49.953546 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:29:49.953529    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-52z9q\""
Jul 28 01:29:49.953546 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:29:49.953544    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 28 01:29:49.961214 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:29:49.961188    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6864dfc7bf-zjc82"]
Jul 28 01:29:50.017596 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:29:50.017555    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0335fba6-3d6b-424a-bfab-a24804570294-webhook-cert\") pod \"maas-controller-6864dfc7bf-zjc82\" (UID: \"0335fba6-3d6b-424a-bfab-a24804570294\") " pod="opendatahub/maas-controller-6864dfc7bf-zjc82"
Jul 28 01:29:50.017752 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:29:50.017603    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dp77q\" (UniqueName: \"kubernetes.io/projected/0335fba6-3d6b-424a-bfab-a24804570294-kube-api-access-dp77q\") pod \"maas-controller-6864dfc7bf-zjc82\" (UID: \"0335fba6-3d6b-424a-bfab-a24804570294\") " pod="opendatahub/maas-controller-6864dfc7bf-zjc82"
Jul 28 01:29:50.118911 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:29:50.118881    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0335fba6-3d6b-424a-bfab-a24804570294-webhook-cert\") pod \"maas-controller-6864dfc7bf-zjc82\" (UID: \"0335fba6-3d6b-424a-bfab-a24804570294\") " pod="opendatahub/maas-controller-6864dfc7bf-zjc82"
Jul 28 01:29:50.119070 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:29:50.118921    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dp77q\" (UniqueName: \"kubernetes.io/projected/0335fba6-3d6b-424a-bfab-a24804570294-kube-api-access-dp77q\") pod \"maas-controller-6864dfc7bf-zjc82\" (UID: \"0335fba6-3d6b-424a-bfab-a24804570294\") " pod="opendatahub/maas-controller-6864dfc7bf-zjc82"
Jul 28 01:29:50.121168 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:29:50.121140    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0335fba6-3d6b-424a-bfab-a24804570294-webhook-cert\") pod \"maas-controller-6864dfc7bf-zjc82\" (UID: \"0335fba6-3d6b-424a-bfab-a24804570294\") " pod="opendatahub/maas-controller-6864dfc7bf-zjc82"
Jul 28 01:29:50.126436 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:29:50.126409    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dp77q\" (UniqueName: \"kubernetes.io/projected/0335fba6-3d6b-424a-bfab-a24804570294-kube-api-access-dp77q\") pod \"maas-controller-6864dfc7bf-zjc82\" (UID: \"0335fba6-3d6b-424a-bfab-a24804570294\") " pod="opendatahub/maas-controller-6864dfc7bf-zjc82"
Jul 28 01:29:50.261750 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:29:50.261653    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6864dfc7bf-zjc82"
Jul 28 01:29:50.394266 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:29:50.394238    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6864dfc7bf-zjc82"]
Jul 28 01:29:50.395869 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:29:50.395840    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0335fba6_3d6b_424a_bfab_a24804570294.slice/crio-6eb0c17bb24559f99fec9ba617ce3406e34ee8917e931934f1cf068fe860b68b WatchSource:0}: Error finding container 6eb0c17bb24559f99fec9ba617ce3406e34ee8917e931934f1cf068fe860b68b: Status 404 returned error can't find the container with id 6eb0c17bb24559f99fec9ba617ce3406e34ee8917e931934f1cf068fe860b68b
Jul 28 01:29:50.406256 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:29:50.406228    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6864dfc7bf-zjc82" event={"ID":"0335fba6-3d6b-424a-bfab-a24804570294","Type":"ContainerStarted","Data":"6eb0c17bb24559f99fec9ba617ce3406e34ee8917e931934f1cf068fe860b68b"}
Jul 28 01:29:51.412100 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:29:51.412062    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6864dfc7bf-zjc82" event={"ID":"0335fba6-3d6b-424a-bfab-a24804570294","Type":"ContainerStarted","Data":"10caa0c0b7ba40b4f7dec799ac6ec0343bee36646073bd99fcc0c340d47f66a2"}
Jul 28 01:29:51.412467 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:29:51.412125    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6864dfc7bf-zjc82"
Jul 28 01:29:51.427998 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:29:51.427942    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6864dfc7bf-zjc82" podStartSLOduration=1.941600315 podStartE2EDuration="2.427928577s" totalImagesPullingTime="486.328262ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:29:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:29:51.425525057 +0000 UTC m=+861.929286363" watchObservedRunningTime="2026-07-28 01:29:51.427928577 +0000 UTC m=+861.931689889"
Jul 28 01:30:00.140876 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:00.140840    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753370-rcjdx"]
Jul 28 01:30:00.144321 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:00.144303    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753370-rcjdx"
Jul 28 01:30:00.146513 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:00.146491    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wjxvt\""
Jul 28 01:30:00.148871 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:00.148815    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753370-rcjdx"]
Jul 28 01:30:00.157434 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:00.157413    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753370-rcjdx"
Jul 28 01:30:00.300952 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:00.300919    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753370-rcjdx"]
Jul 28 01:30:00.304709 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:30:00.304678    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc498128_ebf5_4f5c_b25a_aa3a8a93e14d.slice/crio-e42973f52f6b75577bfdb87df1d8453ee950df04bfcf95944bb9bab4eb8e44f2 WatchSource:0}: Error finding container e42973f52f6b75577bfdb87df1d8453ee950df04bfcf95944bb9bab4eb8e44f2: Status 404 returned error can't find the container with id e42973f52f6b75577bfdb87df1d8453ee950df04bfcf95944bb9bab4eb8e44f2
Jul 28 01:30:00.457658 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:00.457548    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753370-rcjdx" event={"ID":"cc498128-ebf5-4f5c-b25a-aa3a8a93e14d","Type":"ContainerStarted","Data":"e42973f52f6b75577bfdb87df1d8453ee950df04bfcf95944bb9bab4eb8e44f2"}
Jul 28 01:30:02.419958 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:02.419926    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6864dfc7bf-zjc82"
Jul 28 01:30:03.476725 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:03.476679    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753370-rcjdx" event={"ID":"cc498128-ebf5-4f5c-b25a-aa3a8a93e14d","Type":"ContainerStarted","Data":"6f7674e8b1dbf6257ad7b1d6fddc1874d492262c728c13489548ee2aa40fe2c0"}
Jul 28 01:30:03.491328 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:03.491278    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753370-rcjdx" podStartSLOduration=1.123901024 podStartE2EDuration="3.491263398s" totalImagesPullingTime="2.367362374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:30:03.488912539 +0000 UTC m=+873.992673850" watchObservedRunningTime="2026-07-28 01:30:03.491263398 +0000 UTC m=+873.995024709"
Jul 28 01:30:04.484022 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:04.483990    2562 generic.go:356] "Generic (PLEG): container finished" podID="cc498128-ebf5-4f5c-b25a-aa3a8a93e14d" containerID="6f7674e8b1dbf6257ad7b1d6fddc1874d492262c728c13489548ee2aa40fe2c0" exitCode=0
Jul 28 01:30:04.484405 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:04.484080    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753370-rcjdx" event={"ID":"cc498128-ebf5-4f5c-b25a-aa3a8a93e14d","Type":"ContainerDied","Data":"6f7674e8b1dbf6257ad7b1d6fddc1874d492262c728c13489548ee2aa40fe2c0"}
Jul 28 01:30:05.623901 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:05.623875    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753370-rcjdx"
Jul 28 01:30:06.495833 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:06.495801    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753370-rcjdx"
Jul 28 01:30:06.495833 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:06.495810    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753370-rcjdx" event={"ID":"cc498128-ebf5-4f5c-b25a-aa3a8a93e14d","Type":"ContainerDied","Data":"e42973f52f6b75577bfdb87df1d8453ee950df04bfcf95944bb9bab4eb8e44f2"}
Jul 28 01:30:06.496036 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:06.495885    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e42973f52f6b75577bfdb87df1d8453ee950df04bfcf95944bb9bab4eb8e44f2"
Jul 28 01:30:07.062263 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:07.062223    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6864dfc7bf-zjc82"]
Jul 28 01:30:07.062728 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:07.062491    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6864dfc7bf-zjc82" podUID="0335fba6-3d6b-424a-bfab-a24804570294" containerName="manager" containerID="cri-o://10caa0c0b7ba40b4f7dec799ac6ec0343bee36646073bd99fcc0c340d47f66a2" gracePeriod=30
Jul 28 01:30:07.320351 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:07.320296    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6864dfc7bf-zjc82"
Jul 28 01:30:07.380386 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:07.380355    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0335fba6-3d6b-424a-bfab-a24804570294-webhook-cert\") pod \"0335fba6-3d6b-424a-bfab-a24804570294\" (UID: \"0335fba6-3d6b-424a-bfab-a24804570294\") "
Jul 28 01:30:07.380595 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:07.380437    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dp77q\" (UniqueName: \"kubernetes.io/projected/0335fba6-3d6b-424a-bfab-a24804570294-kube-api-access-dp77q\") pod \"0335fba6-3d6b-424a-bfab-a24804570294\" (UID: \"0335fba6-3d6b-424a-bfab-a24804570294\") "
Jul 28 01:30:07.382485 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:07.382447    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0335fba6-3d6b-424a-bfab-a24804570294-kube-api-access-dp77q" (OuterVolumeSpecName: "kube-api-access-dp77q") pod "0335fba6-3d6b-424a-bfab-a24804570294" (UID: "0335fba6-3d6b-424a-bfab-a24804570294"). InnerVolumeSpecName "kube-api-access-dp77q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:30:07.382681 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:07.382495    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0335fba6-3d6b-424a-bfab-a24804570294-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0335fba6-3d6b-424a-bfab-a24804570294" (UID: "0335fba6-3d6b-424a-bfab-a24804570294"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:30:07.481402 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:07.481363    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dp77q\" (UniqueName: \"kubernetes.io/projected/0335fba6-3d6b-424a-bfab-a24804570294-kube-api-access-dp77q\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:30:07.481402 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:07.481398    2562 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0335fba6-3d6b-424a-bfab-a24804570294-webhook-cert\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:30:07.501568 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:07.501527    2562 generic.go:356] "Generic (PLEG): container finished" podID="0335fba6-3d6b-424a-bfab-a24804570294" containerID="10caa0c0b7ba40b4f7dec799ac6ec0343bee36646073bd99fcc0c340d47f66a2" exitCode=0
Jul 28 01:30:07.501703 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:07.501592    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6864dfc7bf-zjc82"
Jul 28 01:30:07.501703 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:07.501621    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6864dfc7bf-zjc82" event={"ID":"0335fba6-3d6b-424a-bfab-a24804570294","Type":"ContainerDied","Data":"10caa0c0b7ba40b4f7dec799ac6ec0343bee36646073bd99fcc0c340d47f66a2"}
Jul 28 01:30:07.501703 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:07.501675    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6864dfc7bf-zjc82" event={"ID":"0335fba6-3d6b-424a-bfab-a24804570294","Type":"ContainerDied","Data":"6eb0c17bb24559f99fec9ba617ce3406e34ee8917e931934f1cf068fe860b68b"}
Jul 28 01:30:07.501703 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:07.501700    2562 scope.go:117] "RemoveContainer" containerID="10caa0c0b7ba40b4f7dec799ac6ec0343bee36646073bd99fcc0c340d47f66a2"
Jul 28 01:30:07.511426 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:07.511409    2562 scope.go:117] "RemoveContainer" containerID="10caa0c0b7ba40b4f7dec799ac6ec0343bee36646073bd99fcc0c340d47f66a2"
Jul 28 01:30:07.511712 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:30:07.511695    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10caa0c0b7ba40b4f7dec799ac6ec0343bee36646073bd99fcc0c340d47f66a2\": container with ID starting with 10caa0c0b7ba40b4f7dec799ac6ec0343bee36646073bd99fcc0c340d47f66a2 not found: ID does not exist" containerID="10caa0c0b7ba40b4f7dec799ac6ec0343bee36646073bd99fcc0c340d47f66a2"
Jul 28 01:30:07.511758 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:07.511722    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10caa0c0b7ba40b4f7dec799ac6ec0343bee36646073bd99fcc0c340d47f66a2"} err="failed to get container status \"10caa0c0b7ba40b4f7dec799ac6ec0343bee36646073bd99fcc0c340d47f66a2\": rpc error: code = NotFound desc = could not find container \"10caa0c0b7ba40b4f7dec799ac6ec0343bee36646073bd99fcc0c340d47f66a2\": container with ID starting with 10caa0c0b7ba40b4f7dec799ac6ec0343bee36646073bd99fcc0c340d47f66a2 not found: ID does not exist"
Jul 28 01:30:07.521714 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:07.521694    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6864dfc7bf-zjc82"]
Jul 28 01:30:07.525358 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:07.525337    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6864dfc7bf-zjc82"]
Jul 28 01:30:08.013915 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:08.013881    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0335fba6-3d6b-424a-bfab-a24804570294" path="/var/lib/kubelet/pods/0335fba6-3d6b-424a-bfab-a24804570294/volumes"
Jul 28 01:30:08.338600 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:08.338495    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6864dfc7bf-p4fs6"]
Jul 28 01:30:08.338942 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:08.338932    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc498128-ebf5-4f5c-b25a-aa3a8a93e14d" containerName="cleanup"
Jul 28 01:30:08.338982 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:08.338945    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc498128-ebf5-4f5c-b25a-aa3a8a93e14d" containerName="cleanup"
Jul 28 01:30:08.338982 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:08.338958    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0335fba6-3d6b-424a-bfab-a24804570294" containerName="manager"
Jul 28 01:30:08.338982 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:08.338963    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0335fba6-3d6b-424a-bfab-a24804570294" containerName="manager"
Jul 28 01:30:08.339070 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:08.339028    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc498128-ebf5-4f5c-b25a-aa3a8a93e14d" containerName="cleanup"
Jul 28 01:30:08.339070 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:08.339035    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0335fba6-3d6b-424a-bfab-a24804570294" containerName="manager"
Jul 28 01:30:08.343792 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:08.343769    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6864dfc7bf-p4fs6"
Jul 28 01:30:08.346026 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:08.346002    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-52z9q\""
Jul 28 01:30:08.346148 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:08.346043    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 28 01:30:08.346148 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:08.346045    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 28 01:30:08.352263 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:08.352233    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6864dfc7bf-p4fs6"]
Jul 28 01:30:08.388658 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:08.388619    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrzvh\" (UniqueName: \"kubernetes.io/projected/f5328829-095e-41f8-ad63-836a13eab112-kube-api-access-rrzvh\") pod \"maas-controller-6864dfc7bf-p4fs6\" (UID: \"f5328829-095e-41f8-ad63-836a13eab112\") " pod="opendatahub/maas-controller-6864dfc7bf-p4fs6"
Jul 28 01:30:08.388833 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:08.388743    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f5328829-095e-41f8-ad63-836a13eab112-webhook-cert\") pod \"maas-controller-6864dfc7bf-p4fs6\" (UID: \"f5328829-095e-41f8-ad63-836a13eab112\") " pod="opendatahub/maas-controller-6864dfc7bf-p4fs6"
Jul 28 01:30:08.490034 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:08.489994    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrzvh\" (UniqueName: \"kubernetes.io/projected/f5328829-095e-41f8-ad63-836a13eab112-kube-api-access-rrzvh\") pod \"maas-controller-6864dfc7bf-p4fs6\" (UID: \"f5328829-095e-41f8-ad63-836a13eab112\") " pod="opendatahub/maas-controller-6864dfc7bf-p4fs6"
Jul 28 01:30:08.490207 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:08.490059    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f5328829-095e-41f8-ad63-836a13eab112-webhook-cert\") pod \"maas-controller-6864dfc7bf-p4fs6\" (UID: \"f5328829-095e-41f8-ad63-836a13eab112\") " pod="opendatahub/maas-controller-6864dfc7bf-p4fs6"
Jul 28 01:30:08.492484 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:08.492461    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f5328829-095e-41f8-ad63-836a13eab112-webhook-cert\") pod \"maas-controller-6864dfc7bf-p4fs6\" (UID: \"f5328829-095e-41f8-ad63-836a13eab112\") " pod="opendatahub/maas-controller-6864dfc7bf-p4fs6"
Jul 28 01:30:08.497736 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:08.497707    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrzvh\" (UniqueName: \"kubernetes.io/projected/f5328829-095e-41f8-ad63-836a13eab112-kube-api-access-rrzvh\") pod \"maas-controller-6864dfc7bf-p4fs6\" (UID: \"f5328829-095e-41f8-ad63-836a13eab112\") " pod="opendatahub/maas-controller-6864dfc7bf-p4fs6"
Jul 28 01:30:08.655955 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:08.655917    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6864dfc7bf-p4fs6"
Jul 28 01:30:08.790469 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:08.790435    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6864dfc7bf-p4fs6"]
Jul 28 01:30:08.794364 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:30:08.794331    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5328829_095e_41f8_ad63_836a13eab112.slice/crio-218a916b261352786263fe432d077f7cf996c0078cfb5381ab21894f7d27940d WatchSource:0}: Error finding container 218a916b261352786263fe432d077f7cf996c0078cfb5381ab21894f7d27940d: Status 404 returned error can't find the container with id 218a916b261352786263fe432d077f7cf996c0078cfb5381ab21894f7d27940d
Jul 28 01:30:09.514978 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:09.514944    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6864dfc7bf-p4fs6" event={"ID":"f5328829-095e-41f8-ad63-836a13eab112","Type":"ContainerStarted","Data":"ffb2d968a27bcd6e7650304ead2179f5d6b803a95390cfcffae3292c52531208"}
Jul 28 01:30:09.515386 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:09.514990    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6864dfc7bf-p4fs6" event={"ID":"f5328829-095e-41f8-ad63-836a13eab112","Type":"ContainerStarted","Data":"218a916b261352786263fe432d077f7cf996c0078cfb5381ab21894f7d27940d"}
Jul 28 01:30:09.515386 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:09.515063    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6864dfc7bf-p4fs6"
Jul 28 01:30:09.530503 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:09.530430    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6864dfc7bf-p4fs6" podStartSLOduration=0.944701187 podStartE2EDuration="1.530409202s" totalImagesPullingTime="585.708015ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:30:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:30:09.528328171 +0000 UTC m=+880.032089482" watchObservedRunningTime="2026-07-28 01:30:09.530409202 +0000 UTC m=+880.034170519"
Jul 28 01:30:20.523011 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:30:20.522982    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6864dfc7bf-p4fs6"
Jul 28 01:35:07.040121 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:35:07.040032    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2hlvl"]
Jul 28 01:35:07.040684 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:35:07.040244    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2hlvl" podUID="7a63d1a9-befe-4d02-b085-ded230fe433c" containerName="manager" containerID="cri-o://04bf04c3ec316914329d0c674ed8493051e90489bffa154ca0e870e52702cdcd" gracePeriod=10
Jul 28 01:35:08.996070 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:35:08.996044    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2hlvl"
Jul 28 01:35:09.026471 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:35:09.026435    2562 generic.go:356] "Generic (PLEG): container finished" podID="7a63d1a9-befe-4d02-b085-ded230fe433c" containerID="04bf04c3ec316914329d0c674ed8493051e90489bffa154ca0e870e52702cdcd" exitCode=0
Jul 28 01:35:09.026471 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:35:09.026481    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2hlvl"
Jul 28 01:35:09.026738 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:35:09.026522    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2hlvl" event={"ID":"7a63d1a9-befe-4d02-b085-ded230fe433c","Type":"ContainerDied","Data":"04bf04c3ec316914329d0c674ed8493051e90489bffa154ca0e870e52702cdcd"}
Jul 28 01:35:09.026738 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:35:09.026606    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2hlvl" event={"ID":"7a63d1a9-befe-4d02-b085-ded230fe433c","Type":"ContainerDied","Data":"5deaa23b585eb2b979623fe418c9cb2476be3e87b865d72766c567f9589b18e6"}
Jul 28 01:35:09.026738 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:35:09.026639    2562 scope.go:117] "RemoveContainer" containerID="04bf04c3ec316914329d0c674ed8493051e90489bffa154ca0e870e52702cdcd"
Jul 28 01:35:09.037421 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:35:09.037398    2562 scope.go:117] "RemoveContainer" containerID="04bf04c3ec316914329d0c674ed8493051e90489bffa154ca0e870e52702cdcd"
Jul 28 01:35:09.037746 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:35:09.037722    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04bf04c3ec316914329d0c674ed8493051e90489bffa154ca0e870e52702cdcd\": container with ID starting with 04bf04c3ec316914329d0c674ed8493051e90489bffa154ca0e870e52702cdcd not found: ID does not exist" containerID="04bf04c3ec316914329d0c674ed8493051e90489bffa154ca0e870e52702cdcd"
Jul 28 01:35:09.037846 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:35:09.037759    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04bf04c3ec316914329d0c674ed8493051e90489bffa154ca0e870e52702cdcd"} err="failed to get container status \"04bf04c3ec316914329d0c674ed8493051e90489bffa154ca0e870e52702cdcd\": rpc error: code = NotFound desc = could not find container \"04bf04c3ec316914329d0c674ed8493051e90489bffa154ca0e870e52702cdcd\": container with ID starting with 04bf04c3ec316914329d0c674ed8493051e90489bffa154ca0e870e52702cdcd not found: ID does not exist"
Jul 28 01:35:09.070104 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:35:09.070072    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7ffl\" (UniqueName: \"kubernetes.io/projected/7a63d1a9-befe-4d02-b085-ded230fe433c-kube-api-access-j7ffl\") pod \"7a63d1a9-befe-4d02-b085-ded230fe433c\" (UID: \"7a63d1a9-befe-4d02-b085-ded230fe433c\") "
Jul 28 01:35:09.070280 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:35:09.070180    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7a63d1a9-befe-4d02-b085-ded230fe433c-extensions-socket-volume\") pod \"7a63d1a9-befe-4d02-b085-ded230fe433c\" (UID: \"7a63d1a9-befe-4d02-b085-ded230fe433c\") "
Jul 28 01:35:09.070583 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:35:09.070536    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a63d1a9-befe-4d02-b085-ded230fe433c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7a63d1a9-befe-4d02-b085-ded230fe433c" (UID: "7a63d1a9-befe-4d02-b085-ded230fe433c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:35:09.072103 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:35:09.072080    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a63d1a9-befe-4d02-b085-ded230fe433c-kube-api-access-j7ffl" (OuterVolumeSpecName: "kube-api-access-j7ffl") pod "7a63d1a9-befe-4d02-b085-ded230fe433c" (UID: "7a63d1a9-befe-4d02-b085-ded230fe433c"). InnerVolumeSpecName "kube-api-access-j7ffl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:35:09.171792 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:35:09.171746    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7ffl\" (UniqueName: \"kubernetes.io/projected/7a63d1a9-befe-4d02-b085-ded230fe433c-kube-api-access-j7ffl\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:35:09.171792 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:35:09.171783    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7a63d1a9-befe-4d02-b085-ded230fe433c-extensions-socket-volume\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:35:09.348730 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:35:09.348697    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2hlvl"]
Jul 28 01:35:09.354893 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:35:09.354864    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2hlvl"]
Jul 28 01:35:10.013040 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:35:10.013006    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a63d1a9-befe-4d02-b085-ded230fe433c" path="/var/lib/kubelet/pods/7a63d1a9-befe-4d02-b085-ded230fe433c/volumes"
Jul 28 01:36:08.230742 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:36:08.230705    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wkkd5"]
Jul 28 01:36:08.231208 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:36:08.231119    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a63d1a9-befe-4d02-b085-ded230fe433c" containerName="manager"
Jul 28 01:36:08.231208 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:36:08.231130    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a63d1a9-befe-4d02-b085-ded230fe433c" containerName="manager"
Jul 28 01:36:08.231208 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:36:08.231188    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a63d1a9-befe-4d02-b085-ded230fe433c" containerName="manager"
Jul 28 01:36:08.233292 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:36:08.233277    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wkkd5"
Jul 28 01:36:08.235675 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:36:08.235655    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-lxpxk\""
Jul 28 01:36:08.247170 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:36:08.247145    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wkkd5"]
Jul 28 01:36:08.282095 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:36:08.282064    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8021dcd0-7bad-43c8-b2e2-eeac6f391afc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wkkd5\" (UID: \"8021dcd0-7bad-43c8-b2e2-eeac6f391afc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wkkd5"
Jul 28 01:36:08.282242 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:36:08.282101    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sqxr\" (UniqueName: \"kubernetes.io/projected/8021dcd0-7bad-43c8-b2e2-eeac6f391afc-kube-api-access-2sqxr\") pod \"kuadrant-operator-controller-manager-86878c769f-wkkd5\" (UID: \"8021dcd0-7bad-43c8-b2e2-eeac6f391afc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wkkd5"
Jul 28 01:36:08.383362 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:36:08.383319    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8021dcd0-7bad-43c8-b2e2-eeac6f391afc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wkkd5\" (UID: \"8021dcd0-7bad-43c8-b2e2-eeac6f391afc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wkkd5"
Jul 28 01:36:08.383362 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:36:08.383365    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sqxr\" (UniqueName: \"kubernetes.io/projected/8021dcd0-7bad-43c8-b2e2-eeac6f391afc-kube-api-access-2sqxr\") pod \"kuadrant-operator-controller-manager-86878c769f-wkkd5\" (UID: \"8021dcd0-7bad-43c8-b2e2-eeac6f391afc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wkkd5"
Jul 28 01:36:08.383761 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:36:08.383743    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8021dcd0-7bad-43c8-b2e2-eeac6f391afc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wkkd5\" (UID: \"8021dcd0-7bad-43c8-b2e2-eeac6f391afc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wkkd5"
Jul 28 01:36:08.395128 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:36:08.395099    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sqxr\" (UniqueName: \"kubernetes.io/projected/8021dcd0-7bad-43c8-b2e2-eeac6f391afc-kube-api-access-2sqxr\") pod \"kuadrant-operator-controller-manager-86878c769f-wkkd5\" (UID: \"8021dcd0-7bad-43c8-b2e2-eeac6f391afc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wkkd5"
Jul 28 01:36:08.543199 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:36:08.543114    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wkkd5"
Jul 28 01:36:08.681990 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:36:08.681963    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wkkd5"]
Jul 28 01:36:08.683135 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:36:08.683092    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8021dcd0_7bad_43c8_b2e2_eeac6f391afc.slice/crio-422cc0dd13da21308b3747e088df1de933db8c44b91018c49663e373f195b4ef WatchSource:0}: Error finding container 422cc0dd13da21308b3747e088df1de933db8c44b91018c49663e373f195b4ef: Status 404 returned error can't find the container with id 422cc0dd13da21308b3747e088df1de933db8c44b91018c49663e373f195b4ef
Jul 28 01:36:09.318611 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:36:09.318576    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wkkd5" event={"ID":"8021dcd0-7bad-43c8-b2e2-eeac6f391afc","Type":"ContainerStarted","Data":"bf4f72bf1037378dcba606da95ac9d235b6d63551c9019379100e61301978a3f"}
Jul 28 01:36:09.319056 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:36:09.318639    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wkkd5" event={"ID":"8021dcd0-7bad-43c8-b2e2-eeac6f391afc","Type":"ContainerStarted","Data":"422cc0dd13da21308b3747e088df1de933db8c44b91018c49663e373f195b4ef"}
Jul 28 01:36:09.319056 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:36:09.318669    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wkkd5"
Jul 28 01:36:09.338256 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:36:09.338187    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wkkd5" podStartSLOduration=1.338168414 podStartE2EDuration="1.338168414s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:36:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:36:09.336217352 +0000 UTC m=+1239.839978686" watchObservedRunningTime="2026-07-28 01:36:09.338168414 +0000 UTC m=+1239.841929726"
Jul 28 01:36:20.325929 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:36:20.325900    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wkkd5"
Jul 28 01:43:18.804529 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:18.804496    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j"]
Jul 28 01:43:18.808339 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:18.808315    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j"
Jul 28 01:43:18.810350 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:18.810330    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-9dc1294f-openshift-default-dockercfg-7nzq7\""
Jul 28 01:43:18.828337 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:18.828313    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j"]
Jul 28 01:43:18.879920 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:18.879889    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64a98122-fad1-4c18-a280-e2c990877b81-istio-podinfo\") pod \"e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j\" (UID: \"64a98122-fad1-4c18-a280-e2c990877b81\") " pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j"
Jul 28 01:43:18.879920 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:18.879926    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64a98122-fad1-4c18-a280-e2c990877b81-workload-certs\") pod \"e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j\" (UID: \"64a98122-fad1-4c18-a280-e2c990877b81\") " pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j"
Jul 28 01:43:18.880132 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:18.879959    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64a98122-fad1-4c18-a280-e2c990877b81-workload-socket\") pod \"e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j\" (UID: \"64a98122-fad1-4c18-a280-e2c990877b81\") " pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j"
Jul 28 01:43:18.880132 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:18.879989    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64a98122-fad1-4c18-a280-e2c990877b81-istio-envoy\") pod \"e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j\" (UID: \"64a98122-fad1-4c18-a280-e2c990877b81\") " pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j"
Jul 28 01:43:18.880132 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:18.880010    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b65n\" (UniqueName: \"kubernetes.io/projected/64a98122-fad1-4c18-a280-e2c990877b81-kube-api-access-8b65n\") pod \"e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j\" (UID: \"64a98122-fad1-4c18-a280-e2c990877b81\") " pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j"
Jul 28 01:43:18.880132 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:18.880075    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64a98122-fad1-4c18-a280-e2c990877b81-istio-token\") pod \"e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j\" (UID: \"64a98122-fad1-4c18-a280-e2c990877b81\") " pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j"
Jul 28 01:43:18.880132 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:18.880094    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64a98122-fad1-4c18-a280-e2c990877b81-credential-socket\") pod \"e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j\" (UID: \"64a98122-fad1-4c18-a280-e2c990877b81\") " pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j"
Jul 28 01:43:18.880132 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:18.880115    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64a98122-fad1-4c18-a280-e2c990877b81-istiod-ca-cert\") pod \"e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j\" (UID: \"64a98122-fad1-4c18-a280-e2c990877b81\") " pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j"
Jul 28 01:43:18.880322 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:18.880162    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64a98122-fad1-4c18-a280-e2c990877b81-istio-data\") pod \"e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j\" (UID: \"64a98122-fad1-4c18-a280-e2c990877b81\") " pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j"
Jul 28 01:43:18.981523 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:18.981484    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64a98122-fad1-4c18-a280-e2c990877b81-istio-data\") pod \"e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j\" (UID: \"64a98122-fad1-4c18-a280-e2c990877b81\") " pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j"
Jul 28 01:43:18.981718 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:18.981539    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64a98122-fad1-4c18-a280-e2c990877b81-istio-podinfo\") pod \"e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j\" (UID: \"64a98122-fad1-4c18-a280-e2c990877b81\") " pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j"
Jul 28 01:43:18.981718 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:18.981602    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64a98122-fad1-4c18-a280-e2c990877b81-workload-certs\") pod \"e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j\" (UID: \"64a98122-fad1-4c18-a280-e2c990877b81\") " pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j"
Jul 28 01:43:18.981718 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:18.981636    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64a98122-fad1-4c18-a280-e2c990877b81-workload-socket\") pod \"e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j\" (UID: \"64a98122-fad1-4c18-a280-e2c990877b81\") " pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j"
Jul 28 01:43:18.981718 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:18.981672    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64a98122-fad1-4c18-a280-e2c990877b81-istio-envoy\") pod \"e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j\" (UID: \"64a98122-fad1-4c18-a280-e2c990877b81\") " pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j"
Jul 28 01:43:18.981718 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:18.981704    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8b65n\" (UniqueName: \"kubernetes.io/projected/64a98122-fad1-4c18-a280-e2c990877b81-kube-api-access-8b65n\") pod \"e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j\" (UID: \"64a98122-fad1-4c18-a280-e2c990877b81\") " pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j"
Jul 28 01:43:18.981983 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:18.981762    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64a98122-fad1-4c18-a280-e2c990877b81-istio-token\") pod \"e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j\" (UID: \"64a98122-fad1-4c18-a280-e2c990877b81\") " pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j"
Jul 28 01:43:18.981983 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:18.981792    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64a98122-fad1-4c18-a280-e2c990877b81-credential-socket\") pod \"e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j\" (UID: \"64a98122-fad1-4c18-a280-e2c990877b81\") " pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j"
Jul 28 01:43:18.981983 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:18.981814    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64a98122-fad1-4c18-a280-e2c990877b81-istiod-ca-cert\") pod \"e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j\" (UID: \"64a98122-fad1-4c18-a280-e2c990877b81\") " pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j"
Jul 28 01:43:18.981983 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:18.981938    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64a98122-fad1-4c18-a280-e2c990877b81-istio-data\") pod \"e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j\" (UID: \"64a98122-fad1-4c18-a280-e2c990877b81\") " pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j"
Jul 28 01:43:18.981983 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:18.981954    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64a98122-fad1-4c18-a280-e2c990877b81-workload-certs\") pod \"e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j\" (UID: \"64a98122-fad1-4c18-a280-e2c990877b81\") " pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j"
Jul 28 01:43:18.982507 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:18.982483    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64a98122-fad1-4c18-a280-e2c990877b81-workload-socket\") pod \"e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j\" (UID: \"64a98122-fad1-4c18-a280-e2c990877b81\") " pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j"
Jul 28 01:43:18.982507 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:18.982496    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64a98122-fad1-4c18-a280-e2c990877b81-credential-socket\") pod \"e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j\" (UID: \"64a98122-fad1-4c18-a280-e2c990877b81\") " pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j"
Jul 28 01:43:18.982665 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:18.982526    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64a98122-fad1-4c18-a280-e2c990877b81-istiod-ca-cert\") pod \"e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j\" (UID: \"64a98122-fad1-4c18-a280-e2c990877b81\") " pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j"
Jul 28 01:43:18.984064 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:18.984034    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64a98122-fad1-4c18-a280-e2c990877b81-istio-podinfo\") pod \"e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j\" (UID: \"64a98122-fad1-4c18-a280-e2c990877b81\") " pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j"
Jul 28 01:43:18.984345 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:18.984325    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64a98122-fad1-4c18-a280-e2c990877b81-istio-envoy\") pod \"e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j\" (UID: \"64a98122-fad1-4c18-a280-e2c990877b81\") " pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j"
Jul 28 01:43:18.989217 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:18.989195    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64a98122-fad1-4c18-a280-e2c990877b81-istio-token\") pod \"e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j\" (UID: \"64a98122-fad1-4c18-a280-e2c990877b81\") " pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j"
Jul 28 01:43:18.989404 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:18.989380    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b65n\" (UniqueName: \"kubernetes.io/projected/64a98122-fad1-4c18-a280-e2c990877b81-kube-api-access-8b65n\") pod \"e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j\" (UID: \"64a98122-fad1-4c18-a280-e2c990877b81\") " pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j"
Jul 28 01:43:19.119398 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:19.119368    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j"
Jul 28 01:43:19.263042 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:19.263008    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j"]
Jul 28 01:43:19.264821 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:43:19.264789    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64a98122_fad1_4c18_a280_e2c990877b81.slice/crio-e1e7c0b5d78c3291f201de92c3b0acf02dc7c2d5fdf1aebaac18a80f4e349ee7 WatchSource:0}: Error finding container e1e7c0b5d78c3291f201de92c3b0acf02dc7c2d5fdf1aebaac18a80f4e349ee7: Status 404 returned error can't find the container with id e1e7c0b5d78c3291f201de92c3b0acf02dc7c2d5fdf1aebaac18a80f4e349ee7
Jul 28 01:43:19.267615 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:19.267535    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:43:19.267734 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:19.267698    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:43:19.267808 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:19.267755    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:43:19.476041 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:19.475941    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j" event={"ID":"64a98122-fad1-4c18-a280-e2c990877b81","Type":"ContainerStarted","Data":"bc5ddf3f9743698279e522dbeaedbafadb16571e9d6b0800006a12ce79738f51"}
Jul 28 01:43:19.476041 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:19.476033    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j" event={"ID":"64a98122-fad1-4c18-a280-e2c990877b81","Type":"ContainerStarted","Data":"e1e7c0b5d78c3291f201de92c3b0acf02dc7c2d5fdf1aebaac18a80f4e349ee7"}
Jul 28 01:43:19.495533 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:19.495477    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j" podStartSLOduration=1.49545736 podStartE2EDuration="1.49545736s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:43:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:43:19.492872606 +0000 UTC m=+1669.996633920" watchObservedRunningTime="2026-07-28 01:43:19.49545736 +0000 UTC m=+1669.999218674"
Jul 28 01:43:20.119496 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:20.119461    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j"
Jul 28 01:43:20.124082 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:20.124055    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j"
Jul 28 01:43:20.481117 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:20.481024    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j"
Jul 28 01:43:20.481807 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:20.481786    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j"
Jul 28 01:43:35.531926 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:35.531890    2562 patch_prober.go:28] interesting pod/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": read tcp 10.132.0.2:57870->10.132.0.55:15021: read: connection reset by peer" start-of-body=
Jul 28 01:43:35.532327 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:35.531960    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j" podUID="64a98122-fad1-4c18-a280-e2c990877b81" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": read tcp 10.132.0.2:57870->10.132.0.55:15021: read: connection reset by peer"
Jul 28 01:43:35.575300 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:35.575269    2562 generic.go:356] "Generic (PLEG): container finished" podID="64a98122-fad1-4c18-a280-e2c990877b81" containerID="bc5ddf3f9743698279e522dbeaedbafadb16571e9d6b0800006a12ce79738f51" exitCode=0
Jul 28 01:43:35.575454 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:35.575341    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j" event={"ID":"64a98122-fad1-4c18-a280-e2c990877b81","Type":"ContainerDied","Data":"bc5ddf3f9743698279e522dbeaedbafadb16571e9d6b0800006a12ce79738f51"}
Jul 28 01:43:35.575794 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:35.575780    2562 scope.go:117] "RemoveContainer" containerID="bc5ddf3f9743698279e522dbeaedbafadb16571e9d6b0800006a12ce79738f51"
Jul 28 01:43:35.576747 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:35.576724    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:43:35.576808 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:35.576794    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:43:35.576844 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:35.576824    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:43:36.582176 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:36.582143    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j" event={"ID":"64a98122-fad1-4c18-a280-e2c990877b81","Type":"ContainerStarted","Data":"d0d438f281b44a9f167c7eb9f0ee398f2447f210cd90c5a8c3598f4cf3dc2eeb"}
Jul 28 01:43:37.119714 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:37.119681    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j"
Jul 28 01:43:37.119936 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:37.119917    2562 patch_prober.go:28] interesting pod/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 28 01:43:37.119993 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:37.119974    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j" podUID="64a98122-fad1-4c18-a280-e2c990877b81" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 28 01:43:38.120295 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:38.120256    2562 patch_prober.go:28] interesting pod/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 28 01:43:38.120694 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:38.120327    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j" podUID="64a98122-fad1-4c18-a280-e2c990877b81" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 28 01:43:39.120381 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:39.120344    2562 patch_prober.go:28] interesting pod/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 28 01:43:39.120769 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:39.120397    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j" podUID="64a98122-fad1-4c18-a280-e2c990877b81" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 28 01:43:40.119912 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:40.119880    2562 patch_prober.go:28] interesting pod/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 28 01:43:40.120087 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:40.119949    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j" podUID="64a98122-fad1-4c18-a280-e2c990877b81" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 28 01:43:41.123511 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:41.123482    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j"
Jul 28 01:43:41.123879 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:41.123748    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j"
Jul 28 01:43:41.124370 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:41.124353    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j"
Jul 28 01:43:46.342810 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:46.342773    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9dc1294f-whmnq"]
Jul 28 01:43:46.345271 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:46.345256    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9dc1294f-whmnq"
Jul 28 01:43:46.347364 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:46.347344    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wjxvt\""
Jul 28 01:43:46.352421 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:46.352397    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9dc1294f-whmnq"]
Jul 28 01:43:46.444185 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:46.444145    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ace6fbc-1743-4ba2-a167-352e21e3afd0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9dc1294f-whmnq\" (UID: \"6ace6fbc-1743-4ba2-a167-352e21e3afd0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9dc1294f-whmnq"
Jul 28 01:43:46.544985 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:46.544951    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ace6fbc-1743-4ba2-a167-352e21e3afd0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9dc1294f-whmnq\" (UID: \"6ace6fbc-1743-4ba2-a167-352e21e3afd0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9dc1294f-whmnq"
Jul 28 01:43:46.545584 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:46.545539    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ace6fbc-1743-4ba2-a167-352e21e3afd0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9dc1294f-whmnq\" (UID: \"6ace6fbc-1743-4ba2-a167-352e21e3afd0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9dc1294f-whmnq"
Jul 28 01:43:46.658283 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:46.658257    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9dc1294f-whmnq"
Jul 28 01:43:46.793087 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:46.793056    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9dc1294f-whmnq"]
Jul 28 01:43:46.794318 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:43:46.794290    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ace6fbc_1743_4ba2_a167_352e21e3afd0.slice/crio-2b0dbcd8be95cf88cf6bed469206b9c7ead6bae90f6f0bc835f9e41492f87a96 WatchSource:0}: Error finding container 2b0dbcd8be95cf88cf6bed469206b9c7ead6bae90f6f0bc835f9e41492f87a96: Status 404 returned error can't find the container with id 2b0dbcd8be95cf88cf6bed469206b9c7ead6bae90f6f0bc835f9e41492f87a96
Jul 28 01:43:47.638859 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:47.638793    2562 generic.go:356] "Generic (PLEG): container finished" podID="6ace6fbc-1743-4ba2-a167-352e21e3afd0" containerID="04eb1385fa422871b37afb42c79ef28afafa4ea239e730d679f5294000d37da6" exitCode=0
Jul 28 01:43:47.639243 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:47.638876    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9dc1294f-whmnq" event={"ID":"6ace6fbc-1743-4ba2-a167-352e21e3afd0","Type":"ContainerDied","Data":"04eb1385fa422871b37afb42c79ef28afafa4ea239e730d679f5294000d37da6"}
Jul 28 01:43:47.639243 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:47.638926    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9dc1294f-whmnq" event={"ID":"6ace6fbc-1743-4ba2-a167-352e21e3afd0","Type":"ContainerStarted","Data":"2b0dbcd8be95cf88cf6bed469206b9c7ead6bae90f6f0bc835f9e41492f87a96"}
Jul 28 01:43:48.780227 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:48.780201    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9dc1294f-whmnq"
Jul 28 01:43:48.966093 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:48.966013    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ace6fbc-1743-4ba2-a167-352e21e3afd0-maas-api-service-ca\") pod \"6ace6fbc-1743-4ba2-a167-352e21e3afd0\" (UID: \"6ace6fbc-1743-4ba2-a167-352e21e3afd0\") "
Jul 28 01:43:48.966338 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:48.966313    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ace6fbc-1743-4ba2-a167-352e21e3afd0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6ace6fbc-1743-4ba2-a167-352e21e3afd0" (UID: "6ace6fbc-1743-4ba2-a167-352e21e3afd0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:43:49.067502 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:49.067469    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ace6fbc-1743-4ba2-a167-352e21e3afd0-maas-api-service-ca\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:43:49.650090 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:49.650060    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9dc1294f-whmnq"
Jul 28 01:43:49.650293 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:49.650098    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9dc1294f-whmnq" event={"ID":"6ace6fbc-1743-4ba2-a167-352e21e3afd0","Type":"ContainerDied","Data":"2b0dbcd8be95cf88cf6bed469206b9c7ead6bae90f6f0bc835f9e41492f87a96"}
Jul 28 01:43:49.650293 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:43:49.650146    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2b0dbcd8be95cf88cf6bed469206b9c7ead6bae90f6f0bc835f9e41492f87a96"
Jul 28 01:44:01.422844 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:01.422706    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9dc1294f-whmnq"]
Jul 28 01:44:01.424748 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:01.424726    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9dc1294f-whmnq"]
Jul 28 01:44:01.560009 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:01.559978    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j"]
Jul 28 01:44:01.560241 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:01.560218    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j" podUID="64a98122-fad1-4c18-a280-e2c990877b81" containerName="istio-proxy" containerID="cri-o://d0d438f281b44a9f167c7eb9f0ee398f2447f210cd90c5a8c3598f4cf3dc2eeb" gracePeriod=30
Jul 28 01:44:02.012975 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:02.012943    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ace6fbc-1743-4ba2-a167-352e21e3afd0" path="/var/lib/kubelet/pods/6ace6fbc-1743-4ba2-a167-352e21e3afd0/volumes"
Jul 28 01:44:02.808376 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:02.808343    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9"]
Jul 28 01:44:02.808797 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:02.808782    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ace6fbc-1743-4ba2-a167-352e21e3afd0" containerName="revoke-keys"
Jul 28 01:44:02.808848 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:02.808799    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ace6fbc-1743-4ba2-a167-352e21e3afd0" containerName="revoke-keys"
Jul 28 01:44:02.808882 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:02.808861    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ace6fbc-1743-4ba2-a167-352e21e3afd0" containerName="revoke-keys"
Jul 28 01:44:02.811819 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:02.811802    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9"
Jul 28 01:44:02.817003 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:02.816980    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-e887be66-gw-openshift-default-dockercfg-25krc\""
Jul 28 01:44:02.834331 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:02.834296    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9"]
Jul 28 01:44:02.889749 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:02.889717    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c23505a7-374c-4867-a956-3ee59344824d-workload-socket\") pod \"e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9\" (UID: \"c23505a7-374c-4867-a956-3ee59344824d\") " pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9"
Jul 28 01:44:02.889946 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:02.889757    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c23505a7-374c-4867-a956-3ee59344824d-istio-envoy\") pod \"e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9\" (UID: \"c23505a7-374c-4867-a956-3ee59344824d\") " pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9"
Jul 28 01:44:02.889946 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:02.889784    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c23505a7-374c-4867-a956-3ee59344824d-istio-token\") pod \"e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9\" (UID: \"c23505a7-374c-4867-a956-3ee59344824d\") " pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9"
Jul 28 01:44:02.889946 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:02.889802    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c23505a7-374c-4867-a956-3ee59344824d-istio-podinfo\") pod \"e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9\" (UID: \"c23505a7-374c-4867-a956-3ee59344824d\") " pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9"
Jul 28 01:44:02.889946 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:02.889849    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c23505a7-374c-4867-a956-3ee59344824d-istiod-ca-cert\") pod \"e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9\" (UID: \"c23505a7-374c-4867-a956-3ee59344824d\") " pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9"
Jul 28 01:44:02.889946 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:02.889897    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c23505a7-374c-4867-a956-3ee59344824d-credential-socket\") pod \"e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9\" (UID: \"c23505a7-374c-4867-a956-3ee59344824d\") " pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9"
Jul 28 01:44:02.889946 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:02.889934    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c23505a7-374c-4867-a956-3ee59344824d-istio-data\") pod \"e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9\" (UID: \"c23505a7-374c-4867-a956-3ee59344824d\") " pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9"
Jul 28 01:44:02.890294 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:02.889961    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22hlz\" (UniqueName: \"kubernetes.io/projected/c23505a7-374c-4867-a956-3ee59344824d-kube-api-access-22hlz\") pod \"e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9\" (UID: \"c23505a7-374c-4867-a956-3ee59344824d\") " pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9"
Jul 28 01:44:02.890294 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:02.890036    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c23505a7-374c-4867-a956-3ee59344824d-workload-certs\") pod \"e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9\" (UID: \"c23505a7-374c-4867-a956-3ee59344824d\") " pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9"
Jul 28 01:44:02.990867 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:02.990836    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c23505a7-374c-4867-a956-3ee59344824d-istio-token\") pod \"e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9\" (UID: \"c23505a7-374c-4867-a956-3ee59344824d\") " pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9"
Jul 28 01:44:02.990867 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:02.990873    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c23505a7-374c-4867-a956-3ee59344824d-istio-podinfo\") pod \"e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9\" (UID: \"c23505a7-374c-4867-a956-3ee59344824d\") " pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9"
Jul 28 01:44:02.991129 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:02.990897    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c23505a7-374c-4867-a956-3ee59344824d-istiod-ca-cert\") pod \"e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9\" (UID: \"c23505a7-374c-4867-a956-3ee59344824d\") " pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9"
Jul 28 01:44:02.991129 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:02.990930    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c23505a7-374c-4867-a956-3ee59344824d-credential-socket\") pod \"e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9\" (UID: \"c23505a7-374c-4867-a956-3ee59344824d\") " pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9"
Jul 28 01:44:02.991129 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:02.990959    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c23505a7-374c-4867-a956-3ee59344824d-istio-data\") pod \"e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9\" (UID: \"c23505a7-374c-4867-a956-3ee59344824d\") " pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9"
Jul 28 01:44:02.991129 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:02.990993    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22hlz\" (UniqueName: \"kubernetes.io/projected/c23505a7-374c-4867-a956-3ee59344824d-kube-api-access-22hlz\") pod \"e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9\" (UID: \"c23505a7-374c-4867-a956-3ee59344824d\") " pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9"
Jul 28 01:44:02.991129 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:02.991060    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c23505a7-374c-4867-a956-3ee59344824d-workload-certs\") pod \"e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9\" (UID: \"c23505a7-374c-4867-a956-3ee59344824d\") " pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9"
Jul 28 01:44:02.991129 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:02.991121    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c23505a7-374c-4867-a956-3ee59344824d-workload-socket\") pod \"e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9\" (UID: \"c23505a7-374c-4867-a956-3ee59344824d\") " pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9"
Jul 28 01:44:02.991438 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:02.991158    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c23505a7-374c-4867-a956-3ee59344824d-istio-envoy\") pod \"e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9\" (UID: \"c23505a7-374c-4867-a956-3ee59344824d\") " pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9"
Jul 28 01:44:02.991501 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:02.991464    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c23505a7-374c-4867-a956-3ee59344824d-istio-data\") pod \"e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9\" (UID: \"c23505a7-374c-4867-a956-3ee59344824d\") " pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9"
Jul 28 01:44:02.991573 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:02.991467    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c23505a7-374c-4867-a956-3ee59344824d-workload-certs\") pod \"e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9\" (UID: \"c23505a7-374c-4867-a956-3ee59344824d\") " pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9"
Jul 28 01:44:02.991573 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:02.991519    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c23505a7-374c-4867-a956-3ee59344824d-workload-socket\") pod \"e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9\" (UID: \"c23505a7-374c-4867-a956-3ee59344824d\") " pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9"
Jul 28 01:44:02.991720 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:02.991699    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c23505a7-374c-4867-a956-3ee59344824d-credential-socket\") pod \"e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9\" (UID: \"c23505a7-374c-4867-a956-3ee59344824d\") " pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9"
Jul 28 01:44:02.991970 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:02.991943    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c23505a7-374c-4867-a956-3ee59344824d-istiod-ca-cert\") pod \"e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9\" (UID: \"c23505a7-374c-4867-a956-3ee59344824d\") " pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9"
Jul 28 01:44:02.993450 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:02.993397    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c23505a7-374c-4867-a956-3ee59344824d-istio-envoy\") pod \"e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9\" (UID: \"c23505a7-374c-4867-a956-3ee59344824d\") " pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9"
Jul 28 01:44:02.993773 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:02.993753    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c23505a7-374c-4867-a956-3ee59344824d-istio-podinfo\") pod \"e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9\" (UID: \"c23505a7-374c-4867-a956-3ee59344824d\") " pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9"
Jul 28 01:44:02.998527 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:02.998505    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c23505a7-374c-4867-a956-3ee59344824d-istio-token\") pod \"e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9\" (UID: \"c23505a7-374c-4867-a956-3ee59344824d\") " pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9"
Jul 28 01:44:02.998888 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:02.998871    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22hlz\" (UniqueName: \"kubernetes.io/projected/c23505a7-374c-4867-a956-3ee59344824d-kube-api-access-22hlz\") pod \"e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9\" (UID: \"c23505a7-374c-4867-a956-3ee59344824d\") " pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9"
Jul 28 01:44:03.122512 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:03.122482    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9"
Jul 28 01:44:03.263421 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:03.263390    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9"]
Jul 28 01:44:03.265947 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:44:03.265921    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc23505a7_374c_4867_a956_3ee59344824d.slice/crio-57ddbd46f8e3fa3c48dc08de70c149320fa68a6a9cab9db1c690c61b762f2f29 WatchSource:0}: Error finding container 57ddbd46f8e3fa3c48dc08de70c149320fa68a6a9cab9db1c690c61b762f2f29: Status 404 returned error can't find the container with id 57ddbd46f8e3fa3c48dc08de70c149320fa68a6a9cab9db1c690c61b762f2f29
Jul 28 01:44:03.268532 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:03.268498    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:44:03.268655 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:03.268592    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:44:03.268655 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:03.268643    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:44:03.722462 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:03.722430    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9" event={"ID":"c23505a7-374c-4867-a956-3ee59344824d","Type":"ContainerStarted","Data":"0e6a3437dbcab249b4cc9bf227f4bf4d04cb000c8245260eebbc2d8564f4f49f"}
Jul 28 01:44:03.722656 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:03.722484    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9" event={"ID":"c23505a7-374c-4867-a956-3ee59344824d","Type":"ContainerStarted","Data":"57ddbd46f8e3fa3c48dc08de70c149320fa68a6a9cab9db1c690c61b762f2f29"}
Jul 28 01:44:03.741732 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:03.741681    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9" podStartSLOduration=1.7416644589999999 podStartE2EDuration="1.741664459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:44:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:44:03.740685491 +0000 UTC m=+1714.244446815" watchObservedRunningTime="2026-07-28 01:44:03.741664459 +0000 UTC m=+1714.245425771"
Jul 28 01:44:04.122861 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:04.122827    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9"
Jul 28 01:44:04.128202 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:04.128180    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9"
Jul 28 01:44:04.727166 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:04.727140    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9"
Jul 28 01:44:04.728012 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:04.727992    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9"
Jul 28 01:44:06.742446 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:06.742414    2562 generic.go:356] "Generic (PLEG): container finished" podID="64a98122-fad1-4c18-a280-e2c990877b81" containerID="d0d438f281b44a9f167c7eb9f0ee398f2447f210cd90c5a8c3598f4cf3dc2eeb" exitCode=0
Jul 28 01:44:06.742961 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:06.742489    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j" event={"ID":"64a98122-fad1-4c18-a280-e2c990877b81","Type":"ContainerDied","Data":"d0d438f281b44a9f167c7eb9f0ee398f2447f210cd90c5a8c3598f4cf3dc2eeb"}
Jul 28 01:44:06.742961 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:06.742577    2562 scope.go:117] "RemoveContainer" containerID="bc5ddf3f9743698279e522dbeaedbafadb16571e9d6b0800006a12ce79738f51"
Jul 28 01:44:06.824168 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:06.824110    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j"
Jul 28 01:44:06.928181 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:06.928150    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8b65n\" (UniqueName: \"kubernetes.io/projected/64a98122-fad1-4c18-a280-e2c990877b81-kube-api-access-8b65n\") pod \"64a98122-fad1-4c18-a280-e2c990877b81\" (UID: \"64a98122-fad1-4c18-a280-e2c990877b81\") "
Jul 28 01:44:06.928181 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:06.928190    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64a98122-fad1-4c18-a280-e2c990877b81-istio-podinfo\") pod \"64a98122-fad1-4c18-a280-e2c990877b81\" (UID: \"64a98122-fad1-4c18-a280-e2c990877b81\") "
Jul 28 01:44:06.928437 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:06.928207    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64a98122-fad1-4c18-a280-e2c990877b81-istio-data\") pod \"64a98122-fad1-4c18-a280-e2c990877b81\" (UID: \"64a98122-fad1-4c18-a280-e2c990877b81\") "
Jul 28 01:44:06.928437 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:06.928232    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64a98122-fad1-4c18-a280-e2c990877b81-istio-envoy\") pod \"64a98122-fad1-4c18-a280-e2c990877b81\" (UID: \"64a98122-fad1-4c18-a280-e2c990877b81\") "
Jul 28 01:44:06.928437 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:06.928258    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64a98122-fad1-4c18-a280-e2c990877b81-credential-socket\") pod \"64a98122-fad1-4c18-a280-e2c990877b81\" (UID: \"64a98122-fad1-4c18-a280-e2c990877b81\") "
Jul 28 01:44:06.928437 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:06.928294    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64a98122-fad1-4c18-a280-e2c990877b81-workload-certs\") pod \"64a98122-fad1-4c18-a280-e2c990877b81\" (UID: \"64a98122-fad1-4c18-a280-e2c990877b81\") "
Jul 28 01:44:06.928437 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:06.928317    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64a98122-fad1-4c18-a280-e2c990877b81-istiod-ca-cert\") pod \"64a98122-fad1-4c18-a280-e2c990877b81\" (UID: \"64a98122-fad1-4c18-a280-e2c990877b81\") "
Jul 28 01:44:06.928437 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:06.928355    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64a98122-fad1-4c18-a280-e2c990877b81-workload-socket\") pod \"64a98122-fad1-4c18-a280-e2c990877b81\" (UID: \"64a98122-fad1-4c18-a280-e2c990877b81\") "
Jul 28 01:44:06.928778 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:06.928646    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64a98122-fad1-4c18-a280-e2c990877b81-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "64a98122-fad1-4c18-a280-e2c990877b81" (UID: "64a98122-fad1-4c18-a280-e2c990877b81"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:44:06.928778 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:06.928673    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64a98122-fad1-4c18-a280-e2c990877b81-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "64a98122-fad1-4c18-a280-e2c990877b81" (UID: "64a98122-fad1-4c18-a280-e2c990877b81"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:44:06.928778 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:06.928767    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64a98122-fad1-4c18-a280-e2c990877b81-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "64a98122-fad1-4c18-a280-e2c990877b81" (UID: "64a98122-fad1-4c18-a280-e2c990877b81"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:44:06.928924 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:06.928825    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64a98122-fad1-4c18-a280-e2c990877b81-istio-token\") pod \"64a98122-fad1-4c18-a280-e2c990877b81\" (UID: \"64a98122-fad1-4c18-a280-e2c990877b81\") "
Jul 28 01:44:06.928924 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:06.928892    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64a98122-fad1-4c18-a280-e2c990877b81-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "64a98122-fad1-4c18-a280-e2c990877b81" (UID: "64a98122-fad1-4c18-a280-e2c990877b81"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:44:06.929151 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:06.929127    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64a98122-fad1-4c18-a280-e2c990877b81-credential-socket\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:44:06.929151 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:06.929153    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64a98122-fad1-4c18-a280-e2c990877b81-workload-certs\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:44:06.929358 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:06.929165    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64a98122-fad1-4c18-a280-e2c990877b81-istiod-ca-cert\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:44:06.929358 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:06.929177    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64a98122-fad1-4c18-a280-e2c990877b81-workload-socket\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:44:06.929467 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:06.929381    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64a98122-fad1-4c18-a280-e2c990877b81-istio-data" (OuterVolumeSpecName: "istio-data") pod "64a98122-fad1-4c18-a280-e2c990877b81" (UID: "64a98122-fad1-4c18-a280-e2c990877b81"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:44:06.932153 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:06.932026    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64a98122-fad1-4c18-a280-e2c990877b81-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "64a98122-fad1-4c18-a280-e2c990877b81" (UID: "64a98122-fad1-4c18-a280-e2c990877b81"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:44:06.932153 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:06.932122    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64a98122-fad1-4c18-a280-e2c990877b81-kube-api-access-8b65n" (OuterVolumeSpecName: "kube-api-access-8b65n") pod "64a98122-fad1-4c18-a280-e2c990877b81" (UID: "64a98122-fad1-4c18-a280-e2c990877b81"). InnerVolumeSpecName "kube-api-access-8b65n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:44:06.932429 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:06.932404    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/64a98122-fad1-4c18-a280-e2c990877b81-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "64a98122-fad1-4c18-a280-e2c990877b81" (UID: "64a98122-fad1-4c18-a280-e2c990877b81"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 01:44:06.932541 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:06.932523    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64a98122-fad1-4c18-a280-e2c990877b81-istio-token" (OuterVolumeSpecName: "istio-token") pod "64a98122-fad1-4c18-a280-e2c990877b81" (UID: "64a98122-fad1-4c18-a280-e2c990877b81"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:44:07.029924 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:07.029888    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64a98122-fad1-4c18-a280-e2c990877b81-istio-token\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:44:07.029924 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:07.029922    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8b65n\" (UniqueName: \"kubernetes.io/projected/64a98122-fad1-4c18-a280-e2c990877b81-kube-api-access-8b65n\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:44:07.029924 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:07.029938    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64a98122-fad1-4c18-a280-e2c990877b81-istio-podinfo\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:44:07.030232 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:07.029951    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64a98122-fad1-4c18-a280-e2c990877b81-istio-data\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:44:07.030232 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:07.029965    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64a98122-fad1-4c18-a280-e2c990877b81-istio-envoy\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:44:07.748605 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:07.748578    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j"
Jul 28 01:44:07.748605 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:07.748584    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j" event={"ID":"64a98122-fad1-4c18-a280-e2c990877b81","Type":"ContainerDied","Data":"e1e7c0b5d78c3291f201de92c3b0acf02dc7c2d5fdf1aebaac18a80f4e349ee7"}
Jul 28 01:44:07.749093 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:07.748648    2562 scope.go:117] "RemoveContainer" containerID="d0d438f281b44a9f167c7eb9f0ee398f2447f210cd90c5a8c3598f4cf3dc2eeb"
Jul 28 01:44:07.768700 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:07.768672    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j"]
Jul 28 01:44:07.773028 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:07.773006    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-9dc1294f-openshift-default-7488968868-sgq7j"]
Jul 28 01:44:08.014167 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:08.014084    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64a98122-fad1-4c18-a280-e2c990877b81" path="/var/lib/kubelet/pods/64a98122-fad1-4c18-a280-e2c990877b81/volumes"
Jul 28 01:44:19.728778 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:19.728686    2562 patch_prober.go:28] interesting pod/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 28 01:44:19.728778 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:19.728758    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9" podUID="c23505a7-374c-4867-a956-3ee59344824d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 28 01:44:19.818976 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:19.818939    2562 generic.go:356] "Generic (PLEG): container finished" podID="c23505a7-374c-4867-a956-3ee59344824d" containerID="0e6a3437dbcab249b4cc9bf227f4bf4d04cb000c8245260eebbc2d8564f4f49f" exitCode=0
Jul 28 01:44:19.818976 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:19.818979    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9" event={"ID":"c23505a7-374c-4867-a956-3ee59344824d","Type":"ContainerDied","Data":"0e6a3437dbcab249b4cc9bf227f4bf4d04cb000c8245260eebbc2d8564f4f49f"}
Jul 28 01:44:19.819422 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:19.819398    2562 scope.go:117] "RemoveContainer" containerID="0e6a3437dbcab249b4cc9bf227f4bf4d04cb000c8245260eebbc2d8564f4f49f"
Jul 28 01:44:19.820461 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:19.820431    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:44:19.820520 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:19.820500    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:44:19.820583 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:19.820537    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:44:20.826411 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:20.826374    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9" event={"ID":"c23505a7-374c-4867-a956-3ee59344824d","Type":"ContainerStarted","Data":"6bccec4b254d198aa3537cd133d81de99a0840022b3c921219bc970c1bedf421"}
Jul 28 01:44:21.123438 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:21.123399    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9"
Jul 28 01:44:21.123717 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:21.123692    2562 patch_prober.go:28] interesting pod/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 28 01:44:21.123811 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:21.123759    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9" podUID="c23505a7-374c-4867-a956-3ee59344824d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 28 01:44:22.123405 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:22.123368    2562 patch_prober.go:28] interesting pod/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 28 01:44:22.123841 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:22.123467    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9" podUID="c23505a7-374c-4867-a956-3ee59344824d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 28 01:44:23.123164 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:23.123124    2562 patch_prober.go:28] interesting pod/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 28 01:44:23.123346 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:23.123177    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9" podUID="c23505a7-374c-4867-a956-3ee59344824d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 28 01:44:24.123515 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:24.123484    2562 patch_prober.go:28] interesting pod/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 28 01:44:24.123920 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:24.123532    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9" podUID="c23505a7-374c-4867-a956-3ee59344824d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 28 01:44:25.127330 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:25.127296    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9"
Jul 28 01:44:25.127716 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:25.127586    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9"
Jul 28 01:44:25.128354 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:25.128336    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9"
Jul 28 01:44:30.253301 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:30.253264    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e887be66-5lrn4"]
Jul 28 01:44:30.253704 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:30.253691    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64a98122-fad1-4c18-a280-e2c990877b81" containerName="istio-proxy"
Jul 28 01:44:30.253761 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:30.253706    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="64a98122-fad1-4c18-a280-e2c990877b81" containerName="istio-proxy"
Jul 28 01:44:30.253797 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:30.253785    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="64a98122-fad1-4c18-a280-e2c990877b81" containerName="istio-proxy"
Jul 28 01:44:30.256714 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:30.256699    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e887be66-5lrn4"
Jul 28 01:44:30.258606 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:30.258584    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wjxvt\""
Jul 28 01:44:30.263767 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:30.263689    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e887be66-5lrn4"]
Jul 28 01:44:30.347008 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:30.346972    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0a8eaf9-437b-4828-a62d-3c2d45727f23-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-e887be66-5lrn4\" (UID: \"a0a8eaf9-437b-4828-a62d-3c2d45727f23\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e887be66-5lrn4"
Jul 28 01:44:30.447901 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:30.447816    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0a8eaf9-437b-4828-a62d-3c2d45727f23-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-e887be66-5lrn4\" (UID: \"a0a8eaf9-437b-4828-a62d-3c2d45727f23\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e887be66-5lrn4"
Jul 28 01:44:30.448461 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:30.448441    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0a8eaf9-437b-4828-a62d-3c2d45727f23-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-e887be66-5lrn4\" (UID: \"a0a8eaf9-437b-4828-a62d-3c2d45727f23\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e887be66-5lrn4"
Jul 28 01:44:30.570541 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:30.570504    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e887be66-5lrn4"
Jul 28 01:44:30.710724 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:30.710699    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e887be66-5lrn4"]
Jul 28 01:44:30.712841 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:44:30.712811    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0a8eaf9_437b_4828_a62d_3c2d45727f23.slice/crio-ad4a49b905f01b2b7a2bfc5492bd6ee2d3ecc54806f76e00ba7a97fa5b16dfc4 WatchSource:0}: Error finding container ad4a49b905f01b2b7a2bfc5492bd6ee2d3ecc54806f76e00ba7a97fa5b16dfc4: Status 404 returned error can't find the container with id ad4a49b905f01b2b7a2bfc5492bd6ee2d3ecc54806f76e00ba7a97fa5b16dfc4
Jul 28 01:44:30.890979 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:30.890945    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e887be66-5lrn4" event={"ID":"a0a8eaf9-437b-4828-a62d-3c2d45727f23","Type":"ContainerStarted","Data":"ad4a49b905f01b2b7a2bfc5492bd6ee2d3ecc54806f76e00ba7a97fa5b16dfc4"}
Jul 28 01:44:31.897617 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:31.897584    2562 generic.go:356] "Generic (PLEG): container finished" podID="a0a8eaf9-437b-4828-a62d-3c2d45727f23" containerID="5cef1ec14bd336a356038f447404be7df3bfaea9e4eb16c231a677cd94326aab" exitCode=0
Jul 28 01:44:31.898037 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:31.897630    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e887be66-5lrn4" event={"ID":"a0a8eaf9-437b-4828-a62d-3c2d45727f23","Type":"ContainerDied","Data":"5cef1ec14bd336a356038f447404be7df3bfaea9e4eb16c231a677cd94326aab"}
Jul 28 01:44:33.047887 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:33.047862    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e887be66-5lrn4"
Jul 28 01:44:33.171464 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:33.171382    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0a8eaf9-437b-4828-a62d-3c2d45727f23-maas-api-service-ca\") pod \"a0a8eaf9-437b-4828-a62d-3c2d45727f23\" (UID: \"a0a8eaf9-437b-4828-a62d-3c2d45727f23\") "
Jul 28 01:44:33.171773 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:33.171749    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0a8eaf9-437b-4828-a62d-3c2d45727f23-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a0a8eaf9-437b-4828-a62d-3c2d45727f23" (UID: "a0a8eaf9-437b-4828-a62d-3c2d45727f23"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:44:33.272624 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:33.272588    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0a8eaf9-437b-4828-a62d-3c2d45727f23-maas-api-service-ca\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:44:33.909810 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:33.909780    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e887be66-5lrn4"
Jul 28 01:44:33.909994 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:33.909825    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e887be66-5lrn4" event={"ID":"a0a8eaf9-437b-4828-a62d-3c2d45727f23","Type":"ContainerDied","Data":"ad4a49b905f01b2b7a2bfc5492bd6ee2d3ecc54806f76e00ba7a97fa5b16dfc4"}
Jul 28 01:44:33.909994 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:33.909880    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ad4a49b905f01b2b7a2bfc5492bd6ee2d3ecc54806f76e00ba7a97fa5b16dfc4"
Jul 28 01:44:45.334955 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:45.334915    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e887be66-5lrn4"]
Jul 28 01:44:45.336929 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:45.336893    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e887be66-5lrn4"]
Jul 28 01:44:45.467701 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:45.467671    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9"]
Jul 28 01:44:45.467963 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:45.467938    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9" podUID="c23505a7-374c-4867-a956-3ee59344824d" containerName="istio-proxy" containerID="cri-o://6bccec4b254d198aa3537cd133d81de99a0840022b3c921219bc970c1bedf421" gracePeriod=30
Jul 28 01:44:46.013460 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:46.013423    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0a8eaf9-437b-4828-a62d-3c2d45727f23" path="/var/lib/kubelet/pods/a0a8eaf9-437b-4828-a62d-3c2d45727f23/volumes"
Jul 28 01:44:46.212805 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:46.212772    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb"]
Jul 28 01:44:46.213203 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:46.213189    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0a8eaf9-437b-4828-a62d-3c2d45727f23" containerName="revoke-keys"
Jul 28 01:44:46.213203 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:46.213203    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0a8eaf9-437b-4828-a62d-3c2d45727f23" containerName="revoke-keys"
Jul 28 01:44:46.213294 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:46.213225    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64a98122-fad1-4c18-a280-e2c990877b81" containerName="istio-proxy"
Jul 28 01:44:46.213294 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:46.213231    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="64a98122-fad1-4c18-a280-e2c990877b81" containerName="istio-proxy"
Jul 28 01:44:46.213294 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:46.213289    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="64a98122-fad1-4c18-a280-e2c990877b81" containerName="istio-proxy"
Jul 28 01:44:46.213385 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:46.213300    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0a8eaf9-437b-4828-a62d-3c2d45727f23" containerName="revoke-keys"
Jul 28 01:44:46.217206 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:46.217183    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb"
Jul 28 01:44:46.219211 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:46.219190    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-1c712754-openshift-default-dockercfg-qqlhx\""
Jul 28 01:44:46.229526 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:46.229478    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb"]
Jul 28 01:44:46.292977 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:46.292887    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73d75776-8be7-4e88-aca4-04aaea9a6cd7-istio-data\") pod \"e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb\" (UID: \"73d75776-8be7-4e88-aca4-04aaea9a6cd7\") " pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb"
Jul 28 01:44:46.292977 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:46.292917    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73d75776-8be7-4e88-aca4-04aaea9a6cd7-istio-podinfo\") pod \"e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb\" (UID: \"73d75776-8be7-4e88-aca4-04aaea9a6cd7\") " pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb"
Jul 28 01:44:46.292977 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:46.292937    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73d75776-8be7-4e88-aca4-04aaea9a6cd7-istio-token\") pod \"e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb\" (UID: \"73d75776-8be7-4e88-aca4-04aaea9a6cd7\") " pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb"
Jul 28 01:44:46.292977 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:46.292961    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73d75776-8be7-4e88-aca4-04aaea9a6cd7-workload-certs\") pod \"e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb\" (UID: \"73d75776-8be7-4e88-aca4-04aaea9a6cd7\") " pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb"
Jul 28 01:44:46.293290 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:46.293044    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73d75776-8be7-4e88-aca4-04aaea9a6cd7-workload-socket\") pod \"e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb\" (UID: \"73d75776-8be7-4e88-aca4-04aaea9a6cd7\") " pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb"
Jul 28 01:44:46.293290 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:46.293079    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgnjc\" (UniqueName: \"kubernetes.io/projected/73d75776-8be7-4e88-aca4-04aaea9a6cd7-kube-api-access-lgnjc\") pod \"e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb\" (UID: \"73d75776-8be7-4e88-aca4-04aaea9a6cd7\") " pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb"
Jul 28 01:44:46.293290 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:46.293102    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73d75776-8be7-4e88-aca4-04aaea9a6cd7-istiod-ca-cert\") pod \"e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb\" (UID: \"73d75776-8be7-4e88-aca4-04aaea9a6cd7\") " pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb"
Jul 28 01:44:46.293290 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:46.293131    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73d75776-8be7-4e88-aca4-04aaea9a6cd7-credential-socket\") pod \"e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb\" (UID: \"73d75776-8be7-4e88-aca4-04aaea9a6cd7\") " pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb"
Jul 28 01:44:46.293290 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:46.293151    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73d75776-8be7-4e88-aca4-04aaea9a6cd7-istio-envoy\") pod \"e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb\" (UID: \"73d75776-8be7-4e88-aca4-04aaea9a6cd7\") " pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb"
Jul 28 01:44:46.393938 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:46.393893    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73d75776-8be7-4e88-aca4-04aaea9a6cd7-istio-data\") pod \"e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb\" (UID: \"73d75776-8be7-4e88-aca4-04aaea9a6cd7\") " pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb"
Jul 28 01:44:46.393938 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:46.393930    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73d75776-8be7-4e88-aca4-04aaea9a6cd7-istio-podinfo\") pod \"e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb\" (UID: \"73d75776-8be7-4e88-aca4-04aaea9a6cd7\") " pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb"
Jul 28 01:44:46.393938 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:46.393948    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73d75776-8be7-4e88-aca4-04aaea9a6cd7-istio-token\") pod \"e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb\" (UID: \"73d75776-8be7-4e88-aca4-04aaea9a6cd7\") " pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb"
Jul 28 01:44:46.394530 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:46.393968    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73d75776-8be7-4e88-aca4-04aaea9a6cd7-workload-certs\") pod \"e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb\" (UID: \"73d75776-8be7-4e88-aca4-04aaea9a6cd7\") " pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb"
Jul 28 01:44:46.394530 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:46.394001    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73d75776-8be7-4e88-aca4-04aaea9a6cd7-workload-socket\") pod \"e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb\" (UID: \"73d75776-8be7-4e88-aca4-04aaea9a6cd7\") " pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb"
Jul 28 01:44:46.394530 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:46.394031    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgnjc\" (UniqueName: \"kubernetes.io/projected/73d75776-8be7-4e88-aca4-04aaea9a6cd7-kube-api-access-lgnjc\") pod \"e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb\" (UID: \"73d75776-8be7-4e88-aca4-04aaea9a6cd7\") " pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb"
Jul 28 01:44:46.394530 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:46.394055    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73d75776-8be7-4e88-aca4-04aaea9a6cd7-istiod-ca-cert\") pod \"e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb\" (UID: \"73d75776-8be7-4e88-aca4-04aaea9a6cd7\") " pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb"
Jul 28 01:44:46.394530 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:46.394096    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73d75776-8be7-4e88-aca4-04aaea9a6cd7-credential-socket\") pod \"e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb\" (UID: \"73d75776-8be7-4e88-aca4-04aaea9a6cd7\") " pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb"
Jul 28 01:44:46.394530 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:46.394127    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73d75776-8be7-4e88-aca4-04aaea9a6cd7-istio-envoy\") pod \"e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb\" (UID: \"73d75776-8be7-4e88-aca4-04aaea9a6cd7\") " pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb"
Jul 28 01:44:46.394530 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:46.394487    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73d75776-8be7-4e88-aca4-04aaea9a6cd7-workload-certs\") pod \"e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb\" (UID: \"73d75776-8be7-4e88-aca4-04aaea9a6cd7\") " pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb"
Jul 28 01:44:46.394900 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:46.394551    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73d75776-8be7-4e88-aca4-04aaea9a6cd7-workload-socket\") pod \"e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb\" (UID: \"73d75776-8be7-4e88-aca4-04aaea9a6cd7\") " pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb"
Jul 28 01:44:46.394900 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:46.394772    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73d75776-8be7-4e88-aca4-04aaea9a6cd7-istio-data\") pod \"e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb\" (UID: \"73d75776-8be7-4e88-aca4-04aaea9a6cd7\") " pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb"
Jul 28 01:44:46.394900 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:46.394808    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73d75776-8be7-4e88-aca4-04aaea9a6cd7-credential-socket\") pod \"e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb\" (UID: \"73d75776-8be7-4e88-aca4-04aaea9a6cd7\") " pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb"
Jul 28 01:44:46.395111 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:46.395088    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73d75776-8be7-4e88-aca4-04aaea9a6cd7-istiod-ca-cert\") pod \"e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb\" (UID: \"73d75776-8be7-4e88-aca4-04aaea9a6cd7\") " pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb"
Jul 28 01:44:46.396401 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:46.396370    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73d75776-8be7-4e88-aca4-04aaea9a6cd7-istio-envoy\") pod \"e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb\" (UID: \"73d75776-8be7-4e88-aca4-04aaea9a6cd7\") " pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb"
Jul 28 01:44:46.396545 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:46.396512    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73d75776-8be7-4e88-aca4-04aaea9a6cd7-istio-podinfo\") pod \"e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb\" (UID: \"73d75776-8be7-4e88-aca4-04aaea9a6cd7\") " pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb"
Jul 28 01:44:46.400839 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:46.400806    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73d75776-8be7-4e88-aca4-04aaea9a6cd7-istio-token\") pod \"e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb\" (UID: \"73d75776-8be7-4e88-aca4-04aaea9a6cd7\") " pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb"
Jul 28 01:44:46.401035 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:46.401014    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgnjc\" (UniqueName: \"kubernetes.io/projected/73d75776-8be7-4e88-aca4-04aaea9a6cd7-kube-api-access-lgnjc\") pod \"e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb\" (UID: \"73d75776-8be7-4e88-aca4-04aaea9a6cd7\") " pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb"
Jul 28 01:44:46.530923 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:46.530887    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb"
Jul 28 01:44:46.671213 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:46.671184    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb"]
Jul 28 01:44:46.672893 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:44:46.672864    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73d75776_8be7_4e88_aca4_04aaea9a6cd7.slice/crio-428d4ad7d69362256f9196e19bdd06d320f2d08e5694a8461a2c7701d3f9172d WatchSource:0}: Error finding container 428d4ad7d69362256f9196e19bdd06d320f2d08e5694a8461a2c7701d3f9172d: Status 404 returned error can't find the container with id 428d4ad7d69362256f9196e19bdd06d320f2d08e5694a8461a2c7701d3f9172d
Jul 28 01:44:46.675158 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:46.675126    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:44:46.675246 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:46.675194    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:44:46.675246 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:46.675226    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:44:46.981225 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:46.981188    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb" event={"ID":"73d75776-8be7-4e88-aca4-04aaea9a6cd7","Type":"ContainerStarted","Data":"df941c7b040962448643d7f4b11cc8366d4d46fcb9d891f85cee5a474b27ff7b"}
Jul 28 01:44:46.981400 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:46.981256    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb" event={"ID":"73d75776-8be7-4e88-aca4-04aaea9a6cd7","Type":"ContainerStarted","Data":"428d4ad7d69362256f9196e19bdd06d320f2d08e5694a8461a2c7701d3f9172d"}
Jul 28 01:44:46.999823 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:46.999779    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb" podStartSLOduration=0.999765531 podStartE2EDuration="999.765531ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:44:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:44:46.998836804 +0000 UTC m=+1757.502598143" watchObservedRunningTime="2026-07-28 01:44:46.999765531 +0000 UTC m=+1757.503526843"
Jul 28 01:44:47.531614 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:47.531571    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb"
Jul 28 01:44:47.536197 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:47.536172    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb"
Jul 28 01:44:47.987333 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:47.987301    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb"
Jul 28 01:44:47.988297 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:47.988273    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb"
Jul 28 01:44:50.720741 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:50.720712    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9"
Jul 28 01:44:50.836476 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:50.836388    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c23505a7-374c-4867-a956-3ee59344824d-istio-token\") pod \"c23505a7-374c-4867-a956-3ee59344824d\" (UID: \"c23505a7-374c-4867-a956-3ee59344824d\") "
Jul 28 01:44:50.836476 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:50.836427    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c23505a7-374c-4867-a956-3ee59344824d-istio-podinfo\") pod \"c23505a7-374c-4867-a956-3ee59344824d\" (UID: \"c23505a7-374c-4867-a956-3ee59344824d\") "
Jul 28 01:44:50.836476 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:50.836456    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c23505a7-374c-4867-a956-3ee59344824d-credential-socket\") pod \"c23505a7-374c-4867-a956-3ee59344824d\" (UID: \"c23505a7-374c-4867-a956-3ee59344824d\") "
Jul 28 01:44:50.836476 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:50.836475    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c23505a7-374c-4867-a956-3ee59344824d-workload-certs\") pod \"c23505a7-374c-4867-a956-3ee59344824d\" (UID: \"c23505a7-374c-4867-a956-3ee59344824d\") "
Jul 28 01:44:50.836868 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:50.836535    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c23505a7-374c-4867-a956-3ee59344824d-istio-data\") pod \"c23505a7-374c-4867-a956-3ee59344824d\" (UID: \"c23505a7-374c-4867-a956-3ee59344824d\") "
Jul 28 01:44:50.836868 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:50.836587    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c23505a7-374c-4867-a956-3ee59344824d-workload-socket\") pod \"c23505a7-374c-4867-a956-3ee59344824d\" (UID: \"c23505a7-374c-4867-a956-3ee59344824d\") "
Jul 28 01:44:50.836868 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:50.836611    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22hlz\" (UniqueName: \"kubernetes.io/projected/c23505a7-374c-4867-a956-3ee59344824d-kube-api-access-22hlz\") pod \"c23505a7-374c-4867-a956-3ee59344824d\" (UID: \"c23505a7-374c-4867-a956-3ee59344824d\") "
Jul 28 01:44:50.836868 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:50.836692    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c23505a7-374c-4867-a956-3ee59344824d-istiod-ca-cert\") pod \"c23505a7-374c-4867-a956-3ee59344824d\" (UID: \"c23505a7-374c-4867-a956-3ee59344824d\") "
Jul 28 01:44:50.836868 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:50.836718    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c23505a7-374c-4867-a956-3ee59344824d-istio-envoy\") pod \"c23505a7-374c-4867-a956-3ee59344824d\" (UID: \"c23505a7-374c-4867-a956-3ee59344824d\") "
Jul 28 01:44:50.836868 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:50.836764    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c23505a7-374c-4867-a956-3ee59344824d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c23505a7-374c-4867-a956-3ee59344824d" (UID: "c23505a7-374c-4867-a956-3ee59344824d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:44:50.837211 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:50.837002    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c23505a7-374c-4867-a956-3ee59344824d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c23505a7-374c-4867-a956-3ee59344824d" (UID: "c23505a7-374c-4867-a956-3ee59344824d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:44:50.837211 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:50.837045    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c23505a7-374c-4867-a956-3ee59344824d-credential-socket\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:44:50.837211 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:50.837085    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c23505a7-374c-4867-a956-3ee59344824d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c23505a7-374c-4867-a956-3ee59344824d" (UID: "c23505a7-374c-4867-a956-3ee59344824d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:44:50.837211 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:50.837114    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c23505a7-374c-4867-a956-3ee59344824d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c23505a7-374c-4867-a956-3ee59344824d" (UID: "c23505a7-374c-4867-a956-3ee59344824d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:44:50.837896 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:50.837873    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c23505a7-374c-4867-a956-3ee59344824d-istio-data" (OuterVolumeSpecName: "istio-data") pod "c23505a7-374c-4867-a956-3ee59344824d" (UID: "c23505a7-374c-4867-a956-3ee59344824d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:44:50.838986 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:50.838964    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c23505a7-374c-4867-a956-3ee59344824d-kube-api-access-22hlz" (OuterVolumeSpecName: "kube-api-access-22hlz") pod "c23505a7-374c-4867-a956-3ee59344824d" (UID: "c23505a7-374c-4867-a956-3ee59344824d"). InnerVolumeSpecName "kube-api-access-22hlz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:44:50.839409 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:50.839381    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c23505a7-374c-4867-a956-3ee59344824d-istio-token" (OuterVolumeSpecName: "istio-token") pod "c23505a7-374c-4867-a956-3ee59344824d" (UID: "c23505a7-374c-4867-a956-3ee59344824d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:44:50.839409 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:50.839406    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c23505a7-374c-4867-a956-3ee59344824d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c23505a7-374c-4867-a956-3ee59344824d" (UID: "c23505a7-374c-4867-a956-3ee59344824d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 01:44:50.839542 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:50.839421    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c23505a7-374c-4867-a956-3ee59344824d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c23505a7-374c-4867-a956-3ee59344824d" (UID: "c23505a7-374c-4867-a956-3ee59344824d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:44:50.938094 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:50.938051    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c23505a7-374c-4867-a956-3ee59344824d-istiod-ca-cert\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:44:50.938094 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:50.938091    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c23505a7-374c-4867-a956-3ee59344824d-istio-envoy\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:44:50.938297 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:50.938105    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c23505a7-374c-4867-a956-3ee59344824d-istio-token\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:44:50.938297 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:50.938117    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c23505a7-374c-4867-a956-3ee59344824d-istio-podinfo\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:44:50.938297 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:50.938130    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c23505a7-374c-4867-a956-3ee59344824d-workload-certs\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:44:50.938297 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:50.938142    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c23505a7-374c-4867-a956-3ee59344824d-istio-data\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:44:50.938297 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:50.938155    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c23505a7-374c-4867-a956-3ee59344824d-workload-socket\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:44:50.938297 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:50.938168    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22hlz\" (UniqueName: \"kubernetes.io/projected/c23505a7-374c-4867-a956-3ee59344824d-kube-api-access-22hlz\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:44:51.004171 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:51.004137    2562 generic.go:356] "Generic (PLEG): container finished" podID="c23505a7-374c-4867-a956-3ee59344824d" containerID="6bccec4b254d198aa3537cd133d81de99a0840022b3c921219bc970c1bedf421" exitCode=0
Jul 28 01:44:51.004333 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:51.004186    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9"
Jul 28 01:44:51.004333 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:51.004220    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9" event={"ID":"c23505a7-374c-4867-a956-3ee59344824d","Type":"ContainerDied","Data":"6bccec4b254d198aa3537cd133d81de99a0840022b3c921219bc970c1bedf421"}
Jul 28 01:44:51.004333 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:51.004275    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9" event={"ID":"c23505a7-374c-4867-a956-3ee59344824d","Type":"ContainerDied","Data":"57ddbd46f8e3fa3c48dc08de70c149320fa68a6a9cab9db1c690c61b762f2f29"}
Jul 28 01:44:51.004333 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:51.004298    2562 scope.go:117] "RemoveContainer" containerID="6bccec4b254d198aa3537cd133d81de99a0840022b3c921219bc970c1bedf421"
Jul 28 01:44:51.013929 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:51.013914    2562 scope.go:117] "RemoveContainer" containerID="0e6a3437dbcab249b4cc9bf227f4bf4d04cb000c8245260eebbc2d8564f4f49f"
Jul 28 01:44:51.021766 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:51.021752    2562 scope.go:117] "RemoveContainer" containerID="6bccec4b254d198aa3537cd133d81de99a0840022b3c921219bc970c1bedf421"
Jul 28 01:44:51.021980 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:44:51.021961    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bccec4b254d198aa3537cd133d81de99a0840022b3c921219bc970c1bedf421\": container with ID starting with 6bccec4b254d198aa3537cd133d81de99a0840022b3c921219bc970c1bedf421 not found: ID does not exist" containerID="6bccec4b254d198aa3537cd133d81de99a0840022b3c921219bc970c1bedf421"
Jul 28 01:44:51.022022 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:51.021989    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bccec4b254d198aa3537cd133d81de99a0840022b3c921219bc970c1bedf421"} err="failed to get container status \"6bccec4b254d198aa3537cd133d81de99a0840022b3c921219bc970c1bedf421\": rpc error: code = NotFound desc = could not find container \"6bccec4b254d198aa3537cd133d81de99a0840022b3c921219bc970c1bedf421\": container with ID starting with 6bccec4b254d198aa3537cd133d81de99a0840022b3c921219bc970c1bedf421 not found: ID does not exist"
Jul 28 01:44:51.022022 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:51.022005    2562 scope.go:117] "RemoveContainer" containerID="0e6a3437dbcab249b4cc9bf227f4bf4d04cb000c8245260eebbc2d8564f4f49f"
Jul 28 01:44:51.022210 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:44:51.022192    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e6a3437dbcab249b4cc9bf227f4bf4d04cb000c8245260eebbc2d8564f4f49f\": container with ID starting with 0e6a3437dbcab249b4cc9bf227f4bf4d04cb000c8245260eebbc2d8564f4f49f not found: ID does not exist" containerID="0e6a3437dbcab249b4cc9bf227f4bf4d04cb000c8245260eebbc2d8564f4f49f"
Jul 28 01:44:51.022259 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:51.022221    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e6a3437dbcab249b4cc9bf227f4bf4d04cb000c8245260eebbc2d8564f4f49f"} err="failed to get container status \"0e6a3437dbcab249b4cc9bf227f4bf4d04cb000c8245260eebbc2d8564f4f49f\": rpc error: code = NotFound desc = could not find container \"0e6a3437dbcab249b4cc9bf227f4bf4d04cb000c8245260eebbc2d8564f4f49f\": container with ID starting with 0e6a3437dbcab249b4cc9bf227f4bf4d04cb000c8245260eebbc2d8564f4f49f not found: ID does not exist"
Jul 28 01:44:51.025212 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:51.025193    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9"]
Jul 28 01:44:51.029170 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:51.029151    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-e887be66-gw-openshift-default-8697c7c9bd-tdfq9"]
Jul 28 01:44:52.013040 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:44:52.013009    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c23505a7-374c-4867-a956-3ee59344824d" path="/var/lib/kubelet/pods/c23505a7-374c-4867-a956-3ee59344824d/volumes"
Jul 28 01:45:03.025282 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:03.024722    2562 patch_prober.go:28] interesting pod/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": read tcp 10.132.0.2:55724->10.132.0.59:15021: read: connection reset by peer" start-of-body=
Jul 28 01:45:03.025282 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:03.024784    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb" podUID="73d75776-8be7-4e88-aca4-04aaea9a6cd7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": read tcp 10.132.0.2:55724->10.132.0.59:15021: read: connection reset by peer"
Jul 28 01:45:03.085313 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:03.085282    2562 generic.go:356] "Generic (PLEG): container finished" podID="73d75776-8be7-4e88-aca4-04aaea9a6cd7" containerID="df941c7b040962448643d7f4b11cc8366d4d46fcb9d891f85cee5a474b27ff7b" exitCode=0
Jul 28 01:45:03.085454 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:03.085322    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb" event={"ID":"73d75776-8be7-4e88-aca4-04aaea9a6cd7","Type":"ContainerDied","Data":"df941c7b040962448643d7f4b11cc8366d4d46fcb9d891f85cee5a474b27ff7b"}
Jul 28 01:45:03.085736 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:03.085722    2562 scope.go:117] "RemoveContainer" containerID="df941c7b040962448643d7f4b11cc8366d4d46fcb9d891f85cee5a474b27ff7b"
Jul 28 01:45:03.086732 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:03.086705    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:45:03.086793 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:03.086774    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:45:03.086833 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:03.086803    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:45:04.092547 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:04.092508    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb" event={"ID":"73d75776-8be7-4e88-aca4-04aaea9a6cd7","Type":"ContainerStarted","Data":"c60864ae5cbf496fa85b57c1a0c79654673f99d4cfbdf93582050b5813d26b36"}
Jul 28 01:45:04.531760 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:04.531662    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb"
Jul 28 01:45:04.531760 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:04.531753    2562 patch_prober.go:28] interesting pod/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 28 01:45:04.532037 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:04.531811    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb" podUID="73d75776-8be7-4e88-aca4-04aaea9a6cd7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 28 01:45:05.532144 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:05.531658    2562 patch_prober.go:28] interesting pod/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 28 01:45:05.532144 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:05.531738    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb" podUID="73d75776-8be7-4e88-aca4-04aaea9a6cd7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 28 01:45:06.532207 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:06.532163    2562 patch_prober.go:28] interesting pod/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 28 01:45:06.532726 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:06.532239    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb" podUID="73d75776-8be7-4e88-aca4-04aaea9a6cd7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 28 01:45:07.531746 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:07.531703    2562 patch_prober.go:28] interesting pod/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 28 01:45:07.532023 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:07.531775    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb" podUID="73d75776-8be7-4e88-aca4-04aaea9a6cd7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 28 01:45:08.535038 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:08.535006    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb"
Jul 28 01:45:08.535402 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:08.535348    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb"
Jul 28 01:45:08.536030 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:08.536008    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb"
Jul 28 01:45:30.343652 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:30.343610    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb"]
Jul 28 01:45:30.344027 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:30.343874    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb" podUID="73d75776-8be7-4e88-aca4-04aaea9a6cd7" containerName="istio-proxy" containerID="cri-o://c60864ae5cbf496fa85b57c1a0c79654673f99d4cfbdf93582050b5813d26b36" gracePeriod=30
Jul 28 01:45:31.238679 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:31.238641    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr"]
Jul 28 01:45:31.239191 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:31.239171    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c23505a7-374c-4867-a956-3ee59344824d" containerName="istio-proxy"
Jul 28 01:45:31.239288 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:31.239194    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c23505a7-374c-4867-a956-3ee59344824d" containerName="istio-proxy"
Jul 28 01:45:31.239288 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:31.239222    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c23505a7-374c-4867-a956-3ee59344824d" containerName="istio-proxy"
Jul 28 01:45:31.239288 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:31.239230    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c23505a7-374c-4867-a956-3ee59344824d" containerName="istio-proxy"
Jul 28 01:45:31.239438 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:31.239351    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c23505a7-374c-4867-a956-3ee59344824d" containerName="istio-proxy"
Jul 28 01:45:31.239438 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:31.239366    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c23505a7-374c-4867-a956-3ee59344824d" containerName="istio-proxy"
Jul 28 01:45:31.242086 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:31.242065    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr"
Jul 28 01:45:31.245276 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:31.245254    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-5442bcc0-openshift-default-dockercfg-xztdb\""
Jul 28 01:45:31.272428 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:31.272402    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr"]
Jul 28 01:45:31.294878 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:31.294840    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a567a7bf-b219-42c3-8992-cbdd79bc647e-istio-podinfo\") pod \"e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr\" (UID: \"a567a7bf-b219-42c3-8992-cbdd79bc647e\") " pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr"
Jul 28 01:45:31.295023 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:31.294923    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a567a7bf-b219-42c3-8992-cbdd79bc647e-workload-socket\") pod \"e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr\" (UID: \"a567a7bf-b219-42c3-8992-cbdd79bc647e\") " pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr"
Jul 28 01:45:31.295023 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:31.294984    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a567a7bf-b219-42c3-8992-cbdd79bc647e-istiod-ca-cert\") pod \"e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr\" (UID: \"a567a7bf-b219-42c3-8992-cbdd79bc647e\") " pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr"
Jul 28 01:45:31.295023 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:31.295012    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a567a7bf-b219-42c3-8992-cbdd79bc647e-istio-envoy\") pod \"e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr\" (UID: \"a567a7bf-b219-42c3-8992-cbdd79bc647e\") " pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr"
Jul 28 01:45:31.295189 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:31.295040    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a567a7bf-b219-42c3-8992-cbdd79bc647e-credential-socket\") pod \"e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr\" (UID: \"a567a7bf-b219-42c3-8992-cbdd79bc647e\") " pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr"
Jul 28 01:45:31.295189 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:31.295087    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a567a7bf-b219-42c3-8992-cbdd79bc647e-istio-token\") pod \"e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr\" (UID: \"a567a7bf-b219-42c3-8992-cbdd79bc647e\") " pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr"
Jul 28 01:45:31.295288 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:31.295183    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9h67\" (UniqueName: \"kubernetes.io/projected/a567a7bf-b219-42c3-8992-cbdd79bc647e-kube-api-access-f9h67\") pod \"e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr\" (UID: \"a567a7bf-b219-42c3-8992-cbdd79bc647e\") " pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr"
Jul 28 01:45:31.295288 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:31.295261    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a567a7bf-b219-42c3-8992-cbdd79bc647e-workload-certs\") pod \"e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr\" (UID: \"a567a7bf-b219-42c3-8992-cbdd79bc647e\") " pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr"
Jul 28 01:45:31.295382 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:31.295311    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a567a7bf-b219-42c3-8992-cbdd79bc647e-istio-data\") pod \"e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr\" (UID: \"a567a7bf-b219-42c3-8992-cbdd79bc647e\") " pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr"
Jul 28 01:45:31.396668 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:31.396629    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a567a7bf-b219-42c3-8992-cbdd79bc647e-workload-socket\") pod \"e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr\" (UID: \"a567a7bf-b219-42c3-8992-cbdd79bc647e\") " pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr"
Jul 28 01:45:31.397137 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:31.396705    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a567a7bf-b219-42c3-8992-cbdd79bc647e-istiod-ca-cert\") pod \"e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr\" (UID: \"a567a7bf-b219-42c3-8992-cbdd79bc647e\") " pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr"
Jul 28 01:45:31.397137 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:31.396730    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a567a7bf-b219-42c3-8992-cbdd79bc647e-istio-envoy\") pod \"e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr\" (UID: \"a567a7bf-b219-42c3-8992-cbdd79bc647e\") " pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr"
Jul 28 01:45:31.397137 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:31.396756    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a567a7bf-b219-42c3-8992-cbdd79bc647e-credential-socket\") pod \"e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr\" (UID: \"a567a7bf-b219-42c3-8992-cbdd79bc647e\") " pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr"
Jul 28 01:45:31.397137 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:31.396801    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a567a7bf-b219-42c3-8992-cbdd79bc647e-istio-token\") pod \"e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr\" (UID: \"a567a7bf-b219-42c3-8992-cbdd79bc647e\") " pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr"
Jul 28 01:45:31.397137 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:31.396842    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9h67\" (UniqueName: \"kubernetes.io/projected/a567a7bf-b219-42c3-8992-cbdd79bc647e-kube-api-access-f9h67\") pod \"e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr\" (UID: \"a567a7bf-b219-42c3-8992-cbdd79bc647e\") " pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr"
Jul 28 01:45:31.397137 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:31.396874    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a567a7bf-b219-42c3-8992-cbdd79bc647e-workload-certs\") pod \"e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr\" (UID: \"a567a7bf-b219-42c3-8992-cbdd79bc647e\") " pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr"
Jul 28 01:45:31.397137 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:31.396934    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a567a7bf-b219-42c3-8992-cbdd79bc647e-istio-data\") pod \"e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr\" (UID: \"a567a7bf-b219-42c3-8992-cbdd79bc647e\") " pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr"
Jul 28 01:45:31.397137 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:31.397000    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a567a7bf-b219-42c3-8992-cbdd79bc647e-istio-podinfo\") pod \"e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr\" (UID: \"a567a7bf-b219-42c3-8992-cbdd79bc647e\") " pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr"
Jul 28 01:45:31.397137 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:31.397081    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a567a7bf-b219-42c3-8992-cbdd79bc647e-workload-socket\") pod \"e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr\" (UID: \"a567a7bf-b219-42c3-8992-cbdd79bc647e\") " pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr"
Jul 28 01:45:31.397590 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:31.397159    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a567a7bf-b219-42c3-8992-cbdd79bc647e-workload-certs\") pod \"e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr\" (UID: \"a567a7bf-b219-42c3-8992-cbdd79bc647e\") " pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr"
Jul 28 01:45:31.397590 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:31.397338    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a567a7bf-b219-42c3-8992-cbdd79bc647e-credential-socket\") pod \"e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr\" (UID: \"a567a7bf-b219-42c3-8992-cbdd79bc647e\") " pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr"
Jul 28 01:45:31.397590 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:31.397350    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a567a7bf-b219-42c3-8992-cbdd79bc647e-istio-data\") pod \"e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr\" (UID: \"a567a7bf-b219-42c3-8992-cbdd79bc647e\") " pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr"
Jul 28 01:45:31.397590 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:31.397469    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a567a7bf-b219-42c3-8992-cbdd79bc647e-istiod-ca-cert\") pod \"e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr\" (UID: \"a567a7bf-b219-42c3-8992-cbdd79bc647e\") " pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr"
Jul 28 01:45:31.399003 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:31.398979    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a567a7bf-b219-42c3-8992-cbdd79bc647e-istio-envoy\") pod \"e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr\" (UID: \"a567a7bf-b219-42c3-8992-cbdd79bc647e\") " pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr"
Jul 28 01:45:31.399396 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:31.399378    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a567a7bf-b219-42c3-8992-cbdd79bc647e-istio-podinfo\") pod \"e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr\" (UID: \"a567a7bf-b219-42c3-8992-cbdd79bc647e\") " pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr"
Jul 28 01:45:31.404034 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:31.404013    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a567a7bf-b219-42c3-8992-cbdd79bc647e-istio-token\") pod \"e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr\" (UID: \"a567a7bf-b219-42c3-8992-cbdd79bc647e\") " pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr"
Jul 28 01:45:31.404529 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:31.404509    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9h67\" (UniqueName: \"kubernetes.io/projected/a567a7bf-b219-42c3-8992-cbdd79bc647e-kube-api-access-f9h67\") pod \"e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr\" (UID: \"a567a7bf-b219-42c3-8992-cbdd79bc647e\") " pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr"
Jul 28 01:45:31.552773 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:31.552692    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr"
Jul 28 01:45:31.688865 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:31.688829    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr"]
Jul 28 01:45:31.691840 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:45:31.691813    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda567a7bf_b219_42c3_8992_cbdd79bc647e.slice/crio-90c080a2117b6ea54fdd17b4595f695a136c3de6a9e71779efd85d19cc084239 WatchSource:0}: Error finding container 90c080a2117b6ea54fdd17b4595f695a136c3de6a9e71779efd85d19cc084239: Status 404 returned error can't find the container with id 90c080a2117b6ea54fdd17b4595f695a136c3de6a9e71779efd85d19cc084239
Jul 28 01:45:31.694740 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:31.694708    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:45:31.694850 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:31.694788    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:45:31.694850 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:31.694833    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:45:32.246097 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:32.246052    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr" event={"ID":"a567a7bf-b219-42c3-8992-cbdd79bc647e","Type":"ContainerStarted","Data":"8d0ad338a8e15353e4bbc11e1a94f7f0aa0157dd3c8915f4890aa56045ad329c"}
Jul 28 01:45:32.246293 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:32.246122    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr" event={"ID":"a567a7bf-b219-42c3-8992-cbdd79bc647e","Type":"ContainerStarted","Data":"90c080a2117b6ea54fdd17b4595f695a136c3de6a9e71779efd85d19cc084239"}
Jul 28 01:45:32.264078 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:32.264028    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr" podStartSLOduration=1.264014105 podStartE2EDuration="1.264014105s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:45:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:45:32.262654022 +0000 UTC m=+1802.766415335" watchObservedRunningTime="2026-07-28 01:45:32.264014105 +0000 UTC m=+1802.767775416"
Jul 28 01:45:32.553431 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:32.553353    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr"
Jul 28 01:45:32.558374 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:32.558348    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr"
Jul 28 01:45:33.253483 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:33.253454    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr"
Jul 28 01:45:33.254505 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:33.254483    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr"
Jul 28 01:45:35.600267 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:35.600244    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb"
Jul 28 01:45:35.635356 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:35.635326    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73d75776-8be7-4e88-aca4-04aaea9a6cd7-istio-token\") pod \"73d75776-8be7-4e88-aca4-04aaea9a6cd7\" (UID: \"73d75776-8be7-4e88-aca4-04aaea9a6cd7\") "
Jul 28 01:45:35.635505 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:35.635376    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73d75776-8be7-4e88-aca4-04aaea9a6cd7-istio-data\") pod \"73d75776-8be7-4e88-aca4-04aaea9a6cd7\" (UID: \"73d75776-8be7-4e88-aca4-04aaea9a6cd7\") "
Jul 28 01:45:35.635505 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:35.635411    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73d75776-8be7-4e88-aca4-04aaea9a6cd7-credential-socket\") pod \"73d75776-8be7-4e88-aca4-04aaea9a6cd7\" (UID: \"73d75776-8be7-4e88-aca4-04aaea9a6cd7\") "
Jul 28 01:45:35.635710 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:35.635547    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73d75776-8be7-4e88-aca4-04aaea9a6cd7-istio-envoy\") pod \"73d75776-8be7-4e88-aca4-04aaea9a6cd7\" (UID: \"73d75776-8be7-4e88-aca4-04aaea9a6cd7\") "
Jul 28 01:45:35.635710 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:35.635664    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73d75776-8be7-4e88-aca4-04aaea9a6cd7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "73d75776-8be7-4e88-aca4-04aaea9a6cd7" (UID: "73d75776-8be7-4e88-aca4-04aaea9a6cd7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:45:35.635710 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:35.635694    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73d75776-8be7-4e88-aca4-04aaea9a6cd7-istio-podinfo\") pod \"73d75776-8be7-4e88-aca4-04aaea9a6cd7\" (UID: \"73d75776-8be7-4e88-aca4-04aaea9a6cd7\") "
Jul 28 01:45:35.635835 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:35.635731    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73d75776-8be7-4e88-aca4-04aaea9a6cd7-workload-socket\") pod \"73d75776-8be7-4e88-aca4-04aaea9a6cd7\" (UID: \"73d75776-8be7-4e88-aca4-04aaea9a6cd7\") "
Jul 28 01:45:35.635835 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:35.635756    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73d75776-8be7-4e88-aca4-04aaea9a6cd7-istiod-ca-cert\") pod \"73d75776-8be7-4e88-aca4-04aaea9a6cd7\" (UID: \"73d75776-8be7-4e88-aca4-04aaea9a6cd7\") "
Jul 28 01:45:35.635835 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:35.635783    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73d75776-8be7-4e88-aca4-04aaea9a6cd7-workload-certs\") pod \"73d75776-8be7-4e88-aca4-04aaea9a6cd7\" (UID: \"73d75776-8be7-4e88-aca4-04aaea9a6cd7\") "
Jul 28 01:45:35.635835 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:35.635819    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lgnjc\" (UniqueName: \"kubernetes.io/projected/73d75776-8be7-4e88-aca4-04aaea9a6cd7-kube-api-access-lgnjc\") pod \"73d75776-8be7-4e88-aca4-04aaea9a6cd7\" (UID: \"73d75776-8be7-4e88-aca4-04aaea9a6cd7\") "
Jul 28 01:45:35.636167 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:35.636064    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73d75776-8be7-4e88-aca4-04aaea9a6cd7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "73d75776-8be7-4e88-aca4-04aaea9a6cd7" (UID: "73d75776-8be7-4e88-aca4-04aaea9a6cd7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:45:35.636167 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:35.636150    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73d75776-8be7-4e88-aca4-04aaea9a6cd7-workload-socket\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:45:35.636314 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:35.636169    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73d75776-8be7-4e88-aca4-04aaea9a6cd7-credential-socket\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:45:35.636545 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:35.636511    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73d75776-8be7-4e88-aca4-04aaea9a6cd7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "73d75776-8be7-4e88-aca4-04aaea9a6cd7" (UID: "73d75776-8be7-4e88-aca4-04aaea9a6cd7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:45:35.636545 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:35.636515    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73d75776-8be7-4e88-aca4-04aaea9a6cd7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "73d75776-8be7-4e88-aca4-04aaea9a6cd7" (UID: "73d75776-8be7-4e88-aca4-04aaea9a6cd7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:45:35.636824 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:35.636800    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73d75776-8be7-4e88-aca4-04aaea9a6cd7-istio-data" (OuterVolumeSpecName: "istio-data") pod "73d75776-8be7-4e88-aca4-04aaea9a6cd7" (UID: "73d75776-8be7-4e88-aca4-04aaea9a6cd7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:45:35.638299 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:35.638241    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73d75776-8be7-4e88-aca4-04aaea9a6cd7-istio-token" (OuterVolumeSpecName: "istio-token") pod "73d75776-8be7-4e88-aca4-04aaea9a6cd7" (UID: "73d75776-8be7-4e88-aca4-04aaea9a6cd7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:45:35.638479 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:35.638456    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/73d75776-8be7-4e88-aca4-04aaea9a6cd7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "73d75776-8be7-4e88-aca4-04aaea9a6cd7" (UID: "73d75776-8be7-4e88-aca4-04aaea9a6cd7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 01:45:35.638652 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:35.638533    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73d75776-8be7-4e88-aca4-04aaea9a6cd7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "73d75776-8be7-4e88-aca4-04aaea9a6cd7" (UID: "73d75776-8be7-4e88-aca4-04aaea9a6cd7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:45:35.638652 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:35.638634    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73d75776-8be7-4e88-aca4-04aaea9a6cd7-kube-api-access-lgnjc" (OuterVolumeSpecName: "kube-api-access-lgnjc") pod "73d75776-8be7-4e88-aca4-04aaea9a6cd7" (UID: "73d75776-8be7-4e88-aca4-04aaea9a6cd7"). InnerVolumeSpecName "kube-api-access-lgnjc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:45:35.737396 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:35.737365    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73d75776-8be7-4e88-aca4-04aaea9a6cd7-istiod-ca-cert\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:45:35.737396 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:35.737387    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73d75776-8be7-4e88-aca4-04aaea9a6cd7-workload-certs\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:45:35.737396 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:35.737396    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lgnjc\" (UniqueName: \"kubernetes.io/projected/73d75776-8be7-4e88-aca4-04aaea9a6cd7-kube-api-access-lgnjc\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:45:35.737396 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:35.737406    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73d75776-8be7-4e88-aca4-04aaea9a6cd7-istio-token\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:45:35.737683 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:35.737414    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73d75776-8be7-4e88-aca4-04aaea9a6cd7-istio-data\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:45:35.737683 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:35.737421    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73d75776-8be7-4e88-aca4-04aaea9a6cd7-istio-envoy\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:45:35.737683 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:35.737429    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73d75776-8be7-4e88-aca4-04aaea9a6cd7-istio-podinfo\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:45:36.269943 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:36.269910    2562 generic.go:356] "Generic (PLEG): container finished" podID="73d75776-8be7-4e88-aca4-04aaea9a6cd7" containerID="c60864ae5cbf496fa85b57c1a0c79654673f99d4cfbdf93582050b5813d26b36" exitCode=0
Jul 28 01:45:36.270105 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:36.269980    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb"
Jul 28 01:45:36.270105 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:36.269997    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb" event={"ID":"73d75776-8be7-4e88-aca4-04aaea9a6cd7","Type":"ContainerDied","Data":"c60864ae5cbf496fa85b57c1a0c79654673f99d4cfbdf93582050b5813d26b36"}
Jul 28 01:45:36.270105 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:36.270053    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb" event={"ID":"73d75776-8be7-4e88-aca4-04aaea9a6cd7","Type":"ContainerDied","Data":"428d4ad7d69362256f9196e19bdd06d320f2d08e5694a8461a2c7701d3f9172d"}
Jul 28 01:45:36.270105 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:36.270078    2562 scope.go:117] "RemoveContainer" containerID="c60864ae5cbf496fa85b57c1a0c79654673f99d4cfbdf93582050b5813d26b36"
Jul 28 01:45:36.279496 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:36.279469    2562 scope.go:117] "RemoveContainer" containerID="df941c7b040962448643d7f4b11cc8366d4d46fcb9d891f85cee5a474b27ff7b"
Jul 28 01:45:36.286434 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:36.286409    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb"]
Jul 28 01:45:36.288055 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:36.288039    2562 scope.go:117] "RemoveContainer" containerID="c60864ae5cbf496fa85b57c1a0c79654673f99d4cfbdf93582050b5813d26b36"
Jul 28 01:45:36.288368 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:45:36.288342    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c60864ae5cbf496fa85b57c1a0c79654673f99d4cfbdf93582050b5813d26b36\": container with ID starting with c60864ae5cbf496fa85b57c1a0c79654673f99d4cfbdf93582050b5813d26b36 not found: ID does not exist" containerID="c60864ae5cbf496fa85b57c1a0c79654673f99d4cfbdf93582050b5813d26b36"
Jul 28 01:45:36.288440 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:36.288378    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c60864ae5cbf496fa85b57c1a0c79654673f99d4cfbdf93582050b5813d26b36"} err="failed to get container status \"c60864ae5cbf496fa85b57c1a0c79654673f99d4cfbdf93582050b5813d26b36\": rpc error: code = NotFound desc = could not find container \"c60864ae5cbf496fa85b57c1a0c79654673f99d4cfbdf93582050b5813d26b36\": container with ID starting with c60864ae5cbf496fa85b57c1a0c79654673f99d4cfbdf93582050b5813d26b36 not found: ID does not exist"
Jul 28 01:45:36.288440 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:36.288403    2562 scope.go:117] "RemoveContainer" containerID="df941c7b040962448643d7f4b11cc8366d4d46fcb9d891f85cee5a474b27ff7b"
Jul 28 01:45:36.288725 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:45:36.288703    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df941c7b040962448643d7f4b11cc8366d4d46fcb9d891f85cee5a474b27ff7b\": container with ID starting with df941c7b040962448643d7f4b11cc8366d4d46fcb9d891f85cee5a474b27ff7b not found: ID does not exist" containerID="df941c7b040962448643d7f4b11cc8366d4d46fcb9d891f85cee5a474b27ff7b"
Jul 28 01:45:36.288809 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:36.288728    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df941c7b040962448643d7f4b11cc8366d4d46fcb9d891f85cee5a474b27ff7b"} err="failed to get container status \"df941c7b040962448643d7f4b11cc8366d4d46fcb9d891f85cee5a474b27ff7b\": rpc error: code = NotFound desc = could not find container \"df941c7b040962448643d7f4b11cc8366d4d46fcb9d891f85cee5a474b27ff7b\": container with ID starting with df941c7b040962448643d7f4b11cc8366d4d46fcb9d891f85cee5a474b27ff7b not found: ID does not exist"
Jul 28 01:45:36.291841 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:36.291819    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-1c712754-openshift-default-fb8b5cdfb-g94jb"]
Jul 28 01:45:38.014003 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:38.013971    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73d75776-8be7-4e88-aca4-04aaea9a6cd7" path="/var/lib/kubelet/pods/73d75776-8be7-4e88-aca4-04aaea9a6cd7/volumes"
Jul 28 01:45:45.320327 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:45.320229    2562 generic.go:356] "Generic (PLEG): container finished" podID="a567a7bf-b219-42c3-8992-cbdd79bc647e" containerID="8d0ad338a8e15353e4bbc11e1a94f7f0aa0157dd3c8915f4890aa56045ad329c" exitCode=0
Jul 28 01:45:45.320327 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:45.320297    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr" event={"ID":"a567a7bf-b219-42c3-8992-cbdd79bc647e","Type":"ContainerDied","Data":"8d0ad338a8e15353e4bbc11e1a94f7f0aa0157dd3c8915f4890aa56045ad329c"}
Jul 28 01:45:45.320799 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:45.320711    2562 scope.go:117] "RemoveContainer" containerID="8d0ad338a8e15353e4bbc11e1a94f7f0aa0157dd3c8915f4890aa56045ad329c"
Jul 28 01:45:45.321819 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:45.321789    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:45:45.321904 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:45.321874    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:45:45.321951 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:45.321932    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:45:46.326899 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:46.326864    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr" event={"ID":"a567a7bf-b219-42c3-8992-cbdd79bc647e","Type":"ContainerStarted","Data":"146007b2169f34aabc598ad19c5f857c8eb014b5d1780cf52d7aa315d3b73acd"}
Jul 28 01:45:46.553964 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:46.553921    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr"
Jul 28 01:45:46.555258 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:46.555227    2562 patch_prober.go:28] interesting pod/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 28 01:45:46.555395 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:46.555292    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr" podUID="a567a7bf-b219-42c3-8992-cbdd79bc647e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 28 01:45:47.554296 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:47.553836    2562 patch_prober.go:28] interesting pod/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 28 01:45:47.554296 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:47.553911    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr" podUID="a567a7bf-b219-42c3-8992-cbdd79bc647e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 28 01:45:48.254308 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:48.254272    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr"
Jul 28 01:45:48.553426 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:48.553321    2562 patch_prober.go:28] interesting pod/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 28 01:45:48.553426 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:48.553403    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr" podUID="a567a7bf-b219-42c3-8992-cbdd79bc647e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 28 01:45:49.553663 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:49.553616    2562 patch_prober.go:28] interesting pod/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 28 01:45:49.554272 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:49.554239    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr" podUID="a567a7bf-b219-42c3-8992-cbdd79bc647e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 28 01:45:50.557305 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:50.557277    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr"
Jul 28 01:45:50.558506 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:45:50.558473    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr"
Jul 28 01:46:13.721293 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:46:13.721254    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr"]
Jul 28 01:46:13.721870 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:46:13.721575    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr" podUID="a567a7bf-b219-42c3-8992-cbdd79bc647e" containerName="istio-proxy" containerID="cri-o://146007b2169f34aabc598ad19c5f857c8eb014b5d1780cf52d7aa315d3b73acd" gracePeriod=30
Jul 28 01:46:18.978665 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:46:18.978636    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr"
Jul 28 01:46:19.049959 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:46:19.049881    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a567a7bf-b219-42c3-8992-cbdd79bc647e-istio-data\") pod \"a567a7bf-b219-42c3-8992-cbdd79bc647e\" (UID: \"a567a7bf-b219-42c3-8992-cbdd79bc647e\") "
Jul 28 01:46:19.049959 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:46:19.049919    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9h67\" (UniqueName: \"kubernetes.io/projected/a567a7bf-b219-42c3-8992-cbdd79bc647e-kube-api-access-f9h67\") pod \"a567a7bf-b219-42c3-8992-cbdd79bc647e\" (UID: \"a567a7bf-b219-42c3-8992-cbdd79bc647e\") "
Jul 28 01:46:19.049959 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:46:19.049946    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a567a7bf-b219-42c3-8992-cbdd79bc647e-istio-token\") pod \"a567a7bf-b219-42c3-8992-cbdd79bc647e\" (UID: \"a567a7bf-b219-42c3-8992-cbdd79bc647e\") "
Jul 28 01:46:19.050247 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:46:19.049978    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a567a7bf-b219-42c3-8992-cbdd79bc647e-istiod-ca-cert\") pod \"a567a7bf-b219-42c3-8992-cbdd79bc647e\" (UID: \"a567a7bf-b219-42c3-8992-cbdd79bc647e\") "
Jul 28 01:46:19.050247 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:46:19.050112    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a567a7bf-b219-42c3-8992-cbdd79bc647e-workload-certs\") pod \"a567a7bf-b219-42c3-8992-cbdd79bc647e\" (UID: \"a567a7bf-b219-42c3-8992-cbdd79bc647e\") "
Jul 28 01:46:19.050247 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:46:19.050148    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a567a7bf-b219-42c3-8992-cbdd79bc647e-credential-socket\") pod \"a567a7bf-b219-42c3-8992-cbdd79bc647e\" (UID: \"a567a7bf-b219-42c3-8992-cbdd79bc647e\") "
Jul 28 01:46:19.050247 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:46:19.050200    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a567a7bf-b219-42c3-8992-cbdd79bc647e-istio-podinfo\") pod \"a567a7bf-b219-42c3-8992-cbdd79bc647e\" (UID: \"a567a7bf-b219-42c3-8992-cbdd79bc647e\") "
Jul 28 01:46:19.050247 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:46:19.050245    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a567a7bf-b219-42c3-8992-cbdd79bc647e-istio-envoy\") pod \"a567a7bf-b219-42c3-8992-cbdd79bc647e\" (UID: \"a567a7bf-b219-42c3-8992-cbdd79bc647e\") "
Jul 28 01:46:19.050501 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:46:19.050313    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a567a7bf-b219-42c3-8992-cbdd79bc647e-workload-socket\") pod \"a567a7bf-b219-42c3-8992-cbdd79bc647e\" (UID: \"a567a7bf-b219-42c3-8992-cbdd79bc647e\") "
Jul 28 01:46:19.050501 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:46:19.050386    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a567a7bf-b219-42c3-8992-cbdd79bc647e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a567a7bf-b219-42c3-8992-cbdd79bc647e" (UID: "a567a7bf-b219-42c3-8992-cbdd79bc647e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:46:19.050501 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:46:19.050390    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a567a7bf-b219-42c3-8992-cbdd79bc647e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a567a7bf-b219-42c3-8992-cbdd79bc647e" (UID: "a567a7bf-b219-42c3-8992-cbdd79bc647e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:46:19.050501 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:46:19.050461    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a567a7bf-b219-42c3-8992-cbdd79bc647e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a567a7bf-b219-42c3-8992-cbdd79bc647e" (UID: "a567a7bf-b219-42c3-8992-cbdd79bc647e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:46:19.050732 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:46:19.050636    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a567a7bf-b219-42c3-8992-cbdd79bc647e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a567a7bf-b219-42c3-8992-cbdd79bc647e" (UID: "a567a7bf-b219-42c3-8992-cbdd79bc647e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:46:19.050789 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:46:19.050774    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a567a7bf-b219-42c3-8992-cbdd79bc647e-istiod-ca-cert\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:46:19.050840 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:46:19.050795    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a567a7bf-b219-42c3-8992-cbdd79bc647e-workload-certs\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:46:19.050840 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:46:19.050808    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a567a7bf-b219-42c3-8992-cbdd79bc647e-credential-socket\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:46:19.050840 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:46:19.050821    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a567a7bf-b219-42c3-8992-cbdd79bc647e-workload-socket\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:46:19.050989 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:46:19.050921    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a567a7bf-b219-42c3-8992-cbdd79bc647e-istio-data" (OuterVolumeSpecName: "istio-data") pod "a567a7bf-b219-42c3-8992-cbdd79bc647e" (UID: "a567a7bf-b219-42c3-8992-cbdd79bc647e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:46:19.052331 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:46:19.052303    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a567a7bf-b219-42c3-8992-cbdd79bc647e-istio-token" (OuterVolumeSpecName: "istio-token") pod "a567a7bf-b219-42c3-8992-cbdd79bc647e" (UID: "a567a7bf-b219-42c3-8992-cbdd79bc647e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:46:19.052440 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:46:19.052330    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a567a7bf-b219-42c3-8992-cbdd79bc647e-kube-api-access-f9h67" (OuterVolumeSpecName: "kube-api-access-f9h67") pod "a567a7bf-b219-42c3-8992-cbdd79bc647e" (UID: "a567a7bf-b219-42c3-8992-cbdd79bc647e"). InnerVolumeSpecName "kube-api-access-f9h67". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:46:19.052812 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:46:19.052791    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a567a7bf-b219-42c3-8992-cbdd79bc647e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a567a7bf-b219-42c3-8992-cbdd79bc647e" (UID: "a567a7bf-b219-42c3-8992-cbdd79bc647e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 01:46:19.052928 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:46:19.052826    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a567a7bf-b219-42c3-8992-cbdd79bc647e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a567a7bf-b219-42c3-8992-cbdd79bc647e" (UID: "a567a7bf-b219-42c3-8992-cbdd79bc647e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:46:19.151977 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:46:19.151948    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a567a7bf-b219-42c3-8992-cbdd79bc647e-istio-envoy\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:46:19.151977 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:46:19.151973    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a567a7bf-b219-42c3-8992-cbdd79bc647e-istio-data\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:46:19.151977 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:46:19.151982    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9h67\" (UniqueName: \"kubernetes.io/projected/a567a7bf-b219-42c3-8992-cbdd79bc647e-kube-api-access-f9h67\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:46:19.152194 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:46:19.151993    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a567a7bf-b219-42c3-8992-cbdd79bc647e-istio-token\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:46:19.152194 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:46:19.152002    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a567a7bf-b219-42c3-8992-cbdd79bc647e-istio-podinfo\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:46:19.499949 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:46:19.499916    2562 generic.go:356] "Generic (PLEG): container finished" podID="a567a7bf-b219-42c3-8992-cbdd79bc647e" containerID="146007b2169f34aabc598ad19c5f857c8eb014b5d1780cf52d7aa315d3b73acd" exitCode=0
Jul 28 01:46:19.500118 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:46:19.499966    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr"
Jul 28 01:46:19.500118 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:46:19.500005    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr" event={"ID":"a567a7bf-b219-42c3-8992-cbdd79bc647e","Type":"ContainerDied","Data":"146007b2169f34aabc598ad19c5f857c8eb014b5d1780cf52d7aa315d3b73acd"}
Jul 28 01:46:19.500118 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:46:19.500059    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr" event={"ID":"a567a7bf-b219-42c3-8992-cbdd79bc647e","Type":"ContainerDied","Data":"90c080a2117b6ea54fdd17b4595f695a136c3de6a9e71779efd85d19cc084239"}
Jul 28 01:46:19.500118 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:46:19.500084    2562 scope.go:117] "RemoveContainer" containerID="146007b2169f34aabc598ad19c5f857c8eb014b5d1780cf52d7aa315d3b73acd"
Jul 28 01:46:19.513586 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:46:19.513548    2562 scope.go:117] "RemoveContainer" containerID="8d0ad338a8e15353e4bbc11e1a94f7f0aa0157dd3c8915f4890aa56045ad329c"
Jul 28 01:46:19.521860 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:46:19.521836    2562 scope.go:117] "RemoveContainer" containerID="146007b2169f34aabc598ad19c5f857c8eb014b5d1780cf52d7aa315d3b73acd"
Jul 28 01:46:19.522123 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:46:19.522105    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"146007b2169f34aabc598ad19c5f857c8eb014b5d1780cf52d7aa315d3b73acd\": container with ID starting with 146007b2169f34aabc598ad19c5f857c8eb014b5d1780cf52d7aa315d3b73acd not found: ID does not exist" containerID="146007b2169f34aabc598ad19c5f857c8eb014b5d1780cf52d7aa315d3b73acd"
Jul 28 01:46:19.522194 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:46:19.522131    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"146007b2169f34aabc598ad19c5f857c8eb014b5d1780cf52d7aa315d3b73acd"} err="failed to get container status \"146007b2169f34aabc598ad19c5f857c8eb014b5d1780cf52d7aa315d3b73acd\": rpc error: code = NotFound desc = could not find container \"146007b2169f34aabc598ad19c5f857c8eb014b5d1780cf52d7aa315d3b73acd\": container with ID starting with 146007b2169f34aabc598ad19c5f857c8eb014b5d1780cf52d7aa315d3b73acd not found: ID does not exist"
Jul 28 01:46:19.522194 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:46:19.522149    2562 scope.go:117] "RemoveContainer" containerID="8d0ad338a8e15353e4bbc11e1a94f7f0aa0157dd3c8915f4890aa56045ad329c"
Jul 28 01:46:19.522389 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:46:19.522370    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d0ad338a8e15353e4bbc11e1a94f7f0aa0157dd3c8915f4890aa56045ad329c\": container with ID starting with 8d0ad338a8e15353e4bbc11e1a94f7f0aa0157dd3c8915f4890aa56045ad329c not found: ID does not exist" containerID="8d0ad338a8e15353e4bbc11e1a94f7f0aa0157dd3c8915f4890aa56045ad329c"
Jul 28 01:46:19.522453 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:46:19.522393    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d0ad338a8e15353e4bbc11e1a94f7f0aa0157dd3c8915f4890aa56045ad329c"} err="failed to get container status \"8d0ad338a8e15353e4bbc11e1a94f7f0aa0157dd3c8915f4890aa56045ad329c\": rpc error: code = NotFound desc = could not find container \"8d0ad338a8e15353e4bbc11e1a94f7f0aa0157dd3c8915f4890aa56045ad329c\": container with ID starting with 8d0ad338a8e15353e4bbc11e1a94f7f0aa0157dd3c8915f4890aa56045ad329c not found: ID does not exist"
Jul 28 01:46:19.523402 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:46:19.523381    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr"]
Jul 28 01:46:19.526631 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:46:19.526610    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-5442bcc0-openshift-default-f847db6d4-qvllr"]
Jul 28 01:46:20.014474 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:46:20.014439    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a567a7bf-b219-42c3-8992-cbdd79bc647e" path="/var/lib/kubelet/pods/a567a7bf-b219-42c3-8992-cbdd79bc647e/volumes"
Jul 28 01:47:59.354061 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:47:59.354022    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f"]
Jul 28 01:47:59.354511 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:47:59.354469    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73d75776-8be7-4e88-aca4-04aaea9a6cd7" containerName="istio-proxy"
Jul 28 01:47:59.354511 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:47:59.354482    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="73d75776-8be7-4e88-aca4-04aaea9a6cd7" containerName="istio-proxy"
Jul 28 01:47:59.354511 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:47:59.354494    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73d75776-8be7-4e88-aca4-04aaea9a6cd7" containerName="istio-proxy"
Jul 28 01:47:59.354511 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:47:59.354500    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="73d75776-8be7-4e88-aca4-04aaea9a6cd7" containerName="istio-proxy"
Jul 28 01:47:59.354511 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:47:59.354511    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a567a7bf-b219-42c3-8992-cbdd79bc647e" containerName="istio-proxy"
Jul 28 01:47:59.354715 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:47:59.354517    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a567a7bf-b219-42c3-8992-cbdd79bc647e" containerName="istio-proxy"
Jul 28 01:47:59.354715 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:47:59.354531    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a567a7bf-b219-42c3-8992-cbdd79bc647e" containerName="istio-proxy"
Jul 28 01:47:59.354715 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:47:59.354537    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a567a7bf-b219-42c3-8992-cbdd79bc647e" containerName="istio-proxy"
Jul 28 01:47:59.354715 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:47:59.354617    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="73d75776-8be7-4e88-aca4-04aaea9a6cd7" containerName="istio-proxy"
Jul 28 01:47:59.354715 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:47:59.354629    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a567a7bf-b219-42c3-8992-cbdd79bc647e" containerName="istio-proxy"
Jul 28 01:47:59.354715 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:47:59.354635    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a567a7bf-b219-42c3-8992-cbdd79bc647e" containerName="istio-proxy"
Jul 28 01:47:59.357442 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:47:59.357425    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f"
Jul 28 01:47:59.359466 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:47:59.359448    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-43a6ae00-openshift-default-dockercfg-64898\""
Jul 28 01:47:59.380899 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:47:59.380869    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f"]
Jul 28 01:47:59.448758 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:47:59.448720    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-credential-socket\") pod \"e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f\" (UID: \"67b39704-ab95-42ba-b4f3-b6b4a3a7125d\") " pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f"
Jul 28 01:47:59.448957 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:47:59.448777    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-workload-socket\") pod \"e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f\" (UID: \"67b39704-ab95-42ba-b4f3-b6b4a3a7125d\") " pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f"
Jul 28 01:47:59.448957 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:47:59.448831    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-istio-envoy\") pod \"e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f\" (UID: \"67b39704-ab95-42ba-b4f3-b6b4a3a7125d\") " pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f"
Jul 28 01:47:59.448957 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:47:59.448851    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-istio-podinfo\") pod \"e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f\" (UID: \"67b39704-ab95-42ba-b4f3-b6b4a3a7125d\") " pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f"
Jul 28 01:47:59.448957 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:47:59.448875    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-workload-certs\") pod \"e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f\" (UID: \"67b39704-ab95-42ba-b4f3-b6b4a3a7125d\") " pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f"
Jul 28 01:47:59.448957 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:47:59.448940    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tl2j\" (UniqueName: \"kubernetes.io/projected/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-kube-api-access-9tl2j\") pod \"e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f\" (UID: \"67b39704-ab95-42ba-b4f3-b6b4a3a7125d\") " pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f"
Jul 28 01:47:59.449221 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:47:59.448977    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-istio-token\") pod \"e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f\" (UID: \"67b39704-ab95-42ba-b4f3-b6b4a3a7125d\") " pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f"
Jul 28 01:47:59.449221 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:47:59.449004    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-istio-data\") pod \"e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f\" (UID: \"67b39704-ab95-42ba-b4f3-b6b4a3a7125d\") " pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f"
Jul 28 01:47:59.449221 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:47:59.449039    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-istiod-ca-cert\") pod \"e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f\" (UID: \"67b39704-ab95-42ba-b4f3-b6b4a3a7125d\") " pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f"
Jul 28 01:47:59.549843 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:47:59.549802    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-credential-socket\") pod \"e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f\" (UID: \"67b39704-ab95-42ba-b4f3-b6b4a3a7125d\") " pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f"
Jul 28 01:47:59.550016 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:47:59.549870    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-workload-socket\") pod \"e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f\" (UID: \"67b39704-ab95-42ba-b4f3-b6b4a3a7125d\") " pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f"
Jul 28 01:47:59.550016 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:47:59.549925    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-istio-envoy\") pod \"e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f\" (UID: \"67b39704-ab95-42ba-b4f3-b6b4a3a7125d\") " pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f"
Jul 28 01:47:59.550120 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:47:59.550047    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-istio-podinfo\") pod \"e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f\" (UID: \"67b39704-ab95-42ba-b4f3-b6b4a3a7125d\") " pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f"
Jul 28 01:47:59.550120 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:47:59.550100    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-workload-certs\") pod \"e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f\" (UID: \"67b39704-ab95-42ba-b4f3-b6b4a3a7125d\") " pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f"
Jul 28 01:47:59.550221 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:47:59.550137    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tl2j\" (UniqueName: \"kubernetes.io/projected/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-kube-api-access-9tl2j\") pod \"e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f\" (UID: \"67b39704-ab95-42ba-b4f3-b6b4a3a7125d\") " pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f"
Jul 28 01:47:59.550221 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:47:59.550179    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-istio-token\") pod \"e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f\" (UID: \"67b39704-ab95-42ba-b4f3-b6b4a3a7125d\") " pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f"
Jul 28 01:47:59.550221 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:47:59.550218    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-istio-data\") pod \"e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f\" (UID: \"67b39704-ab95-42ba-b4f3-b6b4a3a7125d\") " pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f"
Jul 28 01:47:59.550376 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:47:59.550248    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-istiod-ca-cert\") pod \"e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f\" (UID: \"67b39704-ab95-42ba-b4f3-b6b4a3a7125d\") " pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f"
Jul 28 01:47:59.550376 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:47:59.550284    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-credential-socket\") pod \"e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f\" (UID: \"67b39704-ab95-42ba-b4f3-b6b4a3a7125d\") " pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f"
Jul 28 01:47:59.550509 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:47:59.550492    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-istio-data\") pod \"e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f\" (UID: \"67b39704-ab95-42ba-b4f3-b6b4a3a7125d\") " pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f"
Jul 28 01:47:59.550582 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:47:59.550490    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-workload-certs\") pod \"e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f\" (UID: \"67b39704-ab95-42ba-b4f3-b6b4a3a7125d\") " pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f"
Jul 28 01:47:59.550632 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:47:59.550605    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-workload-socket\") pod \"e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f\" (UID: \"67b39704-ab95-42ba-b4f3-b6b4a3a7125d\") " pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f"
Jul 28 01:47:59.550953 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:47:59.550932    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-istiod-ca-cert\") pod \"e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f\" (UID: \"67b39704-ab95-42ba-b4f3-b6b4a3a7125d\") " pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f"
Jul 28 01:47:59.552615 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:47:59.552590    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-istio-envoy\") pod \"e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f\" (UID: \"67b39704-ab95-42ba-b4f3-b6b4a3a7125d\") " pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f"
Jul 28 01:47:59.552729 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:47:59.552711    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-istio-podinfo\") pod \"e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f\" (UID: \"67b39704-ab95-42ba-b4f3-b6b4a3a7125d\") " pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f"
Jul 28 01:47:59.559284 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:47:59.559261    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-istio-token\") pod \"e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f\" (UID: \"67b39704-ab95-42ba-b4f3-b6b4a3a7125d\") " pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f"
Jul 28 01:47:59.559403 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:47:59.559390    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tl2j\" (UniqueName: \"kubernetes.io/projected/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-kube-api-access-9tl2j\") pod \"e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f\" (UID: \"67b39704-ab95-42ba-b4f3-b6b4a3a7125d\") " pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f"
Jul 28 01:47:59.668679 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:47:59.668585    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f"
Jul 28 01:47:59.809280 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:47:59.809255    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f"]
Jul 28 01:47:59.811387 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:47:59.811358    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67b39704_ab95_42ba_b4f3_b6b4a3a7125d.slice/crio-5999e44de824e93c77463e7256ac063018406222425cd66394f6f7474f9db0c7 WatchSource:0}: Error finding container 5999e44de824e93c77463e7256ac063018406222425cd66394f6f7474f9db0c7: Status 404 returned error can't find the container with id 5999e44de824e93c77463e7256ac063018406222425cd66394f6f7474f9db0c7
Jul 28 01:47:59.814108 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:47:59.814075    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:47:59.814217 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:47:59.814148    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:47:59.814217 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:47:59.814184    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:48:00.017577 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:00.017475    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f" event={"ID":"67b39704-ab95-42ba-b4f3-b6b4a3a7125d","Type":"ContainerStarted","Data":"db14e28102f9fac14941bb99e9d044908bb950a3f2f1bd6ef9eba4492d5c1126"}
Jul 28 01:48:00.017577 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:00.017535    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f" event={"ID":"67b39704-ab95-42ba-b4f3-b6b4a3a7125d","Type":"ContainerStarted","Data":"5999e44de824e93c77463e7256ac063018406222425cd66394f6f7474f9db0c7"}
Jul 28 01:48:00.036358 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:00.036299    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f" podStartSLOduration=1.036280092 podStartE2EDuration="1.036280092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:47:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:48:00.034211435 +0000 UTC m=+1950.537972757" watchObservedRunningTime="2026-07-28 01:48:00.036280092 +0000 UTC m=+1950.540041403"
Jul 28 01:48:00.669055 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:00.669014    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f"
Jul 28 01:48:00.674148 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:00.674126    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f"
Jul 28 01:48:01.023030 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:01.022950    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f"
Jul 28 01:48:01.023808 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:01.023789    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f"
Jul 28 01:48:17.064789 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:17.064748    2562 patch_prober.go:28] interesting pod/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 28 01:48:17.066112 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:17.064814    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f" podUID="67b39704-ab95-42ba-b4f3-b6b4a3a7125d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 28 01:48:17.102711 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:17.102684    2562 generic.go:356] "Generic (PLEG): container finished" podID="67b39704-ab95-42ba-b4f3-b6b4a3a7125d" containerID="db14e28102f9fac14941bb99e9d044908bb950a3f2f1bd6ef9eba4492d5c1126" exitCode=0
Jul 28 01:48:17.102819 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:17.102751    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f" event={"ID":"67b39704-ab95-42ba-b4f3-b6b4a3a7125d","Type":"ContainerDied","Data":"db14e28102f9fac14941bb99e9d044908bb950a3f2f1bd6ef9eba4492d5c1126"}
Jul 28 01:48:17.103190 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:17.103177    2562 scope.go:117] "RemoveContainer" containerID="db14e28102f9fac14941bb99e9d044908bb950a3f2f1bd6ef9eba4492d5c1126"
Jul 28 01:48:17.104237 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:17.104210    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:48:17.104327 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:17.104273    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:48:17.104327 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:17.104304    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:48:18.110577 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:18.110524    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f" event={"ID":"67b39704-ab95-42ba-b4f3-b6b4a3a7125d","Type":"ContainerStarted","Data":"be44097dcffc107c24bf5dd3e4542350f0e5e6c3188ac5e1b478787134280319"}
Jul 28 01:48:18.669341 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:18.669291    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f"
Jul 28 01:48:18.669614 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:18.669529    2562 patch_prober.go:28] interesting pod/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Jul 28 01:48:18.669709 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:18.669623    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f" podUID="67b39704-ab95-42ba-b4f3-b6b4a3a7125d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Jul 28 01:48:19.669175 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:19.669137    2562 patch_prober.go:28] interesting pod/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Jul 28 01:48:19.669601 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:19.669197    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f" podUID="67b39704-ab95-42ba-b4f3-b6b4a3a7125d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Jul 28 01:48:20.669944 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:20.669909    2562 patch_prober.go:28] interesting pod/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Jul 28 01:48:20.670433 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:20.669963    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f" podUID="67b39704-ab95-42ba-b4f3-b6b4a3a7125d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Jul 28 01:48:21.669984 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:21.669941    2562 patch_prober.go:28] interesting pod/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Jul 28 01:48:21.670404 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:21.670017    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f" podUID="67b39704-ab95-42ba-b4f3-b6b4a3a7125d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Jul 28 01:48:22.672820 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:22.672743    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f"
Jul 28 01:48:22.673173 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:22.673039    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f"
Jul 28 01:48:22.673675 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:22.673653    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f"
Jul 28 01:48:35.197145 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:35.197108    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f"]
Jul 28 01:48:35.197678 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:35.197369    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f" podUID="67b39704-ab95-42ba-b4f3-b6b4a3a7125d" containerName="istio-proxy" containerID="cri-o://be44097dcffc107c24bf5dd3e4542350f0e5e6c3188ac5e1b478787134280319" gracePeriod=30
Jul 28 01:48:37.675438 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:37.675394    2562 patch_prober.go:28] interesting pod/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 28 01:48:37.675843 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:37.675462    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f" podUID="67b39704-ab95-42ba-b4f3-b6b4a3a7125d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 01:48:40.458951 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:40.458884    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f"
Jul 28 01:48:40.545711 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:40.545680    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-workload-certs\") pod \"67b39704-ab95-42ba-b4f3-b6b4a3a7125d\" (UID: \"67b39704-ab95-42ba-b4f3-b6b4a3a7125d\") "
Jul 28 01:48:40.545908 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:40.545744    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-istio-podinfo\") pod \"67b39704-ab95-42ba-b4f3-b6b4a3a7125d\" (UID: \"67b39704-ab95-42ba-b4f3-b6b4a3a7125d\") "
Jul 28 01:48:40.545908 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:40.545765    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-workload-socket\") pod \"67b39704-ab95-42ba-b4f3-b6b4a3a7125d\" (UID: \"67b39704-ab95-42ba-b4f3-b6b4a3a7125d\") "
Jul 28 01:48:40.545908 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:40.545784    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-istio-envoy\") pod \"67b39704-ab95-42ba-b4f3-b6b4a3a7125d\" (UID: \"67b39704-ab95-42ba-b4f3-b6b4a3a7125d\") "
Jul 28 01:48:40.545908 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:40.545807    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-credential-socket\") pod \"67b39704-ab95-42ba-b4f3-b6b4a3a7125d\" (UID: \"67b39704-ab95-42ba-b4f3-b6b4a3a7125d\") "
Jul 28 01:48:40.545908 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:40.545833    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-istio-data\") pod \"67b39704-ab95-42ba-b4f3-b6b4a3a7125d\" (UID: \"67b39704-ab95-42ba-b4f3-b6b4a3a7125d\") "
Jul 28 01:48:40.545908 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:40.545856    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-istiod-ca-cert\") pod \"67b39704-ab95-42ba-b4f3-b6b4a3a7125d\" (UID: \"67b39704-ab95-42ba-b4f3-b6b4a3a7125d\") "
Jul 28 01:48:40.546240 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:40.545917    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9tl2j\" (UniqueName: \"kubernetes.io/projected/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-kube-api-access-9tl2j\") pod \"67b39704-ab95-42ba-b4f3-b6b4a3a7125d\" (UID: \"67b39704-ab95-42ba-b4f3-b6b4a3a7125d\") "
Jul 28 01:48:40.546240 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:40.545949    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-istio-token\") pod \"67b39704-ab95-42ba-b4f3-b6b4a3a7125d\" (UID: \"67b39704-ab95-42ba-b4f3-b6b4a3a7125d\") "
Jul 28 01:48:40.546240 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:40.546000    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "67b39704-ab95-42ba-b4f3-b6b4a3a7125d" (UID: "67b39704-ab95-42ba-b4f3-b6b4a3a7125d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:48:40.546240 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:40.546144    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "67b39704-ab95-42ba-b4f3-b6b4a3a7125d" (UID: "67b39704-ab95-42ba-b4f3-b6b4a3a7125d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:48:40.546495 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:40.546183    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "67b39704-ab95-42ba-b4f3-b6b4a3a7125d" (UID: "67b39704-ab95-42ba-b4f3-b6b4a3a7125d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:48:40.546495 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:40.546306    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "67b39704-ab95-42ba-b4f3-b6b4a3a7125d" (UID: "67b39704-ab95-42ba-b4f3-b6b4a3a7125d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:48:40.546495 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:40.546314    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-credential-socket\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:48:40.546495 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:40.546341    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-workload-certs\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:48:40.546848 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:40.546822    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-istio-data" (OuterVolumeSpecName: "istio-data") pod "67b39704-ab95-42ba-b4f3-b6b4a3a7125d" (UID: "67b39704-ab95-42ba-b4f3-b6b4a3a7125d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:48:40.548048 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:40.548020    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "67b39704-ab95-42ba-b4f3-b6b4a3a7125d" (UID: "67b39704-ab95-42ba-b4f3-b6b4a3a7125d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:48:40.548152 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:40.548069    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-istio-token" (OuterVolumeSpecName: "istio-token") pod "67b39704-ab95-42ba-b4f3-b6b4a3a7125d" (UID: "67b39704-ab95-42ba-b4f3-b6b4a3a7125d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:48:40.548503 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:40.548482    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-kube-api-access-9tl2j" (OuterVolumeSpecName: "kube-api-access-9tl2j") pod "67b39704-ab95-42ba-b4f3-b6b4a3a7125d" (UID: "67b39704-ab95-42ba-b4f3-b6b4a3a7125d"). InnerVolumeSpecName "kube-api-access-9tl2j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:48:40.548503 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:40.548493    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "67b39704-ab95-42ba-b4f3-b6b4a3a7125d" (UID: "67b39704-ab95-42ba-b4f3-b6b4a3a7125d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 01:48:40.647476 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:40.647440    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-istio-podinfo\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:48:40.647476 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:40.647470    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-workload-socket\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:48:40.647476 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:40.647479    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-istio-envoy\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:48:40.647476 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:40.647487    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-istio-data\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:48:40.647782 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:40.647495    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-istiod-ca-cert\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:48:40.647782 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:40.647504    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tl2j\" (UniqueName: \"kubernetes.io/projected/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-kube-api-access-9tl2j\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:48:40.647782 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:40.647511    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67b39704-ab95-42ba-b4f3-b6b4a3a7125d-istio-token\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:48:41.230190 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:41.230146    2562 generic.go:356] "Generic (PLEG): container finished" podID="67b39704-ab95-42ba-b4f3-b6b4a3a7125d" containerID="be44097dcffc107c24bf5dd3e4542350f0e5e6c3188ac5e1b478787134280319" exitCode=0
Jul 28 01:48:41.230388 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:41.230208    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f"
Jul 28 01:48:41.230388 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:41.230210    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f" event={"ID":"67b39704-ab95-42ba-b4f3-b6b4a3a7125d","Type":"ContainerDied","Data":"be44097dcffc107c24bf5dd3e4542350f0e5e6c3188ac5e1b478787134280319"}
Jul 28 01:48:41.230388 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:41.230265    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f" event={"ID":"67b39704-ab95-42ba-b4f3-b6b4a3a7125d","Type":"ContainerDied","Data":"5999e44de824e93c77463e7256ac063018406222425cd66394f6f7474f9db0c7"}
Jul 28 01:48:41.230388 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:41.230293    2562 scope.go:117] "RemoveContainer" containerID="be44097dcffc107c24bf5dd3e4542350f0e5e6c3188ac5e1b478787134280319"
Jul 28 01:48:41.241852 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:41.241831    2562 scope.go:117] "RemoveContainer" containerID="db14e28102f9fac14941bb99e9d044908bb950a3f2f1bd6ef9eba4492d5c1126"
Jul 28 01:48:41.250766 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:41.250747    2562 scope.go:117] "RemoveContainer" containerID="be44097dcffc107c24bf5dd3e4542350f0e5e6c3188ac5e1b478787134280319"
Jul 28 01:48:41.251003 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:48:41.250985    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be44097dcffc107c24bf5dd3e4542350f0e5e6c3188ac5e1b478787134280319\": container with ID starting with be44097dcffc107c24bf5dd3e4542350f0e5e6c3188ac5e1b478787134280319 not found: ID does not exist" containerID="be44097dcffc107c24bf5dd3e4542350f0e5e6c3188ac5e1b478787134280319"
Jul 28 01:48:41.251067 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:41.251014    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be44097dcffc107c24bf5dd3e4542350f0e5e6c3188ac5e1b478787134280319"} err="failed to get container status \"be44097dcffc107c24bf5dd3e4542350f0e5e6c3188ac5e1b478787134280319\": rpc error: code = NotFound desc = could not find container \"be44097dcffc107c24bf5dd3e4542350f0e5e6c3188ac5e1b478787134280319\": container with ID starting with be44097dcffc107c24bf5dd3e4542350f0e5e6c3188ac5e1b478787134280319 not found: ID does not exist"
Jul 28 01:48:41.251067 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:41.251032    2562 scope.go:117] "RemoveContainer" containerID="db14e28102f9fac14941bb99e9d044908bb950a3f2f1bd6ef9eba4492d5c1126"
Jul 28 01:48:41.251260 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:48:41.251245    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db14e28102f9fac14941bb99e9d044908bb950a3f2f1bd6ef9eba4492d5c1126\": container with ID starting with db14e28102f9fac14941bb99e9d044908bb950a3f2f1bd6ef9eba4492d5c1126 not found: ID does not exist" containerID="db14e28102f9fac14941bb99e9d044908bb950a3f2f1bd6ef9eba4492d5c1126"
Jul 28 01:48:41.251317 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:41.251263    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db14e28102f9fac14941bb99e9d044908bb950a3f2f1bd6ef9eba4492d5c1126"} err="failed to get container status \"db14e28102f9fac14941bb99e9d044908bb950a3f2f1bd6ef9eba4492d5c1126\": rpc error: code = NotFound desc = could not find container \"db14e28102f9fac14941bb99e9d044908bb950a3f2f1bd6ef9eba4492d5c1126\": container with ID starting with db14e28102f9fac14941bb99e9d044908bb950a3f2f1bd6ef9eba4492d5c1126 not found: ID does not exist"
Jul 28 01:48:41.254279 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:41.254258    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f"]
Jul 28 01:48:41.259973 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:41.259949    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-43a6ae00-openshift-default-5547f7688-ztz4f"]
Jul 28 01:48:42.013622 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:42.013591    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67b39704-ab95-42ba-b4f3-b6b4a3a7125d" path="/var/lib/kubelet/pods/67b39704-ab95-42ba-b4f3-b6b4a3a7125d/volumes"
Jul 28 01:48:54.459043 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:54.459013    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs"]
Jul 28 01:48:54.459430 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:54.459404    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67b39704-ab95-42ba-b4f3-b6b4a3a7125d" containerName="istio-proxy"
Jul 28 01:48:54.459430 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:54.459415    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="67b39704-ab95-42ba-b4f3-b6b4a3a7125d" containerName="istio-proxy"
Jul 28 01:48:54.459502 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:54.459493    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="67b39704-ab95-42ba-b4f3-b6b4a3a7125d" containerName="istio-proxy"
Jul 28 01:48:54.459606 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:54.459502    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="73d75776-8be7-4e88-aca4-04aaea9a6cd7" containerName="istio-proxy"
Jul 28 01:48:54.463897 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:54.463879    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs"
Jul 28 01:48:54.465926 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:54.465904    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-2a202a1f-openshift-default-dockercfg-hwqbq\""
Jul 28 01:48:54.471956 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:54.471928    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs"]
Jul 28 01:48:54.572454 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:54.572408    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/edf21de7-e89a-42fb-9987-4240410150af-istio-data\") pod \"e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs\" (UID: \"edf21de7-e89a-42fb-9987-4240410150af\") " pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs"
Jul 28 01:48:54.572655 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:54.572459    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/edf21de7-e89a-42fb-9987-4240410150af-credential-socket\") pod \"e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs\" (UID: \"edf21de7-e89a-42fb-9987-4240410150af\") " pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs"
Jul 28 01:48:54.572655 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:54.572516    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/edf21de7-e89a-42fb-9987-4240410150af-istio-envoy\") pod \"e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs\" (UID: \"edf21de7-e89a-42fb-9987-4240410150af\") " pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs"
Jul 28 01:48:54.572655 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:54.572588    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/edf21de7-e89a-42fb-9987-4240410150af-workload-socket\") pod \"e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs\" (UID: \"edf21de7-e89a-42fb-9987-4240410150af\") " pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs"
Jul 28 01:48:54.572655 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:54.572616    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/edf21de7-e89a-42fb-9987-4240410150af-istio-token\") pod \"e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs\" (UID: \"edf21de7-e89a-42fb-9987-4240410150af\") " pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs"
Jul 28 01:48:54.572655 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:54.572645    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/edf21de7-e89a-42fb-9987-4240410150af-istio-podinfo\") pod \"e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs\" (UID: \"edf21de7-e89a-42fb-9987-4240410150af\") " pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs"
Jul 28 01:48:54.572827 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:54.572689    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/edf21de7-e89a-42fb-9987-4240410150af-workload-certs\") pod \"e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs\" (UID: \"edf21de7-e89a-42fb-9987-4240410150af\") " pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs"
Jul 28 01:48:54.572827 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:54.572707    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l548g\" (UniqueName: \"kubernetes.io/projected/edf21de7-e89a-42fb-9987-4240410150af-kube-api-access-l548g\") pod \"e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs\" (UID: \"edf21de7-e89a-42fb-9987-4240410150af\") " pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs"
Jul 28 01:48:54.572827 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:54.572727    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/edf21de7-e89a-42fb-9987-4240410150af-istiod-ca-cert\") pod \"e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs\" (UID: \"edf21de7-e89a-42fb-9987-4240410150af\") " pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs"
Jul 28 01:48:54.674243 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:54.674185    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/edf21de7-e89a-42fb-9987-4240410150af-istio-data\") pod \"e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs\" (UID: \"edf21de7-e89a-42fb-9987-4240410150af\") " pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs"
Jul 28 01:48:54.674243 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:54.674258    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/edf21de7-e89a-42fb-9987-4240410150af-credential-socket\") pod \"e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs\" (UID: \"edf21de7-e89a-42fb-9987-4240410150af\") " pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs"
Jul 28 01:48:54.674491 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:54.674277    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/edf21de7-e89a-42fb-9987-4240410150af-istio-envoy\") pod \"e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs\" (UID: \"edf21de7-e89a-42fb-9987-4240410150af\") " pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs"
Jul 28 01:48:54.674491 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:54.674308    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/edf21de7-e89a-42fb-9987-4240410150af-workload-socket\") pod \"e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs\" (UID: \"edf21de7-e89a-42fb-9987-4240410150af\") " pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs"
Jul 28 01:48:54.674491 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:54.674435    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/edf21de7-e89a-42fb-9987-4240410150af-istio-token\") pod \"e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs\" (UID: \"edf21de7-e89a-42fb-9987-4240410150af\") " pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs"
Jul 28 01:48:54.674702 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:54.674521    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/edf21de7-e89a-42fb-9987-4240410150af-istio-podinfo\") pod \"e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs\" (UID: \"edf21de7-e89a-42fb-9987-4240410150af\") " pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs"
Jul 28 01:48:54.674702 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:54.674596    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/edf21de7-e89a-42fb-9987-4240410150af-workload-certs\") pod \"e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs\" (UID: \"edf21de7-e89a-42fb-9987-4240410150af\") " pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs"
Jul 28 01:48:54.674702 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:54.674598    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/edf21de7-e89a-42fb-9987-4240410150af-istio-data\") pod \"e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs\" (UID: \"edf21de7-e89a-42fb-9987-4240410150af\") " pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs"
Jul 28 01:48:54.674702 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:54.674630    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l548g\" (UniqueName: \"kubernetes.io/projected/edf21de7-e89a-42fb-9987-4240410150af-kube-api-access-l548g\") pod \"e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs\" (UID: \"edf21de7-e89a-42fb-9987-4240410150af\") " pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs"
Jul 28 01:48:54.674702 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:54.674649    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/edf21de7-e89a-42fb-9987-4240410150af-credential-socket\") pod \"e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs\" (UID: \"edf21de7-e89a-42fb-9987-4240410150af\") " pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs"
Jul 28 01:48:54.674702 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:54.674658    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/edf21de7-e89a-42fb-9987-4240410150af-workload-socket\") pod \"e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs\" (UID: \"edf21de7-e89a-42fb-9987-4240410150af\") " pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs"
Jul 28 01:48:54.674702 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:54.674661    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/edf21de7-e89a-42fb-9987-4240410150af-istiod-ca-cert\") pod \"e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs\" (UID: \"edf21de7-e89a-42fb-9987-4240410150af\") " pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs"
Jul 28 01:48:54.675063 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:54.674836    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/edf21de7-e89a-42fb-9987-4240410150af-workload-certs\") pod \"e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs\" (UID: \"edf21de7-e89a-42fb-9987-4240410150af\") " pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs"
Jul 28 01:48:54.675302 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:54.675279    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/edf21de7-e89a-42fb-9987-4240410150af-istiod-ca-cert\") pod \"e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs\" (UID: \"edf21de7-e89a-42fb-9987-4240410150af\") " pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs"
Jul 28 01:48:54.676749 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:54.676731    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/edf21de7-e89a-42fb-9987-4240410150af-istio-envoy\") pod \"e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs\" (UID: \"edf21de7-e89a-42fb-9987-4240410150af\") " pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs"
Jul 28 01:48:54.676886 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:54.676868    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/edf21de7-e89a-42fb-9987-4240410150af-istio-podinfo\") pod \"e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs\" (UID: \"edf21de7-e89a-42fb-9987-4240410150af\") " pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs"
Jul 28 01:48:54.682306 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:54.682286    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/edf21de7-e89a-42fb-9987-4240410150af-istio-token\") pod \"e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs\" (UID: \"edf21de7-e89a-42fb-9987-4240410150af\") " pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs"
Jul 28 01:48:54.682432 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:54.682416    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l548g\" (UniqueName: \"kubernetes.io/projected/edf21de7-e89a-42fb-9987-4240410150af-kube-api-access-l548g\") pod \"e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs\" (UID: \"edf21de7-e89a-42fb-9987-4240410150af\") " pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs"
Jul 28 01:48:54.775078 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:54.774991    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs"
Jul 28 01:48:54.918709 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:54.918647    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs"]
Jul 28 01:48:54.921131 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:48:54.921095    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedf21de7_e89a_42fb_9987_4240410150af.slice/crio-38c418f783d3039557c7e714937f2d412025ced81396901add3ea5f01fc08094 WatchSource:0}: Error finding container 38c418f783d3039557c7e714937f2d412025ced81396901add3ea5f01fc08094: Status 404 returned error can't find the container with id 38c418f783d3039557c7e714937f2d412025ced81396901add3ea5f01fc08094
Jul 28 01:48:54.923425 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:54.923386    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:48:54.923508 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:54.923482    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:48:54.923552 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:54.923532    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:48:55.308767 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:55.308729    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs" event={"ID":"edf21de7-e89a-42fb-9987-4240410150af","Type":"ContainerStarted","Data":"863b0037e3d79d13e12230f7473c27050a379c4714fde361b5aa073d6b739014"}
Jul 28 01:48:55.308969 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:55.308790    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs" event={"ID":"edf21de7-e89a-42fb-9987-4240410150af","Type":"ContainerStarted","Data":"38c418f783d3039557c7e714937f2d412025ced81396901add3ea5f01fc08094"}
Jul 28 01:48:55.327071 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:55.327023    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs" podStartSLOduration=1.327007413 podStartE2EDuration="1.327007413s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:48:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:48:55.324913332 +0000 UTC m=+2005.828674645" watchObservedRunningTime="2026-07-28 01:48:55.327007413 +0000 UTC m=+2005.830768721"
Jul 28 01:48:55.776062 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:55.776024    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs"
Jul 28 01:48:55.781323 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:55.781296    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs"
Jul 28 01:48:56.314013 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:56.313979    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs"
Jul 28 01:48:56.314831 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:48:56.314811    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs"
Jul 28 01:49:11.315622 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:49:11.315554    2562 patch_prober.go:28] interesting pod/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 28 01:49:11.316036 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:49:11.315636    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs" podUID="edf21de7-e89a-42fb-9987-4240410150af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 28 01:49:11.400485 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:49:11.400451    2562 generic.go:356] "Generic (PLEG): container finished" podID="edf21de7-e89a-42fb-9987-4240410150af" containerID="863b0037e3d79d13e12230f7473c27050a379c4714fde361b5aa073d6b739014" exitCode=0
Jul 28 01:49:11.400685 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:49:11.400510    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs" event={"ID":"edf21de7-e89a-42fb-9987-4240410150af","Type":"ContainerDied","Data":"863b0037e3d79d13e12230f7473c27050a379c4714fde361b5aa073d6b739014"}
Jul 28 01:49:11.400905 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:49:11.400889    2562 scope.go:117] "RemoveContainer" containerID="863b0037e3d79d13e12230f7473c27050a379c4714fde361b5aa073d6b739014"
Jul 28 01:49:11.401969 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:49:11.401937    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:49:11.402038 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:49:11.402023    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:49:11.402077 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:49:11.402062    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:49:12.407966 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:49:12.407931    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs" event={"ID":"edf21de7-e89a-42fb-9987-4240410150af","Type":"ContainerStarted","Data":"cc09a8b6d7066c3f37ae9d5fe549ac7de02144304f7053dbd23a33fe08eaecab"}
Jul 28 01:49:12.775269 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:49:12.775176    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs"
Jul 28 01:49:12.775469 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:49:12.775446    2562 patch_prober.go:28] interesting pod/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 28 01:49:12.775531 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:49:12.775500    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs" podUID="edf21de7-e89a-42fb-9987-4240410150af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 28 01:49:13.776157 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:49:13.776114    2562 patch_prober.go:28] interesting pod/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 28 01:49:13.776688 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:49:13.776196    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs" podUID="edf21de7-e89a-42fb-9987-4240410150af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 28 01:49:14.776308 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:49:14.776270    2562 patch_prober.go:28] interesting pod/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 28 01:49:14.776743 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:49:14.776338    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs" podUID="edf21de7-e89a-42fb-9987-4240410150af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 28 01:49:15.775818 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:49:15.775782    2562 patch_prober.go:28] interesting pod/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 28 01:49:15.775976 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:49:15.775846    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs" podUID="edf21de7-e89a-42fb-9987-4240410150af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 28 01:49:16.779678 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:49:16.779646    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs"
Jul 28 01:49:16.780046 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:49:16.779914    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs"
Jul 28 01:49:16.780637 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:49:16.780617    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs"
Jul 28 01:49:51.641132 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:49:51.641097    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2a202a1f-v5k77"]
Jul 28 01:49:51.641717 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:49:51.641531    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67b39704-ab95-42ba-b4f3-b6b4a3a7125d" containerName="istio-proxy"
Jul 28 01:49:51.641717 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:49:51.641543    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="67b39704-ab95-42ba-b4f3-b6b4a3a7125d" containerName="istio-proxy"
Jul 28 01:49:51.641717 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:49:51.641619    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="67b39704-ab95-42ba-b4f3-b6b4a3a7125d" containerName="istio-proxy"
Jul 28 01:49:51.644968 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:49:51.644949    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2a202a1f-v5k77"
Jul 28 01:49:51.646863 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:49:51.646844    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wjxvt\""
Jul 28 01:49:51.655698 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:49:51.655674    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2a202a1f-v5k77"]
Jul 28 01:49:51.809143 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:49:51.809103    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8128c1aa-0bc4-4a70-8459-d5eb5af33f91-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-2a202a1f-v5k77\" (UID: \"8128c1aa-0bc4-4a70-8459-d5eb5af33f91\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2a202a1f-v5k77"
Jul 28 01:49:51.910427 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:49:51.910329    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8128c1aa-0bc4-4a70-8459-d5eb5af33f91-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-2a202a1f-v5k77\" (UID: \"8128c1aa-0bc4-4a70-8459-d5eb5af33f91\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2a202a1f-v5k77"
Jul 28 01:49:51.911013 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:49:51.910993    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8128c1aa-0bc4-4a70-8459-d5eb5af33f91-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-2a202a1f-v5k77\" (UID: \"8128c1aa-0bc4-4a70-8459-d5eb5af33f91\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2a202a1f-v5k77"
Jul 28 01:49:51.957438 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:49:51.957396    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2a202a1f-v5k77"
Jul 28 01:49:52.102441 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:49:52.102413    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2a202a1f-v5k77"]
Jul 28 01:49:52.105135 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:49:52.105109    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8128c1aa_0bc4_4a70_8459_d5eb5af33f91.slice/crio-ce64d4147bb2b6c2b999eec2e41a65698566bc6e076726b63fe446939660626c WatchSource:0}: Error finding container ce64d4147bb2b6c2b999eec2e41a65698566bc6e076726b63fe446939660626c: Status 404 returned error can't find the container with id ce64d4147bb2b6c2b999eec2e41a65698566bc6e076726b63fe446939660626c
Jul 28 01:49:52.625924 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:49:52.625888    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2a202a1f-v5k77" event={"ID":"8128c1aa-0bc4-4a70-8459-d5eb5af33f91","Type":"ContainerStarted","Data":"62df8f4a9863d629216361d396a5ae093e713b49e1242971b7712c300ad83041"}
Jul 28 01:49:52.626088 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:49:52.625975    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2a202a1f-v5k77" event={"ID":"8128c1aa-0bc4-4a70-8459-d5eb5af33f91","Type":"ContainerStarted","Data":"ce64d4147bb2b6c2b999eec2e41a65698566bc6e076726b63fe446939660626c"}
Jul 28 01:49:52.641378 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:49:52.641326    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2a202a1f-v5k77" podStartSLOduration=1.641311391 podStartE2EDuration="1.641311391s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:49:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:49:52.638793071 +0000 UTC m=+2063.142554397" watchObservedRunningTime="2026-07-28 01:49:52.641311391 +0000 UTC m=+2063.145072702"
Jul 28 01:49:53.632323 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:49:53.632285    2562 generic.go:356] "Generic (PLEG): container finished" podID="8128c1aa-0bc4-4a70-8459-d5eb5af33f91" containerID="62df8f4a9863d629216361d396a5ae093e713b49e1242971b7712c300ad83041" exitCode=0
Jul 28 01:49:53.632508 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:49:53.632370    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2a202a1f-v5k77" event={"ID":"8128c1aa-0bc4-4a70-8459-d5eb5af33f91","Type":"ContainerDied","Data":"62df8f4a9863d629216361d396a5ae093e713b49e1242971b7712c300ad83041"}
Jul 28 01:49:54.783290 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:49:54.783262    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2a202a1f-v5k77"
Jul 28 01:49:54.937766 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:49:54.937657    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8128c1aa-0bc4-4a70-8459-d5eb5af33f91-maas-api-service-ca\") pod \"8128c1aa-0bc4-4a70-8459-d5eb5af33f91\" (UID: \"8128c1aa-0bc4-4a70-8459-d5eb5af33f91\") "
Jul 28 01:49:54.938026 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:49:54.938003    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8128c1aa-0bc4-4a70-8459-d5eb5af33f91-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8128c1aa-0bc4-4a70-8459-d5eb5af33f91" (UID: "8128c1aa-0bc4-4a70-8459-d5eb5af33f91"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:49:55.038660 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:49:55.038618    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8128c1aa-0bc4-4a70-8459-d5eb5af33f91-maas-api-service-ca\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:49:55.645286 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:49:55.645253    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2a202a1f-v5k77" event={"ID":"8128c1aa-0bc4-4a70-8459-d5eb5af33f91","Type":"ContainerDied","Data":"ce64d4147bb2b6c2b999eec2e41a65698566bc6e076726b63fe446939660626c"}
Jul 28 01:49:55.645286 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:49:55.645273    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2a202a1f-v5k77"
Jul 28 01:49:55.645505 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:49:55.645309    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ce64d4147bb2b6c2b999eec2e41a65698566bc6e076726b63fe446939660626c"
Jul 28 01:50:11.719647 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:50:11.719605    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2a202a1f-v5k77"]
Jul 28 01:50:11.721456 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:50:11.721432    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2a202a1f-v5k77"]
Jul 28 01:50:12.013437 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:50:12.013351    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8128c1aa-0bc4-4a70-8459-d5eb5af33f91" path="/var/lib/kubelet/pods/8128c1aa-0bc4-4a70-8459-d5eb5af33f91/volumes"
Jul 28 01:50:30.205169 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:50:30.205137    2562 scope.go:117] "RemoveContainer" containerID="04eb1385fa422871b37afb42c79ef28afafa4ea239e730d679f5294000d37da6"
Jul 28 01:51:16.713576 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:51:16.713525    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs"]
Jul 28 01:51:16.714227 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:51:16.713822    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs" podUID="edf21de7-e89a-42fb-9987-4240410150af" containerName="istio-proxy" containerID="cri-o://cc09a8b6d7066c3f37ae9d5fe549ac7de02144304f7053dbd23a33fe08eaecab" gracePeriod=30
Jul 28 01:51:16.782452 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:51:16.782414    2562 patch_prober.go:28] interesting pod/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 01:51:16.782639 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:51:16.782484    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs" podUID="edf21de7-e89a-42fb-9987-4240410150af" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 01:51:21.982891 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:51:21.982828    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs"
Jul 28 01:51:22.046867 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:51:22.046838    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/edf21de7-e89a-42fb-9987-4240410150af-istio-podinfo\") pod \"edf21de7-e89a-42fb-9987-4240410150af\" (UID: \"edf21de7-e89a-42fb-9987-4240410150af\") "
Jul 28 01:51:22.047081 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:51:22.046876    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l548g\" (UniqueName: \"kubernetes.io/projected/edf21de7-e89a-42fb-9987-4240410150af-kube-api-access-l548g\") pod \"edf21de7-e89a-42fb-9987-4240410150af\" (UID: \"edf21de7-e89a-42fb-9987-4240410150af\") "
Jul 28 01:51:22.047081 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:51:22.046894    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/edf21de7-e89a-42fb-9987-4240410150af-istio-envoy\") pod \"edf21de7-e89a-42fb-9987-4240410150af\" (UID: \"edf21de7-e89a-42fb-9987-4240410150af\") "
Jul 28 01:51:22.047081 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:51:22.046914    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/edf21de7-e89a-42fb-9987-4240410150af-workload-certs\") pod \"edf21de7-e89a-42fb-9987-4240410150af\" (UID: \"edf21de7-e89a-42fb-9987-4240410150af\") "
Jul 28 01:51:22.047259 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:51:22.047085    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/edf21de7-e89a-42fb-9987-4240410150af-istio-data\") pod \"edf21de7-e89a-42fb-9987-4240410150af\" (UID: \"edf21de7-e89a-42fb-9987-4240410150af\") "
Jul 28 01:51:22.047259 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:51:22.047143    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/edf21de7-e89a-42fb-9987-4240410150af-istio-token\") pod \"edf21de7-e89a-42fb-9987-4240410150af\" (UID: \"edf21de7-e89a-42fb-9987-4240410150af\") "
Jul 28 01:51:22.047259 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:51:22.047174    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/edf21de7-e89a-42fb-9987-4240410150af-credential-socket\") pod \"edf21de7-e89a-42fb-9987-4240410150af\" (UID: \"edf21de7-e89a-42fb-9987-4240410150af\") "
Jul 28 01:51:22.047259 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:51:22.047241    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edf21de7-e89a-42fb-9987-4240410150af-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "edf21de7-e89a-42fb-9987-4240410150af" (UID: "edf21de7-e89a-42fb-9987-4240410150af"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:51:22.047259 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:51:22.047251    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/edf21de7-e89a-42fb-9987-4240410150af-istiod-ca-cert\") pod \"edf21de7-e89a-42fb-9987-4240410150af\" (UID: \"edf21de7-e89a-42fb-9987-4240410150af\") "
Jul 28 01:51:22.047517 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:51:22.047282    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/edf21de7-e89a-42fb-9987-4240410150af-workload-socket\") pod \"edf21de7-e89a-42fb-9987-4240410150af\" (UID: \"edf21de7-e89a-42fb-9987-4240410150af\") "
Jul 28 01:51:22.047517 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:51:22.047473    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edf21de7-e89a-42fb-9987-4240410150af-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "edf21de7-e89a-42fb-9987-4240410150af" (UID: "edf21de7-e89a-42fb-9987-4240410150af"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:51:22.048526 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:51:22.047675    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edf21de7-e89a-42fb-9987-4240410150af-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "edf21de7-e89a-42fb-9987-4240410150af" (UID: "edf21de7-e89a-42fb-9987-4240410150af"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:51:22.048526 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:51:22.047817    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/edf21de7-e89a-42fb-9987-4240410150af-workload-certs\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:51:22.048526 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:51:22.047836    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/edf21de7-e89a-42fb-9987-4240410150af-credential-socket\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:51:22.048526 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:51:22.047852    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/edf21de7-e89a-42fb-9987-4240410150af-workload-socket\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:51:22.048526 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:51:22.047964    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edf21de7-e89a-42fb-9987-4240410150af-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "edf21de7-e89a-42fb-9987-4240410150af" (UID: "edf21de7-e89a-42fb-9987-4240410150af"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:51:22.048526 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:51:22.048104    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edf21de7-e89a-42fb-9987-4240410150af-istio-data" (OuterVolumeSpecName: "istio-data") pod "edf21de7-e89a-42fb-9987-4240410150af" (UID: "edf21de7-e89a-42fb-9987-4240410150af"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:51:22.049450 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:51:22.049426    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/edf21de7-e89a-42fb-9987-4240410150af-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "edf21de7-e89a-42fb-9987-4240410150af" (UID: "edf21de7-e89a-42fb-9987-4240410150af"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 01:51:22.049546 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:51:22.049487    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edf21de7-e89a-42fb-9987-4240410150af-kube-api-access-l548g" (OuterVolumeSpecName: "kube-api-access-l548g") pod "edf21de7-e89a-42fb-9987-4240410150af" (UID: "edf21de7-e89a-42fb-9987-4240410150af"). InnerVolumeSpecName "kube-api-access-l548g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:51:22.049678 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:51:22.049657    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edf21de7-e89a-42fb-9987-4240410150af-istio-token" (OuterVolumeSpecName: "istio-token") pod "edf21de7-e89a-42fb-9987-4240410150af" (UID: "edf21de7-e89a-42fb-9987-4240410150af"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:51:22.049740 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:51:22.049684    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edf21de7-e89a-42fb-9987-4240410150af-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "edf21de7-e89a-42fb-9987-4240410150af" (UID: "edf21de7-e89a-42fb-9987-4240410150af"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:51:22.111878 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:51:22.111840    2562 generic.go:356] "Generic (PLEG): container finished" podID="edf21de7-e89a-42fb-9987-4240410150af" containerID="cc09a8b6d7066c3f37ae9d5fe549ac7de02144304f7053dbd23a33fe08eaecab" exitCode=0
Jul 28 01:51:22.112070 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:51:22.111894    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs"
Jul 28 01:51:22.112070 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:51:22.111922    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs" event={"ID":"edf21de7-e89a-42fb-9987-4240410150af","Type":"ContainerDied","Data":"cc09a8b6d7066c3f37ae9d5fe549ac7de02144304f7053dbd23a33fe08eaecab"}
Jul 28 01:51:22.112070 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:51:22.111991    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs" event={"ID":"edf21de7-e89a-42fb-9987-4240410150af","Type":"ContainerDied","Data":"38c418f783d3039557c7e714937f2d412025ced81396901add3ea5f01fc08094"}
Jul 28 01:51:22.112070 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:51:22.112022    2562 scope.go:117] "RemoveContainer" containerID="cc09a8b6d7066c3f37ae9d5fe549ac7de02144304f7053dbd23a33fe08eaecab"
Jul 28 01:51:22.121611 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:51:22.121591    2562 scope.go:117] "RemoveContainer" containerID="863b0037e3d79d13e12230f7473c27050a379c4714fde361b5aa073d6b739014"
Jul 28 01:51:22.130212 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:51:22.130183    2562 scope.go:117] "RemoveContainer" containerID="cc09a8b6d7066c3f37ae9d5fe549ac7de02144304f7053dbd23a33fe08eaecab"
Jul 28 01:51:22.130521 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:51:22.130501    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc09a8b6d7066c3f37ae9d5fe549ac7de02144304f7053dbd23a33fe08eaecab\": container with ID starting with cc09a8b6d7066c3f37ae9d5fe549ac7de02144304f7053dbd23a33fe08eaecab not found: ID does not exist" containerID="cc09a8b6d7066c3f37ae9d5fe549ac7de02144304f7053dbd23a33fe08eaecab"
Jul 28 01:51:22.130648 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:51:22.130531    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc09a8b6d7066c3f37ae9d5fe549ac7de02144304f7053dbd23a33fe08eaecab"} err="failed to get container status \"cc09a8b6d7066c3f37ae9d5fe549ac7de02144304f7053dbd23a33fe08eaecab\": rpc error: code = NotFound desc = could not find container \"cc09a8b6d7066c3f37ae9d5fe549ac7de02144304f7053dbd23a33fe08eaecab\": container with ID starting with cc09a8b6d7066c3f37ae9d5fe549ac7de02144304f7053dbd23a33fe08eaecab not found: ID does not exist"
Jul 28 01:51:22.130648 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:51:22.130549    2562 scope.go:117] "RemoveContainer" containerID="863b0037e3d79d13e12230f7473c27050a379c4714fde361b5aa073d6b739014"
Jul 28 01:51:22.130837 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:51:22.130822    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"863b0037e3d79d13e12230f7473c27050a379c4714fde361b5aa073d6b739014\": container with ID starting with 863b0037e3d79d13e12230f7473c27050a379c4714fde361b5aa073d6b739014 not found: ID does not exist" containerID="863b0037e3d79d13e12230f7473c27050a379c4714fde361b5aa073d6b739014"
Jul 28 01:51:22.130891 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:51:22.130842    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"863b0037e3d79d13e12230f7473c27050a379c4714fde361b5aa073d6b739014"} err="failed to get container status \"863b0037e3d79d13e12230f7473c27050a379c4714fde361b5aa073d6b739014\": rpc error: code = NotFound desc = could not find container \"863b0037e3d79d13e12230f7473c27050a379c4714fde361b5aa073d6b739014\": container with ID starting with 863b0037e3d79d13e12230f7473c27050a379c4714fde361b5aa073d6b739014 not found: ID does not exist"
Jul 28 01:51:22.133948 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:51:22.133927    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs"]
Jul 28 01:51:22.137215 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:51:22.137194    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-2a202a1f-openshift-default-6cc7fb5764-4ntjs"]
Jul 28 01:51:22.148339 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:51:22.148309    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/edf21de7-e89a-42fb-9987-4240410150af-istiod-ca-cert\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:51:22.148339 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:51:22.148331    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/edf21de7-e89a-42fb-9987-4240410150af-istio-podinfo\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:51:22.148339 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:51:22.148340    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l548g\" (UniqueName: \"kubernetes.io/projected/edf21de7-e89a-42fb-9987-4240410150af-kube-api-access-l548g\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:51:22.148504 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:51:22.148351    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/edf21de7-e89a-42fb-9987-4240410150af-istio-envoy\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:51:22.148504 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:51:22.148361    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/edf21de7-e89a-42fb-9987-4240410150af-istio-data\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:51:22.148504 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:51:22.148369    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/edf21de7-e89a-42fb-9987-4240410150af-istio-token\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:51:24.013912 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:51:24.013838    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edf21de7-e89a-42fb-9987-4240410150af" path="/var/lib/kubelet/pods/edf21de7-e89a-42fb-9987-4240410150af/volumes"
Jul 28 01:51:30.225815 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:51:30.225778    2562 scope.go:117] "RemoveContainer" containerID="5cef1ec14bd336a356038f447404be7df3bfaea9e4eb16c231a677cd94326aab"
Jul 28 01:52:11.511194 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:11.511152    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9"]
Jul 28 01:52:11.511816 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:11.511766    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edf21de7-e89a-42fb-9987-4240410150af" containerName="istio-proxy"
Jul 28 01:52:11.511816 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:11.511784    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="edf21de7-e89a-42fb-9987-4240410150af" containerName="istio-proxy"
Jul 28 01:52:11.511933 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:11.511818    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8128c1aa-0bc4-4a70-8459-d5eb5af33f91" containerName="revoke-keys"
Jul 28 01:52:11.511933 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:11.511827    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8128c1aa-0bc4-4a70-8459-d5eb5af33f91" containerName="revoke-keys"
Jul 28 01:52:11.511933 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:11.511930    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="edf21de7-e89a-42fb-9987-4240410150af" containerName="istio-proxy"
Jul 28 01:52:11.512085 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:11.511943    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="edf21de7-e89a-42fb-9987-4240410150af" containerName="istio-proxy"
Jul 28 01:52:11.512085 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:11.511954    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8128c1aa-0bc4-4a70-8459-d5eb5af33f91" containerName="revoke-keys"
Jul 28 01:52:11.515446 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:11.515426    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9"
Jul 28 01:52:11.517342 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:11.517318    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-896d36-openshift-default-dockercfg-rxr9c\""
Jul 28 01:52:11.526413 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:11.526388    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9"]
Jul 28 01:52:11.685842 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:11.685808    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/273a09c0-92ea-4fa0-8d52-84d516337a0d-istio-envoy\") pod \"e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9\" (UID: \"273a09c0-92ea-4fa0-8d52-84d516337a0d\") " pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9"
Jul 28 01:52:11.686035 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:11.685854    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/273a09c0-92ea-4fa0-8d52-84d516337a0d-credential-socket\") pod \"e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9\" (UID: \"273a09c0-92ea-4fa0-8d52-84d516337a0d\") " pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9"
Jul 28 01:52:11.686035 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:11.685878    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/273a09c0-92ea-4fa0-8d52-84d516337a0d-istiod-ca-cert\") pod \"e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9\" (UID: \"273a09c0-92ea-4fa0-8d52-84d516337a0d\") " pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9"
Jul 28 01:52:11.686035 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:11.685993    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/273a09c0-92ea-4fa0-8d52-84d516337a0d-istio-token\") pod \"e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9\" (UID: \"273a09c0-92ea-4fa0-8d52-84d516337a0d\") " pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9"
Jul 28 01:52:11.686165 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:11.686041    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/273a09c0-92ea-4fa0-8d52-84d516337a0d-istio-podinfo\") pod \"e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9\" (UID: \"273a09c0-92ea-4fa0-8d52-84d516337a0d\") " pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9"
Jul 28 01:52:11.686165 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:11.686107    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dcqx\" (UniqueName: \"kubernetes.io/projected/273a09c0-92ea-4fa0-8d52-84d516337a0d-kube-api-access-6dcqx\") pod \"e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9\" (UID: \"273a09c0-92ea-4fa0-8d52-84d516337a0d\") " pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9"
Jul 28 01:52:11.686165 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:11.686150    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/273a09c0-92ea-4fa0-8d52-84d516337a0d-workload-certs\") pod \"e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9\" (UID: \"273a09c0-92ea-4fa0-8d52-84d516337a0d\") " pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9"
Jul 28 01:52:11.686295 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:11.686182    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/273a09c0-92ea-4fa0-8d52-84d516337a0d-workload-socket\") pod \"e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9\" (UID: \"273a09c0-92ea-4fa0-8d52-84d516337a0d\") " pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9"
Jul 28 01:52:11.686295 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:11.686212    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/273a09c0-92ea-4fa0-8d52-84d516337a0d-istio-data\") pod \"e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9\" (UID: \"273a09c0-92ea-4fa0-8d52-84d516337a0d\") " pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9"
Jul 28 01:52:11.786883 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:11.786793    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/273a09c0-92ea-4fa0-8d52-84d516337a0d-istio-data\") pod \"e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9\" (UID: \"273a09c0-92ea-4fa0-8d52-84d516337a0d\") " pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9"
Jul 28 01:52:11.786883 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:11.786838    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/273a09c0-92ea-4fa0-8d52-84d516337a0d-istio-envoy\") pod \"e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9\" (UID: \"273a09c0-92ea-4fa0-8d52-84d516337a0d\") " pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9"
Jul 28 01:52:11.787095 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:11.786938    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/273a09c0-92ea-4fa0-8d52-84d516337a0d-credential-socket\") pod \"e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9\" (UID: \"273a09c0-92ea-4fa0-8d52-84d516337a0d\") " pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9"
Jul 28 01:52:11.787095 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:11.786961    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/273a09c0-92ea-4fa0-8d52-84d516337a0d-istiod-ca-cert\") pod \"e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9\" (UID: \"273a09c0-92ea-4fa0-8d52-84d516337a0d\") " pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9"
Jul 28 01:52:11.787095 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:11.786999    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/273a09c0-92ea-4fa0-8d52-84d516337a0d-istio-token\") pod \"e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9\" (UID: \"273a09c0-92ea-4fa0-8d52-84d516337a0d\") " pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9"
Jul 28 01:52:11.787095 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:11.787020    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/273a09c0-92ea-4fa0-8d52-84d516337a0d-istio-podinfo\") pod \"e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9\" (UID: \"273a09c0-92ea-4fa0-8d52-84d516337a0d\") " pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9"
Jul 28 01:52:11.787095 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:11.787068    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dcqx\" (UniqueName: \"kubernetes.io/projected/273a09c0-92ea-4fa0-8d52-84d516337a0d-kube-api-access-6dcqx\") pod \"e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9\" (UID: \"273a09c0-92ea-4fa0-8d52-84d516337a0d\") " pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9"
Jul 28 01:52:11.787095 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:11.787092    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/273a09c0-92ea-4fa0-8d52-84d516337a0d-workload-certs\") pod \"e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9\" (UID: \"273a09c0-92ea-4fa0-8d52-84d516337a0d\") " pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9"
Jul 28 01:52:11.787413 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:11.787118    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/273a09c0-92ea-4fa0-8d52-84d516337a0d-workload-socket\") pod \"e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9\" (UID: \"273a09c0-92ea-4fa0-8d52-84d516337a0d\") " pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9"
Jul 28 01:52:11.787413 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:11.787237    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/273a09c0-92ea-4fa0-8d52-84d516337a0d-istio-data\") pod \"e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9\" (UID: \"273a09c0-92ea-4fa0-8d52-84d516337a0d\") " pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9"
Jul 28 01:52:11.787709 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:11.787593    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/273a09c0-92ea-4fa0-8d52-84d516337a0d-workload-certs\") pod \"e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9\" (UID: \"273a09c0-92ea-4fa0-8d52-84d516337a0d\") " pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9"
Jul 28 01:52:11.787709 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:11.787600    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/273a09c0-92ea-4fa0-8d52-84d516337a0d-workload-socket\") pod \"e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9\" (UID: \"273a09c0-92ea-4fa0-8d52-84d516337a0d\") " pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9"
Jul 28 01:52:11.787840 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:11.787784    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/273a09c0-92ea-4fa0-8d52-84d516337a0d-istiod-ca-cert\") pod \"e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9\" (UID: \"273a09c0-92ea-4fa0-8d52-84d516337a0d\") " pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9"
Jul 28 01:52:11.787902 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:11.787892    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/273a09c0-92ea-4fa0-8d52-84d516337a0d-credential-socket\") pod \"e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9\" (UID: \"273a09c0-92ea-4fa0-8d52-84d516337a0d\") " pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9"
Jul 28 01:52:11.789295 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:11.789266    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/273a09c0-92ea-4fa0-8d52-84d516337a0d-istio-envoy\") pod \"e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9\" (UID: \"273a09c0-92ea-4fa0-8d52-84d516337a0d\") " pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9"
Jul 28 01:52:11.789573 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:11.789540    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/273a09c0-92ea-4fa0-8d52-84d516337a0d-istio-podinfo\") pod \"e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9\" (UID: \"273a09c0-92ea-4fa0-8d52-84d516337a0d\") " pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9"
Jul 28 01:52:11.794117 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:11.794094    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/273a09c0-92ea-4fa0-8d52-84d516337a0d-istio-token\") pod \"e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9\" (UID: \"273a09c0-92ea-4fa0-8d52-84d516337a0d\") " pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9"
Jul 28 01:52:11.794242 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:11.794143    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dcqx\" (UniqueName: \"kubernetes.io/projected/273a09c0-92ea-4fa0-8d52-84d516337a0d-kube-api-access-6dcqx\") pod \"e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9\" (UID: \"273a09c0-92ea-4fa0-8d52-84d516337a0d\") " pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9"
Jul 28 01:52:11.827243 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:11.827204    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9"
Jul 28 01:52:11.972208 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:11.972177    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9"]
Jul 28 01:52:11.974281 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:52:11.974253    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod273a09c0_92ea_4fa0_8d52_84d516337a0d.slice/crio-d9a1423f1e6384b13934b92f2dc27b45b81eec90fc500a387676058b5e571ab3 WatchSource:0}: Error finding container d9a1423f1e6384b13934b92f2dc27b45b81eec90fc500a387676058b5e571ab3: Status 404 returned error can't find the container with id d9a1423f1e6384b13934b92f2dc27b45b81eec90fc500a387676058b5e571ab3
Jul 28 01:52:11.976841 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:11.976804    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:52:11.976952 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:11.976891    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:52:11.976952 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:11.976935    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:52:12.373936 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:12.373897    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9" event={"ID":"273a09c0-92ea-4fa0-8d52-84d516337a0d","Type":"ContainerStarted","Data":"85e90013767ab91b2d5d2f10946e494cd4001a9a4f401af19df3e2c31f01f3e8"}
Jul 28 01:52:12.374146 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:12.373959    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9" event={"ID":"273a09c0-92ea-4fa0-8d52-84d516337a0d","Type":"ContainerStarted","Data":"d9a1423f1e6384b13934b92f2dc27b45b81eec90fc500a387676058b5e571ab3"}
Jul 28 01:52:12.391612 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:12.391538    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9" podStartSLOduration=1.391522787 podStartE2EDuration="1.391522787s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:52:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:52:12.390600777 +0000 UTC m=+2202.894362104" watchObservedRunningTime="2026-07-28 01:52:12.391522787 +0000 UTC m=+2202.895284099"
Jul 28 01:52:12.827872 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:12.827775    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9"
Jul 28 01:52:13.832908 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:13.832880    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9"
Jul 28 01:52:14.383631 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:14.383595    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9"
Jul 28 01:52:14.384622 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:14.384599    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9"
Jul 28 01:52:30.344092 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:30.342948    2562 patch_prober.go:28] interesting pod/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": read tcp 10.132.0.2:48810->10.132.0.64:15021: read: connection reset by peer" start-of-body=
Jul 28 01:52:30.344092 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:30.343031    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9" podUID="273a09c0-92ea-4fa0-8d52-84d516337a0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": read tcp 10.132.0.2:48810->10.132.0.64:15021: read: connection reset by peer"
Jul 28 01:52:30.476817 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:30.476786    2562 generic.go:356] "Generic (PLEG): container finished" podID="273a09c0-92ea-4fa0-8d52-84d516337a0d" containerID="85e90013767ab91b2d5d2f10946e494cd4001a9a4f401af19df3e2c31f01f3e8" exitCode=0
Jul 28 01:52:30.476985 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:30.476834    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9" event={"ID":"273a09c0-92ea-4fa0-8d52-84d516337a0d","Type":"ContainerDied","Data":"85e90013767ab91b2d5d2f10946e494cd4001a9a4f401af19df3e2c31f01f3e8"}
Jul 28 01:52:30.477240 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:30.477226    2562 scope.go:117] "RemoveContainer" containerID="85e90013767ab91b2d5d2f10946e494cd4001a9a4f401af19df3e2c31f01f3e8"
Jul 28 01:52:30.478324 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:30.478292    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:52:30.478443 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:30.478380    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:52:30.478443 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:30.478427    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:52:31.484433 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:31.484403    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9" event={"ID":"273a09c0-92ea-4fa0-8d52-84d516337a0d","Type":"ContainerStarted","Data":"c503081e491ceeec3d9ed55b6d35d419ad7208979b7e6c71b41aba1d0fe45f7e"}
Jul 28 01:52:31.828414 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:31.828315    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9"
Jul 28 01:52:31.828624 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:31.828591    2562 patch_prober.go:28] interesting pod/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 28 01:52:31.828718 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:31.828664    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9" podUID="273a09c0-92ea-4fa0-8d52-84d516337a0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 28 01:52:32.828037 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:32.828001    2562 patch_prober.go:28] interesting pod/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 28 01:52:32.828425 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:32.828066    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9" podUID="273a09c0-92ea-4fa0-8d52-84d516337a0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 28 01:52:33.828104 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:33.828068    2562 patch_prober.go:28] interesting pod/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 28 01:52:33.828498 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:33.828133    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9" podUID="273a09c0-92ea-4fa0-8d52-84d516337a0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 28 01:52:34.827913 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:34.827876    2562 patch_prober.go:28] interesting pod/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 28 01:52:34.828068 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:34.827945    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9" podUID="273a09c0-92ea-4fa0-8d52-84d516337a0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 28 01:52:35.832349 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:35.832311    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9"
Jul 28 01:52:35.832777 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:35.832713    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9"
Jul 28 01:52:35.833532 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:52:35.833511    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9"
Jul 28 01:54:18.666591 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:18.666543    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-896d36-pqpjh"]
Jul 28 01:54:18.667178 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:18.667006    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edf21de7-e89a-42fb-9987-4240410150af" containerName="istio-proxy"
Jul 28 01:54:18.667178 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:18.667019    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="edf21de7-e89a-42fb-9987-4240410150af" containerName="istio-proxy"
Jul 28 01:54:18.670220 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:18.670200    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-896d36-pqpjh"
Jul 28 01:54:18.672418 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:18.672394    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wjxvt\""
Jul 28 01:54:18.677678 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:18.677653    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-896d36-pqpjh"]
Jul 28 01:54:18.734570 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:18.734533    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5810ad66-3364-483c-ab73-73bb54bc1122-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-896d36-pqpjh\" (UID: \"5810ad66-3364-483c-ab73-73bb54bc1122\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-896d36-pqpjh"
Jul 28 01:54:18.835599 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:18.835549    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5810ad66-3364-483c-ab73-73bb54bc1122-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-896d36-pqpjh\" (UID: \"5810ad66-3364-483c-ab73-73bb54bc1122\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-896d36-pqpjh"
Jul 28 01:54:18.836160 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:18.836140    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5810ad66-3364-483c-ab73-73bb54bc1122-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-896d36-pqpjh\" (UID: \"5810ad66-3364-483c-ab73-73bb54bc1122\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-896d36-pqpjh"
Jul 28 01:54:18.982392 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:18.982318    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-896d36-pqpjh"
Jul 28 01:54:19.117317 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:19.117292    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-896d36-pqpjh"]
Jul 28 01:54:19.120223 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:54:19.120194    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5810ad66_3364_483c_ab73_73bb54bc1122.slice/crio-f4a88778eb5d2459ba22a42a4d419b0402911edbdab4f4f1a499bf6b488ebcde WatchSource:0}: Error finding container f4a88778eb5d2459ba22a42a4d419b0402911edbdab4f4f1a499bf6b488ebcde: Status 404 returned error can't find the container with id f4a88778eb5d2459ba22a42a4d419b0402911edbdab4f4f1a499bf6b488ebcde
Jul 28 01:54:20.053813 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:20.053777    2562 generic.go:356] "Generic (PLEG): container finished" podID="5810ad66-3364-483c-ab73-73bb54bc1122" containerID="a75cadcec32b21ac8b0240f5c0241d2232d74a76d717f7c5f8f8c2148392877c" exitCode=0
Jul 28 01:54:20.054230 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:20.053858    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-896d36-pqpjh" event={"ID":"5810ad66-3364-483c-ab73-73bb54bc1122","Type":"ContainerDied","Data":"a75cadcec32b21ac8b0240f5c0241d2232d74a76d717f7c5f8f8c2148392877c"}
Jul 28 01:54:20.054230 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:20.053907    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-896d36-pqpjh" event={"ID":"5810ad66-3364-483c-ab73-73bb54bc1122","Type":"ContainerStarted","Data":"f4a88778eb5d2459ba22a42a4d419b0402911edbdab4f4f1a499bf6b488ebcde"}
Jul 28 01:54:21.196849 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:21.196827    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-896d36-pqpjh"
Jul 28 01:54:21.257757 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:21.257728    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5810ad66-3364-483c-ab73-73bb54bc1122-maas-api-service-ca\") pod \"5810ad66-3364-483c-ab73-73bb54bc1122\" (UID: \"5810ad66-3364-483c-ab73-73bb54bc1122\") "
Jul 28 01:54:21.258056 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:21.258036    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5810ad66-3364-483c-ab73-73bb54bc1122-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5810ad66-3364-483c-ab73-73bb54bc1122" (UID: "5810ad66-3364-483c-ab73-73bb54bc1122"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:54:21.359368 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:21.359339    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5810ad66-3364-483c-ab73-73bb54bc1122-maas-api-service-ca\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:54:22.064593 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:22.064550    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-896d36-pqpjh"
Jul 28 01:54:22.064760 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:22.064590    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-896d36-pqpjh" event={"ID":"5810ad66-3364-483c-ab73-73bb54bc1122","Type":"ContainerDied","Data":"f4a88778eb5d2459ba22a42a4d419b0402911edbdab4f4f1a499bf6b488ebcde"}
Jul 28 01:54:22.064760 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:22.064636    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f4a88778eb5d2459ba22a42a4d419b0402911edbdab4f4f1a499bf6b488ebcde"
Jul 28 01:54:33.748966 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:33.748923    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-896d36-pqpjh"]
Jul 28 01:54:33.750750 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:33.750728    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-896d36-pqpjh"]
Jul 28 01:54:34.013879 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:34.013801    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5810ad66-3364-483c-ab73-73bb54bc1122" path="/var/lib/kubelet/pods/5810ad66-3364-483c-ab73-73bb54bc1122/volumes"
Jul 28 01:54:40.104470 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:40.104435    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9"]
Jul 28 01:54:40.104902 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:40.104679    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9" podUID="273a09c0-92ea-4fa0-8d52-84d516337a0d" containerName="istio-proxy" containerID="cri-o://c503081e491ceeec3d9ed55b6d35d419ad7208979b7e6c71b41aba1d0fe45f7e" gracePeriod=30
Jul 28 01:54:40.450307 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:40.450220    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-afe8f9-99rnp"]
Jul 28 01:54:40.450660 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:40.450647    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5810ad66-3364-483c-ab73-73bb54bc1122" containerName="revoke-keys"
Jul 28 01:54:40.450660 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:40.450661    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5810ad66-3364-483c-ab73-73bb54bc1122" containerName="revoke-keys"
Jul 28 01:54:40.450770 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:40.450736    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5810ad66-3364-483c-ab73-73bb54bc1122" containerName="revoke-keys"
Jul 28 01:54:40.453850 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:40.453832    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-afe8f9-99rnp"
Jul 28 01:54:40.455723 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:40.455688    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wjxvt\""
Jul 28 01:54:40.459321 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:40.459286    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-afe8f9-99rnp"]
Jul 28 01:54:40.637616 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:40.637539    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01aa2e19-c901-4a26-86e2-ed0b4a5748c8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-afe8f9-99rnp\" (UID: \"01aa2e19-c901-4a26-86e2-ed0b4a5748c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-afe8f9-99rnp"
Jul 28 01:54:40.738828 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:40.738725    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01aa2e19-c901-4a26-86e2-ed0b4a5748c8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-afe8f9-99rnp\" (UID: \"01aa2e19-c901-4a26-86e2-ed0b4a5748c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-afe8f9-99rnp"
Jul 28 01:54:40.739353 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:40.739329    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01aa2e19-c901-4a26-86e2-ed0b4a5748c8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-afe8f9-99rnp\" (UID: \"01aa2e19-c901-4a26-86e2-ed0b4a5748c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-afe8f9-99rnp"
Jul 28 01:54:40.770739 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:40.770698    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-afe8f9-99rnp"
Jul 28 01:54:40.907341 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:40.907318    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-afe8f9-99rnp"]
Jul 28 01:54:40.909606 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:54:40.909573    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01aa2e19_c901_4a26_86e2_ed0b4a5748c8.slice/crio-c8a2b146f820bad625d23d370994c85f25a63d367c68ae76e9123238329e52ab WatchSource:0}: Error finding container c8a2b146f820bad625d23d370994c85f25a63d367c68ae76e9123238329e52ab: Status 404 returned error can't find the container with id c8a2b146f820bad625d23d370994c85f25a63d367c68ae76e9123238329e52ab
Jul 28 01:54:41.168961 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:41.168928    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-afe8f9-99rnp" event={"ID":"01aa2e19-c901-4a26-86e2-ed0b4a5748c8","Type":"ContainerStarted","Data":"c8a2b146f820bad625d23d370994c85f25a63d367c68ae76e9123238329e52ab"}
Jul 28 01:54:42.175299 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:42.175265    2562 generic.go:356] "Generic (PLEG): container finished" podID="01aa2e19-c901-4a26-86e2-ed0b4a5748c8" containerID="0e95a63463ca49fbd54f83e31b24a42019f1379ed23b9a6e5d606d97fcb0bdcd" exitCode=0
Jul 28 01:54:42.175731 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:42.175348    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-afe8f9-99rnp" event={"ID":"01aa2e19-c901-4a26-86e2-ed0b4a5748c8","Type":"ContainerDied","Data":"0e95a63463ca49fbd54f83e31b24a42019f1379ed23b9a6e5d606d97fcb0bdcd"}
Jul 28 01:54:43.319944 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:43.319919    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-afe8f9-99rnp"
Jul 28 01:54:43.463179 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:43.463083    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01aa2e19-c901-4a26-86e2-ed0b4a5748c8-maas-api-service-ca\") pod \"01aa2e19-c901-4a26-86e2-ed0b4a5748c8\" (UID: \"01aa2e19-c901-4a26-86e2-ed0b4a5748c8\") "
Jul 28 01:54:43.463427 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:43.463403    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01aa2e19-c901-4a26-86e2-ed0b4a5748c8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "01aa2e19-c901-4a26-86e2-ed0b4a5748c8" (UID: "01aa2e19-c901-4a26-86e2-ed0b4a5748c8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:54:43.564514 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:43.564480    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01aa2e19-c901-4a26-86e2-ed0b4a5748c8-maas-api-service-ca\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:54:44.187131 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:44.187093    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-afe8f9-99rnp" event={"ID":"01aa2e19-c901-4a26-86e2-ed0b4a5748c8","Type":"ContainerDied","Data":"c8a2b146f820bad625d23d370994c85f25a63d367c68ae76e9123238329e52ab"}
Jul 28 01:54:44.187131 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:44.187126    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-afe8f9-99rnp"
Jul 28 01:54:44.187344 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:44.187154    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c8a2b146f820bad625d23d370994c85f25a63d367c68ae76e9123238329e52ab"
Jul 28 01:54:45.361760 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:45.361733    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9"
Jul 28 01:54:45.378620 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:45.378527    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/273a09c0-92ea-4fa0-8d52-84d516337a0d-istiod-ca-cert\") pod \"273a09c0-92ea-4fa0-8d52-84d516337a0d\" (UID: \"273a09c0-92ea-4fa0-8d52-84d516337a0d\") "
Jul 28 01:54:45.378620 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:45.378589    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/273a09c0-92ea-4fa0-8d52-84d516337a0d-workload-socket\") pod \"273a09c0-92ea-4fa0-8d52-84d516337a0d\" (UID: \"273a09c0-92ea-4fa0-8d52-84d516337a0d\") "
Jul 28 01:54:45.378836 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:45.378622    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/273a09c0-92ea-4fa0-8d52-84d516337a0d-istio-podinfo\") pod \"273a09c0-92ea-4fa0-8d52-84d516337a0d\" (UID: \"273a09c0-92ea-4fa0-8d52-84d516337a0d\") "
Jul 28 01:54:45.378836 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:45.378642    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/273a09c0-92ea-4fa0-8d52-84d516337a0d-workload-certs\") pod \"273a09c0-92ea-4fa0-8d52-84d516337a0d\" (UID: \"273a09c0-92ea-4fa0-8d52-84d516337a0d\") "
Jul 28 01:54:45.378836 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:45.378772    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/273a09c0-92ea-4fa0-8d52-84d516337a0d-credential-socket\") pod \"273a09c0-92ea-4fa0-8d52-84d516337a0d\" (UID: \"273a09c0-92ea-4fa0-8d52-84d516337a0d\") "
Jul 28 01:54:45.379013 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:45.378857    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/273a09c0-92ea-4fa0-8d52-84d516337a0d-istio-token\") pod \"273a09c0-92ea-4fa0-8d52-84d516337a0d\" (UID: \"273a09c0-92ea-4fa0-8d52-84d516337a0d\") "
Jul 28 01:54:45.379013 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:45.378897    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/273a09c0-92ea-4fa0-8d52-84d516337a0d-istio-envoy\") pod \"273a09c0-92ea-4fa0-8d52-84d516337a0d\" (UID: \"273a09c0-92ea-4fa0-8d52-84d516337a0d\") "
Jul 28 01:54:45.379013 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:45.378950    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dcqx\" (UniqueName: \"kubernetes.io/projected/273a09c0-92ea-4fa0-8d52-84d516337a0d-kube-api-access-6dcqx\") pod \"273a09c0-92ea-4fa0-8d52-84d516337a0d\" (UID: \"273a09c0-92ea-4fa0-8d52-84d516337a0d\") "
Jul 28 01:54:45.379013 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:45.379003    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/273a09c0-92ea-4fa0-8d52-84d516337a0d-istio-data\") pod \"273a09c0-92ea-4fa0-8d52-84d516337a0d\" (UID: \"273a09c0-92ea-4fa0-8d52-84d516337a0d\") "
Jul 28 01:54:45.379350 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:45.379325    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/273a09c0-92ea-4fa0-8d52-84d516337a0d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "273a09c0-92ea-4fa0-8d52-84d516337a0d" (UID: "273a09c0-92ea-4fa0-8d52-84d516337a0d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:54:45.379801 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:45.379639    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/273a09c0-92ea-4fa0-8d52-84d516337a0d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "273a09c0-92ea-4fa0-8d52-84d516337a0d" (UID: "273a09c0-92ea-4fa0-8d52-84d516337a0d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:54:45.380045 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:45.380000    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/273a09c0-92ea-4fa0-8d52-84d516337a0d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "273a09c0-92ea-4fa0-8d52-84d516337a0d" (UID: "273a09c0-92ea-4fa0-8d52-84d516337a0d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:54:45.380166 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:45.380060    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/273a09c0-92ea-4fa0-8d52-84d516337a0d-istio-data" (OuterVolumeSpecName: "istio-data") pod "273a09c0-92ea-4fa0-8d52-84d516337a0d" (UID: "273a09c0-92ea-4fa0-8d52-84d516337a0d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:54:45.380327 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:45.380279    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/273a09c0-92ea-4fa0-8d52-84d516337a0d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "273a09c0-92ea-4fa0-8d52-84d516337a0d" (UID: "273a09c0-92ea-4fa0-8d52-84d516337a0d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:54:45.381676 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:45.381642    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/273a09c0-92ea-4fa0-8d52-84d516337a0d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "273a09c0-92ea-4fa0-8d52-84d516337a0d" (UID: "273a09c0-92ea-4fa0-8d52-84d516337a0d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 01:54:45.382338 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:45.382301    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/273a09c0-92ea-4fa0-8d52-84d516337a0d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "273a09c0-92ea-4fa0-8d52-84d516337a0d" (UID: "273a09c0-92ea-4fa0-8d52-84d516337a0d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:54:45.382539 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:45.382505    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/273a09c0-92ea-4fa0-8d52-84d516337a0d-istio-token" (OuterVolumeSpecName: "istio-token") pod "273a09c0-92ea-4fa0-8d52-84d516337a0d" (UID: "273a09c0-92ea-4fa0-8d52-84d516337a0d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:54:45.383053 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:45.383023    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/273a09c0-92ea-4fa0-8d52-84d516337a0d-kube-api-access-6dcqx" (OuterVolumeSpecName: "kube-api-access-6dcqx") pod "273a09c0-92ea-4fa0-8d52-84d516337a0d" (UID: "273a09c0-92ea-4fa0-8d52-84d516337a0d"). InnerVolumeSpecName "kube-api-access-6dcqx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:54:45.480626 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:45.480593    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/273a09c0-92ea-4fa0-8d52-84d516337a0d-credential-socket\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:54:45.480626 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:45.480620    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/273a09c0-92ea-4fa0-8d52-84d516337a0d-istio-token\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:54:45.480626 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:45.480629    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/273a09c0-92ea-4fa0-8d52-84d516337a0d-istio-envoy\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:54:45.480853 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:45.480638    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dcqx\" (UniqueName: \"kubernetes.io/projected/273a09c0-92ea-4fa0-8d52-84d516337a0d-kube-api-access-6dcqx\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:54:45.480853 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:45.480646    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/273a09c0-92ea-4fa0-8d52-84d516337a0d-istio-data\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:54:45.480853 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:45.480654    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/273a09c0-92ea-4fa0-8d52-84d516337a0d-istiod-ca-cert\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:54:45.480853 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:45.480662    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/273a09c0-92ea-4fa0-8d52-84d516337a0d-workload-socket\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:54:45.480853 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:45.480669    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/273a09c0-92ea-4fa0-8d52-84d516337a0d-istio-podinfo\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:54:45.480853 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:45.480677    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/273a09c0-92ea-4fa0-8d52-84d516337a0d-workload-certs\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:54:46.199324 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:46.199290    2562 generic.go:356] "Generic (PLEG): container finished" podID="273a09c0-92ea-4fa0-8d52-84d516337a0d" containerID="c503081e491ceeec3d9ed55b6d35d419ad7208979b7e6c71b41aba1d0fe45f7e" exitCode=0
Jul 28 01:54:46.199484 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:46.199366    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9"
Jul 28 01:54:46.199484 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:46.199372    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9" event={"ID":"273a09c0-92ea-4fa0-8d52-84d516337a0d","Type":"ContainerDied","Data":"c503081e491ceeec3d9ed55b6d35d419ad7208979b7e6c71b41aba1d0fe45f7e"}
Jul 28 01:54:46.199484 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:46.199427    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9" event={"ID":"273a09c0-92ea-4fa0-8d52-84d516337a0d","Type":"ContainerDied","Data":"d9a1423f1e6384b13934b92f2dc27b45b81eec90fc500a387676058b5e571ab3"}
Jul 28 01:54:46.199484 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:46.199449    2562 scope.go:117] "RemoveContainer" containerID="c503081e491ceeec3d9ed55b6d35d419ad7208979b7e6c71b41aba1d0fe45f7e"
Jul 28 01:54:46.208860 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:46.208842    2562 scope.go:117] "RemoveContainer" containerID="85e90013767ab91b2d5d2f10946e494cd4001a9a4f401af19df3e2c31f01f3e8"
Jul 28 01:54:46.216869 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:46.216731    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9"]
Jul 28 01:54:46.220432 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:46.220410    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-896d36-openshift-default-5f854879d6-c46b9"]
Jul 28 01:54:46.220508 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:46.220429    2562 scope.go:117] "RemoveContainer" containerID="c503081e491ceeec3d9ed55b6d35d419ad7208979b7e6c71b41aba1d0fe45f7e"
Jul 28 01:54:46.220754 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:54:46.220735    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c503081e491ceeec3d9ed55b6d35d419ad7208979b7e6c71b41aba1d0fe45f7e\": container with ID starting with c503081e491ceeec3d9ed55b6d35d419ad7208979b7e6c71b41aba1d0fe45f7e not found: ID does not exist" containerID="c503081e491ceeec3d9ed55b6d35d419ad7208979b7e6c71b41aba1d0fe45f7e"
Jul 28 01:54:46.220807 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:46.220762    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c503081e491ceeec3d9ed55b6d35d419ad7208979b7e6c71b41aba1d0fe45f7e"} err="failed to get container status \"c503081e491ceeec3d9ed55b6d35d419ad7208979b7e6c71b41aba1d0fe45f7e\": rpc error: code = NotFound desc = could not find container \"c503081e491ceeec3d9ed55b6d35d419ad7208979b7e6c71b41aba1d0fe45f7e\": container with ID starting with c503081e491ceeec3d9ed55b6d35d419ad7208979b7e6c71b41aba1d0fe45f7e not found: ID does not exist"
Jul 28 01:54:46.220807 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:46.220783    2562 scope.go:117] "RemoveContainer" containerID="85e90013767ab91b2d5d2f10946e494cd4001a9a4f401af19df3e2c31f01f3e8"
Jul 28 01:54:46.220979 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:54:46.220961    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85e90013767ab91b2d5d2f10946e494cd4001a9a4f401af19df3e2c31f01f3e8\": container with ID starting with 85e90013767ab91b2d5d2f10946e494cd4001a9a4f401af19df3e2c31f01f3e8 not found: ID does not exist" containerID="85e90013767ab91b2d5d2f10946e494cd4001a9a4f401af19df3e2c31f01f3e8"
Jul 28 01:54:46.221035 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:46.220985    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85e90013767ab91b2d5d2f10946e494cd4001a9a4f401af19df3e2c31f01f3e8"} err="failed to get container status \"85e90013767ab91b2d5d2f10946e494cd4001a9a4f401af19df3e2c31f01f3e8\": rpc error: code = NotFound desc = could not find container \"85e90013767ab91b2d5d2f10946e494cd4001a9a4f401af19df3e2c31f01f3e8\": container with ID starting with 85e90013767ab91b2d5d2f10946e494cd4001a9a4f401af19df3e2c31f01f3e8 not found: ID does not exist"
Jul 28 01:54:48.014436 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:48.014402    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="273a09c0-92ea-4fa0-8d52-84d516337a0d" path="/var/lib/kubelet/pods/273a09c0-92ea-4fa0-8d52-84d516337a0d/volumes"
Jul 28 01:54:55.522773 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:55.522736    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-afe8f9-99rnp"]
Jul 28 01:54:55.525228 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:55.525205    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-afe8f9-99rnp"]
Jul 28 01:54:56.013879 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:54:56.013844    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01aa2e19-c901-4a26-86e2-ed0b4a5748c8" path="/var/lib/kubelet/pods/01aa2e19-c901-4a26-86e2-ed0b4a5748c8/volumes"
Jul 28 01:55:02.599727 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:02.599688    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf"]
Jul 28 01:55:02.600200 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:02.600181    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="273a09c0-92ea-4fa0-8d52-84d516337a0d" containerName="istio-proxy"
Jul 28 01:55:02.600266 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:02.600204    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="273a09c0-92ea-4fa0-8d52-84d516337a0d" containerName="istio-proxy"
Jul 28 01:55:02.600266 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:02.600225    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="273a09c0-92ea-4fa0-8d52-84d516337a0d" containerName="istio-proxy"
Jul 28 01:55:02.600266 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:02.600235    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="273a09c0-92ea-4fa0-8d52-84d516337a0d" containerName="istio-proxy"
Jul 28 01:55:02.600266 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:02.600244    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01aa2e19-c901-4a26-86e2-ed0b4a5748c8" containerName="revoke-keys"
Jul 28 01:55:02.600266 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:02.600253    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="01aa2e19-c901-4a26-86e2-ed0b4a5748c8" containerName="revoke-keys"
Jul 28 01:55:02.600522 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:02.600346    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="273a09c0-92ea-4fa0-8d52-84d516337a0d" containerName="istio-proxy"
Jul 28 01:55:02.600522 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:02.600363    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="01aa2e19-c901-4a26-86e2-ed0b4a5748c8" containerName="revoke-keys"
Jul 28 01:55:02.605569 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:02.605538    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf"
Jul 28 01:55:02.607460 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:02.607437    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-1bc912-openshift-default-dockercfg-sb5vp\""
Jul 28 01:55:02.615381 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:02.615359    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf"]
Jul 28 01:55:02.726988 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:02.726954    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14b31fa0-ee75-4999-9838-17ef3071da3b-istio-envoy\") pod \"e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf\" (UID: \"14b31fa0-ee75-4999-9838-17ef3071da3b\") " pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf"
Jul 28 01:55:02.726988 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:02.726991    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14b31fa0-ee75-4999-9838-17ef3071da3b-istio-data\") pod \"e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf\" (UID: \"14b31fa0-ee75-4999-9838-17ef3071da3b\") " pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf"
Jul 28 01:55:02.727196 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:02.727017    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14b31fa0-ee75-4999-9838-17ef3071da3b-istio-podinfo\") pod \"e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf\" (UID: \"14b31fa0-ee75-4999-9838-17ef3071da3b\") " pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf"
Jul 28 01:55:02.727196 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:02.727082    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14b31fa0-ee75-4999-9838-17ef3071da3b-istio-token\") pod \"e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf\" (UID: \"14b31fa0-ee75-4999-9838-17ef3071da3b\") " pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf"
Jul 28 01:55:02.727196 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:02.727105    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14b31fa0-ee75-4999-9838-17ef3071da3b-istiod-ca-cert\") pod \"e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf\" (UID: \"14b31fa0-ee75-4999-9838-17ef3071da3b\") " pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf"
Jul 28 01:55:02.727196 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:02.727127    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-458x9\" (UniqueName: \"kubernetes.io/projected/14b31fa0-ee75-4999-9838-17ef3071da3b-kube-api-access-458x9\") pod \"e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf\" (UID: \"14b31fa0-ee75-4999-9838-17ef3071da3b\") " pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf"
Jul 28 01:55:02.727196 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:02.727171    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14b31fa0-ee75-4999-9838-17ef3071da3b-workload-socket\") pod \"e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf\" (UID: \"14b31fa0-ee75-4999-9838-17ef3071da3b\") " pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf"
Jul 28 01:55:02.727415 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:02.727230    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14b31fa0-ee75-4999-9838-17ef3071da3b-credential-socket\") pod \"e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf\" (UID: \"14b31fa0-ee75-4999-9838-17ef3071da3b\") " pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf"
Jul 28 01:55:02.727415 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:02.727247    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14b31fa0-ee75-4999-9838-17ef3071da3b-workload-certs\") pod \"e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf\" (UID: \"14b31fa0-ee75-4999-9838-17ef3071da3b\") " pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf"
Jul 28 01:55:02.827743 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:02.827709    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14b31fa0-ee75-4999-9838-17ef3071da3b-istiod-ca-cert\") pod \"e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf\" (UID: \"14b31fa0-ee75-4999-9838-17ef3071da3b\") " pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf"
Jul 28 01:55:02.827743 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:02.827743    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-458x9\" (UniqueName: \"kubernetes.io/projected/14b31fa0-ee75-4999-9838-17ef3071da3b-kube-api-access-458x9\") pod \"e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf\" (UID: \"14b31fa0-ee75-4999-9838-17ef3071da3b\") " pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf"
Jul 28 01:55:02.827998 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:02.827775    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14b31fa0-ee75-4999-9838-17ef3071da3b-workload-socket\") pod \"e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf\" (UID: \"14b31fa0-ee75-4999-9838-17ef3071da3b\") " pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf"
Jul 28 01:55:02.827998 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:02.827816    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14b31fa0-ee75-4999-9838-17ef3071da3b-credential-socket\") pod \"e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf\" (UID: \"14b31fa0-ee75-4999-9838-17ef3071da3b\") " pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf"
Jul 28 01:55:02.827998 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:02.827834    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14b31fa0-ee75-4999-9838-17ef3071da3b-workload-certs\") pod \"e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf\" (UID: \"14b31fa0-ee75-4999-9838-17ef3071da3b\") " pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf"
Jul 28 01:55:02.827998 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:02.827860    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14b31fa0-ee75-4999-9838-17ef3071da3b-istio-envoy\") pod \"e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf\" (UID: \"14b31fa0-ee75-4999-9838-17ef3071da3b\") " pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf"
Jul 28 01:55:02.828246 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:02.828031    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14b31fa0-ee75-4999-9838-17ef3071da3b-istio-data\") pod \"e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf\" (UID: \"14b31fa0-ee75-4999-9838-17ef3071da3b\") " pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf"
Jul 28 01:55:02.828246 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:02.828091    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14b31fa0-ee75-4999-9838-17ef3071da3b-istio-podinfo\") pod \"e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf\" (UID: \"14b31fa0-ee75-4999-9838-17ef3071da3b\") " pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf"
Jul 28 01:55:02.828246 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:02.828170    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14b31fa0-ee75-4999-9838-17ef3071da3b-istio-token\") pod \"e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf\" (UID: \"14b31fa0-ee75-4999-9838-17ef3071da3b\") " pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf"
Jul 28 01:55:02.828246 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:02.828236    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14b31fa0-ee75-4999-9838-17ef3071da3b-credential-socket\") pod \"e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf\" (UID: \"14b31fa0-ee75-4999-9838-17ef3071da3b\") " pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf"
Jul 28 01:55:02.828468 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:02.828329    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14b31fa0-ee75-4999-9838-17ef3071da3b-workload-socket\") pod \"e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf\" (UID: \"14b31fa0-ee75-4999-9838-17ef3071da3b\") " pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf"
Jul 28 01:55:02.828468 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:02.828366    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14b31fa0-ee75-4999-9838-17ef3071da3b-workload-certs\") pod \"e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf\" (UID: \"14b31fa0-ee75-4999-9838-17ef3071da3b\") " pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf"
Jul 28 01:55:02.828468 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:02.828410    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14b31fa0-ee75-4999-9838-17ef3071da3b-istio-data\") pod \"e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf\" (UID: \"14b31fa0-ee75-4999-9838-17ef3071da3b\") " pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf"
Jul 28 01:55:02.828669 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:02.828526    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14b31fa0-ee75-4999-9838-17ef3071da3b-istiod-ca-cert\") pod \"e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf\" (UID: \"14b31fa0-ee75-4999-9838-17ef3071da3b\") " pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf"
Jul 28 01:55:02.830119 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:02.830090    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14b31fa0-ee75-4999-9838-17ef3071da3b-istio-envoy\") pod \"e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf\" (UID: \"14b31fa0-ee75-4999-9838-17ef3071da3b\") " pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf"
Jul 28 01:55:02.830632 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:02.830610    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14b31fa0-ee75-4999-9838-17ef3071da3b-istio-podinfo\") pod \"e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf\" (UID: \"14b31fa0-ee75-4999-9838-17ef3071da3b\") " pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf"
Jul 28 01:55:02.834907 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:02.834881    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14b31fa0-ee75-4999-9838-17ef3071da3b-istio-token\") pod \"e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf\" (UID: \"14b31fa0-ee75-4999-9838-17ef3071da3b\") " pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf"
Jul 28 01:55:02.835107 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:02.835086    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-458x9\" (UniqueName: \"kubernetes.io/projected/14b31fa0-ee75-4999-9838-17ef3071da3b-kube-api-access-458x9\") pod \"e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf\" (UID: \"14b31fa0-ee75-4999-9838-17ef3071da3b\") " pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf"
Jul 28 01:55:02.918228 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:02.918184    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf"
Jul 28 01:55:03.063687 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:03.063655    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf"]
Jul 28 01:55:03.066570 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:55:03.066527    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14b31fa0_ee75_4999_9838_17ef3071da3b.slice/crio-d10378c51a5ec09aeaa5a6f05383cff1ba9be630027c02f39d53a34405232bf9 WatchSource:0}: Error finding container d10378c51a5ec09aeaa5a6f05383cff1ba9be630027c02f39d53a34405232bf9: Status 404 returned error can't find the container with id d10378c51a5ec09aeaa5a6f05383cff1ba9be630027c02f39d53a34405232bf9
Jul 28 01:55:03.068774 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:03.068740    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:55:03.068885 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:03.068806    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:55:03.068885 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:03.068836    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:55:03.292536 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:03.292455    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf" event={"ID":"14b31fa0-ee75-4999-9838-17ef3071da3b","Type":"ContainerStarted","Data":"c370b89ab6a817612b2e18ee1c66a44172fd9d7f907b6be07444e463a9a3d93e"}
Jul 28 01:55:03.292536 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:03.292505    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf" event={"ID":"14b31fa0-ee75-4999-9838-17ef3071da3b","Type":"ContainerStarted","Data":"d10378c51a5ec09aeaa5a6f05383cff1ba9be630027c02f39d53a34405232bf9"}
Jul 28 01:55:03.318369 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:03.318313    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf" podStartSLOduration=1.318295985 podStartE2EDuration="1.318295985s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:55:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:55:03.315731363 +0000 UTC m=+2373.819492714" watchObservedRunningTime="2026-07-28 01:55:03.318295985 +0000 UTC m=+2373.822057296"
Jul 28 01:55:03.918430 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:03.918396    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf"
Jul 28 01:55:04.924064 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:04.924029    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf"
Jul 28 01:55:05.303859 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:05.303773    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf"
Jul 28 01:55:05.304647 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:05.304626    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf"
Jul 28 01:55:10.450640 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:10.450602    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg"]
Jul 28 01:55:10.451168 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:10.451144    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="273a09c0-92ea-4fa0-8d52-84d516337a0d" containerName="istio-proxy"
Jul 28 01:55:10.454813 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:10.454792    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg"
Jul 28 01:55:10.456747 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:10.456722    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-4b0f72-openshift-default-dockercfg-rks6j\""
Jul 28 01:55:10.467683 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:10.467649    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg"]
Jul 28 01:55:10.604844 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:10.604812    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fada8991-be4e-41ac-b9b8-c78bb6e25704-workload-certs\") pod \"e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg\" (UID: \"fada8991-be4e-41ac-b9b8-c78bb6e25704\") " pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg"
Jul 28 01:55:10.605017 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:10.604886    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fada8991-be4e-41ac-b9b8-c78bb6e25704-istio-podinfo\") pod \"e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg\" (UID: \"fada8991-be4e-41ac-b9b8-c78bb6e25704\") " pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg"
Jul 28 01:55:10.605017 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:10.604937    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9zcj\" (UniqueName: \"kubernetes.io/projected/fada8991-be4e-41ac-b9b8-c78bb6e25704-kube-api-access-q9zcj\") pod \"e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg\" (UID: \"fada8991-be4e-41ac-b9b8-c78bb6e25704\") " pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg"
Jul 28 01:55:10.605017 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:10.604965    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fada8991-be4e-41ac-b9b8-c78bb6e25704-credential-socket\") pod \"e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg\" (UID: \"fada8991-be4e-41ac-b9b8-c78bb6e25704\") " pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg"
Jul 28 01:55:10.605158 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:10.605030    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fada8991-be4e-41ac-b9b8-c78bb6e25704-workload-socket\") pod \"e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg\" (UID: \"fada8991-be4e-41ac-b9b8-c78bb6e25704\") " pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg"
Jul 28 01:55:10.605158 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:10.605049    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fada8991-be4e-41ac-b9b8-c78bb6e25704-istio-envoy\") pod \"e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg\" (UID: \"fada8991-be4e-41ac-b9b8-c78bb6e25704\") " pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg"
Jul 28 01:55:10.605158 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:10.605076    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fada8991-be4e-41ac-b9b8-c78bb6e25704-istiod-ca-cert\") pod \"e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg\" (UID: \"fada8991-be4e-41ac-b9b8-c78bb6e25704\") " pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg"
Jul 28 01:55:10.605158 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:10.605103    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fada8991-be4e-41ac-b9b8-c78bb6e25704-istio-data\") pod \"e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg\" (UID: \"fada8991-be4e-41ac-b9b8-c78bb6e25704\") " pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg"
Jul 28 01:55:10.605340 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:10.605194    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fada8991-be4e-41ac-b9b8-c78bb6e25704-istio-token\") pod \"e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg\" (UID: \"fada8991-be4e-41ac-b9b8-c78bb6e25704\") " pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg"
Jul 28 01:55:10.706734 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:10.706640    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fada8991-be4e-41ac-b9b8-c78bb6e25704-workload-socket\") pod \"e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg\" (UID: \"fada8991-be4e-41ac-b9b8-c78bb6e25704\") " pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg"
Jul 28 01:55:10.706734 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:10.706677    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fada8991-be4e-41ac-b9b8-c78bb6e25704-istio-envoy\") pod \"e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg\" (UID: \"fada8991-be4e-41ac-b9b8-c78bb6e25704\") " pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg"
Jul 28 01:55:10.706734 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:10.706699    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fada8991-be4e-41ac-b9b8-c78bb6e25704-istiod-ca-cert\") pod \"e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg\" (UID: \"fada8991-be4e-41ac-b9b8-c78bb6e25704\") " pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg"
Jul 28 01:55:10.707015 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:10.706736    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fada8991-be4e-41ac-b9b8-c78bb6e25704-istio-data\") pod \"e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg\" (UID: \"fada8991-be4e-41ac-b9b8-c78bb6e25704\") " pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg"
Jul 28 01:55:10.707015 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:10.706777    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fada8991-be4e-41ac-b9b8-c78bb6e25704-istio-token\") pod \"e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg\" (UID: \"fada8991-be4e-41ac-b9b8-c78bb6e25704\") " pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg"
Jul 28 01:55:10.707015 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:10.706802    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fada8991-be4e-41ac-b9b8-c78bb6e25704-workload-certs\") pod \"e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg\" (UID: \"fada8991-be4e-41ac-b9b8-c78bb6e25704\") " pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg"
Jul 28 01:55:10.707015 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:10.706866    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fada8991-be4e-41ac-b9b8-c78bb6e25704-istio-podinfo\") pod \"e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg\" (UID: \"fada8991-be4e-41ac-b9b8-c78bb6e25704\") " pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg"
Jul 28 01:55:10.707015 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:10.706895    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9zcj\" (UniqueName: \"kubernetes.io/projected/fada8991-be4e-41ac-b9b8-c78bb6e25704-kube-api-access-q9zcj\") pod \"e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg\" (UID: \"fada8991-be4e-41ac-b9b8-c78bb6e25704\") " pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg"
Jul 28 01:55:10.707015 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:10.706925    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fada8991-be4e-41ac-b9b8-c78bb6e25704-credential-socket\") pod \"e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg\" (UID: \"fada8991-be4e-41ac-b9b8-c78bb6e25704\") " pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg"
Jul 28 01:55:10.707311 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:10.707102    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fada8991-be4e-41ac-b9b8-c78bb6e25704-workload-socket\") pod \"e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg\" (UID: \"fada8991-be4e-41ac-b9b8-c78bb6e25704\") " pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg"
Jul 28 01:55:10.707311 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:10.707176    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fada8991-be4e-41ac-b9b8-c78bb6e25704-istio-data\") pod \"e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg\" (UID: \"fada8991-be4e-41ac-b9b8-c78bb6e25704\") " pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg"
Jul 28 01:55:10.707311 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:10.707230    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fada8991-be4e-41ac-b9b8-c78bb6e25704-credential-socket\") pod \"e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg\" (UID: \"fada8991-be4e-41ac-b9b8-c78bb6e25704\") " pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg"
Jul 28 01:55:10.707311 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:10.707274    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fada8991-be4e-41ac-b9b8-c78bb6e25704-workload-certs\") pod \"e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg\" (UID: \"fada8991-be4e-41ac-b9b8-c78bb6e25704\") " pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg"
Jul 28 01:55:10.707491 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:10.707473    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fada8991-be4e-41ac-b9b8-c78bb6e25704-istiod-ca-cert\") pod \"e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg\" (UID: \"fada8991-be4e-41ac-b9b8-c78bb6e25704\") " pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg"
Jul 28 01:55:10.709006 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:10.708990    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fada8991-be4e-41ac-b9b8-c78bb6e25704-istio-envoy\") pod \"e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg\" (UID: \"fada8991-be4e-41ac-b9b8-c78bb6e25704\") " pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg"
Jul 28 01:55:10.709404 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:10.709387    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fada8991-be4e-41ac-b9b8-c78bb6e25704-istio-podinfo\") pod \"e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg\" (UID: \"fada8991-be4e-41ac-b9b8-c78bb6e25704\") " pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg"
Jul 28 01:55:10.715286 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:10.715262    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9zcj\" (UniqueName: \"kubernetes.io/projected/fada8991-be4e-41ac-b9b8-c78bb6e25704-kube-api-access-q9zcj\") pod \"e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg\" (UID: \"fada8991-be4e-41ac-b9b8-c78bb6e25704\") " pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg"
Jul 28 01:55:10.715371 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:10.715323    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fada8991-be4e-41ac-b9b8-c78bb6e25704-istio-token\") pod \"e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg\" (UID: \"fada8991-be4e-41ac-b9b8-c78bb6e25704\") " pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg"
Jul 28 01:55:10.769987 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:10.769950    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg"
Jul 28 01:55:10.934965 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:10.934793    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg"]
Jul 28 01:55:10.938502 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:55:10.938459    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfada8991_be4e_41ac_b9b8_c78bb6e25704.slice/crio-1672e53327dbf595864700c3fca8652ac6fbcac36aeb8799b9d1105bd71468cd WatchSource:0}: Error finding container 1672e53327dbf595864700c3fca8652ac6fbcac36aeb8799b9d1105bd71468cd: Status 404 returned error can't find the container with id 1672e53327dbf595864700c3fca8652ac6fbcac36aeb8799b9d1105bd71468cd
Jul 28 01:55:10.940723 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:10.940691    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:55:10.940796 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:10.940756    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:55:10.940796 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:10.940785    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:55:11.336040 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:11.335951    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg" event={"ID":"fada8991-be4e-41ac-b9b8-c78bb6e25704","Type":"ContainerStarted","Data":"1cd7e1d389b3ee2e0c35c63f76cb66994adcd0436707aa911b5f9461f68ee2ed"}
Jul 28 01:55:11.336040 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:11.336006    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg" event={"ID":"fada8991-be4e-41ac-b9b8-c78bb6e25704","Type":"ContainerStarted","Data":"1672e53327dbf595864700c3fca8652ac6fbcac36aeb8799b9d1105bd71468cd"}
Jul 28 01:55:11.355517 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:11.355466    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg" podStartSLOduration=1.355449533 podStartE2EDuration="1.355449533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:55:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:55:11.352898639 +0000 UTC m=+2381.856659953" watchObservedRunningTime="2026-07-28 01:55:11.355449533 +0000 UTC m=+2381.859210845"
Jul 28 01:55:11.770440 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:11.770397    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg"
Jul 28 01:55:12.775717 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:12.775691    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg"
Jul 28 01:55:13.348510 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:13.348484    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg"
Jul 28 01:55:13.349613 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:13.349587    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg"
Jul 28 01:55:21.346011 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:21.345963    2562 patch_prober.go:28] interesting pod/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 28 01:55:21.346406 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:21.346031    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf" podUID="14b31fa0-ee75-4999-9838-17ef3071da3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 28 01:55:22.399189 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:22.399158    2562 generic.go:356] "Generic (PLEG): container finished" podID="14b31fa0-ee75-4999-9838-17ef3071da3b" containerID="c370b89ab6a817612b2e18ee1c66a44172fd9d7f907b6be07444e463a9a3d93e" exitCode=0
Jul 28 01:55:22.399634 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:22.399236    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf" event={"ID":"14b31fa0-ee75-4999-9838-17ef3071da3b","Type":"ContainerDied","Data":"c370b89ab6a817612b2e18ee1c66a44172fd9d7f907b6be07444e463a9a3d93e"}
Jul 28 01:55:22.399696 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:22.399682    2562 scope.go:117] "RemoveContainer" containerID="c370b89ab6a817612b2e18ee1c66a44172fd9d7f907b6be07444e463a9a3d93e"
Jul 28 01:55:22.400715 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:22.400691    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:55:22.400769 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:22.400759    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:55:22.400806 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:22.400793    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:55:23.407010 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:23.406970    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf" event={"ID":"14b31fa0-ee75-4999-9838-17ef3071da3b","Type":"ContainerStarted","Data":"95a557ebf642a25965ea1d5ccb9dd04bdfdbb1b8e52f86dfe3a99e71ef19842c"}
Jul 28 01:55:23.918957 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:23.918915    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf"
Jul 28 01:55:23.919163 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:23.919037    2562 patch_prober.go:28] interesting pod/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Jul 28 01:55:23.919163 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:23.919097    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf" podUID="14b31fa0-ee75-4999-9838-17ef3071da3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Jul 28 01:55:24.918846 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:24.918810    2562 patch_prober.go:28] interesting pod/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Jul 28 01:55:24.919233 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:24.918867    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf" podUID="14b31fa0-ee75-4999-9838-17ef3071da3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Jul 28 01:55:25.919307 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:25.919276    2562 patch_prober.go:28] interesting pod/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Jul 28 01:55:25.919762 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:25.919685    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf" podUID="14b31fa0-ee75-4999-9838-17ef3071da3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Jul 28 01:55:26.919013 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:26.918975    2562 patch_prober.go:28] interesting pod/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Jul 28 01:55:26.919270 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:26.919028    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf" podUID="14b31fa0-ee75-4999-9838-17ef3071da3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Jul 28 01:55:27.922356 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:27.922263    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf"
Jul 28 01:55:27.922783 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:27.922754    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf"
Jul 28 01:55:27.923484 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:27.923459    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf"
Jul 28 01:55:29.390705 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:29.390667    2562 patch_prober.go:28] interesting pod/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 28 01:55:29.391091 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:29.390746    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg" podUID="fada8991-be4e-41ac-b9b8-c78bb6e25704" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 28 01:55:30.447783 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:30.447753    2562 generic.go:356] "Generic (PLEG): container finished" podID="fada8991-be4e-41ac-b9b8-c78bb6e25704" containerID="1cd7e1d389b3ee2e0c35c63f76cb66994adcd0436707aa911b5f9461f68ee2ed" exitCode=0
Jul 28 01:55:30.448174 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:30.447827    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg" event={"ID":"fada8991-be4e-41ac-b9b8-c78bb6e25704","Type":"ContainerDied","Data":"1cd7e1d389b3ee2e0c35c63f76cb66994adcd0436707aa911b5f9461f68ee2ed"}
Jul 28 01:55:30.448288 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:30.448270    2562 scope.go:117] "RemoveContainer" containerID="1cd7e1d389b3ee2e0c35c63f76cb66994adcd0436707aa911b5f9461f68ee2ed"
Jul 28 01:55:30.449371 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:30.449337    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:55:30.449487 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:30.449421    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:55:30.449487 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:30.449451    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:55:31.459609 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:31.459550    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg" event={"ID":"fada8991-be4e-41ac-b9b8-c78bb6e25704","Type":"ContainerStarted","Data":"568de686cd5ae5f26b1f049f162bb63cbb7ffe6a02cf0afe0a8d73ebe873e429"}
Jul 28 01:55:31.771165 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:31.771065    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg"
Jul 28 01:55:31.771411 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:31.771386    2562 patch_prober.go:28] interesting pod/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 28 01:55:31.771475 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:31.771452    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg" podUID="fada8991-be4e-41ac-b9b8-c78bb6e25704" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 28 01:55:32.770595 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:32.770546    2562 patch_prober.go:28] interesting pod/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 28 01:55:32.770987 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:32.770633    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg" podUID="fada8991-be4e-41ac-b9b8-c78bb6e25704" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 28 01:55:33.770455 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:33.770417    2562 patch_prober.go:28] interesting pod/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 28 01:55:33.770649 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:33.770470    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg" podUID="fada8991-be4e-41ac-b9b8-c78bb6e25704" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 28 01:55:34.770836 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:34.770795    2562 patch_prober.go:28] interesting pod/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 28 01:55:34.771316 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:34.770855    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg" podUID="fada8991-be4e-41ac-b9b8-c78bb6e25704" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 28 01:55:35.774358 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:35.774326    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg"
Jul 28 01:55:35.774762 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:35.774593    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg"
Jul 28 01:55:35.775189 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:35.775168    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg"
Jul 28 01:55:52.104890 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:52.104854    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf"]
Jul 28 01:55:52.105294 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:52.105066    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf" podUID="14b31fa0-ee75-4999-9838-17ef3071da3b" containerName="istio-proxy" containerID="cri-o://95a557ebf642a25965ea1d5ccb9dd04bdfdbb1b8e52f86dfe3a99e71ef19842c" gracePeriod=30
Jul 28 01:55:57.369897 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:57.369825    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf"
Jul 28 01:55:57.472412 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:57.472378    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14b31fa0-ee75-4999-9838-17ef3071da3b-istio-envoy\") pod \"14b31fa0-ee75-4999-9838-17ef3071da3b\" (UID: \"14b31fa0-ee75-4999-9838-17ef3071da3b\") "
Jul 28 01:55:57.472412 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:57.472416    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-458x9\" (UniqueName: \"kubernetes.io/projected/14b31fa0-ee75-4999-9838-17ef3071da3b-kube-api-access-458x9\") pod \"14b31fa0-ee75-4999-9838-17ef3071da3b\" (UID: \"14b31fa0-ee75-4999-9838-17ef3071da3b\") "
Jul 28 01:55:57.472701 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:57.472472    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14b31fa0-ee75-4999-9838-17ef3071da3b-istio-podinfo\") pod \"14b31fa0-ee75-4999-9838-17ef3071da3b\" (UID: \"14b31fa0-ee75-4999-9838-17ef3071da3b\") "
Jul 28 01:55:57.472701 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:57.472494    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14b31fa0-ee75-4999-9838-17ef3071da3b-workload-certs\") pod \"14b31fa0-ee75-4999-9838-17ef3071da3b\" (UID: \"14b31fa0-ee75-4999-9838-17ef3071da3b\") "
Jul 28 01:55:57.472701 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:57.472532    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14b31fa0-ee75-4999-9838-17ef3071da3b-istio-data\") pod \"14b31fa0-ee75-4999-9838-17ef3071da3b\" (UID: \"14b31fa0-ee75-4999-9838-17ef3071da3b\") "
Jul 28 01:55:57.472701 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:57.472575    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14b31fa0-ee75-4999-9838-17ef3071da3b-istio-token\") pod \"14b31fa0-ee75-4999-9838-17ef3071da3b\" (UID: \"14b31fa0-ee75-4999-9838-17ef3071da3b\") "
Jul 28 01:55:57.472701 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:57.472643    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14b31fa0-ee75-4999-9838-17ef3071da3b-istiod-ca-cert\") pod \"14b31fa0-ee75-4999-9838-17ef3071da3b\" (UID: \"14b31fa0-ee75-4999-9838-17ef3071da3b\") "
Jul 28 01:55:57.472962 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:57.472712    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14b31fa0-ee75-4999-9838-17ef3071da3b-credential-socket\") pod \"14b31fa0-ee75-4999-9838-17ef3071da3b\" (UID: \"14b31fa0-ee75-4999-9838-17ef3071da3b\") "
Jul 28 01:55:57.472962 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:57.472748    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14b31fa0-ee75-4999-9838-17ef3071da3b-workload-socket\") pod \"14b31fa0-ee75-4999-9838-17ef3071da3b\" (UID: \"14b31fa0-ee75-4999-9838-17ef3071da3b\") "
Jul 28 01:55:57.472962 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:57.472868    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14b31fa0-ee75-4999-9838-17ef3071da3b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "14b31fa0-ee75-4999-9838-17ef3071da3b" (UID: "14b31fa0-ee75-4999-9838-17ef3071da3b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:55:57.473127 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:57.473107    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14b31fa0-ee75-4999-9838-17ef3071da3b-workload-certs\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:55:57.473127 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:57.473105    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14b31fa0-ee75-4999-9838-17ef3071da3b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "14b31fa0-ee75-4999-9838-17ef3071da3b" (UID: "14b31fa0-ee75-4999-9838-17ef3071da3b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:55:57.473337 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:57.473300    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14b31fa0-ee75-4999-9838-17ef3071da3b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "14b31fa0-ee75-4999-9838-17ef3071da3b" (UID: "14b31fa0-ee75-4999-9838-17ef3071da3b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:55:57.473458 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:57.473336    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14b31fa0-ee75-4999-9838-17ef3071da3b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "14b31fa0-ee75-4999-9838-17ef3071da3b" (UID: "14b31fa0-ee75-4999-9838-17ef3071da3b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:55:57.473522 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:57.473500    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14b31fa0-ee75-4999-9838-17ef3071da3b-istio-data" (OuterVolumeSpecName: "istio-data") pod "14b31fa0-ee75-4999-9838-17ef3071da3b" (UID: "14b31fa0-ee75-4999-9838-17ef3071da3b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:55:57.474806 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:57.474770    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/14b31fa0-ee75-4999-9838-17ef3071da3b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "14b31fa0-ee75-4999-9838-17ef3071da3b" (UID: "14b31fa0-ee75-4999-9838-17ef3071da3b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 01:55:57.475050 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:57.475017    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14b31fa0-ee75-4999-9838-17ef3071da3b-kube-api-access-458x9" (OuterVolumeSpecName: "kube-api-access-458x9") pod "14b31fa0-ee75-4999-9838-17ef3071da3b" (UID: "14b31fa0-ee75-4999-9838-17ef3071da3b"). InnerVolumeSpecName "kube-api-access-458x9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:55:57.475112 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:57.475048    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14b31fa0-ee75-4999-9838-17ef3071da3b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "14b31fa0-ee75-4999-9838-17ef3071da3b" (UID: "14b31fa0-ee75-4999-9838-17ef3071da3b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:55:57.475112 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:57.475079    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14b31fa0-ee75-4999-9838-17ef3071da3b-istio-token" (OuterVolumeSpecName: "istio-token") pod "14b31fa0-ee75-4999-9838-17ef3071da3b" (UID: "14b31fa0-ee75-4999-9838-17ef3071da3b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:55:57.573831 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:57.573797    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14b31fa0-ee75-4999-9838-17ef3071da3b-credential-socket\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:55:57.573831 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:57.573828    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14b31fa0-ee75-4999-9838-17ef3071da3b-workload-socket\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:55:57.574034 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:57.573840    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14b31fa0-ee75-4999-9838-17ef3071da3b-istio-envoy\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:55:57.574034 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:57.573854    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-458x9\" (UniqueName: \"kubernetes.io/projected/14b31fa0-ee75-4999-9838-17ef3071da3b-kube-api-access-458x9\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:55:57.574034 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:57.573862    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14b31fa0-ee75-4999-9838-17ef3071da3b-istio-podinfo\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:55:57.574034 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:57.573870    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14b31fa0-ee75-4999-9838-17ef3071da3b-istio-data\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:55:57.574034 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:57.573878    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14b31fa0-ee75-4999-9838-17ef3071da3b-istio-token\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:55:57.574034 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:57.573887    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14b31fa0-ee75-4999-9838-17ef3071da3b-istiod-ca-cert\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:55:57.603018 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:57.602983    2562 generic.go:356] "Generic (PLEG): container finished" podID="14b31fa0-ee75-4999-9838-17ef3071da3b" containerID="95a557ebf642a25965ea1d5ccb9dd04bdfdbb1b8e52f86dfe3a99e71ef19842c" exitCode=0
Jul 28 01:55:57.603189 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:57.603024    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf" event={"ID":"14b31fa0-ee75-4999-9838-17ef3071da3b","Type":"ContainerDied","Data":"95a557ebf642a25965ea1d5ccb9dd04bdfdbb1b8e52f86dfe3a99e71ef19842c"}
Jul 28 01:55:57.603189 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:57.603033    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf"
Jul 28 01:55:57.603189 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:57.603070    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf" event={"ID":"14b31fa0-ee75-4999-9838-17ef3071da3b","Type":"ContainerDied","Data":"d10378c51a5ec09aeaa5a6f05383cff1ba9be630027c02f39d53a34405232bf9"}
Jul 28 01:55:57.603189 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:57.603091    2562 scope.go:117] "RemoveContainer" containerID="95a557ebf642a25965ea1d5ccb9dd04bdfdbb1b8e52f86dfe3a99e71ef19842c"
Jul 28 01:55:57.612791 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:57.612771    2562 scope.go:117] "RemoveContainer" containerID="c370b89ab6a817612b2e18ee1c66a44172fd9d7f907b6be07444e463a9a3d93e"
Jul 28 01:55:57.620660 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:57.620642    2562 scope.go:117] "RemoveContainer" containerID="95a557ebf642a25965ea1d5ccb9dd04bdfdbb1b8e52f86dfe3a99e71ef19842c"
Jul 28 01:55:57.620935 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:55:57.620907    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95a557ebf642a25965ea1d5ccb9dd04bdfdbb1b8e52f86dfe3a99e71ef19842c\": container with ID starting with 95a557ebf642a25965ea1d5ccb9dd04bdfdbb1b8e52f86dfe3a99e71ef19842c not found: ID does not exist" containerID="95a557ebf642a25965ea1d5ccb9dd04bdfdbb1b8e52f86dfe3a99e71ef19842c"
Jul 28 01:55:57.620991 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:57.620949    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95a557ebf642a25965ea1d5ccb9dd04bdfdbb1b8e52f86dfe3a99e71ef19842c"} err="failed to get container status \"95a557ebf642a25965ea1d5ccb9dd04bdfdbb1b8e52f86dfe3a99e71ef19842c\": rpc error: code = NotFound desc = could not find container \"95a557ebf642a25965ea1d5ccb9dd04bdfdbb1b8e52f86dfe3a99e71ef19842c\": container with ID starting with 95a557ebf642a25965ea1d5ccb9dd04bdfdbb1b8e52f86dfe3a99e71ef19842c not found: ID does not exist"
Jul 28 01:55:57.620991 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:57.620972    2562 scope.go:117] "RemoveContainer" containerID="c370b89ab6a817612b2e18ee1c66a44172fd9d7f907b6be07444e463a9a3d93e"
Jul 28 01:55:57.621271 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:55:57.621228    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c370b89ab6a817612b2e18ee1c66a44172fd9d7f907b6be07444e463a9a3d93e\": container with ID starting with c370b89ab6a817612b2e18ee1c66a44172fd9d7f907b6be07444e463a9a3d93e not found: ID does not exist" containerID="c370b89ab6a817612b2e18ee1c66a44172fd9d7f907b6be07444e463a9a3d93e"
Jul 28 01:55:57.621271 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:57.621252    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c370b89ab6a817612b2e18ee1c66a44172fd9d7f907b6be07444e463a9a3d93e"} err="failed to get container status \"c370b89ab6a817612b2e18ee1c66a44172fd9d7f907b6be07444e463a9a3d93e\": rpc error: code = NotFound desc = could not find container \"c370b89ab6a817612b2e18ee1c66a44172fd9d7f907b6be07444e463a9a3d93e\": container with ID starting with c370b89ab6a817612b2e18ee1c66a44172fd9d7f907b6be07444e463a9a3d93e not found: ID does not exist"
Jul 28 01:55:57.623878 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:57.623857    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf"]
Jul 28 01:55:57.627214 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:57.627193    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-1bc912-openshift-default-5b8bcbc6dd-j4ctf"]
Jul 28 01:55:58.013329 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:55:58.013250    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14b31fa0-ee75-4999-9838-17ef3071da3b" path="/var/lib/kubelet/pods/14b31fa0-ee75-4999-9838-17ef3071da3b/volumes"
Jul 28 01:56:19.108621 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:19.108582    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg"]
Jul 28 01:56:19.109098 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:19.108885    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg" podUID="fada8991-be4e-41ac-b9b8-c78bb6e25704" containerName="istio-proxy" containerID="cri-o://568de686cd5ae5f26b1f049f162bb63cbb7ffe6a02cf0afe0a8d73ebe873e429" gracePeriod=30
Jul 28 01:56:19.985600 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:19.985551    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2"]
Jul 28 01:56:19.986029 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:19.986016    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14b31fa0-ee75-4999-9838-17ef3071da3b" containerName="istio-proxy"
Jul 28 01:56:19.986077 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:19.986031    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="14b31fa0-ee75-4999-9838-17ef3071da3b" containerName="istio-proxy"
Jul 28 01:56:19.986077 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:19.986038    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14b31fa0-ee75-4999-9838-17ef3071da3b" containerName="istio-proxy"
Jul 28 01:56:19.986077 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:19.986044    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="14b31fa0-ee75-4999-9838-17ef3071da3b" containerName="istio-proxy"
Jul 28 01:56:19.986175 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:19.986128    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="14b31fa0-ee75-4999-9838-17ef3071da3b" containerName="istio-proxy"
Jul 28 01:56:19.986175 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:19.986138    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="14b31fa0-ee75-4999-9838-17ef3071da3b" containerName="istio-proxy"
Jul 28 01:56:19.988468 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:19.988452    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2"
Jul 28 01:56:19.990509 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:19.990486    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-dfed9b-openshift-default-dockercfg-9frkq\""
Jul 28 01:56:20.000891 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:20.000866    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2"]
Jul 28 01:56:20.085088 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:20.085036    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81df2652-7265-45bf-8dd1-eadd9ef737eb-istio-envoy\") pod \"e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2\" (UID: \"81df2652-7265-45bf-8dd1-eadd9ef737eb\") " pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2"
Jul 28 01:56:20.085273 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:20.085100    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81df2652-7265-45bf-8dd1-eadd9ef737eb-workload-socket\") pod \"e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2\" (UID: \"81df2652-7265-45bf-8dd1-eadd9ef737eb\") " pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2"
Jul 28 01:56:20.085273 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:20.085168    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81df2652-7265-45bf-8dd1-eadd9ef737eb-istio-podinfo\") pod \"e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2\" (UID: \"81df2652-7265-45bf-8dd1-eadd9ef737eb\") " pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2"
Jul 28 01:56:20.085273 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:20.085210    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81df2652-7265-45bf-8dd1-eadd9ef737eb-istio-data\") pod \"e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2\" (UID: \"81df2652-7265-45bf-8dd1-eadd9ef737eb\") " pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2"
Jul 28 01:56:20.085273 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:20.085242    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm6vz\" (UniqueName: \"kubernetes.io/projected/81df2652-7265-45bf-8dd1-eadd9ef737eb-kube-api-access-nm6vz\") pod \"e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2\" (UID: \"81df2652-7265-45bf-8dd1-eadd9ef737eb\") " pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2"
Jul 28 01:56:20.085504 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:20.085338    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81df2652-7265-45bf-8dd1-eadd9ef737eb-istiod-ca-cert\") pod \"e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2\" (UID: \"81df2652-7265-45bf-8dd1-eadd9ef737eb\") " pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2"
Jul 28 01:56:20.085504 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:20.085370    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81df2652-7265-45bf-8dd1-eadd9ef737eb-istio-token\") pod \"e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2\" (UID: \"81df2652-7265-45bf-8dd1-eadd9ef737eb\") " pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2"
Jul 28 01:56:20.085504 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:20.085396    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81df2652-7265-45bf-8dd1-eadd9ef737eb-credential-socket\") pod \"e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2\" (UID: \"81df2652-7265-45bf-8dd1-eadd9ef737eb\") " pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2"
Jul 28 01:56:20.085504 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:20.085431    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81df2652-7265-45bf-8dd1-eadd9ef737eb-workload-certs\") pod \"e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2\" (UID: \"81df2652-7265-45bf-8dd1-eadd9ef737eb\") " pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2"
Jul 28 01:56:20.186057 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:20.186020    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81df2652-7265-45bf-8dd1-eadd9ef737eb-istiod-ca-cert\") pod \"e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2\" (UID: \"81df2652-7265-45bf-8dd1-eadd9ef737eb\") " pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2"
Jul 28 01:56:20.186057 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:20.186061    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81df2652-7265-45bf-8dd1-eadd9ef737eb-istio-token\") pod \"e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2\" (UID: \"81df2652-7265-45bf-8dd1-eadd9ef737eb\") " pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2"
Jul 28 01:56:20.186676 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:20.186086    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81df2652-7265-45bf-8dd1-eadd9ef737eb-credential-socket\") pod \"e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2\" (UID: \"81df2652-7265-45bf-8dd1-eadd9ef737eb\") " pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2"
Jul 28 01:56:20.186676 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:20.186118    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81df2652-7265-45bf-8dd1-eadd9ef737eb-workload-certs\") pod \"e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2\" (UID: \"81df2652-7265-45bf-8dd1-eadd9ef737eb\") " pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2"
Jul 28 01:56:20.186676 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:20.186173    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81df2652-7265-45bf-8dd1-eadd9ef737eb-istio-envoy\") pod \"e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2\" (UID: \"81df2652-7265-45bf-8dd1-eadd9ef737eb\") " pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2"
Jul 28 01:56:20.186676 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:20.186215    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81df2652-7265-45bf-8dd1-eadd9ef737eb-workload-socket\") pod \"e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2\" (UID: \"81df2652-7265-45bf-8dd1-eadd9ef737eb\") " pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2"
Jul 28 01:56:20.186676 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:20.186234    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81df2652-7265-45bf-8dd1-eadd9ef737eb-istio-podinfo\") pod \"e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2\" (UID: \"81df2652-7265-45bf-8dd1-eadd9ef737eb\") " pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2"
Jul 28 01:56:20.186676 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:20.186251    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81df2652-7265-45bf-8dd1-eadd9ef737eb-istio-data\") pod \"e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2\" (UID: \"81df2652-7265-45bf-8dd1-eadd9ef737eb\") " pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2"
Jul 28 01:56:20.186676 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:20.186276    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm6vz\" (UniqueName: \"kubernetes.io/projected/81df2652-7265-45bf-8dd1-eadd9ef737eb-kube-api-access-nm6vz\") pod \"e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2\" (UID: \"81df2652-7265-45bf-8dd1-eadd9ef737eb\") " pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2"
Jul 28 01:56:20.186676 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:20.186592    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81df2652-7265-45bf-8dd1-eadd9ef737eb-credential-socket\") pod \"e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2\" (UID: \"81df2652-7265-45bf-8dd1-eadd9ef737eb\") " pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2"
Jul 28 01:56:20.186676 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:20.186646    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81df2652-7265-45bf-8dd1-eadd9ef737eb-workload-socket\") pod \"e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2\" (UID: \"81df2652-7265-45bf-8dd1-eadd9ef737eb\") " pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2"
Jul 28 01:56:20.187127 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:20.186850    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81df2652-7265-45bf-8dd1-eadd9ef737eb-istio-data\") pod \"e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2\" (UID: \"81df2652-7265-45bf-8dd1-eadd9ef737eb\") " pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2"
Jul 28 01:56:20.187127 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:20.186861    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81df2652-7265-45bf-8dd1-eadd9ef737eb-workload-certs\") pod \"e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2\" (UID: \"81df2652-7265-45bf-8dd1-eadd9ef737eb\") " pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2"
Jul 28 01:56:20.187357 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:20.187331    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81df2652-7265-45bf-8dd1-eadd9ef737eb-istiod-ca-cert\") pod \"e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2\" (UID: \"81df2652-7265-45bf-8dd1-eadd9ef737eb\") " pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2"
Jul 28 01:56:20.188960 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:20.188932    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81df2652-7265-45bf-8dd1-eadd9ef737eb-istio-envoy\") pod \"e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2\" (UID: \"81df2652-7265-45bf-8dd1-eadd9ef737eb\") " pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2"
Jul 28 01:56:20.189200 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:20.189180    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81df2652-7265-45bf-8dd1-eadd9ef737eb-istio-podinfo\") pod \"e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2\" (UID: \"81df2652-7265-45bf-8dd1-eadd9ef737eb\") " pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2"
Jul 28 01:56:20.194271 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:20.194250    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81df2652-7265-45bf-8dd1-eadd9ef737eb-istio-token\") pod \"e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2\" (UID: \"81df2652-7265-45bf-8dd1-eadd9ef737eb\") " pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2"
Jul 28 01:56:20.194906 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:20.194888    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm6vz\" (UniqueName: \"kubernetes.io/projected/81df2652-7265-45bf-8dd1-eadd9ef737eb-kube-api-access-nm6vz\") pod \"e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2\" (UID: \"81df2652-7265-45bf-8dd1-eadd9ef737eb\") " pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2"
Jul 28 01:56:20.299864 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:20.299785    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2"
Jul 28 01:56:20.439854 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:20.439831    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2"]
Jul 28 01:56:20.441633 ip-10-0-134-165 kubenswrapper[2562]: W0728 01:56:20.441603    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81df2652_7265_45bf_8dd1_eadd9ef737eb.slice/crio-a018867e3593cf18b075cf0f3370bab5212351073d64a56402164f26d3a5fad4 WatchSource:0}: Error finding container a018867e3593cf18b075cf0f3370bab5212351073d64a56402164f26d3a5fad4: Status 404 returned error can't find the container with id a018867e3593cf18b075cf0f3370bab5212351073d64a56402164f26d3a5fad4
Jul 28 01:56:20.443829 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:20.443798    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:56:20.443917 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:20.443866    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:56:20.443917 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:20.443894    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:56:20.729513 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:20.729479    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2" event={"ID":"81df2652-7265-45bf-8dd1-eadd9ef737eb","Type":"ContainerStarted","Data":"635e4586b447d06aff7d61274c85d610109a64637dadd0b65c427e62b00d79ff"}
Jul 28 01:56:20.729735 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:20.729538    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2" event={"ID":"81df2652-7265-45bf-8dd1-eadd9ef737eb","Type":"ContainerStarted","Data":"a018867e3593cf18b075cf0f3370bab5212351073d64a56402164f26d3a5fad4"}
Jul 28 01:56:20.747938 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:20.747893    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2" podStartSLOduration=1.7478772930000002 podStartE2EDuration="1.747877293s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:56:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:56:20.747368933 +0000 UTC m=+2451.251130247" watchObservedRunningTime="2026-07-28 01:56:20.747877293 +0000 UTC m=+2451.251638604"
Jul 28 01:56:20.776895 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:20.776853    2562 patch_prober.go:28] interesting pod/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 28 01:56:20.777049 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:20.776906    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg" podUID="fada8991-be4e-41ac-b9b8-c78bb6e25704" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 01:56:21.300707 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:21.300666    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2"
Jul 28 01:56:21.305422 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:21.305402    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2"
Jul 28 01:56:21.736623 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:21.736588    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2"
Jul 28 01:56:21.737620 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:21.737597    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2"
Jul 28 01:56:24.371129 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:24.371069    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg"
Jul 28 01:56:24.427864 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:24.427836    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fada8991-be4e-41ac-b9b8-c78bb6e25704-istio-data\") pod \"fada8991-be4e-41ac-b9b8-c78bb6e25704\" (UID: \"fada8991-be4e-41ac-b9b8-c78bb6e25704\") "
Jul 28 01:56:24.428039 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:24.427905    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fada8991-be4e-41ac-b9b8-c78bb6e25704-istio-token\") pod \"fada8991-be4e-41ac-b9b8-c78bb6e25704\" (UID: \"fada8991-be4e-41ac-b9b8-c78bb6e25704\") "
Jul 28 01:56:24.428039 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:24.427940    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fada8991-be4e-41ac-b9b8-c78bb6e25704-istiod-ca-cert\") pod \"fada8991-be4e-41ac-b9b8-c78bb6e25704\" (UID: \"fada8991-be4e-41ac-b9b8-c78bb6e25704\") "
Jul 28 01:56:24.428039 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:24.427969    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fada8991-be4e-41ac-b9b8-c78bb6e25704-workload-certs\") pod \"fada8991-be4e-41ac-b9b8-c78bb6e25704\" (UID: \"fada8991-be4e-41ac-b9b8-c78bb6e25704\") "
Jul 28 01:56:24.428241 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:24.428089    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fada8991-be4e-41ac-b9b8-c78bb6e25704-istio-podinfo\") pod \"fada8991-be4e-41ac-b9b8-c78bb6e25704\" (UID: \"fada8991-be4e-41ac-b9b8-c78bb6e25704\") "
Jul 28 01:56:24.428241 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:24.428123    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9zcj\" (UniqueName: \"kubernetes.io/projected/fada8991-be4e-41ac-b9b8-c78bb6e25704-kube-api-access-q9zcj\") pod \"fada8991-be4e-41ac-b9b8-c78bb6e25704\" (UID: \"fada8991-be4e-41ac-b9b8-c78bb6e25704\") "
Jul 28 01:56:24.428241 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:24.428157    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fada8991-be4e-41ac-b9b8-c78bb6e25704-istio-envoy\") pod \"fada8991-be4e-41ac-b9b8-c78bb6e25704\" (UID: \"fada8991-be4e-41ac-b9b8-c78bb6e25704\") "
Jul 28 01:56:24.428241 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:24.428201    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fada8991-be4e-41ac-b9b8-c78bb6e25704-credential-socket\") pod \"fada8991-be4e-41ac-b9b8-c78bb6e25704\" (UID: \"fada8991-be4e-41ac-b9b8-c78bb6e25704\") "
Jul 28 01:56:24.428241 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:24.428234    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fada8991-be4e-41ac-b9b8-c78bb6e25704-workload-socket\") pod \"fada8991-be4e-41ac-b9b8-c78bb6e25704\" (UID: \"fada8991-be4e-41ac-b9b8-c78bb6e25704\") "
Jul 28 01:56:24.428510 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:24.428248    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fada8991-be4e-41ac-b9b8-c78bb6e25704-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fada8991-be4e-41ac-b9b8-c78bb6e25704" (UID: "fada8991-be4e-41ac-b9b8-c78bb6e25704"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:56:24.428510 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:24.428347    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fada8991-be4e-41ac-b9b8-c78bb6e25704-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fada8991-be4e-41ac-b9b8-c78bb6e25704" (UID: "fada8991-be4e-41ac-b9b8-c78bb6e25704"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:56:24.428510 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:24.428458    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fada8991-be4e-41ac-b9b8-c78bb6e25704-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fada8991-be4e-41ac-b9b8-c78bb6e25704" (UID: "fada8991-be4e-41ac-b9b8-c78bb6e25704"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:56:24.428698 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:24.428520    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fada8991-be4e-41ac-b9b8-c78bb6e25704-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fada8991-be4e-41ac-b9b8-c78bb6e25704" (UID: "fada8991-be4e-41ac-b9b8-c78bb6e25704"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:56:24.428758 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:24.428700    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fada8991-be4e-41ac-b9b8-c78bb6e25704-istiod-ca-cert\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:56:24.428758 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:24.428720    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fada8991-be4e-41ac-b9b8-c78bb6e25704-workload-certs\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:56:24.428758 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:24.428733    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fada8991-be4e-41ac-b9b8-c78bb6e25704-credential-socket\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:56:24.428758 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:24.428746    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fada8991-be4e-41ac-b9b8-c78bb6e25704-workload-socket\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:56:24.428959 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:24.428851    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fada8991-be4e-41ac-b9b8-c78bb6e25704-istio-data" (OuterVolumeSpecName: "istio-data") pod "fada8991-be4e-41ac-b9b8-c78bb6e25704" (UID: "fada8991-be4e-41ac-b9b8-c78bb6e25704"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:56:24.430349 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:24.430288    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fada8991-be4e-41ac-b9b8-c78bb6e25704-istio-token" (OuterVolumeSpecName: "istio-token") pod "fada8991-be4e-41ac-b9b8-c78bb6e25704" (UID: "fada8991-be4e-41ac-b9b8-c78bb6e25704"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:56:24.430476 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:24.430404    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fada8991-be4e-41ac-b9b8-c78bb6e25704-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fada8991-be4e-41ac-b9b8-c78bb6e25704" (UID: "fada8991-be4e-41ac-b9b8-c78bb6e25704"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 01:56:24.430767 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:24.430743    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fada8991-be4e-41ac-b9b8-c78bb6e25704-kube-api-access-q9zcj" (OuterVolumeSpecName: "kube-api-access-q9zcj") pod "fada8991-be4e-41ac-b9b8-c78bb6e25704" (UID: "fada8991-be4e-41ac-b9b8-c78bb6e25704"). InnerVolumeSpecName "kube-api-access-q9zcj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:56:24.430767 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:24.430751    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fada8991-be4e-41ac-b9b8-c78bb6e25704-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fada8991-be4e-41ac-b9b8-c78bb6e25704" (UID: "fada8991-be4e-41ac-b9b8-c78bb6e25704"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:56:24.529388 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:24.529352    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fada8991-be4e-41ac-b9b8-c78bb6e25704-istio-data\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:56:24.529388 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:24.529382    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fada8991-be4e-41ac-b9b8-c78bb6e25704-istio-token\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:56:24.529388 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:24.529391    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fada8991-be4e-41ac-b9b8-c78bb6e25704-istio-podinfo\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:56:24.529388 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:24.529399    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9zcj\" (UniqueName: \"kubernetes.io/projected/fada8991-be4e-41ac-b9b8-c78bb6e25704-kube-api-access-q9zcj\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:56:24.529762 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:24.529408    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fada8991-be4e-41ac-b9b8-c78bb6e25704-istio-envoy\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 01:56:24.754768 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:24.754685    2562 generic.go:356] "Generic (PLEG): container finished" podID="fada8991-be4e-41ac-b9b8-c78bb6e25704" containerID="568de686cd5ae5f26b1f049f162bb63cbb7ffe6a02cf0afe0a8d73ebe873e429" exitCode=0
Jul 28 01:56:24.754768 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:24.754741    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg"
Jul 28 01:56:24.754969 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:24.754769    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg" event={"ID":"fada8991-be4e-41ac-b9b8-c78bb6e25704","Type":"ContainerDied","Data":"568de686cd5ae5f26b1f049f162bb63cbb7ffe6a02cf0afe0a8d73ebe873e429"}
Jul 28 01:56:24.754969 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:24.754823    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg" event={"ID":"fada8991-be4e-41ac-b9b8-c78bb6e25704","Type":"ContainerDied","Data":"1672e53327dbf595864700c3fca8652ac6fbcac36aeb8799b9d1105bd71468cd"}
Jul 28 01:56:24.754969 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:24.754847    2562 scope.go:117] "RemoveContainer" containerID="568de686cd5ae5f26b1f049f162bb63cbb7ffe6a02cf0afe0a8d73ebe873e429"
Jul 28 01:56:24.765264 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:24.765248    2562 scope.go:117] "RemoveContainer" containerID="1cd7e1d389b3ee2e0c35c63f76cb66994adcd0436707aa911b5f9461f68ee2ed"
Jul 28 01:56:24.773426 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:24.773404    2562 scope.go:117] "RemoveContainer" containerID="568de686cd5ae5f26b1f049f162bb63cbb7ffe6a02cf0afe0a8d73ebe873e429"
Jul 28 01:56:24.773699 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:56:24.773676    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"568de686cd5ae5f26b1f049f162bb63cbb7ffe6a02cf0afe0a8d73ebe873e429\": container with ID starting with 568de686cd5ae5f26b1f049f162bb63cbb7ffe6a02cf0afe0a8d73ebe873e429 not found: ID does not exist" containerID="568de686cd5ae5f26b1f049f162bb63cbb7ffe6a02cf0afe0a8d73ebe873e429"
Jul 28 01:56:24.773827 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:24.773703    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"568de686cd5ae5f26b1f049f162bb63cbb7ffe6a02cf0afe0a8d73ebe873e429"} err="failed to get container status \"568de686cd5ae5f26b1f049f162bb63cbb7ffe6a02cf0afe0a8d73ebe873e429\": rpc error: code = NotFound desc = could not find container \"568de686cd5ae5f26b1f049f162bb63cbb7ffe6a02cf0afe0a8d73ebe873e429\": container with ID starting with 568de686cd5ae5f26b1f049f162bb63cbb7ffe6a02cf0afe0a8d73ebe873e429 not found: ID does not exist"
Jul 28 01:56:24.773827 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:24.773723    2562 scope.go:117] "RemoveContainer" containerID="1cd7e1d389b3ee2e0c35c63f76cb66994adcd0436707aa911b5f9461f68ee2ed"
Jul 28 01:56:24.774017 ip-10-0-134-165 kubenswrapper[2562]: E0728 01:56:24.773993    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cd7e1d389b3ee2e0c35c63f76cb66994adcd0436707aa911b5f9461f68ee2ed\": container with ID starting with 1cd7e1d389b3ee2e0c35c63f76cb66994adcd0436707aa911b5f9461f68ee2ed not found: ID does not exist" containerID="1cd7e1d389b3ee2e0c35c63f76cb66994adcd0436707aa911b5f9461f68ee2ed"
Jul 28 01:56:24.774082 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:24.774031    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cd7e1d389b3ee2e0c35c63f76cb66994adcd0436707aa911b5f9461f68ee2ed"} err="failed to get container status \"1cd7e1d389b3ee2e0c35c63f76cb66994adcd0436707aa911b5f9461f68ee2ed\": rpc error: code = NotFound desc = could not find container \"1cd7e1d389b3ee2e0c35c63f76cb66994adcd0436707aa911b5f9461f68ee2ed\": container with ID starting with 1cd7e1d389b3ee2e0c35c63f76cb66994adcd0436707aa911b5f9461f68ee2ed not found: ID does not exist"
Jul 28 01:56:24.776500 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:24.776479    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg"]
Jul 28 01:56:24.779842 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:24.779821    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-4b0f72-openshift-default-86bf6b4f7b-k44hg"]
Jul 28 01:56:26.013841 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:26.013803    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fada8991-be4e-41ac-b9b8-c78bb6e25704" path="/var/lib/kubelet/pods/fada8991-be4e-41ac-b9b8-c78bb6e25704/volumes"
Jul 28 01:56:30.294595 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:30.292938    2562 scope.go:117] "RemoveContainer" containerID="62df8f4a9863d629216361d396a5ae093e713b49e1242971b7712c300ad83041"
Jul 28 01:56:36.738509 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:36.738470    2562 patch_prober.go:28] interesting pod/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Jul 28 01:56:36.738929 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:36.738531    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2" podUID="81df2652-7265-45bf-8dd1-eadd9ef737eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Jul 28 01:56:36.822001 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:36.821968    2562 generic.go:356] "Generic (PLEG): container finished" podID="81df2652-7265-45bf-8dd1-eadd9ef737eb" containerID="635e4586b447d06aff7d61274c85d610109a64637dadd0b65c427e62b00d79ff" exitCode=0
Jul 28 01:56:36.822165 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:36.822043    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2" event={"ID":"81df2652-7265-45bf-8dd1-eadd9ef737eb","Type":"ContainerDied","Data":"635e4586b447d06aff7d61274c85d610109a64637dadd0b65c427e62b00d79ff"}
Jul 28 01:56:36.822439 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:36.822426    2562 scope.go:117] "RemoveContainer" containerID="635e4586b447d06aff7d61274c85d610109a64637dadd0b65c427e62b00d79ff"
Jul 28 01:56:36.823472 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:36.823446    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:56:36.823546 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:36.823530    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:56:36.823605 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:36.823584    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 01:56:37.829144 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:37.829107    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2" event={"ID":"81df2652-7265-45bf-8dd1-eadd9ef737eb","Type":"ContainerStarted","Data":"779e5abce4a5b1310f743ff247226254b256cbb1bd0ea1911c0e9a7050db7ebc"}
Jul 28 01:56:38.300370 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:38.300331    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2"
Jul 28 01:56:38.300588 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:38.300543    2562 patch_prober.go:28] interesting pod/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Jul 28 01:56:38.300641 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:38.300620    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2" podUID="81df2652-7265-45bf-8dd1-eadd9ef737eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Jul 28 01:56:39.300844 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:39.300809    2562 patch_prober.go:28] interesting pod/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Jul 28 01:56:39.301234 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:39.300874    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2" podUID="81df2652-7265-45bf-8dd1-eadd9ef737eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Jul 28 01:56:40.301327 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:40.301284    2562 patch_prober.go:28] interesting pod/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Jul 28 01:56:40.301755 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:40.301352    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2" podUID="81df2652-7265-45bf-8dd1-eadd9ef737eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Jul 28 01:56:41.300280 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:41.300243    2562 patch_prober.go:28] interesting pod/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Jul 28 01:56:41.300446 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:41.300300    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2" podUID="81df2652-7265-45bf-8dd1-eadd9ef737eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Jul 28 01:56:42.304330 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:42.304300    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2"
Jul 28 01:56:42.304746 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:42.304553    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2"
Jul 28 01:56:42.305343 ip-10-0-134-165 kubenswrapper[2562]: I0728 01:56:42.305323    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2"
Jul 28 02:00:00.135992 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:00:00.135959    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-de398f-29753400-crwg4"]
Jul 28 02:00:00.136612 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:00:00.136578    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fada8991-be4e-41ac-b9b8-c78bb6e25704" containerName="istio-proxy"
Jul 28 02:00:00.136612 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:00:00.136598    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fada8991-be4e-41ac-b9b8-c78bb6e25704" containerName="istio-proxy"
Jul 28 02:00:00.136749 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:00:00.136637    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fada8991-be4e-41ac-b9b8-c78bb6e25704" containerName="istio-proxy"
Jul 28 02:00:00.136749 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:00:00.136646    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fada8991-be4e-41ac-b9b8-c78bb6e25704" containerName="istio-proxy"
Jul 28 02:00:00.136856 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:00:00.136754    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="fada8991-be4e-41ac-b9b8-c78bb6e25704" containerName="istio-proxy"
Jul 28 02:00:00.136856 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:00:00.136774    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="fada8991-be4e-41ac-b9b8-c78bb6e25704" containerName="istio-proxy"
Jul 28 02:00:00.139773 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:00:00.139753    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-dfed9b-29753400-hrptf"]
Jul 28 02:00:00.139900 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:00:00.139878    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-de398f-29753400-crwg4"
Jul 28 02:00:00.141871 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:00:00.141852    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wjxvt\""
Jul 28 02:00:00.143048 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:00:00.143029    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753400-2jggc"]
Jul 28 02:00:00.143210 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:00:00.143190    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-dfed9b-29753400-hrptf"
Jul 28 02:00:00.146319 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:00:00.146299    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753400-2jggc"
Jul 28 02:00:00.151225 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:00:00.151210    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-de398f-29753400-crwg4"
Jul 28 02:00:00.154663 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:00:00.154640    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-dfed9b-29753400-hrptf"]
Jul 28 02:00:00.158468 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:00:00.158438    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-de398f-29753400-crwg4"]
Jul 28 02:00:00.163998 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:00:00.163980    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-dfed9b-29753400-hrptf"
Jul 28 02:00:00.175636 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:00:00.175518    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753400-2jggc"]
Jul 28 02:00:00.211473 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:00:00.211451    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753400-2jggc"
Jul 28 02:00:00.383401 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:00:00.383377    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753400-2jggc"]
Jul 28 02:00:00.386085 ip-10-0-134-165 kubenswrapper[2562]: W0728 02:00:00.386012    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8a36e7c_424a_4186_b187_693b0ec67c4e.slice/crio-336ca00a0f9a92f724f195400224c4706664857b188b139d5f51c256f3ebc588 WatchSource:0}: Error finding container 336ca00a0f9a92f724f195400224c4706664857b188b139d5f51c256f3ebc588: Status 404 returned error can't find the container with id 336ca00a0f9a92f724f195400224c4706664857b188b139d5f51c256f3ebc588
Jul 28 02:00:00.528768 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:00:00.528727    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-de398f-29753400-crwg4"]
Jul 28 02:00:00.530144 ip-10-0-134-165 kubenswrapper[2562]: W0728 02:00:00.530097    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda173d3c_6453_4b0c_8c43_93ba5ca2c421.slice/crio-9cc48d6f5ccff5ea5f2b4c9afe34f04875be6770eb4ecf928133615513ec7726 WatchSource:0}: Error finding container 9cc48d6f5ccff5ea5f2b4c9afe34f04875be6770eb4ecf928133615513ec7726: Status 404 returned error can't find the container with id 9cc48d6f5ccff5ea5f2b4c9afe34f04875be6770eb4ecf928133615513ec7726
Jul 28 02:00:00.560687 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:00:00.560664    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-dfed9b-29753400-hrptf"]
Jul 28 02:00:00.562728 ip-10-0-134-165 kubenswrapper[2562]: W0728 02:00:00.562706    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae01d1d3_96c0_41a8_b661_7553b0aa7374.slice/crio-3100d61b2f4de7fcbb06e897ebc76b3a0c4637b26a5b8fe3eaca31460bb53184 WatchSource:0}: Error finding container 3100d61b2f4de7fcbb06e897ebc76b3a0c4637b26a5b8fe3eaca31460bb53184: Status 404 returned error can't find the container with id 3100d61b2f4de7fcbb06e897ebc76b3a0c4637b26a5b8fe3eaca31460bb53184
Jul 28 02:00:00.898975 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:00:00.898942    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753400-2jggc" event={"ID":"e8a36e7c-424a-4186-b187-693b0ec67c4e","Type":"ContainerStarted","Data":"d29405c6a7aaadd4c23f2fb17802e99b7cf9e590246aeb0649f0deac326405d4"}
Jul 28 02:00:00.899163 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:00:00.899000    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753400-2jggc" event={"ID":"e8a36e7c-424a-4186-b187-693b0ec67c4e","Type":"ContainerStarted","Data":"336ca00a0f9a92f724f195400224c4706664857b188b139d5f51c256f3ebc588"}
Jul 28 02:00:00.900198 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:00:00.900175    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-de398f-29753400-crwg4" event={"ID":"da173d3c-6453-4b0c-8c43-93ba5ca2c421","Type":"ContainerStarted","Data":"9cc48d6f5ccff5ea5f2b4c9afe34f04875be6770eb4ecf928133615513ec7726"}
Jul 28 02:00:00.901748 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:00:00.901721    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-dfed9b-29753400-hrptf" event={"ID":"ae01d1d3-96c0-41a8-b661-7553b0aa7374","Type":"ContainerStarted","Data":"e86a120eea8055ae899edf13f0964a78681feb2ef591809becba8244e6aa935f"}
Jul 28 02:00:00.901827 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:00:00.901767    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-dfed9b-29753400-hrptf" event={"ID":"ae01d1d3-96c0-41a8-b661-7553b0aa7374","Type":"ContainerStarted","Data":"3100d61b2f4de7fcbb06e897ebc76b3a0c4637b26a5b8fe3eaca31460bb53184"}
Jul 28 02:00:00.913163 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:00:00.913117    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753400-2jggc" podStartSLOduration=0.913104097 podStartE2EDuration="913.104097ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 02:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 02:00:00.91175786 +0000 UTC m=+2671.415519173" watchObservedRunningTime="2026-07-28 02:00:00.913104097 +0000 UTC m=+2671.416865409"
Jul 28 02:00:00.928138 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:00:00.928098    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-dfed9b-29753400-hrptf" podStartSLOduration=0.928086095 podStartE2EDuration="928.086095ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 02:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 02:00:00.926141751 +0000 UTC m=+2671.429903063" watchObservedRunningTime="2026-07-28 02:00:00.928086095 +0000 UTC m=+2671.431847408"
Jul 28 02:00:01.908828 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:00:01.908789    2562 generic.go:356] "Generic (PLEG): container finished" podID="ae01d1d3-96c0-41a8-b661-7553b0aa7374" containerID="e86a120eea8055ae899edf13f0964a78681feb2ef591809becba8244e6aa935f" exitCode=0
Jul 28 02:00:01.909263 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:00:01.908876    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-dfed9b-29753400-hrptf" event={"ID":"ae01d1d3-96c0-41a8-b661-7553b0aa7374","Type":"ContainerDied","Data":"e86a120eea8055ae899edf13f0964a78681feb2ef591809becba8244e6aa935f"}
Jul 28 02:00:01.910488 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:00:01.910462    2562 generic.go:356] "Generic (PLEG): container finished" podID="e8a36e7c-424a-4186-b187-693b0ec67c4e" containerID="d29405c6a7aaadd4c23f2fb17802e99b7cf9e590246aeb0649f0deac326405d4" exitCode=0
Jul 28 02:00:01.910636 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:00:01.910512    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753400-2jggc" event={"ID":"e8a36e7c-424a-4186-b187-693b0ec67c4e","Type":"ContainerDied","Data":"d29405c6a7aaadd4c23f2fb17802e99b7cf9e590246aeb0649f0deac326405d4"}
Jul 28 02:00:01.912167 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:00:01.912146    2562 generic.go:356] "Generic (PLEG): container finished" podID="da173d3c-6453-4b0c-8c43-93ba5ca2c421" containerID="6630b42d2cf81abc6dbcd83bf9f6ef8a07035fe36aaee467cd82ae24a3fb13fd" exitCode=0
Jul 28 02:00:01.912249 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:00:01.912206    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-de398f-29753400-crwg4" event={"ID":"da173d3c-6453-4b0c-8c43-93ba5ca2c421","Type":"ContainerDied","Data":"6630b42d2cf81abc6dbcd83bf9f6ef8a07035fe36aaee467cd82ae24a3fb13fd"}
Jul 28 02:00:03.060575 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:00:03.060537    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753400-2jggc"
Jul 28 02:00:03.105603 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:00:03.105580    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-de398f-29753400-crwg4"
Jul 28 02:00:03.125325 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:00:03.125297    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-dfed9b-29753400-hrptf"
Jul 28 02:00:03.925295 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:00:03.925269    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-dfed9b-29753400-hrptf"
Jul 28 02:00:03.925482 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:00:03.925307    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-dfed9b-29753400-hrptf" event={"ID":"ae01d1d3-96c0-41a8-b661-7553b0aa7374","Type":"ContainerDied","Data":"3100d61b2f4de7fcbb06e897ebc76b3a0c4637b26a5b8fe3eaca31460bb53184"}
Jul 28 02:00:03.925482 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:00:03.925358    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3100d61b2f4de7fcbb06e897ebc76b3a0c4637b26a5b8fe3eaca31460bb53184"
Jul 28 02:00:03.926642 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:00:03.926626    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753400-2jggc"
Jul 28 02:00:03.926770 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:00:03.926639    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753400-2jggc" event={"ID":"e8a36e7c-424a-4186-b187-693b0ec67c4e","Type":"ContainerDied","Data":"336ca00a0f9a92f724f195400224c4706664857b188b139d5f51c256f3ebc588"}
Jul 28 02:00:03.926770 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:00:03.926682    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="336ca00a0f9a92f724f195400224c4706664857b188b139d5f51c256f3ebc588"
Jul 28 02:00:03.928000 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:00:03.927977    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-de398f-29753400-crwg4" event={"ID":"da173d3c-6453-4b0c-8c43-93ba5ca2c421","Type":"ContainerDied","Data":"9cc48d6f5ccff5ea5f2b4c9afe34f04875be6770eb4ecf928133615513ec7726"}
Jul 28 02:00:03.928094 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:00:03.928000    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-de398f-29753400-crwg4"
Jul 28 02:00:03.928094 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:00:03.928020    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9cc48d6f5ccff5ea5f2b4c9afe34f04875be6770eb4ecf928133615513ec7726"
Jul 28 02:00:30.351969 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:00:30.351895    2562 scope.go:117] "RemoveContainer" containerID="a75cadcec32b21ac8b0240f5c0241d2232d74a76d717f7c5f8f8c2148392877c"
Jul 28 02:01:30.373179 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:01:30.373145    2562 scope.go:117] "RemoveContainer" containerID="0e95a63463ca49fbd54f83e31b24a42019f1379ed23b9a6e5d606d97fcb0bdcd"
Jul 28 02:05:25.145351 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:25.145271    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7637-140682728373680"]
Jul 28 02:05:25.145826 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:25.145707    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da173d3c-6453-4b0c-8c43-93ba5ca2c421" containerName="cleanup"
Jul 28 02:05:25.145826 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:25.145718    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="da173d3c-6453-4b0c-8c43-93ba5ca2c421" containerName="cleanup"
Jul 28 02:05:25.145826 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:25.145728    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8a36e7c-424a-4186-b187-693b0ec67c4e" containerName="cleanup"
Jul 28 02:05:25.145826 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:25.145734    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8a36e7c-424a-4186-b187-693b0ec67c4e" containerName="cleanup"
Jul 28 02:05:25.145826 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:25.145752    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae01d1d3-96c0-41a8-b661-7553b0aa7374" containerName="cleanup"
Jul 28 02:05:25.145826 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:25.145759    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae01d1d3-96c0-41a8-b661-7553b0aa7374" containerName="cleanup"
Jul 28 02:05:25.145826 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:25.145812    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8a36e7c-424a-4186-b187-693b0ec67c4e" containerName="cleanup"
Jul 28 02:05:25.145826 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:25.145818    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="da173d3c-6453-4b0c-8c43-93ba5ca2c421" containerName="cleanup"
Jul 28 02:05:25.145826 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:25.145827    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae01d1d3-96c0-41a8-b661-7553b0aa7374" containerName="cleanup"
Jul 28 02:05:25.148899 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:25.148883    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7637-140682728373680"
Jul 28 02:05:25.151221 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:25.151201    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-t9q96\""
Jul 28 02:05:25.156845 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:25.156261    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7637-140682728373680"]
Jul 28 02:05:25.163282 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:25.163256    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqx2d\" (UniqueName: \"kubernetes.io/projected/f6cf4d2b-fe96-4279-8975-16b32633f7e5-kube-api-access-qqx2d\") pod \"test-curl-7637-140682728373680\" (UID: \"f6cf4d2b-fe96-4279-8975-16b32633f7e5\") " pod="opendatahub/test-curl-7637-140682728373680"
Jul 28 02:05:25.264698 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:25.264656    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqx2d\" (UniqueName: \"kubernetes.io/projected/f6cf4d2b-fe96-4279-8975-16b32633f7e5-kube-api-access-qqx2d\") pod \"test-curl-7637-140682728373680\" (UID: \"f6cf4d2b-fe96-4279-8975-16b32633f7e5\") " pod="opendatahub/test-curl-7637-140682728373680"
Jul 28 02:05:25.272855 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:25.272830    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqx2d\" (UniqueName: \"kubernetes.io/projected/f6cf4d2b-fe96-4279-8975-16b32633f7e5-kube-api-access-qqx2d\") pod \"test-curl-7637-140682728373680\" (UID: \"f6cf4d2b-fe96-4279-8975-16b32633f7e5\") " pod="opendatahub/test-curl-7637-140682728373680"
Jul 28 02:05:25.459998 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:25.459913    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7637-140682728373680"
Jul 28 02:05:25.603715 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:25.603683    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7637-140682728373680"]
Jul 28 02:05:25.605427 ip-10-0-134-165 kubenswrapper[2562]: W0728 02:05:25.605396    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf6cf4d2b_fe96_4279_8975_16b32633f7e5.slice/crio-015d662195ca5b16181af8334e0b4709e089c7fac1054c72fa63b42002389487 WatchSource:0}: Error finding container 015d662195ca5b16181af8334e0b4709e089c7fac1054c72fa63b42002389487: Status 404 returned error can't find the container with id 015d662195ca5b16181af8334e0b4709e089c7fac1054c72fa63b42002389487
Jul 28 02:05:25.606684 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:25.606667    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 02:05:25.641133 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:25.641097    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7637-140682728373680" event={"ID":"f6cf4d2b-fe96-4279-8975-16b32633f7e5","Type":"ContainerStarted","Data":"015d662195ca5b16181af8334e0b4709e089c7fac1054c72fa63b42002389487"}
Jul 28 02:05:26.647269 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:26.647232    2562 generic.go:356] "Generic (PLEG): container finished" podID="f6cf4d2b-fe96-4279-8975-16b32633f7e5" containerID="be6acccad69aecc85352b14dafa9acd48e6580e8772c1fa137b0b9cc38ce05d2" exitCode=0
Jul 28 02:05:26.647677 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:26.647312    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7637-140682728373680" event={"ID":"f6cf4d2b-fe96-4279-8975-16b32633f7e5","Type":"ContainerDied","Data":"be6acccad69aecc85352b14dafa9acd48e6580e8772c1fa137b0b9cc38ce05d2"}
Jul 28 02:05:27.800757 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:27.800729    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7637-140682728373680"
Jul 28 02:05:27.835714 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:27.835681    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7637-140682728373680_f6cf4d2b-fe96-4279-8975-16b32633f7e5/test-curl-7637-140682728373680/0.log"
Jul 28 02:05:27.855983 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:27.855952    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7637-140682728373680"]
Jul 28 02:05:27.859006 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:27.858975    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7637-140682728373680"]
Jul 28 02:05:27.889198 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:27.889171    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqx2d\" (UniqueName: \"kubernetes.io/projected/f6cf4d2b-fe96-4279-8975-16b32633f7e5-kube-api-access-qqx2d\") pod \"f6cf4d2b-fe96-4279-8975-16b32633f7e5\" (UID: \"f6cf4d2b-fe96-4279-8975-16b32633f7e5\") "
Jul 28 02:05:27.891357 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:27.891327    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6cf4d2b-fe96-4279-8975-16b32633f7e5-kube-api-access-qqx2d" (OuterVolumeSpecName: "kube-api-access-qqx2d") pod "f6cf4d2b-fe96-4279-8975-16b32633f7e5" (UID: "f6cf4d2b-fe96-4279-8975-16b32633f7e5"). InnerVolumeSpecName "kube-api-access-qqx2d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 02:05:27.982955 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:27.982859    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7637-140682728371248"]
Jul 28 02:05:27.983331 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:27.983314    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6cf4d2b-fe96-4279-8975-16b32633f7e5" containerName="test-curl-7637-140682728373680"
Jul 28 02:05:27.983422 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:27.983333    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6cf4d2b-fe96-4279-8975-16b32633f7e5" containerName="test-curl-7637-140682728373680"
Jul 28 02:05:27.983422 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:27.983400    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6cf4d2b-fe96-4279-8975-16b32633f7e5" containerName="test-curl-7637-140682728373680"
Jul 28 02:05:27.986624 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:27.986603    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7637-140682728371248"
Jul 28 02:05:27.989945 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:27.989911    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqx2d\" (UniqueName: \"kubernetes.io/projected/f6cf4d2b-fe96-4279-8975-16b32633f7e5-kube-api-access-qqx2d\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 02:05:27.992770 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:27.992748    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7637-140682728371248"]
Jul 28 02:05:28.015635 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:28.015599    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6cf4d2b-fe96-4279-8975-16b32633f7e5" path="/var/lib/kubelet/pods/f6cf4d2b-fe96-4279-8975-16b32633f7e5/volumes"
Jul 28 02:05:28.090971 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:28.090934    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hv46r\" (UniqueName: \"kubernetes.io/projected/cbdd4c5a-be5d-4cca-bf43-03363a9ab636-kube-api-access-hv46r\") pod \"test-curl-7637-140682728371248\" (UID: \"cbdd4c5a-be5d-4cca-bf43-03363a9ab636\") " pod="opendatahub/test-curl-7637-140682728371248"
Jul 28 02:05:28.191761 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:28.191725    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hv46r\" (UniqueName: \"kubernetes.io/projected/cbdd4c5a-be5d-4cca-bf43-03363a9ab636-kube-api-access-hv46r\") pod \"test-curl-7637-140682728371248\" (UID: \"cbdd4c5a-be5d-4cca-bf43-03363a9ab636\") " pod="opendatahub/test-curl-7637-140682728371248"
Jul 28 02:05:28.200332 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:28.200305    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hv46r\" (UniqueName: \"kubernetes.io/projected/cbdd4c5a-be5d-4cca-bf43-03363a9ab636-kube-api-access-hv46r\") pod \"test-curl-7637-140682728371248\" (UID: \"cbdd4c5a-be5d-4cca-bf43-03363a9ab636\") " pod="opendatahub/test-curl-7637-140682728371248"
Jul 28 02:05:28.299706 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:28.299622    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7637-140682728371248"
Jul 28 02:05:28.434969 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:28.434937    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7637-140682728371248"]
Jul 28 02:05:28.436085 ip-10-0-134-165 kubenswrapper[2562]: W0728 02:05:28.436057    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcbdd4c5a_be5d_4cca_bf43_03363a9ab636.slice/crio-2965cdcdcd5a1f98c27de7acfb8120bf8f92837756ce8073ea0db94bcb29dcc5 WatchSource:0}: Error finding container 2965cdcdcd5a1f98c27de7acfb8120bf8f92837756ce8073ea0db94bcb29dcc5: Status 404 returned error can't find the container with id 2965cdcdcd5a1f98c27de7acfb8120bf8f92837756ce8073ea0db94bcb29dcc5
Jul 28 02:05:28.660500 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:28.660463    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7637-140682728371248" event={"ID":"cbdd4c5a-be5d-4cca-bf43-03363a9ab636","Type":"ContainerStarted","Data":"2965cdcdcd5a1f98c27de7acfb8120bf8f92837756ce8073ea0db94bcb29dcc5"}
Jul 28 02:05:28.661810 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:28.661791    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7637-140682728373680"
Jul 28 02:05:28.661953 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:28.661816    2562 scope.go:117] "RemoveContainer" containerID="be6acccad69aecc85352b14dafa9acd48e6580e8772c1fa137b0b9cc38ce05d2"
Jul 28 02:05:29.668167 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:29.668129    2562 generic.go:356] "Generic (PLEG): container finished" podID="cbdd4c5a-be5d-4cca-bf43-03363a9ab636" containerID="4efd10d610ff2e3b9e181995c9b2bcab468e2156e57065c7c3b071afd8786207" exitCode=0
Jul 28 02:05:29.668659 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:29.668216    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7637-140682728371248" event={"ID":"cbdd4c5a-be5d-4cca-bf43-03363a9ab636","Type":"ContainerDied","Data":"4efd10d610ff2e3b9e181995c9b2bcab468e2156e57065c7c3b071afd8786207"}
Jul 28 02:05:30.817769 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:30.817745    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7637-140682728371248"
Jul 28 02:05:30.836852 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:30.836827    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7637-140682728371248_cbdd4c5a-be5d-4cca-bf43-03363a9ab636/test-curl-7637-140682728371248/0.log"
Jul 28 02:05:30.859904 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:30.859872    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7637-140682728371248"]
Jul 28 02:05:30.864826 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:30.864801    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7637-140682728371248"]
Jul 28 02:05:30.918850 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:30.918823    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hv46r\" (UniqueName: \"kubernetes.io/projected/cbdd4c5a-be5d-4cca-bf43-03363a9ab636-kube-api-access-hv46r\") pod \"cbdd4c5a-be5d-4cca-bf43-03363a9ab636\" (UID: \"cbdd4c5a-be5d-4cca-bf43-03363a9ab636\") "
Jul 28 02:05:30.920862 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:30.920836    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbdd4c5a-be5d-4cca-bf43-03363a9ab636-kube-api-access-hv46r" (OuterVolumeSpecName: "kube-api-access-hv46r") pod "cbdd4c5a-be5d-4cca-bf43-03363a9ab636" (UID: "cbdd4c5a-be5d-4cca-bf43-03363a9ab636"). InnerVolumeSpecName "kube-api-access-hv46r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 02:05:31.019667 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:31.019632    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hv46r\" (UniqueName: \"kubernetes.io/projected/cbdd4c5a-be5d-4cca-bf43-03363a9ab636-kube-api-access-hv46r\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 02:05:31.023461 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:31.023434    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7637-140682728286224"]
Jul 28 02:05:31.023847 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:31.023834    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbdd4c5a-be5d-4cca-bf43-03363a9ab636" containerName="test-curl-7637-140682728371248"
Jul 28 02:05:31.023888 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:31.023848    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbdd4c5a-be5d-4cca-bf43-03363a9ab636" containerName="test-curl-7637-140682728371248"
Jul 28 02:05:31.023937 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:31.023928    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbdd4c5a-be5d-4cca-bf43-03363a9ab636" containerName="test-curl-7637-140682728371248"
Jul 28 02:05:31.026968 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:31.026953    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7637-140682728286224"
Jul 28 02:05:31.032427 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:31.032400    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7637-140682728286224"]
Jul 28 02:05:31.120835 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:31.120804    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd4ld\" (UniqueName: \"kubernetes.io/projected/93fffd6f-e8db-451a-80a0-cd4d56b2802e-kube-api-access-bd4ld\") pod \"test-curl-7637-140682728286224\" (UID: \"93fffd6f-e8db-451a-80a0-cd4d56b2802e\") " pod="opendatahub/test-curl-7637-140682728286224"
Jul 28 02:05:31.222173 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:31.222071    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd4ld\" (UniqueName: \"kubernetes.io/projected/93fffd6f-e8db-451a-80a0-cd4d56b2802e-kube-api-access-bd4ld\") pod \"test-curl-7637-140682728286224\" (UID: \"93fffd6f-e8db-451a-80a0-cd4d56b2802e\") " pod="opendatahub/test-curl-7637-140682728286224"
Jul 28 02:05:31.231391 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:31.231357    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd4ld\" (UniqueName: \"kubernetes.io/projected/93fffd6f-e8db-451a-80a0-cd4d56b2802e-kube-api-access-bd4ld\") pod \"test-curl-7637-140682728286224\" (UID: \"93fffd6f-e8db-451a-80a0-cd4d56b2802e\") " pod="opendatahub/test-curl-7637-140682728286224"
Jul 28 02:05:31.339163 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:31.339122    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7637-140682728286224"
Jul 28 02:05:31.478506 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:31.478479    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7637-140682728286224"]
Jul 28 02:05:31.480480 ip-10-0-134-165 kubenswrapper[2562]: W0728 02:05:31.480451    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod93fffd6f_e8db_451a_80a0_cd4d56b2802e.slice/crio-db05738bbed8c439be56062708cf5f2abc6bf39ebc0f7e30ce8d817494ee2546 WatchSource:0}: Error finding container db05738bbed8c439be56062708cf5f2abc6bf39ebc0f7e30ce8d817494ee2546: Status 404 returned error can't find the container with id db05738bbed8c439be56062708cf5f2abc6bf39ebc0f7e30ce8d817494ee2546
Jul 28 02:05:31.680900 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:31.680877    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2965cdcdcd5a1f98c27de7acfb8120bf8f92837756ce8073ea0db94bcb29dcc5"
Jul 28 02:05:31.680900 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:31.680878    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7637-140682728371248"
Jul 28 02:05:31.682123 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:31.682095    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7637-140682728286224" event={"ID":"93fffd6f-e8db-451a-80a0-cd4d56b2802e","Type":"ContainerStarted","Data":"db05738bbed8c439be56062708cf5f2abc6bf39ebc0f7e30ce8d817494ee2546"}
Jul 28 02:05:31.691790 ip-10-0-134-165 kubenswrapper[2562]: E0728 02:05:31.691765    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7637-140682728371248\" is forbidden: User \"system:node:ip-10-0-134-165.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-165.ec2.internal' and this object" podUID="cbdd4c5a-be5d-4cca-bf43-03363a9ab636" pod="opendatahub/test-curl-7637-140682728371248"
Jul 28 02:05:32.014548 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:32.014469    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbdd4c5a-be5d-4cca-bf43-03363a9ab636" path="/var/lib/kubelet/pods/cbdd4c5a-be5d-4cca-bf43-03363a9ab636/volumes"
Jul 28 02:05:32.688650 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:32.688617    2562 generic.go:356] "Generic (PLEG): container finished" podID="93fffd6f-e8db-451a-80a0-cd4d56b2802e" containerID="30c801b56f5c99247fea1dbd9922b9330bcb3a430d4b04e82dea7866d5a51a64" exitCode=0
Jul 28 02:05:32.688809 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:32.688698    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7637-140682728286224" event={"ID":"93fffd6f-e8db-451a-80a0-cd4d56b2802e","Type":"ContainerDied","Data":"30c801b56f5c99247fea1dbd9922b9330bcb3a430d4b04e82dea7866d5a51a64"}
Jul 28 02:05:33.833202 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:33.833179    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7637-140682728286224"
Jul 28 02:05:33.852003 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:33.851979    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7637-140682728286224_93fffd6f-e8db-451a-80a0-cd4d56b2802e/test-curl-7637-140682728286224/0.log"
Jul 28 02:05:33.873873 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:33.873847    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7637-140682728286224"]
Jul 28 02:05:33.877493 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:33.877471    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7637-140682728286224"]
Jul 28 02:05:33.946798 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:33.946723    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bd4ld\" (UniqueName: \"kubernetes.io/projected/93fffd6f-e8db-451a-80a0-cd4d56b2802e-kube-api-access-bd4ld\") pod \"93fffd6f-e8db-451a-80a0-cd4d56b2802e\" (UID: \"93fffd6f-e8db-451a-80a0-cd4d56b2802e\") "
Jul 28 02:05:33.948731 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:33.948705    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93fffd6f-e8db-451a-80a0-cd4d56b2802e-kube-api-access-bd4ld" (OuterVolumeSpecName: "kube-api-access-bd4ld") pod "93fffd6f-e8db-451a-80a0-cd4d56b2802e" (UID: "93fffd6f-e8db-451a-80a0-cd4d56b2802e"). InnerVolumeSpecName "kube-api-access-bd4ld". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 02:05:33.997412 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:33.997382    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7637-140682728286224"]
Jul 28 02:05:33.997839 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:33.997826    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93fffd6f-e8db-451a-80a0-cd4d56b2802e" containerName="test-curl-7637-140682728286224"
Jul 28 02:05:33.997888 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:33.997841    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="93fffd6f-e8db-451a-80a0-cd4d56b2802e" containerName="test-curl-7637-140682728286224"
Jul 28 02:05:33.997931 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:33.997913    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="93fffd6f-e8db-451a-80a0-cd4d56b2802e" containerName="test-curl-7637-140682728286224"
Jul 28 02:05:34.000857 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:34.000843    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7637-140682728286224"
Jul 28 02:05:34.015817 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:34.015794    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93fffd6f-e8db-451a-80a0-cd4d56b2802e" path="/var/lib/kubelet/pods/93fffd6f-e8db-451a-80a0-cd4d56b2802e/volumes"
Jul 28 02:05:34.016129 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:34.016116    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7637-140682728286224"]
Jul 28 02:05:34.048182 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:34.048150    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z7q5\" (UniqueName: \"kubernetes.io/projected/943b0460-e105-43c5-b0e8-6894ce4d2aa1-kube-api-access-2z7q5\") pod \"test-curl-7637-140682728286224\" (UID: \"943b0460-e105-43c5-b0e8-6894ce4d2aa1\") " pod="opendatahub/test-curl-7637-140682728286224"
Jul 28 02:05:34.048462 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:34.048436    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bd4ld\" (UniqueName: \"kubernetes.io/projected/93fffd6f-e8db-451a-80a0-cd4d56b2802e-kube-api-access-bd4ld\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 02:05:34.149579 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:34.149518    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z7q5\" (UniqueName: \"kubernetes.io/projected/943b0460-e105-43c5-b0e8-6894ce4d2aa1-kube-api-access-2z7q5\") pod \"test-curl-7637-140682728286224\" (UID: \"943b0460-e105-43c5-b0e8-6894ce4d2aa1\") " pod="opendatahub/test-curl-7637-140682728286224"
Jul 28 02:05:34.157592 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:34.157547    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z7q5\" (UniqueName: \"kubernetes.io/projected/943b0460-e105-43c5-b0e8-6894ce4d2aa1-kube-api-access-2z7q5\") pod \"test-curl-7637-140682728286224\" (UID: \"943b0460-e105-43c5-b0e8-6894ce4d2aa1\") " pod="opendatahub/test-curl-7637-140682728286224"
Jul 28 02:05:34.311763 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:34.311675    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7637-140682728286224"
Jul 28 02:05:34.448285 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:34.448257    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7637-140682728286224"]
Jul 28 02:05:34.449916 ip-10-0-134-165 kubenswrapper[2562]: W0728 02:05:34.449889    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod943b0460_e105_43c5_b0e8_6894ce4d2aa1.slice/crio-0fd1bc03fe7f0df584c0fdea7eaf5da2d12cddbc517c81a7ddc89197328d3a64 WatchSource:0}: Error finding container 0fd1bc03fe7f0df584c0fdea7eaf5da2d12cddbc517c81a7ddc89197328d3a64: Status 404 returned error can't find the container with id 0fd1bc03fe7f0df584c0fdea7eaf5da2d12cddbc517c81a7ddc89197328d3a64
Jul 28 02:05:34.699723 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:34.699693    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7637-140682728286224"
Jul 28 02:05:34.699913 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:34.699702    2562 scope.go:117] "RemoveContainer" containerID="30c801b56f5c99247fea1dbd9922b9330bcb3a430d4b04e82dea7866d5a51a64"
Jul 28 02:05:34.701028 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:34.700943    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7637-140682728286224" event={"ID":"943b0460-e105-43c5-b0e8-6894ce4d2aa1","Type":"ContainerStarted","Data":"0fd1bc03fe7f0df584c0fdea7eaf5da2d12cddbc517c81a7ddc89197328d3a64"}
Jul 28 02:05:35.708716 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:35.708685    2562 generic.go:356] "Generic (PLEG): container finished" podID="943b0460-e105-43c5-b0e8-6894ce4d2aa1" containerID="078b01b089d205e2441dd5e1fcda46c9d19826ab4266c819ef3a2ab7c2534b19" exitCode=0
Jul 28 02:05:35.709122 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:35.708763    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7637-140682728286224" event={"ID":"943b0460-e105-43c5-b0e8-6894ce4d2aa1","Type":"ContainerDied","Data":"078b01b089d205e2441dd5e1fcda46c9d19826ab4266c819ef3a2ab7c2534b19"}
Jul 28 02:05:36.862466 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:36.862440    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7637-140682728286224"
Jul 28 02:05:36.882425 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:36.882397    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7637-140682728286224_943b0460-e105-43c5-b0e8-6894ce4d2aa1/test-curl-7637-140682728286224/0.log"
Jul 28 02:05:36.903575 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:36.903538    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7637-140682728286224"]
Jul 28 02:05:36.908770 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:36.908745    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7637-140682728286224"]
Jul 28 02:05:36.974822 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:36.974737    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2z7q5\" (UniqueName: \"kubernetes.io/projected/943b0460-e105-43c5-b0e8-6894ce4d2aa1-kube-api-access-2z7q5\") pod \"943b0460-e105-43c5-b0e8-6894ce4d2aa1\" (UID: \"943b0460-e105-43c5-b0e8-6894ce4d2aa1\") "
Jul 28 02:05:36.976800 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:36.976774    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/943b0460-e105-43c5-b0e8-6894ce4d2aa1-kube-api-access-2z7q5" (OuterVolumeSpecName: "kube-api-access-2z7q5") pod "943b0460-e105-43c5-b0e8-6894ce4d2aa1" (UID: "943b0460-e105-43c5-b0e8-6894ce4d2aa1"). InnerVolumeSpecName "kube-api-access-2z7q5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 02:05:37.028506 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:37.028472    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7637-140682728287232"]
Jul 28 02:05:37.028897 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:37.028883    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="943b0460-e105-43c5-b0e8-6894ce4d2aa1" containerName="test-curl-7637-140682728286224"
Jul 28 02:05:37.028942 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:37.028899    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="943b0460-e105-43c5-b0e8-6894ce4d2aa1" containerName="test-curl-7637-140682728286224"
Jul 28 02:05:37.028991 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:37.028982    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="943b0460-e105-43c5-b0e8-6894ce4d2aa1" containerName="test-curl-7637-140682728286224"
Jul 28 02:05:37.032189 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:37.032166    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7637-140682728287232"
Jul 28 02:05:37.038258 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:37.038229    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7637-140682728287232"]
Jul 28 02:05:37.075924 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:37.075889    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrs5t\" (UniqueName: \"kubernetes.io/projected/ddbf5c8a-fb63-4104-be20-1527bb998aca-kube-api-access-qrs5t\") pod \"test-curl-7637-140682728287232\" (UID: \"ddbf5c8a-fb63-4104-be20-1527bb998aca\") " pod="opendatahub/test-curl-7637-140682728287232"
Jul 28 02:05:37.076119 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:37.076071    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2z7q5\" (UniqueName: \"kubernetes.io/projected/943b0460-e105-43c5-b0e8-6894ce4d2aa1-kube-api-access-2z7q5\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 02:05:37.176936 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:37.176898    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrs5t\" (UniqueName: \"kubernetes.io/projected/ddbf5c8a-fb63-4104-be20-1527bb998aca-kube-api-access-qrs5t\") pod \"test-curl-7637-140682728287232\" (UID: \"ddbf5c8a-fb63-4104-be20-1527bb998aca\") " pod="opendatahub/test-curl-7637-140682728287232"
Jul 28 02:05:37.185053 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:37.185022    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrs5t\" (UniqueName: \"kubernetes.io/projected/ddbf5c8a-fb63-4104-be20-1527bb998aca-kube-api-access-qrs5t\") pod \"test-curl-7637-140682728287232\" (UID: \"ddbf5c8a-fb63-4104-be20-1527bb998aca\") " pod="opendatahub/test-curl-7637-140682728287232"
Jul 28 02:05:37.343429 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:37.343341    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7637-140682728287232"
Jul 28 02:05:37.477884 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:37.477849    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7637-140682728287232"]
Jul 28 02:05:37.480497 ip-10-0-134-165 kubenswrapper[2562]: W0728 02:05:37.480467    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podddbf5c8a_fb63_4104_be20_1527bb998aca.slice/crio-f5dd81c243a527a51d99fddce759d09d1a57b731a0acf292b5343f9cbb2a80a5 WatchSource:0}: Error finding container f5dd81c243a527a51d99fddce759d09d1a57b731a0acf292b5343f9cbb2a80a5: Status 404 returned error can't find the container with id f5dd81c243a527a51d99fddce759d09d1a57b731a0acf292b5343f9cbb2a80a5
Jul 28 02:05:37.721343 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:37.721305    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0fd1bc03fe7f0df584c0fdea7eaf5da2d12cddbc517c81a7ddc89197328d3a64"
Jul 28 02:05:37.721343 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:37.721309    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7637-140682728286224"
Jul 28 02:05:37.722581 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:37.722537    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7637-140682728287232" event={"ID":"ddbf5c8a-fb63-4104-be20-1527bb998aca","Type":"ContainerStarted","Data":"f5dd81c243a527a51d99fddce759d09d1a57b731a0acf292b5343f9cbb2a80a5"}
Jul 28 02:05:37.731666 ip-10-0-134-165 kubenswrapper[2562]: E0728 02:05:37.731638    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7637-140682728286224\" is forbidden: User \"system:node:ip-10-0-134-165.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-165.ec2.internal' and this object" podUID="943b0460-e105-43c5-b0e8-6894ce4d2aa1" pod="opendatahub/test-curl-7637-140682728286224"
Jul 28 02:05:38.013421 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:38.013345    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="943b0460-e105-43c5-b0e8-6894ce4d2aa1" path="/var/lib/kubelet/pods/943b0460-e105-43c5-b0e8-6894ce4d2aa1/volumes"
Jul 28 02:05:38.729348 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:38.729317    2562 generic.go:356] "Generic (PLEG): container finished" podID="ddbf5c8a-fb63-4104-be20-1527bb998aca" containerID="2108b97200f8ccb12afcae77e6228bdb648d7ca094198563ea30234a1dacb196" exitCode=0
Jul 28 02:05:38.729518 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:38.729391    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7637-140682728287232" event={"ID":"ddbf5c8a-fb63-4104-be20-1527bb998aca","Type":"ContainerDied","Data":"2108b97200f8ccb12afcae77e6228bdb648d7ca094198563ea30234a1dacb196"}
Jul 28 02:05:39.878054 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:39.878026    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7637-140682728287232"
Jul 28 02:05:39.899320 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:39.899291    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7637-140682728287232_ddbf5c8a-fb63-4104-be20-1527bb998aca/test-curl-7637-140682728287232/0.log"
Jul 28 02:05:39.923955 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:39.923919    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7637-140682728287232"]
Jul 28 02:05:39.928581 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:39.928535    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7637-140682728287232"]
Jul 28 02:05:40.006031 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:40.005936    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrs5t\" (UniqueName: \"kubernetes.io/projected/ddbf5c8a-fb63-4104-be20-1527bb998aca-kube-api-access-qrs5t\") pod \"ddbf5c8a-fb63-4104-be20-1527bb998aca\" (UID: \"ddbf5c8a-fb63-4104-be20-1527bb998aca\") "
Jul 28 02:05:40.008127 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:40.008097    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddbf5c8a-fb63-4104-be20-1527bb998aca-kube-api-access-qrs5t" (OuterVolumeSpecName: "kube-api-access-qrs5t") pod "ddbf5c8a-fb63-4104-be20-1527bb998aca" (UID: "ddbf5c8a-fb63-4104-be20-1527bb998aca"). InnerVolumeSpecName "kube-api-access-qrs5t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 02:05:40.013151 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:40.013127    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddbf5c8a-fb63-4104-be20-1527bb998aca" path="/var/lib/kubelet/pods/ddbf5c8a-fb63-4104-be20-1527bb998aca/volumes"
Jul 28 02:05:40.055549 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:40.055520    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7637-140682728287232"]
Jul 28 02:05:40.056070 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:40.056052    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddbf5c8a-fb63-4104-be20-1527bb998aca" containerName="test-curl-7637-140682728287232"
Jul 28 02:05:40.056137 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:40.056073    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddbf5c8a-fb63-4104-be20-1527bb998aca" containerName="test-curl-7637-140682728287232"
Jul 28 02:05:40.056137 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:40.056129    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddbf5c8a-fb63-4104-be20-1527bb998aca" containerName="test-curl-7637-140682728287232"
Jul 28 02:05:40.059355 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:40.059331    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7637-140682728287232"
Jul 28 02:05:40.066148 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:40.066103    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7637-140682728287232"]
Jul 28 02:05:40.107505 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:40.107461    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs56k\" (UniqueName: \"kubernetes.io/projected/4735d5a5-6665-4156-bc1b-609df1ef53c8-kube-api-access-cs56k\") pod \"test-curl-7637-140682728287232\" (UID: \"4735d5a5-6665-4156-bc1b-609df1ef53c8\") " pod="opendatahub/test-curl-7637-140682728287232"
Jul 28 02:05:40.107712 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:40.107584    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrs5t\" (UniqueName: \"kubernetes.io/projected/ddbf5c8a-fb63-4104-be20-1527bb998aca-kube-api-access-qrs5t\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 02:05:40.208926 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:40.208892    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs56k\" (UniqueName: \"kubernetes.io/projected/4735d5a5-6665-4156-bc1b-609df1ef53c8-kube-api-access-cs56k\") pod \"test-curl-7637-140682728287232\" (UID: \"4735d5a5-6665-4156-bc1b-609df1ef53c8\") " pod="opendatahub/test-curl-7637-140682728287232"
Jul 28 02:05:40.217660 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:40.217626    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs56k\" (UniqueName: \"kubernetes.io/projected/4735d5a5-6665-4156-bc1b-609df1ef53c8-kube-api-access-cs56k\") pod \"test-curl-7637-140682728287232\" (UID: \"4735d5a5-6665-4156-bc1b-609df1ef53c8\") " pod="opendatahub/test-curl-7637-140682728287232"
Jul 28 02:05:40.370284 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:40.370238    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7637-140682728287232"
Jul 28 02:05:40.509345 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:40.509323    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7637-140682728287232"]
Jul 28 02:05:40.511302 ip-10-0-134-165 kubenswrapper[2562]: W0728 02:05:40.511270    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4735d5a5_6665_4156_bc1b_609df1ef53c8.slice/crio-753b80597810ba7626cd9b7b10ce5961310b26ada68b372c46f16640ddb702dd WatchSource:0}: Error finding container 753b80597810ba7626cd9b7b10ce5961310b26ada68b372c46f16640ddb702dd: Status 404 returned error can't find the container with id 753b80597810ba7626cd9b7b10ce5961310b26ada68b372c46f16640ddb702dd
Jul 28 02:05:40.742146 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:40.742056    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7637-140682728287232" event={"ID":"4735d5a5-6665-4156-bc1b-609df1ef53c8","Type":"ContainerStarted","Data":"753b80597810ba7626cd9b7b10ce5961310b26ada68b372c46f16640ddb702dd"}
Jul 28 02:05:40.743320 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:40.743297    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7637-140682728287232"
Jul 28 02:05:40.743455 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:40.743326    2562 scope.go:117] "RemoveContainer" containerID="2108b97200f8ccb12afcae77e6228bdb648d7ca094198563ea30234a1dacb196"
Jul 28 02:05:41.750378 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:41.750341    2562 generic.go:356] "Generic (PLEG): container finished" podID="4735d5a5-6665-4156-bc1b-609df1ef53c8" containerID="5a700f631355086270b30b47e5955ea9429830c082d8c9276204a74819bbc8a0" exitCode=0
Jul 28 02:05:41.750860 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:41.750431    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7637-140682728287232" event={"ID":"4735d5a5-6665-4156-bc1b-609df1ef53c8","Type":"ContainerDied","Data":"5a700f631355086270b30b47e5955ea9429830c082d8c9276204a74819bbc8a0"}
Jul 28 02:05:42.890454 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:42.890430    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7637-140682728287232"
Jul 28 02:05:42.912546 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:42.912516    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7637-140682728287232_4735d5a5-6665-4156-bc1b-609df1ef53c8/test-curl-7637-140682728287232/0.log"
Jul 28 02:05:42.935121 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:42.935088    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7637-140682728287232"]
Jul 28 02:05:42.939234 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:42.939206    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7637-140682728287232"]
Jul 28 02:05:43.036247 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:43.036150    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cs56k\" (UniqueName: \"kubernetes.io/projected/4735d5a5-6665-4156-bc1b-609df1ef53c8-kube-api-access-cs56k\") pod \"4735d5a5-6665-4156-bc1b-609df1ef53c8\" (UID: \"4735d5a5-6665-4156-bc1b-609df1ef53c8\") "
Jul 28 02:05:43.038251 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:43.038218    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4735d5a5-6665-4156-bc1b-609df1ef53c8-kube-api-access-cs56k" (OuterVolumeSpecName: "kube-api-access-cs56k") pod "4735d5a5-6665-4156-bc1b-609df1ef53c8" (UID: "4735d5a5-6665-4156-bc1b-609df1ef53c8"). InnerVolumeSpecName "kube-api-access-cs56k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 02:05:43.137237 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:43.137205    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cs56k\" (UniqueName: \"kubernetes.io/projected/4735d5a5-6665-4156-bc1b-609df1ef53c8-kube-api-access-cs56k\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 02:05:43.725545 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:43.725502    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b"]
Jul 28 02:05:43.726150 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:43.726133    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4735d5a5-6665-4156-bc1b-609df1ef53c8" containerName="test-curl-7637-140682728287232"
Jul 28 02:05:43.726227 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:43.726153    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4735d5a5-6665-4156-bc1b-609df1ef53c8" containerName="test-curl-7637-140682728287232"
Jul 28 02:05:43.726315 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:43.726296    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4735d5a5-6665-4156-bc1b-609df1ef53c8" containerName="test-curl-7637-140682728287232"
Jul 28 02:05:43.729711 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:43.729686    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b"
Jul 28 02:05:43.731794 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:43.731774    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-49ecf4-openshift-default-dockercfg-pwfsv\""
Jul 28 02:05:43.743278 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:43.743229    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b"]
Jul 28 02:05:43.764023 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:43.763999    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="753b80597810ba7626cd9b7b10ce5961310b26ada68b372c46f16640ddb702dd"
Jul 28 02:05:43.764023 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:43.764032    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7637-140682728287232"
Jul 28 02:05:43.773857 ip-10-0-134-165 kubenswrapper[2562]: E0728 02:05:43.773828    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7637-140682728287232\" is forbidden: User \"system:node:ip-10-0-134-165.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-165.ec2.internal' and this object" podUID="4735d5a5-6665-4156-bc1b-609df1ef53c8" pod="opendatahub/test-curl-7637-140682728287232"
Jul 28 02:05:43.844114 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:43.844082    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-credential-socket\") pod \"e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b\" (UID: \"58fd37a7-b176-4e06-9f6f-dc26071d3bd3\") " pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b"
Jul 28 02:05:43.844277 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:43.844187    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-istio-data\") pod \"e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b\" (UID: \"58fd37a7-b176-4e06-9f6f-dc26071d3bd3\") " pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b"
Jul 28 02:05:43.844277 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:43.844219    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-workload-socket\") pod \"e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b\" (UID: \"58fd37a7-b176-4e06-9f6f-dc26071d3bd3\") " pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b"
Jul 28 02:05:43.844277 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:43.844242    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-istio-envoy\") pod \"e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b\" (UID: \"58fd37a7-b176-4e06-9f6f-dc26071d3bd3\") " pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b"
Jul 28 02:05:43.844277 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:43.844266    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-workload-certs\") pod \"e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b\" (UID: \"58fd37a7-b176-4e06-9f6f-dc26071d3bd3\") " pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b"
Jul 28 02:05:43.844497 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:43.844281    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bjd7\" (UniqueName: \"kubernetes.io/projected/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-kube-api-access-6bjd7\") pod \"e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b\" (UID: \"58fd37a7-b176-4e06-9f6f-dc26071d3bd3\") " pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b"
Jul 28 02:05:43.844497 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:43.844413    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-istio-token\") pod \"e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b\" (UID: \"58fd37a7-b176-4e06-9f6f-dc26071d3bd3\") " pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b"
Jul 28 02:05:43.844497 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:43.844472    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-istio-podinfo\") pod \"e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b\" (UID: \"58fd37a7-b176-4e06-9f6f-dc26071d3bd3\") " pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b"
Jul 28 02:05:43.844656 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:43.844505    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-istiod-ca-cert\") pod \"e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b\" (UID: \"58fd37a7-b176-4e06-9f6f-dc26071d3bd3\") " pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b"
Jul 28 02:05:43.945978 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:43.945939    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-istio-data\") pod \"e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b\" (UID: \"58fd37a7-b176-4e06-9f6f-dc26071d3bd3\") " pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b"
Jul 28 02:05:43.945978 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:43.945977    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-workload-socket\") pod \"e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b\" (UID: \"58fd37a7-b176-4e06-9f6f-dc26071d3bd3\") " pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b"
Jul 28 02:05:43.946489 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:43.945998    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-istio-envoy\") pod \"e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b\" (UID: \"58fd37a7-b176-4e06-9f6f-dc26071d3bd3\") " pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b"
Jul 28 02:05:43.946489 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:43.946030    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-workload-certs\") pod \"e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b\" (UID: \"58fd37a7-b176-4e06-9f6f-dc26071d3bd3\") " pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b"
Jul 28 02:05:43.946489 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:43.946054    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bjd7\" (UniqueName: \"kubernetes.io/projected/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-kube-api-access-6bjd7\") pod \"e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b\" (UID: \"58fd37a7-b176-4e06-9f6f-dc26071d3bd3\") " pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b"
Jul 28 02:05:43.946489 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:43.946109    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-istio-token\") pod \"e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b\" (UID: \"58fd37a7-b176-4e06-9f6f-dc26071d3bd3\") " pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b"
Jul 28 02:05:43.946489 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:43.946323    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-istio-podinfo\") pod \"e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b\" (UID: \"58fd37a7-b176-4e06-9f6f-dc26071d3bd3\") " pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b"
Jul 28 02:05:43.946489 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:43.946372    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-istiod-ca-cert\") pod \"e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b\" (UID: \"58fd37a7-b176-4e06-9f6f-dc26071d3bd3\") " pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b"
Jul 28 02:05:43.946489 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:43.946405    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-istio-data\") pod \"e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b\" (UID: \"58fd37a7-b176-4e06-9f6f-dc26071d3bd3\") " pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b"
Jul 28 02:05:43.946489 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:43.946436    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-credential-socket\") pod \"e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b\" (UID: \"58fd37a7-b176-4e06-9f6f-dc26071d3bd3\") " pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b"
Jul 28 02:05:43.946922 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:43.946629    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-workload-certs\") pod \"e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b\" (UID: \"58fd37a7-b176-4e06-9f6f-dc26071d3bd3\") " pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b"
Jul 28 02:05:43.946922 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:43.946740    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-workload-socket\") pod \"e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b\" (UID: \"58fd37a7-b176-4e06-9f6f-dc26071d3bd3\") " pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b"
Jul 28 02:05:43.946922 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:43.946827    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-credential-socket\") pod \"e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b\" (UID: \"58fd37a7-b176-4e06-9f6f-dc26071d3bd3\") " pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b"
Jul 28 02:05:43.947118 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:43.947096    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-istiod-ca-cert\") pod \"e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b\" (UID: \"58fd37a7-b176-4e06-9f6f-dc26071d3bd3\") " pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b"
Jul 28 02:05:43.948544 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:43.948518    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-istio-envoy\") pod \"e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b\" (UID: \"58fd37a7-b176-4e06-9f6f-dc26071d3bd3\") " pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b"
Jul 28 02:05:43.948726 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:43.948709    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-istio-podinfo\") pod \"e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b\" (UID: \"58fd37a7-b176-4e06-9f6f-dc26071d3bd3\") " pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b"
Jul 28 02:05:43.965145 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:43.965115    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-istio-token\") pod \"e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b\" (UID: \"58fd37a7-b176-4e06-9f6f-dc26071d3bd3\") " pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b"
Jul 28 02:05:43.965375 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:43.965356    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bjd7\" (UniqueName: \"kubernetes.io/projected/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-kube-api-access-6bjd7\") pod \"e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b\" (UID: \"58fd37a7-b176-4e06-9f6f-dc26071d3bd3\") " pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b"
Jul 28 02:05:44.013903 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:44.013829    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4735d5a5-6665-4156-bc1b-609df1ef53c8" path="/var/lib/kubelet/pods/4735d5a5-6665-4156-bc1b-609df1ef53c8/volumes"
Jul 28 02:05:44.041474 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:44.041450    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b"
Jul 28 02:05:44.209628 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:44.209600    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b"]
Jul 28 02:05:44.212243 ip-10-0-134-165 kubenswrapper[2562]: W0728 02:05:44.212215    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58fd37a7_b176_4e06_9f6f_dc26071d3bd3.slice/crio-41bf230cb7cdba51df0749f0d2e496af69fc7fd22ffade8e9d7f6b71d891fecb WatchSource:0}: Error finding container 41bf230cb7cdba51df0749f0d2e496af69fc7fd22ffade8e9d7f6b71d891fecb: Status 404 returned error can't find the container with id 41bf230cb7cdba51df0749f0d2e496af69fc7fd22ffade8e9d7f6b71d891fecb
Jul 28 02:05:44.215503 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:44.215472    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 02:05:44.215588 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:44.215538    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 02:05:44.215634 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:44.215586    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 02:05:44.771459 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:44.771426    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b" event={"ID":"58fd37a7-b176-4e06-9f6f-dc26071d3bd3","Type":"ContainerStarted","Data":"08106c6ae665ed4bce5049780ae0b7a5de8b7cb469d2bb1c4fdbec4c7da5e67c"}
Jul 28 02:05:44.771666 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:44.771485    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b" event={"ID":"58fd37a7-b176-4e06-9f6f-dc26071d3bd3","Type":"ContainerStarted","Data":"41bf230cb7cdba51df0749f0d2e496af69fc7fd22ffade8e9d7f6b71d891fecb"}
Jul 28 02:05:44.790695 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:44.790650    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b" podStartSLOduration=1.790635948 podStartE2EDuration="1.790635948s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 02:05:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 02:05:44.789192735 +0000 UTC m=+3015.292954076" watchObservedRunningTime="2026-07-28 02:05:44.790635948 +0000 UTC m=+3015.294397260"
Jul 28 02:05:45.042071 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:45.041983    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b"
Jul 28 02:05:45.047423 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:45.047397    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b"
Jul 28 02:05:45.776954 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:45.776925    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b"
Jul 28 02:05:45.777780 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:05:45.777761    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b"
Jul 28 02:06:02.403736 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:02.403706    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x"]
Jul 28 02:06:02.409599 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:02.409576    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x"
Jul 28 02:06:02.411758 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:02.411738    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-e0a963-openshift-default-dockercfg-cq68d\""
Jul 28 02:06:02.421235 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:02.421209    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x"]
Jul 28 02:06:02.421970 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:02.421943    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb9f4d1c-461a-4d34-baba-918aec710b6e-credential-socket\") pod \"e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x\" (UID: \"cb9f4d1c-461a-4d34-baba-918aec710b6e\") " pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x"
Jul 28 02:06:02.422082 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:02.421985    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb9f4d1c-461a-4d34-baba-918aec710b6e-istio-envoy\") pod \"e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x\" (UID: \"cb9f4d1c-461a-4d34-baba-918aec710b6e\") " pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x"
Jul 28 02:06:02.422082 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:02.422059    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb9f4d1c-461a-4d34-baba-918aec710b6e-istio-data\") pod \"e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x\" (UID: \"cb9f4d1c-461a-4d34-baba-918aec710b6e\") " pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x"
Jul 28 02:06:02.422082 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:02.422080    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb9f4d1c-461a-4d34-baba-918aec710b6e-istio-token\") pod \"e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x\" (UID: \"cb9f4d1c-461a-4d34-baba-918aec710b6e\") " pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x"
Jul 28 02:06:02.422275 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:02.422097    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb9f4d1c-461a-4d34-baba-918aec710b6e-istiod-ca-cert\") pod \"e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x\" (UID: \"cb9f4d1c-461a-4d34-baba-918aec710b6e\") " pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x"
Jul 28 02:06:02.422275 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:02.422123    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb9f4d1c-461a-4d34-baba-918aec710b6e-workload-socket\") pod \"e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x\" (UID: \"cb9f4d1c-461a-4d34-baba-918aec710b6e\") " pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x"
Jul 28 02:06:02.422275 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:02.422254    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb9f4d1c-461a-4d34-baba-918aec710b6e-workload-certs\") pod \"e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x\" (UID: \"cb9f4d1c-461a-4d34-baba-918aec710b6e\") " pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x"
Jul 28 02:06:02.422436 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:02.422314    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb9f4d1c-461a-4d34-baba-918aec710b6e-istio-podinfo\") pod \"e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x\" (UID: \"cb9f4d1c-461a-4d34-baba-918aec710b6e\") " pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x"
Jul 28 02:06:02.422436 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:02.422338    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9nns\" (UniqueName: \"kubernetes.io/projected/cb9f4d1c-461a-4d34-baba-918aec710b6e-kube-api-access-x9nns\") pod \"e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x\" (UID: \"cb9f4d1c-461a-4d34-baba-918aec710b6e\") " pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x"
Jul 28 02:06:02.523973 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:02.523934    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb9f4d1c-461a-4d34-baba-918aec710b6e-credential-socket\") pod \"e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x\" (UID: \"cb9f4d1c-461a-4d34-baba-918aec710b6e\") " pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x"
Jul 28 02:06:02.524215 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:02.523987    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb9f4d1c-461a-4d34-baba-918aec710b6e-istio-envoy\") pod \"e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x\" (UID: \"cb9f4d1c-461a-4d34-baba-918aec710b6e\") " pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x"
Jul 28 02:06:02.524215 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:02.524071    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb9f4d1c-461a-4d34-baba-918aec710b6e-istio-data\") pod \"e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x\" (UID: \"cb9f4d1c-461a-4d34-baba-918aec710b6e\") " pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x"
Jul 28 02:06:02.524215 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:02.524101    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb9f4d1c-461a-4d34-baba-918aec710b6e-istio-token\") pod \"e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x\" (UID: \"cb9f4d1c-461a-4d34-baba-918aec710b6e\") " pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x"
Jul 28 02:06:02.524215 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:02.524126    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb9f4d1c-461a-4d34-baba-918aec710b6e-istiod-ca-cert\") pod \"e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x\" (UID: \"cb9f4d1c-461a-4d34-baba-918aec710b6e\") " pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x"
Jul 28 02:06:02.524215 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:02.524166    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb9f4d1c-461a-4d34-baba-918aec710b6e-workload-socket\") pod \"e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x\" (UID: \"cb9f4d1c-461a-4d34-baba-918aec710b6e\") " pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x"
Jul 28 02:06:02.524215 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:02.524218    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb9f4d1c-461a-4d34-baba-918aec710b6e-workload-certs\") pod \"e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x\" (UID: \"cb9f4d1c-461a-4d34-baba-918aec710b6e\") " pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x"
Jul 28 02:06:02.525032 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:02.524272    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb9f4d1c-461a-4d34-baba-918aec710b6e-istio-podinfo\") pod \"e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x\" (UID: \"cb9f4d1c-461a-4d34-baba-918aec710b6e\") " pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x"
Jul 28 02:06:02.525032 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:02.524299    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9nns\" (UniqueName: \"kubernetes.io/projected/cb9f4d1c-461a-4d34-baba-918aec710b6e-kube-api-access-x9nns\") pod \"e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x\" (UID: \"cb9f4d1c-461a-4d34-baba-918aec710b6e\") " pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x"
Jul 28 02:06:02.525254 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:02.525043    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb9f4d1c-461a-4d34-baba-918aec710b6e-credential-socket\") pod \"e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x\" (UID: \"cb9f4d1c-461a-4d34-baba-918aec710b6e\") " pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x"
Jul 28 02:06:02.525695 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:02.525671    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb9f4d1c-461a-4d34-baba-918aec710b6e-istio-data\") pod \"e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x\" (UID: \"cb9f4d1c-461a-4d34-baba-918aec710b6e\") " pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x"
Jul 28 02:06:02.525871 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:02.525842    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb9f4d1c-461a-4d34-baba-918aec710b6e-workload-certs\") pod \"e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x\" (UID: \"cb9f4d1c-461a-4d34-baba-918aec710b6e\") " pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x"
Jul 28 02:06:02.526200 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:02.526142    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb9f4d1c-461a-4d34-baba-918aec710b6e-workload-socket\") pod \"e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x\" (UID: \"cb9f4d1c-461a-4d34-baba-918aec710b6e\") " pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x"
Jul 28 02:06:02.526984 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:02.526959    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb9f4d1c-461a-4d34-baba-918aec710b6e-istiod-ca-cert\") pod \"e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x\" (UID: \"cb9f4d1c-461a-4d34-baba-918aec710b6e\") " pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x"
Jul 28 02:06:02.528800 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:02.528757    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb9f4d1c-461a-4d34-baba-918aec710b6e-istio-envoy\") pod \"e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x\" (UID: \"cb9f4d1c-461a-4d34-baba-918aec710b6e\") " pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x"
Jul 28 02:06:02.529314 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:02.529291    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb9f4d1c-461a-4d34-baba-918aec710b6e-istio-podinfo\") pod \"e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x\" (UID: \"cb9f4d1c-461a-4d34-baba-918aec710b6e\") " pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x"
Jul 28 02:06:02.534176 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:02.534149    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9nns\" (UniqueName: \"kubernetes.io/projected/cb9f4d1c-461a-4d34-baba-918aec710b6e-kube-api-access-x9nns\") pod \"e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x\" (UID: \"cb9f4d1c-461a-4d34-baba-918aec710b6e\") " pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x"
Jul 28 02:06:02.534767 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:02.534725    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb9f4d1c-461a-4d34-baba-918aec710b6e-istio-token\") pod \"e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x\" (UID: \"cb9f4d1c-461a-4d34-baba-918aec710b6e\") " pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x"
Jul 28 02:06:02.722137 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:02.722065    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x"
Jul 28 02:06:02.884856 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:02.884832    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x"]
Jul 28 02:06:02.887357 ip-10-0-134-165 kubenswrapper[2562]: W0728 02:06:02.887325    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb9f4d1c_461a_4d34_baba_918aec710b6e.slice/crio-499d8bd393a68fbd97b5171f9c4a854209c87b92e0c5c5ccdc35c4b3227d4bef WatchSource:0}: Error finding container 499d8bd393a68fbd97b5171f9c4a854209c87b92e0c5c5ccdc35c4b3227d4bef: Status 404 returned error can't find the container with id 499d8bd393a68fbd97b5171f9c4a854209c87b92e0c5c5ccdc35c4b3227d4bef
Jul 28 02:06:02.889839 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:02.889812    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 02:06:02.889914 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:02.889873    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 02:06:02.889914 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:02.889900    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 02:06:03.894486 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:03.894451    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x" event={"ID":"cb9f4d1c-461a-4d34-baba-918aec710b6e","Type":"ContainerStarted","Data":"ef752132a3267d000e3db4f1ed17f21f2c6840ad30f870ed0b70adcc2fc6e2b8"}
Jul 28 02:06:03.895026 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:03.894520    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x" event={"ID":"cb9f4d1c-461a-4d34-baba-918aec710b6e","Type":"ContainerStarted","Data":"499d8bd393a68fbd97b5171f9c4a854209c87b92e0c5c5ccdc35c4b3227d4bef"}
Jul 28 02:06:03.896071 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:03.896047    2562 generic.go:356] "Generic (PLEG): container finished" podID="58fd37a7-b176-4e06-9f6f-dc26071d3bd3" containerID="08106c6ae665ed4bce5049780ae0b7a5de8b7cb469d2bb1c4fdbec4c7da5e67c" exitCode=0
Jul 28 02:06:03.896153 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:03.896119    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b" event={"ID":"58fd37a7-b176-4e06-9f6f-dc26071d3bd3","Type":"ContainerDied","Data":"08106c6ae665ed4bce5049780ae0b7a5de8b7cb469d2bb1c4fdbec4c7da5e67c"}
Jul 28 02:06:03.896478 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:03.896465    2562 scope.go:117] "RemoveContainer" containerID="08106c6ae665ed4bce5049780ae0b7a5de8b7cb469d2bb1c4fdbec4c7da5e67c"
Jul 28 02:06:03.897494 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:03.897462    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 02:06:03.897546 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:03.897528    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 02:06:03.897601 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:03.897570    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 02:06:03.918281 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:03.918236    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x" podStartSLOduration=1.918219883 podStartE2EDuration="1.918219883s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 02:06:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 02:06:03.917332846 +0000 UTC m=+3034.421094161" watchObservedRunningTime="2026-07-28 02:06:03.918219883 +0000 UTC m=+3034.421981195"
Jul 28 02:06:04.722977 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:04.722939    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x"
Jul 28 02:06:04.727821 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:04.727799    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x"
Jul 28 02:06:04.906577 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:04.906520    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b" event={"ID":"58fd37a7-b176-4e06-9f6f-dc26071d3bd3","Type":"ContainerStarted","Data":"cf4b5ea6833c8cb2777287ac6b30fec3868f47e9dc8695d3b8e7085c6186cb9c"}
Jul 28 02:06:04.906990 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:04.906616    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x"
Jul 28 02:06:04.907476 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:04.907447    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x"
Jul 28 02:06:05.047646 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:05.046037    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b"
Jul 28 02:06:05.047646 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:05.046162    2562 patch_prober.go:28] interesting pod/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Jul 28 02:06:05.047646 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:05.046216    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b" podUID="58fd37a7-b176-4e06-9f6f-dc26071d3bd3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Jul 28 02:06:06.051582 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:06.050881    2562 patch_prober.go:28] interesting pod/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Jul 28 02:06:06.051582 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:06.050945    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b" podUID="58fd37a7-b176-4e06-9f6f-dc26071d3bd3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Jul 28 02:06:07.048645 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:07.048609    2562 patch_prober.go:28] interesting pod/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Jul 28 02:06:07.048931 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:07.048903    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b" podUID="58fd37a7-b176-4e06-9f6f-dc26071d3bd3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Jul 28 02:06:08.042832 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:08.042795    2562 patch_prober.go:28] interesting pod/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Jul 28 02:06:08.043388 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:08.043355    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b" podUID="58fd37a7-b176-4e06-9f6f-dc26071d3bd3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Jul 28 02:06:09.042833 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:09.042794    2562 patch_prober.go:28] interesting pod/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Jul 28 02:06:09.043233 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:09.042854    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b" podUID="58fd37a7-b176-4e06-9f6f-dc26071d3bd3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Jul 28 02:06:10.045831 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:10.045800    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b"
Jul 28 02:06:10.046230 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:10.046070    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b"
Jul 28 02:06:10.046885 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:10.046861    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b"
Jul 28 02:06:18.997639 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:18.997606    2562 generic.go:356] "Generic (PLEG): container finished" podID="cb9f4d1c-461a-4d34-baba-918aec710b6e" containerID="ef752132a3267d000e3db4f1ed17f21f2c6840ad30f870ed0b70adcc2fc6e2b8" exitCode=0
Jul 28 02:06:18.998031 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:18.997665    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x" event={"ID":"cb9f4d1c-461a-4d34-baba-918aec710b6e","Type":"ContainerDied","Data":"ef752132a3267d000e3db4f1ed17f21f2c6840ad30f870ed0b70adcc2fc6e2b8"}
Jul 28 02:06:18.998031 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:18.998011    2562 scope.go:117] "RemoveContainer" containerID="ef752132a3267d000e3db4f1ed17f21f2c6840ad30f870ed0b70adcc2fc6e2b8"
Jul 28 02:06:18.999021 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:18.998994    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 02:06:18.999077 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:18.999064    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 02:06:18.999115 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:18.999096    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 02:06:19.906408 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:19.906377    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x"
Jul 28 02:06:20.006470 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:20.006435    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x" event={"ID":"cb9f4d1c-461a-4d34-baba-918aec710b6e","Type":"ContainerStarted","Data":"8edd2d2f3593b639ee6974879b0ae83987d4e253f610b820c567bbbc4d190d30"}
Jul 28 02:06:20.722624 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:20.722575    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x"
Jul 28 02:06:20.723877 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:20.723847    2562 patch_prober.go:28] interesting pod/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Jul 28 02:06:20.724034 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:20.723912    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x" podUID="cb9f4d1c-461a-4d34-baba-918aec710b6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Jul 28 02:06:21.722778 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:21.722743    2562 patch_prober.go:28] interesting pod/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Jul 28 02:06:21.723164 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:21.722813    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x" podUID="cb9f4d1c-461a-4d34-baba-918aec710b6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Jul 28 02:06:22.722991 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:22.722911    2562 patch_prober.go:28] interesting pod/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Jul 28 02:06:22.722991 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:22.722970    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x" podUID="cb9f4d1c-461a-4d34-baba-918aec710b6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Jul 28 02:06:23.722519 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:23.722481    2562 patch_prober.go:28] interesting pod/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Jul 28 02:06:23.722722 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:23.722544    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x" podUID="cb9f4d1c-461a-4d34-baba-918aec710b6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Jul 28 02:06:24.727099 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:24.727068    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x"
Jul 28 02:06:24.727545 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:24.727328    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x"
Jul 28 02:06:24.728015 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:24.727998    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x"
Jul 28 02:06:58.034700 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:58.034662    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-94vc8"]
Jul 28 02:06:58.038397 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:58.038377    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-94vc8"
Jul 28 02:06:58.047245 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:58.047216    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-94vc8"]
Jul 28 02:06:58.170390 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:58.170352    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7n4g\" (UniqueName: \"kubernetes.io/projected/7e1e0ca2-aa60-452d-a866-361161f11caa-kube-api-access-z7n4g\") pod \"kuadrant-operator-catalog-94vc8\" (UID: \"7e1e0ca2-aa60-452d-a866-361161f11caa\") " pod="kuadrant-system/kuadrant-operator-catalog-94vc8"
Jul 28 02:06:58.271995 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:58.271963    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7n4g\" (UniqueName: \"kubernetes.io/projected/7e1e0ca2-aa60-452d-a866-361161f11caa-kube-api-access-z7n4g\") pod \"kuadrant-operator-catalog-94vc8\" (UID: \"7e1e0ca2-aa60-452d-a866-361161f11caa\") " pod="kuadrant-system/kuadrant-operator-catalog-94vc8"
Jul 28 02:06:58.279419 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:58.279391    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7n4g\" (UniqueName: \"kubernetes.io/projected/7e1e0ca2-aa60-452d-a866-361161f11caa-kube-api-access-z7n4g\") pod \"kuadrant-operator-catalog-94vc8\" (UID: \"7e1e0ca2-aa60-452d-a866-361161f11caa\") " pod="kuadrant-system/kuadrant-operator-catalog-94vc8"
Jul 28 02:06:58.350629 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:58.350525    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-94vc8"
Jul 28 02:06:58.494164 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:58.494137    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-94vc8"]
Jul 28 02:06:58.495684 ip-10-0-134-165 kubenswrapper[2562]: W0728 02:06:58.495660    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e1e0ca2_aa60_452d_a866_361161f11caa.slice/crio-470c242c152cd14be056be4955282396ea2747614407390cfa583c4378f8a623 WatchSource:0}: Error finding container 470c242c152cd14be056be4955282396ea2747614407390cfa583c4378f8a623: Status 404 returned error can't find the container with id 470c242c152cd14be056be4955282396ea2747614407390cfa583c4378f8a623
Jul 28 02:06:59.227016 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:59.226931    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-94vc8" event={"ID":"7e1e0ca2-aa60-452d-a866-361161f11caa","Type":"ContainerStarted","Data":"e4a619341c3b632dbf8369662e6725f42db458d349ed3f90d1bfe117242cc44a"}
Jul 28 02:06:59.227016 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:59.226992    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-94vc8" event={"ID":"7e1e0ca2-aa60-452d-a866-361161f11caa","Type":"ContainerStarted","Data":"470c242c152cd14be056be4955282396ea2747614407390cfa583c4378f8a623"}
Jul 28 02:06:59.241609 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:06:59.241547    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-94vc8" podStartSLOduration=0.797820307 podStartE2EDuration="1.241526313s" totalImagesPullingTime="443.706006ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 02:06:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 02:06:59.240924193 +0000 UTC m=+3089.744685506" watchObservedRunningTime="2026-07-28 02:06:59.241526313 +0000 UTC m=+3089.745287629"
Jul 28 02:07:08.350890 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:08.350851    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-94vc8"
Jul 28 02:07:08.351413 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:08.350916    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-94vc8"
Jul 28 02:07:08.372379 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:08.372353    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-94vc8"
Jul 28 02:07:09.304629 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:09.304600    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-94vc8"
Jul 28 02:07:09.339091 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:09.339048    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-94vc8"]
Jul 28 02:07:11.294427 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:11.294366    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-94vc8" podUID="7e1e0ca2-aa60-452d-a866-361161f11caa" containerName="registry-server" containerID="cri-o://e4a619341c3b632dbf8369662e6725f42db458d349ed3f90d1bfe117242cc44a" gracePeriod=2
Jul 28 02:07:11.564381 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:11.564317    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-94vc8"
Jul 28 02:07:11.705293 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:11.705261    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7n4g\" (UniqueName: \"kubernetes.io/projected/7e1e0ca2-aa60-452d-a866-361161f11caa-kube-api-access-z7n4g\") pod \"7e1e0ca2-aa60-452d-a866-361161f11caa\" (UID: \"7e1e0ca2-aa60-452d-a866-361161f11caa\") "
Jul 28 02:07:11.707219 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:11.707198    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e1e0ca2-aa60-452d-a866-361161f11caa-kube-api-access-z7n4g" (OuterVolumeSpecName: "kube-api-access-z7n4g") pod "7e1e0ca2-aa60-452d-a866-361161f11caa" (UID: "7e1e0ca2-aa60-452d-a866-361161f11caa"). InnerVolumeSpecName "kube-api-access-z7n4g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 02:07:11.806530 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:11.806487    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7n4g\" (UniqueName: \"kubernetes.io/projected/7e1e0ca2-aa60-452d-a866-361161f11caa-kube-api-access-z7n4g\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 02:07:12.300816 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:12.300726    2562 generic.go:356] "Generic (PLEG): container finished" podID="7e1e0ca2-aa60-452d-a866-361161f11caa" containerID="e4a619341c3b632dbf8369662e6725f42db458d349ed3f90d1bfe117242cc44a" exitCode=0
Jul 28 02:07:12.300816 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:12.300764    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-94vc8"
Jul 28 02:07:12.301251 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:12.300821    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-94vc8" event={"ID":"7e1e0ca2-aa60-452d-a866-361161f11caa","Type":"ContainerDied","Data":"e4a619341c3b632dbf8369662e6725f42db458d349ed3f90d1bfe117242cc44a"}
Jul 28 02:07:12.301251 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:12.300869    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-94vc8" event={"ID":"7e1e0ca2-aa60-452d-a866-361161f11caa","Type":"ContainerDied","Data":"470c242c152cd14be056be4955282396ea2747614407390cfa583c4378f8a623"}
Jul 28 02:07:12.301251 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:12.300898    2562 scope.go:117] "RemoveContainer" containerID="e4a619341c3b632dbf8369662e6725f42db458d349ed3f90d1bfe117242cc44a"
Jul 28 02:07:12.310378 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:12.310357    2562 scope.go:117] "RemoveContainer" containerID="e4a619341c3b632dbf8369662e6725f42db458d349ed3f90d1bfe117242cc44a"
Jul 28 02:07:12.310701 ip-10-0-134-165 kubenswrapper[2562]: E0728 02:07:12.310681    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4a619341c3b632dbf8369662e6725f42db458d349ed3f90d1bfe117242cc44a\": container with ID starting with e4a619341c3b632dbf8369662e6725f42db458d349ed3f90d1bfe117242cc44a not found: ID does not exist" containerID="e4a619341c3b632dbf8369662e6725f42db458d349ed3f90d1bfe117242cc44a"
Jul 28 02:07:12.310782 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:12.310708    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4a619341c3b632dbf8369662e6725f42db458d349ed3f90d1bfe117242cc44a"} err="failed to get container status \"e4a619341c3b632dbf8369662e6725f42db458d349ed3f90d1bfe117242cc44a\": rpc error: code = NotFound desc = could not find container \"e4a619341c3b632dbf8369662e6725f42db458d349ed3f90d1bfe117242cc44a\": container with ID starting with e4a619341c3b632dbf8369662e6725f42db458d349ed3f90d1bfe117242cc44a not found: ID does not exist"
Jul 28 02:07:12.317757 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:12.317737    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-94vc8"]
Jul 28 02:07:12.323830 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:12.323806    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-94vc8"]
Jul 28 02:07:14.013963 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:14.013929    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e1e0ca2-aa60-452d-a866-361161f11caa" path="/var/lib/kubelet/pods/7e1e0ca2-aa60-452d-a866-361161f11caa/volumes"
Jul 28 02:07:20.348406 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:20.348367    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h"]
Jul 28 02:07:20.349034 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:20.349019    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e1e0ca2-aa60-452d-a866-361161f11caa" containerName="registry-server"
Jul 28 02:07:20.349083 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:20.349037    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e1e0ca2-aa60-452d-a866-361161f11caa" containerName="registry-server"
Jul 28 02:07:20.349149 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:20.349138    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e1e0ca2-aa60-452d-a866-361161f11caa" containerName="registry-server"
Jul 28 02:07:20.353754 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:20.353733    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h"
Jul 28 02:07:20.356244 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:20.356223    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-e78415-openshift-default-dockercfg-brzhz\""
Jul 28 02:07:20.388606 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:20.386542    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h"]
Jul 28 02:07:20.397407 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:20.392783    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0018ade2-e9cf-40ac-9450-d835b5fba1d6-istiod-ca-cert\") pod \"e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h\" (UID: \"0018ade2-e9cf-40ac-9450-d835b5fba1d6\") " pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h"
Jul 28 02:07:20.397407 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:20.392843    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0018ade2-e9cf-40ac-9450-d835b5fba1d6-istio-podinfo\") pod \"e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h\" (UID: \"0018ade2-e9cf-40ac-9450-d835b5fba1d6\") " pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h"
Jul 28 02:07:20.397407 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:20.392933    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0018ade2-e9cf-40ac-9450-d835b5fba1d6-istio-token\") pod \"e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h\" (UID: \"0018ade2-e9cf-40ac-9450-d835b5fba1d6\") " pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h"
Jul 28 02:07:20.397407 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:20.392966    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0018ade2-e9cf-40ac-9450-d835b5fba1d6-istio-data\") pod \"e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h\" (UID: \"0018ade2-e9cf-40ac-9450-d835b5fba1d6\") " pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h"
Jul 28 02:07:20.397407 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:20.393017    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0018ade2-e9cf-40ac-9450-d835b5fba1d6-workload-socket\") pod \"e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h\" (UID: \"0018ade2-e9cf-40ac-9450-d835b5fba1d6\") " pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h"
Jul 28 02:07:20.397407 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:20.393086    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0018ade2-e9cf-40ac-9450-d835b5fba1d6-istio-envoy\") pod \"e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h\" (UID: \"0018ade2-e9cf-40ac-9450-d835b5fba1d6\") " pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h"
Jul 28 02:07:20.397407 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:20.393119    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qdhj\" (UniqueName: \"kubernetes.io/projected/0018ade2-e9cf-40ac-9450-d835b5fba1d6-kube-api-access-6qdhj\") pod \"e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h\" (UID: \"0018ade2-e9cf-40ac-9450-d835b5fba1d6\") " pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h"
Jul 28 02:07:20.397407 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:20.393175    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0018ade2-e9cf-40ac-9450-d835b5fba1d6-workload-certs\") pod \"e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h\" (UID: \"0018ade2-e9cf-40ac-9450-d835b5fba1d6\") " pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h"
Jul 28 02:07:20.397407 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:20.393241    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0018ade2-e9cf-40ac-9450-d835b5fba1d6-credential-socket\") pod \"e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h\" (UID: \"0018ade2-e9cf-40ac-9450-d835b5fba1d6\") " pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h"
Jul 28 02:07:20.494310 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:20.494280    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0018ade2-e9cf-40ac-9450-d835b5fba1d6-istio-data\") pod \"e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h\" (UID: \"0018ade2-e9cf-40ac-9450-d835b5fba1d6\") " pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h"
Jul 28 02:07:20.494507 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:20.494327    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0018ade2-e9cf-40ac-9450-d835b5fba1d6-workload-socket\") pod \"e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h\" (UID: \"0018ade2-e9cf-40ac-9450-d835b5fba1d6\") " pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h"
Jul 28 02:07:20.494507 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:20.494346    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0018ade2-e9cf-40ac-9450-d835b5fba1d6-istio-envoy\") pod \"e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h\" (UID: \"0018ade2-e9cf-40ac-9450-d835b5fba1d6\") " pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h"
Jul 28 02:07:20.494507 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:20.494375    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qdhj\" (UniqueName: \"kubernetes.io/projected/0018ade2-e9cf-40ac-9450-d835b5fba1d6-kube-api-access-6qdhj\") pod \"e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h\" (UID: \"0018ade2-e9cf-40ac-9450-d835b5fba1d6\") " pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h"
Jul 28 02:07:20.494507 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:20.494404    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0018ade2-e9cf-40ac-9450-d835b5fba1d6-workload-certs\") pod \"e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h\" (UID: \"0018ade2-e9cf-40ac-9450-d835b5fba1d6\") " pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h"
Jul 28 02:07:20.494507 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:20.494432    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0018ade2-e9cf-40ac-9450-d835b5fba1d6-credential-socket\") pod \"e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h\" (UID: \"0018ade2-e9cf-40ac-9450-d835b5fba1d6\") " pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h"
Jul 28 02:07:20.494507 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:20.494461    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0018ade2-e9cf-40ac-9450-d835b5fba1d6-istiod-ca-cert\") pod \"e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h\" (UID: \"0018ade2-e9cf-40ac-9450-d835b5fba1d6\") " pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h"
Jul 28 02:07:20.494507 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:20.494483    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0018ade2-e9cf-40ac-9450-d835b5fba1d6-istio-podinfo\") pod \"e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h\" (UID: \"0018ade2-e9cf-40ac-9450-d835b5fba1d6\") " pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h"
Jul 28 02:07:20.494882 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:20.494528    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0018ade2-e9cf-40ac-9450-d835b5fba1d6-istio-token\") pod \"e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h\" (UID: \"0018ade2-e9cf-40ac-9450-d835b5fba1d6\") " pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h"
Jul 28 02:07:20.494882 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:20.494761    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0018ade2-e9cf-40ac-9450-d835b5fba1d6-workload-socket\") pod \"e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h\" (UID: \"0018ade2-e9cf-40ac-9450-d835b5fba1d6\") " pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h"
Jul 28 02:07:20.494951 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:20.494916    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0018ade2-e9cf-40ac-9450-d835b5fba1d6-workload-certs\") pod \"e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h\" (UID: \"0018ade2-e9cf-40ac-9450-d835b5fba1d6\") " pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h"
Jul 28 02:07:20.495107 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:20.495085    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0018ade2-e9cf-40ac-9450-d835b5fba1d6-credential-socket\") pod \"e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h\" (UID: \"0018ade2-e9cf-40ac-9450-d835b5fba1d6\") " pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h"
Jul 28 02:07:20.495183 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:20.495093    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0018ade2-e9cf-40ac-9450-d835b5fba1d6-istio-data\") pod \"e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h\" (UID: \"0018ade2-e9cf-40ac-9450-d835b5fba1d6\") " pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h"
Jul 28 02:07:20.495439 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:20.495415    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0018ade2-e9cf-40ac-9450-d835b5fba1d6-istiod-ca-cert\") pod \"e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h\" (UID: \"0018ade2-e9cf-40ac-9450-d835b5fba1d6\") " pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h"
Jul 28 02:07:20.496836 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:20.496811    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0018ade2-e9cf-40ac-9450-d835b5fba1d6-istio-envoy\") pod \"e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h\" (UID: \"0018ade2-e9cf-40ac-9450-d835b5fba1d6\") " pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h"
Jul 28 02:07:20.497161 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:20.497141    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0018ade2-e9cf-40ac-9450-d835b5fba1d6-istio-podinfo\") pod \"e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h\" (UID: \"0018ade2-e9cf-40ac-9450-d835b5fba1d6\") " pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h"
Jul 28 02:07:20.503273 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:20.503248    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0018ade2-e9cf-40ac-9450-d835b5fba1d6-istio-token\") pod \"e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h\" (UID: \"0018ade2-e9cf-40ac-9450-d835b5fba1d6\") " pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h"
Jul 28 02:07:20.503490 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:20.503470    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qdhj\" (UniqueName: \"kubernetes.io/projected/0018ade2-e9cf-40ac-9450-d835b5fba1d6-kube-api-access-6qdhj\") pod \"e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h\" (UID: \"0018ade2-e9cf-40ac-9450-d835b5fba1d6\") " pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h"
Jul 28 02:07:20.664260 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:20.664223    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h"
Jul 28 02:07:20.816747 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:20.816606    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h"]
Jul 28 02:07:20.819952 ip-10-0-134-165 kubenswrapper[2562]: W0728 02:07:20.819927    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0018ade2_e9cf_40ac_9450_d835b5fba1d6.slice/crio-5bb9a660a2c8ca5feaaafd38dee1ce941f59d752ecde88369310eac066178f67 WatchSource:0}: Error finding container 5bb9a660a2c8ca5feaaafd38dee1ce941f59d752ecde88369310eac066178f67: Status 404 returned error can't find the container with id 5bb9a660a2c8ca5feaaafd38dee1ce941f59d752ecde88369310eac066178f67
Jul 28 02:07:20.822778 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:20.822736    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 02:07:20.822875 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:20.822828    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 02:07:20.822917 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:20.822874    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 02:07:21.353219 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:21.353184    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h" event={"ID":"0018ade2-e9cf-40ac-9450-d835b5fba1d6","Type":"ContainerStarted","Data":"42aa67e9ed2a09a2d6476ba5b9c00f0b9ba9a572f1d19d9df43b6292e85d0c30"}
Jul 28 02:07:21.353731 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:21.353244    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h" event={"ID":"0018ade2-e9cf-40ac-9450-d835b5fba1d6","Type":"ContainerStarted","Data":"5bb9a660a2c8ca5feaaafd38dee1ce941f59d752ecde88369310eac066178f67"}
Jul 28 02:07:21.371476 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:21.371428    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h" podStartSLOduration=1.371411409 podStartE2EDuration="1.371411409s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 02:07:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 02:07:21.370378398 +0000 UTC m=+3111.874139710" watchObservedRunningTime="2026-07-28 02:07:21.371411409 +0000 UTC m=+3111.875172723"
Jul 28 02:07:21.664554 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:21.664517    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h"
Jul 28 02:07:21.670033 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:21.670007    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h"
Jul 28 02:07:22.358921 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:22.358885    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h"
Jul 28 02:07:22.360022 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:22.359998    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h"
Jul 28 02:07:43.494424 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:43.494389    2562 generic.go:356] "Generic (PLEG): container finished" podID="0018ade2-e9cf-40ac-9450-d835b5fba1d6" containerID="42aa67e9ed2a09a2d6476ba5b9c00f0b9ba9a572f1d19d9df43b6292e85d0c30" exitCode=0
Jul 28 02:07:43.494905 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:43.494465    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h" event={"ID":"0018ade2-e9cf-40ac-9450-d835b5fba1d6","Type":"ContainerDied","Data":"42aa67e9ed2a09a2d6476ba5b9c00f0b9ba9a572f1d19d9df43b6292e85d0c30"}
Jul 28 02:07:43.494949 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:43.494941    2562 scope.go:117] "RemoveContainer" containerID="42aa67e9ed2a09a2d6476ba5b9c00f0b9ba9a572f1d19d9df43b6292e85d0c30"
Jul 28 02:07:43.496152 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:43.496123    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 02:07:43.496241 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:43.496194    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 02:07:43.496241 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:43.496228    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 02:07:44.502325 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:44.502287    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h" event={"ID":"0018ade2-e9cf-40ac-9450-d835b5fba1d6","Type":"ContainerStarted","Data":"20753a858dca8c8da372a5df1e6b81c9246ca342e44af0a0a814b9c524c86d07"}
Jul 28 02:07:44.665263 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:44.665224    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h"
Jul 28 02:07:44.665444 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:44.665408    2562 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Jul 28 02:07:44.665498 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:44.665456    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h" podUID="0018ade2-e9cf-40ac-9450-d835b5fba1d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Jul 28 02:07:45.664983 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:45.664951    2562 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Jul 28 02:07:45.665359 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:45.665006    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h" podUID="0018ade2-e9cf-40ac-9450-d835b5fba1d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Jul 28 02:07:46.665313 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:46.665282    2562 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Jul 28 02:07:46.665684 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:46.665346    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h" podUID="0018ade2-e9cf-40ac-9450-d835b5fba1d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Jul 28 02:07:47.665153 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:47.665118    2562 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Jul 28 02:07:47.665333 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:47.665176    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h" podUID="0018ade2-e9cf-40ac-9450-d835b5fba1d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Jul 28 02:07:48.669359 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:48.669316    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h"
Jul 28 02:07:48.669836 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:48.669592    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h"
Jul 28 02:07:48.670316 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:07:48.670296    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h"
Jul 28 02:08:05.661063 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:08:05.660989    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h"]
Jul 28 02:08:05.661458 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:08:05.661217    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h" podUID="0018ade2-e9cf-40ac-9450-d835b5fba1d6" containerName="istio-proxy" containerID="cri-o://20753a858dca8c8da372a5df1e6b81c9246ca342e44af0a0a814b9c524c86d07" gracePeriod=30
Jul 28 02:08:10.922965 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:08:10.922940    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h"
Jul 28 02:08:11.010589 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:08:11.010496    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0018ade2-e9cf-40ac-9450-d835b5fba1d6-workload-certs\") pod \"0018ade2-e9cf-40ac-9450-d835b5fba1d6\" (UID: \"0018ade2-e9cf-40ac-9450-d835b5fba1d6\") "
Jul 28 02:08:11.010589 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:08:11.010538    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0018ade2-e9cf-40ac-9450-d835b5fba1d6-istio-token\") pod \"0018ade2-e9cf-40ac-9450-d835b5fba1d6\" (UID: \"0018ade2-e9cf-40ac-9450-d835b5fba1d6\") "
Jul 28 02:08:11.010589 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:08:11.010578    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0018ade2-e9cf-40ac-9450-d835b5fba1d6-workload-socket\") pod \"0018ade2-e9cf-40ac-9450-d835b5fba1d6\" (UID: \"0018ade2-e9cf-40ac-9450-d835b5fba1d6\") "
Jul 28 02:08:11.010870 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:08:11.010595    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0018ade2-e9cf-40ac-9450-d835b5fba1d6-credential-socket\") pod \"0018ade2-e9cf-40ac-9450-d835b5fba1d6\" (UID: \"0018ade2-e9cf-40ac-9450-d835b5fba1d6\") "
Jul 28 02:08:11.010870 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:08:11.010622    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0018ade2-e9cf-40ac-9450-d835b5fba1d6-istiod-ca-cert\") pod \"0018ade2-e9cf-40ac-9450-d835b5fba1d6\" (UID: \"0018ade2-e9cf-40ac-9450-d835b5fba1d6\") "
Jul 28 02:08:11.010870 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:08:11.010669    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qdhj\" (UniqueName: \"kubernetes.io/projected/0018ade2-e9cf-40ac-9450-d835b5fba1d6-kube-api-access-6qdhj\") pod \"0018ade2-e9cf-40ac-9450-d835b5fba1d6\" (UID: \"0018ade2-e9cf-40ac-9450-d835b5fba1d6\") "
Jul 28 02:08:11.010870 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:08:11.010718    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0018ade2-e9cf-40ac-9450-d835b5fba1d6-istio-podinfo\") pod \"0018ade2-e9cf-40ac-9450-d835b5fba1d6\" (UID: \"0018ade2-e9cf-40ac-9450-d835b5fba1d6\") "
Jul 28 02:08:11.010870 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:08:11.010766    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0018ade2-e9cf-40ac-9450-d835b5fba1d6-istio-envoy\") pod \"0018ade2-e9cf-40ac-9450-d835b5fba1d6\" (UID: \"0018ade2-e9cf-40ac-9450-d835b5fba1d6\") "
Jul 28 02:08:11.010870 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:08:11.010765    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0018ade2-e9cf-40ac-9450-d835b5fba1d6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0018ade2-e9cf-40ac-9450-d835b5fba1d6" (UID: "0018ade2-e9cf-40ac-9450-d835b5fba1d6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:08:11.010870 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:08:11.010803    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0018ade2-e9cf-40ac-9450-d835b5fba1d6-istio-data\") pod \"0018ade2-e9cf-40ac-9450-d835b5fba1d6\" (UID: \"0018ade2-e9cf-40ac-9450-d835b5fba1d6\") "
Jul 28 02:08:11.011262 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:08:11.010944    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0018ade2-e9cf-40ac-9450-d835b5fba1d6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0018ade2-e9cf-40ac-9450-d835b5fba1d6" (UID: "0018ade2-e9cf-40ac-9450-d835b5fba1d6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:08:11.011262 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:08:11.010952    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0018ade2-e9cf-40ac-9450-d835b5fba1d6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0018ade2-e9cf-40ac-9450-d835b5fba1d6" (UID: "0018ade2-e9cf-40ac-9450-d835b5fba1d6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:08:11.011262 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:08:11.011086    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0018ade2-e9cf-40ac-9450-d835b5fba1d6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0018ade2-e9cf-40ac-9450-d835b5fba1d6" (UID: "0018ade2-e9cf-40ac-9450-d835b5fba1d6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 02:08:11.011262 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:08:11.011129    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0018ade2-e9cf-40ac-9450-d835b5fba1d6-workload-socket\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 02:08:11.011262 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:08:11.011151    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0018ade2-e9cf-40ac-9450-d835b5fba1d6-credential-socket\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 02:08:11.011262 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:08:11.011166    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0018ade2-e9cf-40ac-9450-d835b5fba1d6-workload-certs\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 02:08:11.011754 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:08:11.011729    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0018ade2-e9cf-40ac-9450-d835b5fba1d6-istio-data" (OuterVolumeSpecName: "istio-data") pod "0018ade2-e9cf-40ac-9450-d835b5fba1d6" (UID: "0018ade2-e9cf-40ac-9450-d835b5fba1d6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:08:11.012974 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:08:11.012939    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0018ade2-e9cf-40ac-9450-d835b5fba1d6-istio-token" (OuterVolumeSpecName: "istio-token") pod "0018ade2-e9cf-40ac-9450-d835b5fba1d6" (UID: "0018ade2-e9cf-40ac-9450-d835b5fba1d6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 02:08:11.012974 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:08:11.012951    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0018ade2-e9cf-40ac-9450-d835b5fba1d6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0018ade2-e9cf-40ac-9450-d835b5fba1d6" (UID: "0018ade2-e9cf-40ac-9450-d835b5fba1d6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 02:08:11.013130 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:08:11.012970    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0018ade2-e9cf-40ac-9450-d835b5fba1d6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0018ade2-e9cf-40ac-9450-d835b5fba1d6" (UID: "0018ade2-e9cf-40ac-9450-d835b5fba1d6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:08:11.013130 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:08:11.013076    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0018ade2-e9cf-40ac-9450-d835b5fba1d6-kube-api-access-6qdhj" (OuterVolumeSpecName: "kube-api-access-6qdhj") pod "0018ade2-e9cf-40ac-9450-d835b5fba1d6" (UID: "0018ade2-e9cf-40ac-9450-d835b5fba1d6"). InnerVolumeSpecName "kube-api-access-6qdhj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 02:08:11.112546 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:08:11.112508    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qdhj\" (UniqueName: \"kubernetes.io/projected/0018ade2-e9cf-40ac-9450-d835b5fba1d6-kube-api-access-6qdhj\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 02:08:11.112546 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:08:11.112539    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0018ade2-e9cf-40ac-9450-d835b5fba1d6-istio-podinfo\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 02:08:11.112546 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:08:11.112548    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0018ade2-e9cf-40ac-9450-d835b5fba1d6-istio-envoy\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 02:08:11.112546 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:08:11.112582    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0018ade2-e9cf-40ac-9450-d835b5fba1d6-istio-data\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 02:08:11.112847 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:08:11.112590    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0018ade2-e9cf-40ac-9450-d835b5fba1d6-istio-token\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 02:08:11.112847 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:08:11.112598    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0018ade2-e9cf-40ac-9450-d835b5fba1d6-istiod-ca-cert\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 02:08:11.661641 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:08:11.661610    2562 generic.go:356] "Generic (PLEG): container finished" podID="0018ade2-e9cf-40ac-9450-d835b5fba1d6" containerID="20753a858dca8c8da372a5df1e6b81c9246ca342e44af0a0a814b9c524c86d07" exitCode=0
Jul 28 02:08:11.661816 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:08:11.661664    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h"
Jul 28 02:08:11.661816 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:08:11.661700    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h" event={"ID":"0018ade2-e9cf-40ac-9450-d835b5fba1d6","Type":"ContainerDied","Data":"20753a858dca8c8da372a5df1e6b81c9246ca342e44af0a0a814b9c524c86d07"}
Jul 28 02:08:11.661816 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:08:11.661761    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h" event={"ID":"0018ade2-e9cf-40ac-9450-d835b5fba1d6","Type":"ContainerDied","Data":"5bb9a660a2c8ca5feaaafd38dee1ce941f59d752ecde88369310eac066178f67"}
Jul 28 02:08:11.661816 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:08:11.661795    2562 scope.go:117] "RemoveContainer" containerID="20753a858dca8c8da372a5df1e6b81c9246ca342e44af0a0a814b9c524c86d07"
Jul 28 02:08:11.672011 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:08:11.671988    2562 scope.go:117] "RemoveContainer" containerID="42aa67e9ed2a09a2d6476ba5b9c00f0b9ba9a572f1d19d9df43b6292e85d0c30"
Jul 28 02:08:11.680292 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:08:11.680270    2562 scope.go:117] "RemoveContainer" containerID="20753a858dca8c8da372a5df1e6b81c9246ca342e44af0a0a814b9c524c86d07"
Jul 28 02:08:11.681199 ip-10-0-134-165 kubenswrapper[2562]: E0728 02:08:11.681169    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20753a858dca8c8da372a5df1e6b81c9246ca342e44af0a0a814b9c524c86d07\": container with ID starting with 20753a858dca8c8da372a5df1e6b81c9246ca342e44af0a0a814b9c524c86d07 not found: ID does not exist" containerID="20753a858dca8c8da372a5df1e6b81c9246ca342e44af0a0a814b9c524c86d07"
Jul 28 02:08:11.681292 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:08:11.681205    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20753a858dca8c8da372a5df1e6b81c9246ca342e44af0a0a814b9c524c86d07"} err="failed to get container status \"20753a858dca8c8da372a5df1e6b81c9246ca342e44af0a0a814b9c524c86d07\": rpc error: code = NotFound desc = could not find container \"20753a858dca8c8da372a5df1e6b81c9246ca342e44af0a0a814b9c524c86d07\": container with ID starting with 20753a858dca8c8da372a5df1e6b81c9246ca342e44af0a0a814b9c524c86d07 not found: ID does not exist"
Jul 28 02:08:11.681292 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:08:11.681224    2562 scope.go:117] "RemoveContainer" containerID="42aa67e9ed2a09a2d6476ba5b9c00f0b9ba9a572f1d19d9df43b6292e85d0c30"
Jul 28 02:08:11.681503 ip-10-0-134-165 kubenswrapper[2562]: E0728 02:08:11.681486    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42aa67e9ed2a09a2d6476ba5b9c00f0b9ba9a572f1d19d9df43b6292e85d0c30\": container with ID starting with 42aa67e9ed2a09a2d6476ba5b9c00f0b9ba9a572f1d19d9df43b6292e85d0c30 not found: ID does not exist" containerID="42aa67e9ed2a09a2d6476ba5b9c00f0b9ba9a572f1d19d9df43b6292e85d0c30"
Jul 28 02:08:11.681545 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:08:11.681509    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42aa67e9ed2a09a2d6476ba5b9c00f0b9ba9a572f1d19d9df43b6292e85d0c30"} err="failed to get container status \"42aa67e9ed2a09a2d6476ba5b9c00f0b9ba9a572f1d19d9df43b6292e85d0c30\": rpc error: code = NotFound desc = could not find container \"42aa67e9ed2a09a2d6476ba5b9c00f0b9ba9a572f1d19d9df43b6292e85d0c30\": container with ID starting with 42aa67e9ed2a09a2d6476ba5b9c00f0b9ba9a572f1d19d9df43b6292e85d0c30 not found: ID does not exist"
Jul 28 02:08:11.683403 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:08:11.683384    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h"]
Jul 28 02:08:11.686837 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:08:11.686817    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-e78415-openshift-default-7b74dbc64-cjm2h"]
Jul 28 02:08:12.014035 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:08:12.013954    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0018ade2-e9cf-40ac-9450-d835b5fba1d6" path="/var/lib/kubelet/pods/0018ade2-e9cf-40ac-9450-d835b5fba1d6/volumes"
Jul 28 02:09:18.233351 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:18.233317    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b"]
Jul 28 02:09:18.233993 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:18.233602    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b" podUID="58fd37a7-b176-4e06-9f6f-dc26071d3bd3" containerName="istio-proxy" containerID="cri-o://cf4b5ea6833c8cb2777287ac6b30fec3868f47e9dc8695d3b8e7085c6186cb9c" gracePeriod=30
Jul 28 02:09:23.497760 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:23.497697    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b"
Jul 28 02:09:23.629197 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:23.629164    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-istio-envoy\") pod \"58fd37a7-b176-4e06-9f6f-dc26071d3bd3\" (UID: \"58fd37a7-b176-4e06-9f6f-dc26071d3bd3\") "
Jul 28 02:09:23.629488 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:23.629207    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6bjd7\" (UniqueName: \"kubernetes.io/projected/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-kube-api-access-6bjd7\") pod \"58fd37a7-b176-4e06-9f6f-dc26071d3bd3\" (UID: \"58fd37a7-b176-4e06-9f6f-dc26071d3bd3\") "
Jul 28 02:09:23.629488 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:23.629272    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-credential-socket\") pod \"58fd37a7-b176-4e06-9f6f-dc26071d3bd3\" (UID: \"58fd37a7-b176-4e06-9f6f-dc26071d3bd3\") "
Jul 28 02:09:23.629488 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:23.629326    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-istio-data\") pod \"58fd37a7-b176-4e06-9f6f-dc26071d3bd3\" (UID: \"58fd37a7-b176-4e06-9f6f-dc26071d3bd3\") "
Jul 28 02:09:23.629488 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:23.629356    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-istio-podinfo\") pod \"58fd37a7-b176-4e06-9f6f-dc26071d3bd3\" (UID: \"58fd37a7-b176-4e06-9f6f-dc26071d3bd3\") "
Jul 28 02:09:23.629488 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:23.629383    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-istio-token\") pod \"58fd37a7-b176-4e06-9f6f-dc26071d3bd3\" (UID: \"58fd37a7-b176-4e06-9f6f-dc26071d3bd3\") "
Jul 28 02:09:23.629488 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:23.629407    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-istiod-ca-cert\") pod \"58fd37a7-b176-4e06-9f6f-dc26071d3bd3\" (UID: \"58fd37a7-b176-4e06-9f6f-dc26071d3bd3\") "
Jul 28 02:09:23.629488 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:23.629442    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-workload-socket\") pod \"58fd37a7-b176-4e06-9f6f-dc26071d3bd3\" (UID: \"58fd37a7-b176-4e06-9f6f-dc26071d3bd3\") "
Jul 28 02:09:23.629887 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:23.629495    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-workload-certs\") pod \"58fd37a7-b176-4e06-9f6f-dc26071d3bd3\" (UID: \"58fd37a7-b176-4e06-9f6f-dc26071d3bd3\") "
Jul 28 02:09:23.630018 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:23.629965    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "58fd37a7-b176-4e06-9f6f-dc26071d3bd3" (UID: "58fd37a7-b176-4e06-9f6f-dc26071d3bd3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 02:09:23.630197 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:23.630060    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "58fd37a7-b176-4e06-9f6f-dc26071d3bd3" (UID: "58fd37a7-b176-4e06-9f6f-dc26071d3bd3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:09:23.630197 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:23.630100    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "58fd37a7-b176-4e06-9f6f-dc26071d3bd3" (UID: "58fd37a7-b176-4e06-9f6f-dc26071d3bd3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:09:23.630393 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:23.630219    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "58fd37a7-b176-4e06-9f6f-dc26071d3bd3" (UID: "58fd37a7-b176-4e06-9f6f-dc26071d3bd3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:09:23.630393 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:23.630316    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-istio-data" (OuterVolumeSpecName: "istio-data") pod "58fd37a7-b176-4e06-9f6f-dc26071d3bd3" (UID: "58fd37a7-b176-4e06-9f6f-dc26071d3bd3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:09:23.631657 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:23.631626    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "58fd37a7-b176-4e06-9f6f-dc26071d3bd3" (UID: "58fd37a7-b176-4e06-9f6f-dc26071d3bd3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 02:09:23.631811 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:23.631789    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-kube-api-access-6bjd7" (OuterVolumeSpecName: "kube-api-access-6bjd7") pod "58fd37a7-b176-4e06-9f6f-dc26071d3bd3" (UID: "58fd37a7-b176-4e06-9f6f-dc26071d3bd3"). InnerVolumeSpecName "kube-api-access-6bjd7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 02:09:23.631905 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:23.631854    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "58fd37a7-b176-4e06-9f6f-dc26071d3bd3" (UID: "58fd37a7-b176-4e06-9f6f-dc26071d3bd3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:09:23.631950 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:23.631928    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-istio-token" (OuterVolumeSpecName: "istio-token") pod "58fd37a7-b176-4e06-9f6f-dc26071d3bd3" (UID: "58fd37a7-b176-4e06-9f6f-dc26071d3bd3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 02:09:23.731022 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:23.730992    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-credential-socket\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 02:09:23.731022 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:23.731017    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-istio-data\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 02:09:23.731022 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:23.731027    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-istio-podinfo\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 02:09:23.731264 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:23.731035    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-istio-token\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 02:09:23.731264 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:23.731043    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-istiod-ca-cert\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 02:09:23.731264 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:23.731052    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-workload-socket\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 02:09:23.731264 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:23.731061    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-workload-certs\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 02:09:23.731264 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:23.731069    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-istio-envoy\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 02:09:23.731264 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:23.731076    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bjd7\" (UniqueName: \"kubernetes.io/projected/58fd37a7-b176-4e06-9f6f-dc26071d3bd3-kube-api-access-6bjd7\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 02:09:24.070536 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:24.070504    2562 generic.go:356] "Generic (PLEG): container finished" podID="58fd37a7-b176-4e06-9f6f-dc26071d3bd3" containerID="cf4b5ea6833c8cb2777287ac6b30fec3868f47e9dc8695d3b8e7085c6186cb9c" exitCode=0
Jul 28 02:09:24.070745 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:24.070585    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b"
Jul 28 02:09:24.070745 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:24.070593    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b" event={"ID":"58fd37a7-b176-4e06-9f6f-dc26071d3bd3","Type":"ContainerDied","Data":"cf4b5ea6833c8cb2777287ac6b30fec3868f47e9dc8695d3b8e7085c6186cb9c"}
Jul 28 02:09:24.070745 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:24.070648    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b" event={"ID":"58fd37a7-b176-4e06-9f6f-dc26071d3bd3","Type":"ContainerDied","Data":"41bf230cb7cdba51df0749f0d2e496af69fc7fd22ffade8e9d7f6b71d891fecb"}
Jul 28 02:09:24.070745 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:24.070672    2562 scope.go:117] "RemoveContainer" containerID="cf4b5ea6833c8cb2777287ac6b30fec3868f47e9dc8695d3b8e7085c6186cb9c"
Jul 28 02:09:24.080658 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:24.080638    2562 scope.go:117] "RemoveContainer" containerID="08106c6ae665ed4bce5049780ae0b7a5de8b7cb469d2bb1c4fdbec4c7da5e67c"
Jul 28 02:09:24.090990 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:24.090816    2562 scope.go:117] "RemoveContainer" containerID="cf4b5ea6833c8cb2777287ac6b30fec3868f47e9dc8695d3b8e7085c6186cb9c"
Jul 28 02:09:24.090990 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:24.090902    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b"]
Jul 28 02:09:24.092053 ip-10-0-134-165 kubenswrapper[2562]: E0728 02:09:24.091199    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf4b5ea6833c8cb2777287ac6b30fec3868f47e9dc8695d3b8e7085c6186cb9c\": container with ID starting with cf4b5ea6833c8cb2777287ac6b30fec3868f47e9dc8695d3b8e7085c6186cb9c not found: ID does not exist" containerID="cf4b5ea6833c8cb2777287ac6b30fec3868f47e9dc8695d3b8e7085c6186cb9c"
Jul 28 02:09:24.092053 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:24.091231    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf4b5ea6833c8cb2777287ac6b30fec3868f47e9dc8695d3b8e7085c6186cb9c"} err="failed to get container status \"cf4b5ea6833c8cb2777287ac6b30fec3868f47e9dc8695d3b8e7085c6186cb9c\": rpc error: code = NotFound desc = could not find container \"cf4b5ea6833c8cb2777287ac6b30fec3868f47e9dc8695d3b8e7085c6186cb9c\": container with ID starting with cf4b5ea6833c8cb2777287ac6b30fec3868f47e9dc8695d3b8e7085c6186cb9c not found: ID does not exist"
Jul 28 02:09:24.092053 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:24.091255    2562 scope.go:117] "RemoveContainer" containerID="08106c6ae665ed4bce5049780ae0b7a5de8b7cb469d2bb1c4fdbec4c7da5e67c"
Jul 28 02:09:24.092053 ip-10-0-134-165 kubenswrapper[2562]: E0728 02:09:24.091511    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08106c6ae665ed4bce5049780ae0b7a5de8b7cb469d2bb1c4fdbec4c7da5e67c\": container with ID starting with 08106c6ae665ed4bce5049780ae0b7a5de8b7cb469d2bb1c4fdbec4c7da5e67c not found: ID does not exist" containerID="08106c6ae665ed4bce5049780ae0b7a5de8b7cb469d2bb1c4fdbec4c7da5e67c"
Jul 28 02:09:24.092053 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:24.091610    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08106c6ae665ed4bce5049780ae0b7a5de8b7cb469d2bb1c4fdbec4c7da5e67c"} err="failed to get container status \"08106c6ae665ed4bce5049780ae0b7a5de8b7cb469d2bb1c4fdbec4c7da5e67c\": rpc error: code = NotFound desc = could not find container \"08106c6ae665ed4bce5049780ae0b7a5de8b7cb469d2bb1c4fdbec4c7da5e67c\": container with ID starting with 08106c6ae665ed4bce5049780ae0b7a5de8b7cb469d2bb1c4fdbec4c7da5e67c not found: ID does not exist"
Jul 28 02:09:24.092053 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:24.091985    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-49ecf4-openshift-default-59b544ffb-mqt2b"]
Jul 28 02:09:26.013749 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:26.013713    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58fd37a7-b176-4e06-9f6f-dc26071d3bd3" path="/var/lib/kubelet/pods/58fd37a7-b176-4e06-9f6f-dc26071d3bd3/volumes"
Jul 28 02:09:40.845122 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:40.845081    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x"]
Jul 28 02:09:40.845486 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:40.845332    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x" podUID="cb9f4d1c-461a-4d34-baba-918aec710b6e" containerName="istio-proxy" containerID="cri-o://8edd2d2f3593b639ee6974879b0ae83987d4e253f610b820c567bbbc4d190d30" gracePeriod=30
Jul 28 02:09:41.259489 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:41.259458    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-dfed9b-4cl92"]
Jul 28 02:09:41.259887 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:41.259875    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58fd37a7-b176-4e06-9f6f-dc26071d3bd3" containerName="istio-proxy"
Jul 28 02:09:41.259933 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:41.259889    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="58fd37a7-b176-4e06-9f6f-dc26071d3bd3" containerName="istio-proxy"
Jul 28 02:09:41.259933 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:41.259897    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0018ade2-e9cf-40ac-9450-d835b5fba1d6" containerName="istio-proxy"
Jul 28 02:09:41.259933 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:41.259903    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0018ade2-e9cf-40ac-9450-d835b5fba1d6" containerName="istio-proxy"
Jul 28 02:09:41.259933 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:41.259919    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0018ade2-e9cf-40ac-9450-d835b5fba1d6" containerName="istio-proxy"
Jul 28 02:09:41.259933 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:41.259925    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0018ade2-e9cf-40ac-9450-d835b5fba1d6" containerName="istio-proxy"
Jul 28 02:09:41.259933 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:41.259933    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58fd37a7-b176-4e06-9f6f-dc26071d3bd3" containerName="istio-proxy"
Jul 28 02:09:41.260129 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:41.259938    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="58fd37a7-b176-4e06-9f6f-dc26071d3bd3" containerName="istio-proxy"
Jul 28 02:09:41.260129 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:41.260007    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="58fd37a7-b176-4e06-9f6f-dc26071d3bd3" containerName="istio-proxy"
Jul 28 02:09:41.260129 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:41.260015    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="58fd37a7-b176-4e06-9f6f-dc26071d3bd3" containerName="istio-proxy"
Jul 28 02:09:41.260129 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:41.260023    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0018ade2-e9cf-40ac-9450-d835b5fba1d6" containerName="istio-proxy"
Jul 28 02:09:41.260129 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:41.260031    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0018ade2-e9cf-40ac-9450-d835b5fba1d6" containerName="istio-proxy"
Jul 28 02:09:41.263085 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:41.263070    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-dfed9b-4cl92"
Jul 28 02:09:41.265449 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:41.265429    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wjxvt\""
Jul 28 02:09:41.273024 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:41.272998    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-dfed9b-4cl92"]
Jul 28 02:09:41.399467 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:41.399435    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a3bf2d5-9b20-4792-8673-1ae3d0b7eaf6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-dfed9b-4cl92\" (UID: \"3a3bf2d5-9b20-4792-8673-1ae3d0b7eaf6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-dfed9b-4cl92"
Jul 28 02:09:41.501055 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:41.501016    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a3bf2d5-9b20-4792-8673-1ae3d0b7eaf6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-dfed9b-4cl92\" (UID: \"3a3bf2d5-9b20-4792-8673-1ae3d0b7eaf6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-dfed9b-4cl92"
Jul 28 02:09:41.501665 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:41.501644    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a3bf2d5-9b20-4792-8673-1ae3d0b7eaf6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-dfed9b-4cl92\" (UID: \"3a3bf2d5-9b20-4792-8673-1ae3d0b7eaf6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-dfed9b-4cl92"
Jul 28 02:09:41.575130 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:41.575043    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-dfed9b-4cl92"
Jul 28 02:09:41.921234 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:41.921209    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-dfed9b-4cl92"]
Jul 28 02:09:41.923147 ip-10-0-134-165 kubenswrapper[2562]: W0728 02:09:41.923115    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a3bf2d5_9b20_4792_8673_1ae3d0b7eaf6.slice/crio-d32572b89792baf9f875e4c5784498333b3c8a7b092009e073b11e2bf2697579 WatchSource:0}: Error finding container d32572b89792baf9f875e4c5784498333b3c8a7b092009e073b11e2bf2697579: Status 404 returned error can't find the container with id d32572b89792baf9f875e4c5784498333b3c8a7b092009e073b11e2bf2697579
Jul 28 02:09:42.173487 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:42.173394    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-dfed9b-4cl92" event={"ID":"3a3bf2d5-9b20-4792-8673-1ae3d0b7eaf6","Type":"ContainerStarted","Data":"d32572b89792baf9f875e4c5784498333b3c8a7b092009e073b11e2bf2697579"}
Jul 28 02:09:43.180858 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:43.180825    2562 generic.go:356] "Generic (PLEG): container finished" podID="3a3bf2d5-9b20-4792-8673-1ae3d0b7eaf6" containerID="943cb6a1743945f2c4b9eb46a585c8a000c3aa0abe9fd6d8398ec41857f6d657" exitCode=0
Jul 28 02:09:43.181294 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:43.180917    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-dfed9b-4cl92" event={"ID":"3a3bf2d5-9b20-4792-8673-1ae3d0b7eaf6","Type":"ContainerDied","Data":"943cb6a1743945f2c4b9eb46a585c8a000c3aa0abe9fd6d8398ec41857f6d657"}
Jul 28 02:09:44.333258 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:44.333228    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-dfed9b-4cl92"
Jul 28 02:09:44.427506 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:44.427478    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a3bf2d5-9b20-4792-8673-1ae3d0b7eaf6-maas-api-service-ca\") pod \"3a3bf2d5-9b20-4792-8673-1ae3d0b7eaf6\" (UID: \"3a3bf2d5-9b20-4792-8673-1ae3d0b7eaf6\") "
Jul 28 02:09:44.427859 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:44.427839    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a3bf2d5-9b20-4792-8673-1ae3d0b7eaf6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3a3bf2d5-9b20-4792-8673-1ae3d0b7eaf6" (UID: "3a3bf2d5-9b20-4792-8673-1ae3d0b7eaf6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 02:09:44.528853 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:44.528768    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a3bf2d5-9b20-4792-8673-1ae3d0b7eaf6-maas-api-service-ca\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 02:09:45.196445 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:45.196413    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-dfed9b-4cl92" event={"ID":"3a3bf2d5-9b20-4792-8673-1ae3d0b7eaf6","Type":"ContainerDied","Data":"d32572b89792baf9f875e4c5784498333b3c8a7b092009e073b11e2bf2697579"}
Jul 28 02:09:45.196445 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:45.196447    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-dfed9b-4cl92"
Jul 28 02:09:45.196690 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:45.196460    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d32572b89792baf9f875e4c5784498333b3c8a7b092009e073b11e2bf2697579"
Jul 28 02:09:46.105791 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:46.105700    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x"
Jul 28 02:09:46.203816 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:46.203782    2562 generic.go:356] "Generic (PLEG): container finished" podID="cb9f4d1c-461a-4d34-baba-918aec710b6e" containerID="8edd2d2f3593b639ee6974879b0ae83987d4e253f610b820c567bbbc4d190d30" exitCode=0
Jul 28 02:09:46.203975 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:46.203829    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x"
Jul 28 02:09:46.203975 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:46.203871    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x" event={"ID":"cb9f4d1c-461a-4d34-baba-918aec710b6e","Type":"ContainerDied","Data":"8edd2d2f3593b639ee6974879b0ae83987d4e253f610b820c567bbbc4d190d30"}
Jul 28 02:09:46.203975 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:46.203924    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x" event={"ID":"cb9f4d1c-461a-4d34-baba-918aec710b6e","Type":"ContainerDied","Data":"499d8bd393a68fbd97b5171f9c4a854209c87b92e0c5c5ccdc35c4b3227d4bef"}
Jul 28 02:09:46.203975 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:46.203952    2562 scope.go:117] "RemoveContainer" containerID="8edd2d2f3593b639ee6974879b0ae83987d4e253f610b820c567bbbc4d190d30"
Jul 28 02:09:46.213079 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:46.213060    2562 scope.go:117] "RemoveContainer" containerID="ef752132a3267d000e3db4f1ed17f21f2c6840ad30f870ed0b70adcc2fc6e2b8"
Jul 28 02:09:46.221106 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:46.221090    2562 scope.go:117] "RemoveContainer" containerID="8edd2d2f3593b639ee6974879b0ae83987d4e253f610b820c567bbbc4d190d30"
Jul 28 02:09:46.221369 ip-10-0-134-165 kubenswrapper[2562]: E0728 02:09:46.221347    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8edd2d2f3593b639ee6974879b0ae83987d4e253f610b820c567bbbc4d190d30\": container with ID starting with 8edd2d2f3593b639ee6974879b0ae83987d4e253f610b820c567bbbc4d190d30 not found: ID does not exist" containerID="8edd2d2f3593b639ee6974879b0ae83987d4e253f610b820c567bbbc4d190d30"
Jul 28 02:09:46.221442 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:46.221379    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8edd2d2f3593b639ee6974879b0ae83987d4e253f610b820c567bbbc4d190d30"} err="failed to get container status \"8edd2d2f3593b639ee6974879b0ae83987d4e253f610b820c567bbbc4d190d30\": rpc error: code = NotFound desc = could not find container \"8edd2d2f3593b639ee6974879b0ae83987d4e253f610b820c567bbbc4d190d30\": container with ID starting with 8edd2d2f3593b639ee6974879b0ae83987d4e253f610b820c567bbbc4d190d30 not found: ID does not exist"
Jul 28 02:09:46.221442 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:46.221397    2562 scope.go:117] "RemoveContainer" containerID="ef752132a3267d000e3db4f1ed17f21f2c6840ad30f870ed0b70adcc2fc6e2b8"
Jul 28 02:09:46.221719 ip-10-0-134-165 kubenswrapper[2562]: E0728 02:09:46.221700    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef752132a3267d000e3db4f1ed17f21f2c6840ad30f870ed0b70adcc2fc6e2b8\": container with ID starting with ef752132a3267d000e3db4f1ed17f21f2c6840ad30f870ed0b70adcc2fc6e2b8 not found: ID does not exist" containerID="ef752132a3267d000e3db4f1ed17f21f2c6840ad30f870ed0b70adcc2fc6e2b8"
Jul 28 02:09:46.221770 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:46.221727    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef752132a3267d000e3db4f1ed17f21f2c6840ad30f870ed0b70adcc2fc6e2b8"} err="failed to get container status \"ef752132a3267d000e3db4f1ed17f21f2c6840ad30f870ed0b70adcc2fc6e2b8\": rpc error: code = NotFound desc = could not find container \"ef752132a3267d000e3db4f1ed17f21f2c6840ad30f870ed0b70adcc2fc6e2b8\": container with ID starting with ef752132a3267d000e3db4f1ed17f21f2c6840ad30f870ed0b70adcc2fc6e2b8 not found: ID does not exist"
Jul 28 02:09:46.246061 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:46.246037    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb9f4d1c-461a-4d34-baba-918aec710b6e-workload-socket\") pod \"cb9f4d1c-461a-4d34-baba-918aec710b6e\" (UID: \"cb9f4d1c-461a-4d34-baba-918aec710b6e\") "
Jul 28 02:09:46.246144 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:46.246080    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb9f4d1c-461a-4d34-baba-918aec710b6e-credential-socket\") pod \"cb9f4d1c-461a-4d34-baba-918aec710b6e\" (UID: \"cb9f4d1c-461a-4d34-baba-918aec710b6e\") "
Jul 28 02:09:46.246144 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:46.246105    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb9f4d1c-461a-4d34-baba-918aec710b6e-workload-certs\") pod \"cb9f4d1c-461a-4d34-baba-918aec710b6e\" (UID: \"cb9f4d1c-461a-4d34-baba-918aec710b6e\") "
Jul 28 02:09:46.246144 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:46.246124    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb9f4d1c-461a-4d34-baba-918aec710b6e-istio-envoy\") pod \"cb9f4d1c-461a-4d34-baba-918aec710b6e\" (UID: \"cb9f4d1c-461a-4d34-baba-918aec710b6e\") "
Jul 28 02:09:46.246303 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:46.246171    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb9f4d1c-461a-4d34-baba-918aec710b6e-istio-token\") pod \"cb9f4d1c-461a-4d34-baba-918aec710b6e\" (UID: \"cb9f4d1c-461a-4d34-baba-918aec710b6e\") "
Jul 28 02:09:46.246303 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:46.246186    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb9f4d1c-461a-4d34-baba-918aec710b6e-istio-podinfo\") pod \"cb9f4d1c-461a-4d34-baba-918aec710b6e\" (UID: \"cb9f4d1c-461a-4d34-baba-918aec710b6e\") "
Jul 28 02:09:46.246303 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:46.246204    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb9f4d1c-461a-4d34-baba-918aec710b6e-istiod-ca-cert\") pod \"cb9f4d1c-461a-4d34-baba-918aec710b6e\" (UID: \"cb9f4d1c-461a-4d34-baba-918aec710b6e\") "
Jul 28 02:09:46.246303 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:46.246301    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x9nns\" (UniqueName: \"kubernetes.io/projected/cb9f4d1c-461a-4d34-baba-918aec710b6e-kube-api-access-x9nns\") pod \"cb9f4d1c-461a-4d34-baba-918aec710b6e\" (UID: \"cb9f4d1c-461a-4d34-baba-918aec710b6e\") "
Jul 28 02:09:46.246503 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:46.246327    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb9f4d1c-461a-4d34-baba-918aec710b6e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cb9f4d1c-461a-4d34-baba-918aec710b6e" (UID: "cb9f4d1c-461a-4d34-baba-918aec710b6e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:09:46.246503 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:46.246336    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb9f4d1c-461a-4d34-baba-918aec710b6e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cb9f4d1c-461a-4d34-baba-918aec710b6e" (UID: "cb9f4d1c-461a-4d34-baba-918aec710b6e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:09:46.246503 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:46.246333    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb9f4d1c-461a-4d34-baba-918aec710b6e-istio-data\") pod \"cb9f4d1c-461a-4d34-baba-918aec710b6e\" (UID: \"cb9f4d1c-461a-4d34-baba-918aec710b6e\") "
Jul 28 02:09:46.246710 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:46.246653    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb9f4d1c-461a-4d34-baba-918aec710b6e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cb9f4d1c-461a-4d34-baba-918aec710b6e" (UID: "cb9f4d1c-461a-4d34-baba-918aec710b6e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 02:09:46.246778 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:46.246763    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb9f4d1c-461a-4d34-baba-918aec710b6e-istiod-ca-cert\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 02:09:46.246838 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:46.246779    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb9f4d1c-461a-4d34-baba-918aec710b6e-workload-socket\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 02:09:46.246838 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:46.246782    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb9f4d1c-461a-4d34-baba-918aec710b6e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cb9f4d1c-461a-4d34-baba-918aec710b6e" (UID: "cb9f4d1c-461a-4d34-baba-918aec710b6e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:09:46.246838 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:46.246793    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb9f4d1c-461a-4d34-baba-918aec710b6e-credential-socket\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 02:09:46.247267 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:46.247242    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb9f4d1c-461a-4d34-baba-918aec710b6e-istio-data" (OuterVolumeSpecName: "istio-data") pod "cb9f4d1c-461a-4d34-baba-918aec710b6e" (UID: "cb9f4d1c-461a-4d34-baba-918aec710b6e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:09:46.248459 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:46.248434    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cb9f4d1c-461a-4d34-baba-918aec710b6e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cb9f4d1c-461a-4d34-baba-918aec710b6e" (UID: "cb9f4d1c-461a-4d34-baba-918aec710b6e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 02:09:46.248459 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:46.248443    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb9f4d1c-461a-4d34-baba-918aec710b6e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cb9f4d1c-461a-4d34-baba-918aec710b6e" (UID: "cb9f4d1c-461a-4d34-baba-918aec710b6e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:09:46.248692 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:46.248605    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb9f4d1c-461a-4d34-baba-918aec710b6e-kube-api-access-x9nns" (OuterVolumeSpecName: "kube-api-access-x9nns") pod "cb9f4d1c-461a-4d34-baba-918aec710b6e" (UID: "cb9f4d1c-461a-4d34-baba-918aec710b6e"). InnerVolumeSpecName "kube-api-access-x9nns". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 02:09:46.248692 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:46.248645    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb9f4d1c-461a-4d34-baba-918aec710b6e-istio-token" (OuterVolumeSpecName: "istio-token") pod "cb9f4d1c-461a-4d34-baba-918aec710b6e" (UID: "cb9f4d1c-461a-4d34-baba-918aec710b6e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 02:09:46.347865 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:46.347832    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9nns\" (UniqueName: \"kubernetes.io/projected/cb9f4d1c-461a-4d34-baba-918aec710b6e-kube-api-access-x9nns\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 02:09:46.347865 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:46.347869    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb9f4d1c-461a-4d34-baba-918aec710b6e-istio-data\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 02:09:46.348067 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:46.347884    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb9f4d1c-461a-4d34-baba-918aec710b6e-workload-certs\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 02:09:46.348067 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:46.347918    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb9f4d1c-461a-4d34-baba-918aec710b6e-istio-envoy\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 02:09:46.348067 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:46.347927    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb9f4d1c-461a-4d34-baba-918aec710b6e-istio-token\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 02:09:46.348067 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:46.347937    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb9f4d1c-461a-4d34-baba-918aec710b6e-istio-podinfo\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 02:09:46.526154 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:46.526124    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x"]
Jul 28 02:09:46.529676 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:46.529649    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-e0a963-openshift-default-7f8d5646b8-wl62x"]
Jul 28 02:09:48.014535 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:48.014492    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb9f4d1c-461a-4d34-baba-918aec710b6e" path="/var/lib/kubelet/pods/cb9f4d1c-461a-4d34-baba-918aec710b6e/volumes"
Jul 28 02:09:52.899333 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:52.899295    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-dfed9b-29753400-hrptf"]
Jul 28 02:09:52.906312 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:52.906282    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-dfed9b-29753400-hrptf"]
Jul 28 02:09:54.013549 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:54.013515    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae01d1d3-96c0-41a8-b661-7553b0aa7374" path="/var/lib/kubelet/pods/ae01d1d3-96c0-41a8-b661-7553b0aa7374/volumes"
Jul 28 02:09:56.347876 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:56.347840    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-dfed9b-4cl92"]
Jul 28 02:09:56.353113 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:56.353084    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-dfed9b-4cl92"]
Jul 28 02:09:58.013652 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:09:58.013619    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a3bf2d5-9b20-4792-8673-1ae3d0b7eaf6" path="/var/lib/kubelet/pods/3a3bf2d5-9b20-4792-8673-1ae3d0b7eaf6/volumes"
Jul 28 02:10:03.040760 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:03.040725    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2"]
Jul 28 02:10:03.041195 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:03.040933    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2" podUID="81df2652-7265-45bf-8dd1-eadd9ef737eb" containerName="istio-proxy" containerID="cri-o://779e5abce4a5b1310f743ff247226254b256cbb1bd0ea1911c0e9a7050db7ebc" gracePeriod=30
Jul 28 02:10:03.388817 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:03.388779    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-de398f-hm4gg"]
Jul 28 02:10:03.389305 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:03.389286    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a3bf2d5-9b20-4792-8673-1ae3d0b7eaf6" containerName="revoke-keys"
Jul 28 02:10:03.389305 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:03.389307    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a3bf2d5-9b20-4792-8673-1ae3d0b7eaf6" containerName="revoke-keys"
Jul 28 02:10:03.389465 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:03.389327    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb9f4d1c-461a-4d34-baba-918aec710b6e" containerName="istio-proxy"
Jul 28 02:10:03.389465 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:03.389336    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb9f4d1c-461a-4d34-baba-918aec710b6e" containerName="istio-proxy"
Jul 28 02:10:03.389465 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:03.389350    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb9f4d1c-461a-4d34-baba-918aec710b6e" containerName="istio-proxy"
Jul 28 02:10:03.389465 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:03.389358    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb9f4d1c-461a-4d34-baba-918aec710b6e" containerName="istio-proxy"
Jul 28 02:10:03.389693 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:03.389494    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb9f4d1c-461a-4d34-baba-918aec710b6e" containerName="istio-proxy"
Jul 28 02:10:03.389693 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:03.389507    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a3bf2d5-9b20-4792-8673-1ae3d0b7eaf6" containerName="revoke-keys"
Jul 28 02:10:03.389693 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:03.389521    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb9f4d1c-461a-4d34-baba-918aec710b6e" containerName="istio-proxy"
Jul 28 02:10:03.394346 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:03.394325    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-de398f-hm4gg"
Jul 28 02:10:03.396985 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:03.396753    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wjxvt\""
Jul 28 02:10:03.398603 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:03.398576    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-de398f-hm4gg"]
Jul 28 02:10:03.507100 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:03.507062    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/12fd246f-de8e-4a92-8292-8b1bb28a73e0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-de398f-hm4gg\" (UID: \"12fd246f-de8e-4a92-8292-8b1bb28a73e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-de398f-hm4gg"
Jul 28 02:10:03.608607 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:03.608577    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/12fd246f-de8e-4a92-8292-8b1bb28a73e0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-de398f-hm4gg\" (UID: \"12fd246f-de8e-4a92-8292-8b1bb28a73e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-de398f-hm4gg"
Jul 28 02:10:03.609161 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:03.609139    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/12fd246f-de8e-4a92-8292-8b1bb28a73e0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-de398f-hm4gg\" (UID: \"12fd246f-de8e-4a92-8292-8b1bb28a73e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-de398f-hm4gg"
Jul 28 02:10:03.707799 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:03.707704    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-de398f-hm4gg"
Jul 28 02:10:03.852419 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:03.852385    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-de398f-hm4gg"]
Jul 28 02:10:03.853645 ip-10-0-134-165 kubenswrapper[2562]: W0728 02:10:03.853618    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12fd246f_de8e_4a92_8292_8b1bb28a73e0.slice/crio-af09c97eeff950b04e1a5f2307d8680694175fa95be7a48c60f69ce048c04052 WatchSource:0}: Error finding container af09c97eeff950b04e1a5f2307d8680694175fa95be7a48c60f69ce048c04052: Status 404 returned error can't find the container with id af09c97eeff950b04e1a5f2307d8680694175fa95be7a48c60f69ce048c04052
Jul 28 02:10:04.303222 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:04.303174    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-de398f-hm4gg" event={"ID":"12fd246f-de8e-4a92-8292-8b1bb28a73e0","Type":"ContainerStarted","Data":"de62a6cf83020c8b8e2dcd476480a0e52e83c38039c792d070840ef0e9110242"}
Jul 28 02:10:04.303727 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:04.303251    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-de398f-hm4gg" event={"ID":"12fd246f-de8e-4a92-8292-8b1bb28a73e0","Type":"ContainerStarted","Data":"af09c97eeff950b04e1a5f2307d8680694175fa95be7a48c60f69ce048c04052"}
Jul 28 02:10:05.310298 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:05.310261    2562 generic.go:356] "Generic (PLEG): container finished" podID="12fd246f-de8e-4a92-8292-8b1bb28a73e0" containerID="de62a6cf83020c8b8e2dcd476480a0e52e83c38039c792d070840ef0e9110242" exitCode=0
Jul 28 02:10:05.310735 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:05.310353    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-de398f-hm4gg" event={"ID":"12fd246f-de8e-4a92-8292-8b1bb28a73e0","Type":"ContainerDied","Data":"de62a6cf83020c8b8e2dcd476480a0e52e83c38039c792d070840ef0e9110242"}
Jul 28 02:10:06.452818 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:06.452793    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-de398f-hm4gg"
Jul 28 02:10:06.536071 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:06.536040    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/12fd246f-de8e-4a92-8292-8b1bb28a73e0-maas-api-service-ca\") pod \"12fd246f-de8e-4a92-8292-8b1bb28a73e0\" (UID: \"12fd246f-de8e-4a92-8292-8b1bb28a73e0\") "
Jul 28 02:10:06.536496 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:06.536468    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12fd246f-de8e-4a92-8292-8b1bb28a73e0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "12fd246f-de8e-4a92-8292-8b1bb28a73e0" (UID: "12fd246f-de8e-4a92-8292-8b1bb28a73e0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 02:10:06.637713 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:06.637676    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/12fd246f-de8e-4a92-8292-8b1bb28a73e0-maas-api-service-ca\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 02:10:07.322354 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:07.322315    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-de398f-hm4gg" event={"ID":"12fd246f-de8e-4a92-8292-8b1bb28a73e0","Type":"ContainerDied","Data":"af09c97eeff950b04e1a5f2307d8680694175fa95be7a48c60f69ce048c04052"}
Jul 28 02:10:07.322527 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:07.322374    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="af09c97eeff950b04e1a5f2307d8680694175fa95be7a48c60f69ce048c04052"
Jul 28 02:10:07.322527 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:07.322329    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-de398f-hm4gg"
Jul 28 02:10:08.298056 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:08.298032    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2"
Jul 28 02:10:08.330017 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:08.329927    2562 generic.go:356] "Generic (PLEG): container finished" podID="81df2652-7265-45bf-8dd1-eadd9ef737eb" containerID="779e5abce4a5b1310f743ff247226254b256cbb1bd0ea1911c0e9a7050db7ebc" exitCode=0
Jul 28 02:10:08.330017 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:08.330001    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2"
Jul 28 02:10:08.330192 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:08.330024    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2" event={"ID":"81df2652-7265-45bf-8dd1-eadd9ef737eb","Type":"ContainerDied","Data":"779e5abce4a5b1310f743ff247226254b256cbb1bd0ea1911c0e9a7050db7ebc"}
Jul 28 02:10:08.330192 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:08.330085    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2" event={"ID":"81df2652-7265-45bf-8dd1-eadd9ef737eb","Type":"ContainerDied","Data":"a018867e3593cf18b075cf0f3370bab5212351073d64a56402164f26d3a5fad4"}
Jul 28 02:10:08.330192 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:08.330108    2562 scope.go:117] "RemoveContainer" containerID="779e5abce4a5b1310f743ff247226254b256cbb1bd0ea1911c0e9a7050db7ebc"
Jul 28 02:10:08.341137 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:08.341112    2562 scope.go:117] "RemoveContainer" containerID="635e4586b447d06aff7d61274c85d610109a64637dadd0b65c427e62b00d79ff"
Jul 28 02:10:08.351662 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:08.351638    2562 scope.go:117] "RemoveContainer" containerID="779e5abce4a5b1310f743ff247226254b256cbb1bd0ea1911c0e9a7050db7ebc"
Jul 28 02:10:08.351940 ip-10-0-134-165 kubenswrapper[2562]: E0728 02:10:08.351913    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"779e5abce4a5b1310f743ff247226254b256cbb1bd0ea1911c0e9a7050db7ebc\": container with ID starting with 779e5abce4a5b1310f743ff247226254b256cbb1bd0ea1911c0e9a7050db7ebc not found: ID does not exist" containerID="779e5abce4a5b1310f743ff247226254b256cbb1bd0ea1911c0e9a7050db7ebc"
Jul 28 02:10:08.351989 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:08.351946    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"779e5abce4a5b1310f743ff247226254b256cbb1bd0ea1911c0e9a7050db7ebc"} err="failed to get container status \"779e5abce4a5b1310f743ff247226254b256cbb1bd0ea1911c0e9a7050db7ebc\": rpc error: code = NotFound desc = could not find container \"779e5abce4a5b1310f743ff247226254b256cbb1bd0ea1911c0e9a7050db7ebc\": container with ID starting with 779e5abce4a5b1310f743ff247226254b256cbb1bd0ea1911c0e9a7050db7ebc not found: ID does not exist"
Jul 28 02:10:08.351989 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:08.351966    2562 scope.go:117] "RemoveContainer" containerID="635e4586b447d06aff7d61274c85d610109a64637dadd0b65c427e62b00d79ff"
Jul 28 02:10:08.352180 ip-10-0-134-165 kubenswrapper[2562]: E0728 02:10:08.352160    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"635e4586b447d06aff7d61274c85d610109a64637dadd0b65c427e62b00d79ff\": container with ID starting with 635e4586b447d06aff7d61274c85d610109a64637dadd0b65c427e62b00d79ff not found: ID does not exist" containerID="635e4586b447d06aff7d61274c85d610109a64637dadd0b65c427e62b00d79ff"
Jul 28 02:10:08.352220 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:08.352182    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"635e4586b447d06aff7d61274c85d610109a64637dadd0b65c427e62b00d79ff"} err="failed to get container status \"635e4586b447d06aff7d61274c85d610109a64637dadd0b65c427e62b00d79ff\": rpc error: code = NotFound desc = could not find container \"635e4586b447d06aff7d61274c85d610109a64637dadd0b65c427e62b00d79ff\": container with ID starting with 635e4586b447d06aff7d61274c85d610109a64637dadd0b65c427e62b00d79ff not found: ID does not exist"
Jul 28 02:10:08.354486 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:08.354471    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81df2652-7265-45bf-8dd1-eadd9ef737eb-istio-podinfo\") pod \"81df2652-7265-45bf-8dd1-eadd9ef737eb\" (UID: \"81df2652-7265-45bf-8dd1-eadd9ef737eb\") "
Jul 28 02:10:08.354571 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:08.354506    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81df2652-7265-45bf-8dd1-eadd9ef737eb-istio-data\") pod \"81df2652-7265-45bf-8dd1-eadd9ef737eb\" (UID: \"81df2652-7265-45bf-8dd1-eadd9ef737eb\") "
Jul 28 02:10:08.354617 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:08.354594    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nm6vz\" (UniqueName: \"kubernetes.io/projected/81df2652-7265-45bf-8dd1-eadd9ef737eb-kube-api-access-nm6vz\") pod \"81df2652-7265-45bf-8dd1-eadd9ef737eb\" (UID: \"81df2652-7265-45bf-8dd1-eadd9ef737eb\") "
Jul 28 02:10:08.354653 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:08.354625    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81df2652-7265-45bf-8dd1-eadd9ef737eb-istio-envoy\") pod \"81df2652-7265-45bf-8dd1-eadd9ef737eb\" (UID: \"81df2652-7265-45bf-8dd1-eadd9ef737eb\") "
Jul 28 02:10:08.354701 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:08.354658    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81df2652-7265-45bf-8dd1-eadd9ef737eb-workload-certs\") pod \"81df2652-7265-45bf-8dd1-eadd9ef737eb\" (UID: \"81df2652-7265-45bf-8dd1-eadd9ef737eb\") "
Jul 28 02:10:08.354701 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:08.354685    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81df2652-7265-45bf-8dd1-eadd9ef737eb-workload-socket\") pod \"81df2652-7265-45bf-8dd1-eadd9ef737eb\" (UID: \"81df2652-7265-45bf-8dd1-eadd9ef737eb\") "
Jul 28 02:10:08.354809 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:08.354718    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81df2652-7265-45bf-8dd1-eadd9ef737eb-credential-socket\") pod \"81df2652-7265-45bf-8dd1-eadd9ef737eb\" (UID: \"81df2652-7265-45bf-8dd1-eadd9ef737eb\") "
Jul 28 02:10:08.354809 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:08.354748    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81df2652-7265-45bf-8dd1-eadd9ef737eb-istiod-ca-cert\") pod \"81df2652-7265-45bf-8dd1-eadd9ef737eb\" (UID: \"81df2652-7265-45bf-8dd1-eadd9ef737eb\") "
Jul 28 02:10:08.354809 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:08.354780    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81df2652-7265-45bf-8dd1-eadd9ef737eb-istio-token\") pod \"81df2652-7265-45bf-8dd1-eadd9ef737eb\" (UID: \"81df2652-7265-45bf-8dd1-eadd9ef737eb\") "
Jul 28 02:10:08.354960 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:08.354932    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81df2652-7265-45bf-8dd1-eadd9ef737eb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "81df2652-7265-45bf-8dd1-eadd9ef737eb" (UID: "81df2652-7265-45bf-8dd1-eadd9ef737eb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:10:08.355032 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:08.354955    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81df2652-7265-45bf-8dd1-eadd9ef737eb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "81df2652-7265-45bf-8dd1-eadd9ef737eb" (UID: "81df2652-7265-45bf-8dd1-eadd9ef737eb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:10:08.355161 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:08.355142    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81df2652-7265-45bf-8dd1-eadd9ef737eb-workload-certs\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 02:10:08.355223 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:08.355154    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81df2652-7265-45bf-8dd1-eadd9ef737eb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "81df2652-7265-45bf-8dd1-eadd9ef737eb" (UID: "81df2652-7265-45bf-8dd1-eadd9ef737eb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:10:08.355223 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:08.355165    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81df2652-7265-45bf-8dd1-eadd9ef737eb-credential-socket\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 02:10:08.355457 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:08.355436    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81df2652-7265-45bf-8dd1-eadd9ef737eb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "81df2652-7265-45bf-8dd1-eadd9ef737eb" (UID: "81df2652-7265-45bf-8dd1-eadd9ef737eb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 02:10:08.355529 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:08.355481    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81df2652-7265-45bf-8dd1-eadd9ef737eb-istio-data" (OuterVolumeSpecName: "istio-data") pod "81df2652-7265-45bf-8dd1-eadd9ef737eb" (UID: "81df2652-7265-45bf-8dd1-eadd9ef737eb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:10:08.356787 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:08.356761    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81df2652-7265-45bf-8dd1-eadd9ef737eb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "81df2652-7265-45bf-8dd1-eadd9ef737eb" (UID: "81df2652-7265-45bf-8dd1-eadd9ef737eb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:10:08.356787 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:08.356776    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/81df2652-7265-45bf-8dd1-eadd9ef737eb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "81df2652-7265-45bf-8dd1-eadd9ef737eb" (UID: "81df2652-7265-45bf-8dd1-eadd9ef737eb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 02:10:08.357119 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:08.357092    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81df2652-7265-45bf-8dd1-eadd9ef737eb-kube-api-access-nm6vz" (OuterVolumeSpecName: "kube-api-access-nm6vz") pod "81df2652-7265-45bf-8dd1-eadd9ef737eb" (UID: "81df2652-7265-45bf-8dd1-eadd9ef737eb"). InnerVolumeSpecName "kube-api-access-nm6vz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 02:10:08.357329 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:08.357180    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81df2652-7265-45bf-8dd1-eadd9ef737eb-istio-token" (OuterVolumeSpecName: "istio-token") pod "81df2652-7265-45bf-8dd1-eadd9ef737eb" (UID: "81df2652-7265-45bf-8dd1-eadd9ef737eb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 02:10:08.455990 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:08.455954    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81df2652-7265-45bf-8dd1-eadd9ef737eb-istio-envoy\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 02:10:08.455990 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:08.455982    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81df2652-7265-45bf-8dd1-eadd9ef737eb-workload-socket\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 02:10:08.455990 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:08.455991    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81df2652-7265-45bf-8dd1-eadd9ef737eb-istiod-ca-cert\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 02:10:08.455990 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:08.455999    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81df2652-7265-45bf-8dd1-eadd9ef737eb-istio-token\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 02:10:08.456253 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:08.456007    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81df2652-7265-45bf-8dd1-eadd9ef737eb-istio-podinfo\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 02:10:08.456253 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:08.456014    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81df2652-7265-45bf-8dd1-eadd9ef737eb-istio-data\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 02:10:08.456253 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:08.456023    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nm6vz\" (UniqueName: \"kubernetes.io/projected/81df2652-7265-45bf-8dd1-eadd9ef737eb-kube-api-access-nm6vz\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 28 02:10:08.653244 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:08.653212    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2"]
Jul 28 02:10:08.656393 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:08.656367    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-dfed9b-openshift-default-7d5c695688-x7wk2"]
Jul 28 02:10:10.013509 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:10.013477    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81df2652-7265-45bf-8dd1-eadd9ef737eb" path="/var/lib/kubelet/pods/81df2652-7265-45bf-8dd1-eadd9ef737eb/volumes"
Jul 28 02:10:13.845757 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:13.845722    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-de398f-29753400-crwg4"]
Jul 28 02:10:13.850119 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:13.850093    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-de398f-29753400-crwg4"]
Jul 28 02:10:14.013202 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:14.013158    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da173d3c-6453-4b0c-8c43-93ba5ca2c421" path="/var/lib/kubelet/pods/da173d3c-6453-4b0c-8c43-93ba5ca2c421/volumes"
Jul 28 02:10:18.462543 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:18.462504    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-de398f-hm4gg"]
Jul 28 02:10:18.464477 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:18.464453    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-de398f-hm4gg"]
Jul 28 02:10:20.018664 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:20.018631    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12fd246f-de8e-4a92-8292-8b1bb28a73e0" path="/var/lib/kubelet/pods/12fd246f-de8e-4a92-8292-8b1bb28a73e0/volumes"
Jul 28 02:10:30.487756 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:30.487719    2562 scope.go:117] "RemoveContainer" containerID="6630b42d2cf81abc6dbcd83bf9f6ef8a07035fe36aaee467cd82ae24a3fb13fd"
Jul 28 02:10:30.496250 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:30.496227    2562 scope.go:117] "RemoveContainer" containerID="e86a120eea8055ae899edf13f0964a78681feb2ef591809becba8244e6aa935f"
Jul 28 02:10:31.265661 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:31.265622    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-fwgkq_ec2ef917-0f37-45fb-abf6-34b159a17fd7/manager/0.log"
Jul 28 02:10:31.380109 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:31.380075    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-xwr9q_75fb6ceb-add9-4486-a051-8ccfdd160483/manager/0.log"
Jul 28 02:10:31.499421 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:31.499386    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6864dfc7bf-p4fs6_f5328829-095e-41f8-ad63-836a13eab112/manager/0.log"
Jul 28 02:10:31.611227 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:31.611204    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-4jlg7_d509438d-c187-4bfb-ba75-e852edfbdb51/server/0.log"
Jul 28 02:10:31.727504 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:31.727471    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-sbt5v_df40053d-df05-4109-b47b-be7f11bf16a6/manager/0.log"
Jul 28 02:10:32.092276 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:32.092197    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8699bb9d7c-sdhrk_4385af7d-5257-4f5b-b0fc-e9d1f4ba547a/copy-manifests/0.log"
Jul 28 02:10:32.098164 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:32.098143    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8699bb9d7c-sdhrk_4385af7d-5257-4f5b-b0fc-e9d1f4ba547a/manager/0.log"
Jul 28 02:10:32.440083 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:32.440055    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-77bdc77655-2vpcx_b688ae60-adfe-45ae-b342-59f0ca4a7fb3/maas-api/0.log"
Jul 28 02:10:32.555825 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:32.555799    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29753370-rcjdx_cc498128-ebf5-4f5c-b25a-aa3a8a93e14d/cleanup/0.log"
Jul 28 02:10:32.775409 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:32.775325    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29753400-2jggc_e8a36e7c-424a-4186-b187-693b0ec67c4e/cleanup/0.log"
Jul 28 02:10:32.886957 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:32.886932    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-9xwbt_0b1c48a3-c13d-4940-8ba2-694c3bf0183a/postgres/0.log"
Jul 28 02:10:34.305340 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:34.305309    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-skwf2_e6cce1ca-4f45-4f4b-8ad8-684eaf865ea7/manager/0.log"
Jul 28 02:10:34.427594 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:34.427552    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-7ffrv_fcfa3b03-06a0-46c8-8351-f7d8378bd6e2/manager/0.log"
Jul 28 02:10:34.658818 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:34.658789    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-shg77_0947867b-744e-4b5a-b609-a7836b07d8af/registry-server/0.log"
Jul 28 02:10:34.787740 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:34.787711    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-wkkd5_8021dcd0-7bad-43c8-b2e2-eeac6f391afc/manager/0.log"
Jul 28 02:10:35.713313 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:35.713280    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-78d7d88cc5-rhkkf_2d033810-cbde-44be-a6f8-6dab6a46240a/kube-auth-proxy/0.log"
Jul 28 02:10:35.823040 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:35.823006    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-6lq2h_59e683f8-4134-4f09-aa4d-4159d59ca05b/istio-proxy/1.log"
Jul 28 02:10:35.934954 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:35.934922    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-xmrps_584f45b4-49b5-4983-a997-ea1fff7770a7/payload-pre-processing/0.log"
Jul 28 02:10:36.157124 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:36.157087    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6767b674f-cvttp_09603ca6-faf1-449e-b871-a9fe15fd6411/router/0.log"
Jul 28 02:10:36.718829 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:36.718799    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-9gbw8_6962dfd3-d154-4410-81f0-7ba7618a74dc/main/0.log"
Jul 28 02:10:36.829179 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:36.829148    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6clxc_e4826561-4c9d-4e49-8cca-1edeb9733324/main/0.log"
Jul 28 02:10:42.176343 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:42.176304    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wvjdf/must-gather-fzttt"]
Jul 28 02:10:42.176921 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:42.176899    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81df2652-7265-45bf-8dd1-eadd9ef737eb" containerName="istio-proxy"
Jul 28 02:10:42.177007 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:42.176923    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="81df2652-7265-45bf-8dd1-eadd9ef737eb" containerName="istio-proxy"
Jul 28 02:10:42.177007 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:42.176943    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12fd246f-de8e-4a92-8292-8b1bb28a73e0" containerName="revoke-keys"
Jul 28 02:10:42.177007 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:42.176952    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="12fd246f-de8e-4a92-8292-8b1bb28a73e0" containerName="revoke-keys"
Jul 28 02:10:42.177168 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:42.177062    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="12fd246f-de8e-4a92-8292-8b1bb28a73e0" containerName="revoke-keys"
Jul 28 02:10:42.177168 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:42.177078    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="81df2652-7265-45bf-8dd1-eadd9ef737eb" containerName="istio-proxy"
Jul 28 02:10:42.177168 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:42.177088    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="81df2652-7265-45bf-8dd1-eadd9ef737eb" containerName="istio-proxy"
Jul 28 02:10:42.177322 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:42.177177    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81df2652-7265-45bf-8dd1-eadd9ef737eb" containerName="istio-proxy"
Jul 28 02:10:42.177322 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:42.177188    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="81df2652-7265-45bf-8dd1-eadd9ef737eb" containerName="istio-proxy"
Jul 28 02:10:42.181686 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:42.181664    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wvjdf/must-gather-fzttt"
Jul 28 02:10:42.184001 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:42.183976    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wvjdf\"/\"default-dockercfg-njkfq\""
Jul 28 02:10:42.184130 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:42.184107    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wvjdf\"/\"openshift-service-ca.crt\""
Jul 28 02:10:42.184404 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:42.184387    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wvjdf\"/\"kube-root-ca.crt\""
Jul 28 02:10:42.194655 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:42.194629    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wvjdf/must-gather-fzttt"]
Jul 28 02:10:42.260226 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:42.260183    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcs2t\" (UniqueName: \"kubernetes.io/projected/a1357d49-da8e-429c-97ec-4aff0704ce9f-kube-api-access-pcs2t\") pod \"must-gather-fzttt\" (UID: \"a1357d49-da8e-429c-97ec-4aff0704ce9f\") " pod="openshift-must-gather-wvjdf/must-gather-fzttt"
Jul 28 02:10:42.260226 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:42.260227    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a1357d49-da8e-429c-97ec-4aff0704ce9f-must-gather-output\") pod \"must-gather-fzttt\" (UID: \"a1357d49-da8e-429c-97ec-4aff0704ce9f\") " pod="openshift-must-gather-wvjdf/must-gather-fzttt"
Jul 28 02:10:42.360621 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:42.360580    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a1357d49-da8e-429c-97ec-4aff0704ce9f-must-gather-output\") pod \"must-gather-fzttt\" (UID: \"a1357d49-da8e-429c-97ec-4aff0704ce9f\") " pod="openshift-must-gather-wvjdf/must-gather-fzttt"
Jul 28 02:10:42.360793 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:42.360703    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcs2t\" (UniqueName: \"kubernetes.io/projected/a1357d49-da8e-429c-97ec-4aff0704ce9f-kube-api-access-pcs2t\") pod \"must-gather-fzttt\" (UID: \"a1357d49-da8e-429c-97ec-4aff0704ce9f\") " pod="openshift-must-gather-wvjdf/must-gather-fzttt"
Jul 28 02:10:42.361000 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:42.360980    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a1357d49-da8e-429c-97ec-4aff0704ce9f-must-gather-output\") pod \"must-gather-fzttt\" (UID: \"a1357d49-da8e-429c-97ec-4aff0704ce9f\") " pod="openshift-must-gather-wvjdf/must-gather-fzttt"
Jul 28 02:10:42.368132 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:42.368106    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcs2t\" (UniqueName: \"kubernetes.io/projected/a1357d49-da8e-429c-97ec-4aff0704ce9f-kube-api-access-pcs2t\") pod \"must-gather-fzttt\" (UID: \"a1357d49-da8e-429c-97ec-4aff0704ce9f\") " pod="openshift-must-gather-wvjdf/must-gather-fzttt"
Jul 28 02:10:42.491091 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:42.490999    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wvjdf/must-gather-fzttt"
Jul 28 02:10:42.631525 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:42.631492    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wvjdf/must-gather-fzttt"]
Jul 28 02:10:42.635293 ip-10-0-134-165 kubenswrapper[2562]: W0728 02:10:42.635263    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda1357d49_da8e_429c_97ec_4aff0704ce9f.slice/crio-f43674b9238919bae2c7957a15976115de38bf1b0ee6629ac4a97cacc3a7c37b WatchSource:0}: Error finding container f43674b9238919bae2c7957a15976115de38bf1b0ee6629ac4a97cacc3a7c37b: Status 404 returned error can't find the container with id f43674b9238919bae2c7957a15976115de38bf1b0ee6629ac4a97cacc3a7c37b
Jul 28 02:10:42.637602 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:42.637587    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 02:10:43.529996 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:43.529957    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wvjdf/must-gather-fzttt" event={"ID":"a1357d49-da8e-429c-97ec-4aff0704ce9f","Type":"ContainerStarted","Data":"7989a5bb1cdb4cf70ce97f735f9247bd51a769909da6d3c7ccbae735f3a64b7e"}
Jul 28 02:10:43.530361 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:43.530015    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wvjdf/must-gather-fzttt" event={"ID":"a1357d49-da8e-429c-97ec-4aff0704ce9f","Type":"ContainerStarted","Data":"f43674b9238919bae2c7957a15976115de38bf1b0ee6629ac4a97cacc3a7c37b"}
Jul 28 02:10:44.538061 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:44.538026    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wvjdf/must-gather-fzttt" event={"ID":"a1357d49-da8e-429c-97ec-4aff0704ce9f","Type":"ContainerStarted","Data":"4d5c934779771e9f53b1890689ee2bd408d331505dcbe72b9e8993ccc1ceec6c"}
Jul 28 02:10:44.554764 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:44.554709    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wvjdf/must-gather-fzttt" podStartSLOduration=1.863333408 podStartE2EDuration="2.55469094s" totalImagesPullingTime="691.357532ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 02:10:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 02:10:44.55319 +0000 UTC m=+3315.056951314" watchObservedRunningTime="2026-07-28 02:10:44.55469094 +0000 UTC m=+3315.058452254"
Jul 28 02:10:44.961180 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:44.961137    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xvdx4_c7994abb-0ef2-4c9c-8a5c-ce46fb1da68d/global-pull-secret-syncer/0.log"
Jul 28 02:10:45.053060 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:45.053029    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vdcp5_43162e49-7fbb-42a7-9041-00ac2fbcd96d/konnectivity-agent/0.log"
Jul 28 02:10:45.184363 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:45.184334    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-165.ec2.internal_03bf1d8f9ce5d5c18bbead8a350817c2/haproxy/0.log"
Jul 28 02:10:50.222774 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:50.222736    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-skwf2_e6cce1ca-4f45-4f4b-8ad8-684eaf865ea7/manager/0.log"
Jul 28 02:10:50.249170 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:50.249132    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-7ffrv_fcfa3b03-06a0-46c8-8351-f7d8378bd6e2/manager/0.log"
Jul 28 02:10:50.327985 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:50.327951    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-shg77_0947867b-744e-4b5a-b609-a7836b07d8af/registry-server/0.log"
Jul 28 02:10:50.485246 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:50.485152    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-wkkd5_8021dcd0-7bad-43c8-b2e2-eeac6f391afc/manager/0.log"
Jul 28 02:10:52.341226 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:52.341179    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-sdkzl_e47369d7-9c2f-44a0-a162-205a9cdea9ad/cluster-monitoring-operator/0.log"
Jul 28 02:10:52.544256 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:52.544227    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2bdv4_65a1a259-27df-49c4-a300-4c21df5ae6c2/node-exporter/0.log"
Jul 28 02:10:52.568828 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:52.568750    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2bdv4_65a1a259-27df-49c4-a300-4c21df5ae6c2/kube-rbac-proxy/0.log"
Jul 28 02:10:52.596135 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:52.596110    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2bdv4_65a1a259-27df-49c4-a300-4c21df5ae6c2/init-textfile/0.log"
Jul 28 02:10:54.527956 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:54.527922    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-lztg6_acfd3678-0809-4d22-b8bf-16e381d8dbb6/networking-console-plugin/0.log"
Jul 28 02:10:54.964091 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:54.964052    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wvjdf/perf-node-gather-daemonset-n99dp"]
Jul 28 02:10:54.970287 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:54.970252    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wvjdf/perf-node-gather-daemonset-n99dp"
Jul 28 02:10:54.977703 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:54.977667    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wvjdf/perf-node-gather-daemonset-n99dp"]
Jul 28 02:10:54.990435 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:54.990398    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5plk\" (UniqueName: \"kubernetes.io/projected/654c10f7-92f9-4f4d-99e4-0e301ad7edcf-kube-api-access-d5plk\") pod \"perf-node-gather-daemonset-n99dp\" (UID: \"654c10f7-92f9-4f4d-99e4-0e301ad7edcf\") " pod="openshift-must-gather-wvjdf/perf-node-gather-daemonset-n99dp"
Jul 28 02:10:54.990610 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:54.990488    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/654c10f7-92f9-4f4d-99e4-0e301ad7edcf-lib-modules\") pod \"perf-node-gather-daemonset-n99dp\" (UID: \"654c10f7-92f9-4f4d-99e4-0e301ad7edcf\") " pod="openshift-must-gather-wvjdf/perf-node-gather-daemonset-n99dp"
Jul 28 02:10:54.990610 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:54.990582    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/654c10f7-92f9-4f4d-99e4-0e301ad7edcf-podres\") pod \"perf-node-gather-daemonset-n99dp\" (UID: \"654c10f7-92f9-4f4d-99e4-0e301ad7edcf\") " pod="openshift-must-gather-wvjdf/perf-node-gather-daemonset-n99dp"
Jul 28 02:10:54.990610 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:54.990609    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/654c10f7-92f9-4f4d-99e4-0e301ad7edcf-proc\") pod \"perf-node-gather-daemonset-n99dp\" (UID: \"654c10f7-92f9-4f4d-99e4-0e301ad7edcf\") " pod="openshift-must-gather-wvjdf/perf-node-gather-daemonset-n99dp"
Jul 28 02:10:54.990796 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:54.990710    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/654c10f7-92f9-4f4d-99e4-0e301ad7edcf-sys\") pod \"perf-node-gather-daemonset-n99dp\" (UID: \"654c10f7-92f9-4f4d-99e4-0e301ad7edcf\") " pod="openshift-must-gather-wvjdf/perf-node-gather-daemonset-n99dp"
Jul 28 02:10:55.092189 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:55.092139    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/654c10f7-92f9-4f4d-99e4-0e301ad7edcf-sys\") pod \"perf-node-gather-daemonset-n99dp\" (UID: \"654c10f7-92f9-4f4d-99e4-0e301ad7edcf\") " pod="openshift-must-gather-wvjdf/perf-node-gather-daemonset-n99dp"
Jul 28 02:10:55.092390 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:55.092277    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5plk\" (UniqueName: \"kubernetes.io/projected/654c10f7-92f9-4f4d-99e4-0e301ad7edcf-kube-api-access-d5plk\") pod \"perf-node-gather-daemonset-n99dp\" (UID: \"654c10f7-92f9-4f4d-99e4-0e301ad7edcf\") " pod="openshift-must-gather-wvjdf/perf-node-gather-daemonset-n99dp"
Jul 28 02:10:55.092390 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:55.092321    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/654c10f7-92f9-4f4d-99e4-0e301ad7edcf-lib-modules\") pod \"perf-node-gather-daemonset-n99dp\" (UID: \"654c10f7-92f9-4f4d-99e4-0e301ad7edcf\") " pod="openshift-must-gather-wvjdf/perf-node-gather-daemonset-n99dp"
Jul 28 02:10:55.092390 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:55.092363    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/654c10f7-92f9-4f4d-99e4-0e301ad7edcf-podres\") pod \"perf-node-gather-daemonset-n99dp\" (UID: \"654c10f7-92f9-4f4d-99e4-0e301ad7edcf\") " pod="openshift-must-gather-wvjdf/perf-node-gather-daemonset-n99dp"
Jul 28 02:10:55.092390 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:55.092386    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/654c10f7-92f9-4f4d-99e4-0e301ad7edcf-proc\") pod \"perf-node-gather-daemonset-n99dp\" (UID: \"654c10f7-92f9-4f4d-99e4-0e301ad7edcf\") " pod="openshift-must-gather-wvjdf/perf-node-gather-daemonset-n99dp"
Jul 28 02:10:55.092646 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:55.092495    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/654c10f7-92f9-4f4d-99e4-0e301ad7edcf-proc\") pod \"perf-node-gather-daemonset-n99dp\" (UID: \"654c10f7-92f9-4f4d-99e4-0e301ad7edcf\") " pod="openshift-must-gather-wvjdf/perf-node-gather-daemonset-n99dp"
Jul 28 02:10:55.092646 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:55.092551    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/654c10f7-92f9-4f4d-99e4-0e301ad7edcf-sys\") pod \"perf-node-gather-daemonset-n99dp\" (UID: \"654c10f7-92f9-4f4d-99e4-0e301ad7edcf\") " pod="openshift-must-gather-wvjdf/perf-node-gather-daemonset-n99dp"
Jul 28 02:10:55.093038 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:55.092951    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/654c10f7-92f9-4f4d-99e4-0e301ad7edcf-lib-modules\") pod \"perf-node-gather-daemonset-n99dp\" (UID: \"654c10f7-92f9-4f4d-99e4-0e301ad7edcf\") " pod="openshift-must-gather-wvjdf/perf-node-gather-daemonset-n99dp"
Jul 28 02:10:55.093038 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:55.092967    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/654c10f7-92f9-4f4d-99e4-0e301ad7edcf-podres\") pod \"perf-node-gather-daemonset-n99dp\" (UID: \"654c10f7-92f9-4f4d-99e4-0e301ad7edcf\") " pod="openshift-must-gather-wvjdf/perf-node-gather-daemonset-n99dp"
Jul 28 02:10:55.101860 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:55.101828    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5plk\" (UniqueName: \"kubernetes.io/projected/654c10f7-92f9-4f4d-99e4-0e301ad7edcf-kube-api-access-d5plk\") pod \"perf-node-gather-daemonset-n99dp\" (UID: \"654c10f7-92f9-4f4d-99e4-0e301ad7edcf\") " pod="openshift-must-gather-wvjdf/perf-node-gather-daemonset-n99dp"
Jul 28 02:10:55.285128 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:55.284794    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wvjdf/perf-node-gather-daemonset-n99dp"
Jul 28 02:10:55.482884 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:55.482834    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wvjdf/perf-node-gather-daemonset-n99dp"]
Jul 28 02:10:55.631430 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:55.631395    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wvjdf/perf-node-gather-daemonset-n99dp" event={"ID":"654c10f7-92f9-4f4d-99e4-0e301ad7edcf","Type":"ContainerStarted","Data":"0768a7cea357e65699ead0ff0ad0c05c1b0f04e308a4cb26f5451e12dae96152"}
Jul 28 02:10:56.411131 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:56.411099    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-bkmjd_14a474d7-483d-4aab-8115-37636c73d0fe/volume-data-source-validator/0.log"
Jul 28 02:10:56.643403 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:56.643356    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wvjdf/perf-node-gather-daemonset-n99dp" event={"ID":"654c10f7-92f9-4f4d-99e4-0e301ad7edcf","Type":"ContainerStarted","Data":"f6a0f088e73d34ab0eb232a72ef0960da283d92f0038bb4082ff610929bdef84"}
Jul 28 02:10:56.643949 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:56.643925    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wvjdf/perf-node-gather-daemonset-n99dp"
Jul 28 02:10:56.659641 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:56.659550    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wvjdf/perf-node-gather-daemonset-n99dp" podStartSLOduration=2.659532157 podStartE2EDuration="2.659532157s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 02:10:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 02:10:56.658828341 +0000 UTC m=+3327.162589655" watchObservedRunningTime="2026-07-28 02:10:56.659532157 +0000 UTC m=+3327.163293471"
Jul 28 02:10:57.440700 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:57.440668    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-46gx9_adf1e90a-9fdd-438a-857d-6a271dfd94c5/dns/0.log"
Jul 28 02:10:57.475397 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:57.475371    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-46gx9_adf1e90a-9fdd-438a-857d-6a271dfd94c5/kube-rbac-proxy/0.log"
Jul 28 02:10:57.616081 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:57.616050    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-grq5v_4ce4a74c-58bc-476f-ba50-fe5e53e2fc84/dns-node-resolver/0.log"
Jul 28 02:10:58.268173 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:58.268144    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8r6nb_9e6d77bc-6fb4-4f91-bb89-084a03ee29df/node-ca/0.log"
Jul 28 02:10:59.616152 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:59.616119    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-78d7d88cc5-rhkkf_2d033810-cbde-44be-a6f8-6dab6a46240a/kube-auth-proxy/0.log"
Jul 28 02:10:59.651756 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:59.651728    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-6lq2h_59e683f8-4134-4f09-aa4d-4159d59ca05b/istio-proxy/0.log"
Jul 28 02:10:59.689486 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:59.689460    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-6lq2h_59e683f8-4134-4f09-aa4d-4159d59ca05b/istio-proxy/1.log"
Jul 28 02:10:59.728505 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:59.728477    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-xmrps_584f45b4-49b5-4983-a997-ea1fff7770a7/payload-pre-processing/0.log"
Jul 28 02:10:59.781352 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:10:59.781319    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6767b674f-cvttp_09603ca6-faf1-449e-b871-a9fe15fd6411/router/0.log"
Jul 28 02:11:00.619794 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:11:00.619761    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d4xnz_d010bf4e-4f54-4204-b1f3-8813b3a4a1de/serve-healthcheck-canary/0.log"
Jul 28 02:11:01.129013 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:11:01.128986    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-dcb5f_889bce92-e710-4e62-8b8f-e2d78a8489a8/insights-operator/0.log"
Jul 28 02:11:01.237603 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:11:01.237553    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v6mhz_872fcfeb-a64a-4749-b65c-89d38987befa/kube-rbac-proxy/0.log"
Jul 28 02:11:01.261406 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:11:01.261380    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v6mhz_872fcfeb-a64a-4749-b65c-89d38987befa/exporter/0.log"
Jul 28 02:11:01.284964 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:11:01.284915    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v6mhz_872fcfeb-a64a-4749-b65c-89d38987befa/extractor/0.log"
Jul 28 02:11:02.661039 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:11:02.661009    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wvjdf/perf-node-gather-daemonset-n99dp"
Jul 28 02:11:03.560522 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:11:03.560472    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-fwgkq_ec2ef917-0f37-45fb-abf6-34b159a17fd7/manager/0.log"
Jul 28 02:11:03.839345 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:11:03.839266    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-xwr9q_75fb6ceb-add9-4486-a051-8ccfdd160483/manager/0.log"
Jul 28 02:11:04.086855 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:11:04.086811    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6864dfc7bf-p4fs6_f5328829-095e-41f8-ad63-836a13eab112/manager/0.log"
Jul 28 02:11:04.108164 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:11:04.108137    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-4jlg7_d509438d-c187-4bfb-ba75-e852edfbdb51/server/0.log"
Jul 28 02:11:04.212216 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:11:04.212185    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-sbt5v_df40053d-df05-4109-b47b-be7f11bf16a6/manager/0.log"
Jul 28 02:11:04.460371 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:11:04.460345    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8699bb9d7c-sdhrk_4385af7d-5257-4f5b-b0fc-e9d1f4ba547a/manager/0.log"
Jul 28 02:11:04.485698 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:11:04.485608    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8699bb9d7c-sdhrk_4385af7d-5257-4f5b-b0fc-e9d1f4ba547a/copy-manifests/0.log"
Jul 28 02:11:05.624052 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:11:05.624025    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-78d7d88cc5-rhkkf_2d033810-cbde-44be-a6f8-6dab6a46240a/kube-auth-proxy/0.log"
Jul 28 02:11:05.644545 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:11:05.644515    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-6lq2h_59e683f8-4134-4f09-aa4d-4159d59ca05b/istio-proxy/0.log"
Jul 28 02:11:05.679089 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:11:05.679055    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-6lq2h_59e683f8-4134-4f09-aa4d-4159d59ca05b/istio-proxy/1.log"
Jul 28 02:11:05.703447 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:11:05.703409    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-xmrps_584f45b4-49b5-4983-a997-ea1fff7770a7/payload-pre-processing/0.log"
Jul 28 02:11:05.742524 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:11:05.742500    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6767b674f-cvttp_09603ca6-faf1-449e-b871-a9fe15fd6411/router/0.log"
Jul 28 02:11:07.446383 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:11:07.446355    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-78d7d88cc5-rhkkf_2d033810-cbde-44be-a6f8-6dab6a46240a/kube-auth-proxy/0.log"
Jul 28 02:11:07.468149 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:11:07.468116    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-6lq2h_59e683f8-4134-4f09-aa4d-4159d59ca05b/istio-proxy/0.log"
Jul 28 02:11:07.505904 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:11:07.505872    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-6lq2h_59e683f8-4134-4f09-aa4d-4159d59ca05b/istio-proxy/1.log"
Jul 28 02:11:07.538545 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:11:07.538513    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-xmrps_584f45b4-49b5-4983-a997-ea1fff7770a7/payload-pre-processing/0.log"
Jul 28 02:11:07.576412 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:11:07.576385    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6767b674f-cvttp_09603ca6-faf1-449e-b871-a9fe15fd6411/router/0.log"
Jul 28 02:11:10.844067 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:11:10.844038    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-268qq_a56d4b0f-b38b-4606-b203-75dc17bf3086/migrator/0.log"
Jul 28 02:11:10.866376 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:11:10.866344    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-268qq_a56d4b0f-b38b-4606-b203-75dc17bf3086/graceful-termination/0.log"
Jul 28 02:11:11.220320 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:11:11.220288    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-7nlbl_fdc9c853-3bbb-4e92-8d4f-960c02d7a125/kube-storage-version-migrator-operator/1.log"
Jul 28 02:11:11.221148 ip-10-0-134-165 kubenswrapper[2562]: I0728 02:11:11.221128    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-7nlbl_fdc9c853-3bbb-4e92-8d4f-960c02d7a125/kube-storage-version-migrator-operator/0.log"