Jul 09 00:53:09.935295 ip-10-0-133-31 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 09 00:53:09.935306 ip-10-0-133-31 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 09 00:53:09.935313 ip-10-0-133-31 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 09 00:53:09.935532 ip-10-0-133-31 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 09 00:53:20.081906 ip-10-0-133-31 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 09 00:53:20.081920 ip-10-0-133-31 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 981e008f9ce0467f860697e660145747 --
Jul 09 00:54:52.399501 ip-10-0-133-31 systemd[1]: Starting Kubernetes Kubelet...
Jul 09 00:54:52.920087 ip-10-0-133-31 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 00:54:52.920087 ip-10-0-133-31 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 09 00:54:52.920087 ip-10-0-133-31 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 00:54:52.920087 ip-10-0-133-31 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 09 00:54:52.920087 ip-10-0-133-31 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 00:54:52.920087 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.851875    2557 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 09 00:54:52.920087 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859002    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 00:54:52.920087 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859017    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 00:54:52.920087 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859020    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 00:54:52.920087 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859023    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 00:54:52.920087 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859026    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 00:54:52.920087 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859030    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 00:54:52.920087 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859033    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 00:54:52.920087 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859036    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 00:54:52.922166 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859041    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 00:54:52.922166 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859044    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 00:54:52.922166 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859047    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 00:54:52.922166 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859050    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 00:54:52.922166 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859053    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 00:54:52.922166 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859056    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 00:54:52.922166 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859059    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 00:54:52.922166 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859061    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 00:54:52.922166 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859065    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 00:54:52.922166 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859068    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 00:54:52.922166 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859071    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 00:54:52.922166 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859073    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 00:54:52.922166 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859077    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 00:54:52.922166 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859081    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 00:54:52.922166 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859084    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 00:54:52.922166 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859086    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 00:54:52.922166 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859089    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 00:54:52.922166 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859092    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 00:54:52.922166 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859094    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 00:54:52.922166 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859097    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 00:54:52.924540 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859100    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 00:54:52.924540 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859102    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 00:54:52.924540 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859107    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 00:54:52.924540 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859110    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 00:54:52.924540 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859113    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 00:54:52.924540 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859116    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 00:54:52.924540 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859119    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 00:54:52.924540 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859121    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 00:54:52.924540 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859124    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 00:54:52.924540 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859126    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 00:54:52.924540 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859129    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 00:54:52.924540 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859132    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 00:54:52.924540 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859134    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 00:54:52.924540 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859137    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 00:54:52.924540 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859140    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 00:54:52.924540 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859143    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 00:54:52.924540 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859145    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 00:54:52.924540 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859148    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 00:54:52.924540 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859150    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 00:54:52.926268 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859153    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 00:54:52.926268 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859156    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 00:54:52.926268 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859159    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 00:54:52.926268 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859162    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 00:54:52.926268 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859164    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 00:54:52.926268 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859168    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 00:54:52.926268 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859173    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 00:54:52.926268 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859176    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 00:54:52.926268 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859180    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 00:54:52.926268 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859182    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 00:54:52.926268 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859185    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 00:54:52.926268 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859188    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 00:54:52.926268 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859190    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 00:54:52.926268 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859194    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 00:54:52.926268 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859196    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 00:54:52.926268 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859199    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 00:54:52.926268 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859201    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 00:54:52.926268 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859204    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 00:54:52.926268 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859219    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 00:54:52.926268 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859222    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 00:54:52.928384 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859224    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 00:54:52.928384 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859227    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 00:54:52.928384 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859230    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 00:54:52.928384 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859233    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 00:54:52.928384 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859235    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 00:54:52.928384 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859238    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 00:54:52.928384 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859240    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 00:54:52.928384 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859243    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 00:54:52.928384 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859245    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 00:54:52.928384 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859247    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 00:54:52.928384 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859250    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 00:54:52.928384 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859254    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 00:54:52.928384 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859258    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 00:54:52.928384 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859261    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 00:54:52.928384 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859264    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 00:54:52.928384 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859266    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 00:54:52.928384 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859269    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 00:54:52.928384 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859271    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 00:54:52.928384 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859274    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 00:54:52.930296 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859277    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 00:54:52.930296 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859280    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 00:54:52.930296 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859283    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 00:54:52.930296 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859285    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 00:54:52.930296 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859288    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 00:54:52.930296 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859290    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 00:54:52.930296 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859293    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 00:54:52.930296 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859295    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 00:54:52.930296 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859298    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 00:54:52.930296 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859300    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 00:54:52.930296 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859303    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 00:54:52.930296 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859305    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 00:54:52.930296 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.859307    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 00:54:52.930296 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860051    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 00:54:52.930296 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860058    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 00:54:52.930296 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860062    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 00:54:52.930296 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860064    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 00:54:52.930296 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860067    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 00:54:52.930296 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860070    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 00:54:52.932875 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860072    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 00:54:52.932875 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860075    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 00:54:52.932875 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860078    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 00:54:52.932875 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860081    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 00:54:52.932875 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860083    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 00:54:52.932875 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860088    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 00:54:52.932875 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860093    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 00:54:52.932875 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860096    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 00:54:52.932875 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860099    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 00:54:52.932875 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860102    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 00:54:52.932875 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860105    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 00:54:52.932875 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860107    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 00:54:52.932875 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860111    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 00:54:52.932875 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860114    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 00:54:52.932875 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860118    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 00:54:52.932875 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860121    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 00:54:52.932875 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860124    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 00:54:52.932875 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860127    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 00:54:52.932875 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860131    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 00:54:52.934904 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860135    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 00:54:52.934904 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860138    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 00:54:52.934904 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860141    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 00:54:52.934904 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860144    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 00:54:52.934904 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860147    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 00:54:52.934904 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860150    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 00:54:52.934904 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860153    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 00:54:52.934904 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860156    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 00:54:52.934904 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860161    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 00:54:52.934904 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860164    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 00:54:52.934904 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860167    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 00:54:52.934904 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860169    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 00:54:52.934904 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860172    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 00:54:52.934904 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860175    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 00:54:52.934904 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860177    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 00:54:52.934904 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860180    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 00:54:52.934904 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860183    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 00:54:52.934904 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860185    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 00:54:52.934904 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860188    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 00:54:52.934904 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860190    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 00:54:52.937245 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860193    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 00:54:52.937245 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860195    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 00:54:52.937245 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860198    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 00:54:52.937245 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860200    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 00:54:52.937245 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860203    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 00:54:52.937245 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860221    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 00:54:52.937245 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860225    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 00:54:52.937245 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860228    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 00:54:52.937245 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860231    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 00:54:52.937245 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860234    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 00:54:52.937245 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860237    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 00:54:52.937245 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860240    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 00:54:52.937245 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860242    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 00:54:52.937245 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860245    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 00:54:52.937245 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860247    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 00:54:52.937245 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860250    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 00:54:52.937245 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860253    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 00:54:52.937245 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860256    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 00:54:52.937245 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860258    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 00:54:52.939043 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860261    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 00:54:52.939043 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860264    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 00:54:52.939043 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860266    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 00:54:52.939043 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860269    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 00:54:52.939043 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860271    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 00:54:52.939043 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860274    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 00:54:52.939043 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860276    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 00:54:52.939043 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860278    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 00:54:52.939043 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860281    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 00:54:52.939043 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860283    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 00:54:52.939043 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860286    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 00:54:52.939043 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860288    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 00:54:52.939043 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860291    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 00:54:52.939043 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860293    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 00:54:52.939043 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860296    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 00:54:52.939043 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860298    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 00:54:52.939043 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860301    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 00:54:52.939043 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860304    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 00:54:52.939043 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860306    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 00:54:52.939043 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860309    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 00:54:52.941492 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860312    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 00:54:52.941492 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860314    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 00:54:52.941492 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860317    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 00:54:52.941492 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860320    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 00:54:52.941492 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860322    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 00:54:52.941492 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860325    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 00:54:52.941492 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860327    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 00:54:52.941492 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860329    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 00:54:52.941492 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860333    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 00:54:52.941492 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860335    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 00:54:52.941492 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860338    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 00:54:52.941492 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860341    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 00:54:52.941492 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860344    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 00:54:52.941492 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860346    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 00:54:52.941492 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860349    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 00:54:52.941492 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860730    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 00:54:52.941492 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860735    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 00:54:52.941492 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860737    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 00:54:52.941492 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860740    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 00:54:52.941492 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860743    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 00:54:52.943327 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860746    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 00:54:52.943327 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860748    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 00:54:52.943327 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860751    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 00:54:52.943327 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860755    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 00:54:52.943327 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860760    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 00:54:52.943327 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860763    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 00:54:52.943327 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860766    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 00:54:52.943327 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860768    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 00:54:52.943327 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860771    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 00:54:52.943327 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860773    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 00:54:52.943327 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860776    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 00:54:52.943327 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860778    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 00:54:52.943327 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860781    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 00:54:52.943327 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860783    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 00:54:52.943327 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860787    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 00:54:52.943327 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860790    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 00:54:52.943327 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860793    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 00:54:52.943327 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860795    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 00:54:52.943327 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860798    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 00:54:52.943327 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860800    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 00:54:52.946071 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860803    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 00:54:52.946071 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860805    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 00:54:52.946071 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860808    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 00:54:52.946071 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860811    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 00:54:52.946071 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860813    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 00:54:52.946071 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860816    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 00:54:52.946071 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860820    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 00:54:52.946071 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860823    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 00:54:52.946071 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860826    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 00:54:52.946071 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860829    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 00:54:52.946071 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860832    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 00:54:52.946071 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860835    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 00:54:52.946071 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860837    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 00:54:52.946071 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860840    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 00:54:52.946071 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860843    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 00:54:52.946071 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860846    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 00:54:52.946071 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860851    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 00:54:52.946071 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860854    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 00:54:52.946071 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860857    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 00:54:52.946574 ip-10-0-133-31 systemd[1]: Started Kubernetes Kubelet.
Jul 09 00:54:52.949293 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860859    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 00:54:52.949293 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860862    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 00:54:52.949293 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860865    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 00:54:52.949293 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860869    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 00:54:52.949293 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860873    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 00:54:52.949293 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860875    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 00:54:52.949293 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860878    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 00:54:52.949293 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860881    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 00:54:52.949293 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860884    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 00:54:52.949293 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860887    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 00:54:52.949293 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860890    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 00:54:52.949293 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860893    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 00:54:52.949293 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860895    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 00:54:52.949293 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860898    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 00:54:52.949293 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860901    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 00:54:52.949293 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860903    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 00:54:52.949293 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860906    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 00:54:52.949293 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860909    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 00:54:52.949293 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860912    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 00:54:52.949293 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860915    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 00:54:52.953105 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860918    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 00:54:52.953105 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860920    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 00:54:52.953105 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860923    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 00:54:52.953105 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860925    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 00:54:52.953105 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860928    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 00:54:52.953105 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860932    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 00:54:52.953105 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860935    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 00:54:52.953105 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860937    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 00:54:52.953105 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860940    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 00:54:52.953105 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860944    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 00:54:52.953105 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860947    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 00:54:52.953105 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860950    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 00:54:52.953105 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860952    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 00:54:52.953105 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860955    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 00:54:52.953105 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860958    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 00:54:52.953105 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860962    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 00:54:52.953105 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860964    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 00:54:52.953105 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860967    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 00:54:52.953105 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860969    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 00:54:52.953105 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860972    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 00:54:52.964985 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860974    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 00:54:52.964985 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860977    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 00:54:52.964985 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860980    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 00:54:52.964985 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860982    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 00:54:52.964985 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860985    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 00:54:52.964985 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860987    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 00:54:52.964985 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860990    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 00:54:52.964985 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860992    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 00:54:52.964985 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860995    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 00:54:52.964985 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.860997    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 00:54:52.964985 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861000    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 00:54:52.964985 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861002    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 00:54:52.964985 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861004    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 00:54:52.964985 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861007    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 00:54:52.964985 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861010    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 00:54:52.964985 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861086    2557 flags.go:64] FLAG: --address="0.0.0.0"
Jul 09 00:54:52.964985 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861093    2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 09 00:54:52.964985 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861099    2557 flags.go:64] FLAG: --anonymous-auth="true"
Jul 09 00:54:52.964985 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861104    2557 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 09 00:54:52.964985 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861109    2557 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 09 00:54:52.967586 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861112    2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 09 00:54:52.967586 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861118    2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 09 00:54:52.967586 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861122    2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 09 00:54:52.967586 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861125    2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 09 00:54:52.967586 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861129    2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 09 00:54:52.967586 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861132    2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 09 00:54:52.967586 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861135    2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 09 00:54:52.967586 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861140    2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 09 00:54:52.967586 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861143    2557 flags.go:64] FLAG: --cgroup-root=""
Jul 09 00:54:52.967586 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861146    2557 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 09 00:54:52.967586 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861149    2557 flags.go:64] FLAG: --client-ca-file=""
Jul 09 00:54:52.967586 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861152    2557 flags.go:64] FLAG: --cloud-provider="external"
Jul 09 00:54:52.967586 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861155    2557 flags.go:64] FLAG: --cluster-dns="[]"
Jul 09 00:54:52.967586 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861160    2557 flags.go:64] FLAG: --cluster-domain=""
Jul 09 00:54:52.967586 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861163    2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 09 00:54:52.967586 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861166    2557 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 09 00:54:52.967586 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861169    2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 09 00:54:52.967586 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861173    2557 flags.go:64] FLAG: --container-log-max-files="5"
Jul 09 00:54:52.967586 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861177    2557 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 09 00:54:52.967586 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861180    2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 09 00:54:52.967586 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861183    2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 09 00:54:52.967586 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861186    2557 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 09 00:54:52.967586 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861189    2557 flags.go:64] FLAG: --contention-profiling="false"
Jul 09 00:54:52.967586 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861192    2557 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 09 00:54:52.982005 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861195    2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 09 00:54:52.982005 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861198    2557 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 09 00:54:52.982005 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861201    2557 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 09 00:54:52.982005 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861219    2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 09 00:54:52.982005 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861222    2557 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 09 00:54:52.982005 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861225    2557 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 09 00:54:52.982005 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861228    2557 flags.go:64] FLAG: --enable-load-reader="false"
Jul 09 00:54:52.982005 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861231    2557 flags.go:64] FLAG: --enable-server="true"
Jul 09 00:54:52.982005 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861235    2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 09 00:54:52.982005 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861240    2557 flags.go:64] FLAG: --event-burst="100"
Jul 09 00:54:52.982005 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861243    2557 flags.go:64] FLAG: --event-qps="50"
Jul 09 00:54:52.982005 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861246    2557 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 09 00:54:52.982005 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861249    2557 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 09 00:54:52.982005 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861252    2557 flags.go:64] FLAG: --eviction-hard=""
Jul 09 00:54:52.982005 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861256    2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 09 00:54:52.982005 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861261    2557 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 09 00:54:52.982005 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861264    2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 09 00:54:52.982005 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861267    2557 flags.go:64] FLAG: --eviction-soft=""
Jul 09 00:54:52.982005 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861270    2557 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 09 00:54:52.982005 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861273    2557 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 09 00:54:52.982005 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861276    2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 09 00:54:52.982005 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861278    2557 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 09 00:54:52.982005 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861281    2557 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 09 00:54:52.982005 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861285    2557 flags.go:64] FLAG: --fail-swap-on="true"
Jul 09 00:54:52.982005 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861288    2557 flags.go:64] FLAG: --feature-gates=""
Jul 09 00:54:52.985185 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861292    2557 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 09 00:54:52.985185 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861295    2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 09 00:54:52.985185 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861298    2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 09 00:54:52.985185 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861301    2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 09 00:54:52.985185 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861304    2557 flags.go:64] FLAG: --healthz-port="10248"
Jul 09 00:54:52.985185 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861307    2557 flags.go:64] FLAG: --help="false"
Jul 09 00:54:52.985185 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861310    2557 flags.go:64] FLAG: --hostname-override="ip-10-0-133-31.ec2.internal"
Jul 09 00:54:52.985185 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861313    2557 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 09 00:54:52.985185 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861316    2557 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 09 00:54:52.985185 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861320    2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 09 00:54:52.985185 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861324    2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 09 00:54:52.985185 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861327    2557 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 09 00:54:52.985185 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861329    2557 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 09 00:54:52.985185 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861332    2557 flags.go:64] FLAG: --image-service-endpoint=""
Jul 09 00:54:52.985185 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861335    2557 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 09 00:54:52.985185 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861338    2557 flags.go:64] FLAG: --kube-api-burst="100"
Jul 09 00:54:52.985185 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861343    2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 09 00:54:52.985185 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861347    2557 flags.go:64] FLAG: --kube-api-qps="50"
Jul 09 00:54:52.985185 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861350    2557 flags.go:64] FLAG: --kube-reserved=""
Jul 09 00:54:52.985185 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861353    2557 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 09 00:54:52.985185 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861355    2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 09 00:54:52.985185 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861358    2557 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 09 00:54:52.985185 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861362    2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 09 00:54:52.985185 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861365    2557 flags.go:64] FLAG: --lock-file=""
Jul 09 00:54:53.171340 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861368    2557 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 09 00:54:53.171340 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861371    2557 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 09 00:54:53.171340 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861374    2557 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 09 00:54:53.171340 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861379    2557 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 09 00:54:53.171340 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861382    2557 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 09 00:54:53.171340 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861384    2557 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 09 00:54:53.171340 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861387    2557 flags.go:64] FLAG: --logging-format="text"
Jul 09 00:54:53.171340 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861391    2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 09 00:54:53.171340 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861394    2557 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 09 00:54:53.171340 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861397    2557 flags.go:64] FLAG: --manifest-url=""
Jul 09 00:54:53.171340 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861399    2557 flags.go:64] FLAG: --manifest-url-header=""
Jul 09 00:54:53.171340 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861404    2557 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 09 00:54:53.171340 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861407    2557 flags.go:64] FLAG: --max-open-files="1000000"
Jul 09 00:54:53.171340 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861411    2557 flags.go:64] FLAG: --max-pods="110"
Jul 09 00:54:53.171340 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861414    2557 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 09 00:54:53.171340 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861417    2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 09 00:54:53.171340 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861420    2557 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 09 00:54:53.171340 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861423    2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 09 00:54:53.171340 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861426    2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 09 00:54:53.171340 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861429    2557 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 09 00:54:53.171340 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861431    2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 09 00:54:53.171340 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861438    2557 flags.go:64] FLAG: --node-status-max-images="50"
Jul 09 00:54:53.171340 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861441    2557 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 09 00:54:53.171340 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861444    2557 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 09 00:54:53.171340 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861449    2557 flags.go:64] FLAG: --pod-cidr=""
Jul 09 00:54:53.172747 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861452    2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 09 00:54:53.172747 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861458    2557 flags.go:64] FLAG: --pod-manifest-path=""
Jul 09 00:54:53.172747 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861461    2557 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 09 00:54:53.172747 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861464    2557 flags.go:64] FLAG: --pods-per-core="0"
Jul 09 00:54:53.172747 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861467    2557 flags.go:64] FLAG: --port="10250"
Jul 09 00:54:53.172747 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861471    2557 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 09 00:54:53.172747 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861474    2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03d6b38e39eb10d63"
Jul 09 00:54:53.172747 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861477    2557 flags.go:64] FLAG: --qos-reserved=""
Jul 09 00:54:53.172747 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861480    2557 flags.go:64] FLAG: --read-only-port="10255"
Jul 09 00:54:53.172747 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861483    2557 flags.go:64] FLAG: --register-node="true"
Jul 09 00:54:53.172747 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861485    2557 flags.go:64] FLAG: --register-with-taints=""
Jul 09 00:54:53.172747 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861489    2557 flags.go:64] FLAG: --registry-burst="10"
Jul 09 00:54:53.172747 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861491    2557 flags.go:64] FLAG: --registry-qps="5"
Jul 09 00:54:53.172747 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861494    2557 flags.go:64] FLAG: --reserved-cpus=""
Jul 09 00:54:53.172747 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861497    2557 flags.go:64] FLAG: --reserved-memory=""
Jul 09 00:54:53.172747 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861501    2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 09 00:54:53.172747 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861504    2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 09 00:54:53.172747 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861507    2557 flags.go:64] FLAG: --rotate-certificates="false"
Jul 09 00:54:53.172747 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861510    2557 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 09 00:54:53.172747 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861513    2557 flags.go:64] FLAG: --runonce="false"
Jul 09 00:54:53.172747 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861516    2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 09 00:54:53.172747 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861519    2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 09 00:54:53.172747 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861521    2557 flags.go:64] FLAG: --seccomp-default="false"
Jul 09 00:54:53.172747 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861524    2557 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 09 00:54:53.172747 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861527    2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 09 00:54:53.178059 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861530    2557 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 09 00:54:53.178059 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861533    2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 09 00:54:53.178059 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861536    2557 flags.go:64] FLAG: --storage-driver-password="root"
Jul 09 00:54:53.178059 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861539    2557 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 09 00:54:53.178059 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861542    2557 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 09 00:54:53.178059 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861545    2557 flags.go:64] FLAG: --storage-driver-user="root"
Jul 09 00:54:53.178059 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861548    2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 09 00:54:53.178059 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861552    2557 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 09 00:54:53.178059 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861555    2557 flags.go:64] FLAG: --system-cgroups=""
Jul 09 00:54:53.178059 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861558    2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 09 00:54:53.178059 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861563    2557 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 09 00:54:53.178059 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861566    2557 flags.go:64] FLAG: --tls-cert-file=""
Jul 09 00:54:53.178059 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861570    2557 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 09 00:54:53.178059 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861574    2557 flags.go:64] FLAG: --tls-min-version=""
Jul 09 00:54:53.178059 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861577    2557 flags.go:64] FLAG: --tls-private-key-file=""
Jul 09 00:54:53.178059 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861580    2557 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 09 00:54:53.178059 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861583    2557 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 09 00:54:53.178059 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861586    2557 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 09 00:54:53.178059 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861589    2557 flags.go:64] FLAG: --v="2"
Jul 09 00:54:53.178059 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861593    2557 flags.go:64] FLAG: --version="false"
Jul 09 00:54:53.178059 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861597    2557 flags.go:64] FLAG: --vmodule=""
Jul 09 00:54:53.178059 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861601    2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 09 00:54:53.178059 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861604    2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 09 00:54:53.178059 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861719    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 00:54:53.178059 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861723    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 00:54:53.178856 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861726    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 00:54:53.178856 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861730    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 00:54:53.178856 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861733    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 00:54:53.178856 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861736    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 00:54:53.178856 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861738    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 00:54:53.178856 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861741    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 00:54:53.178856 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861744    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 00:54:53.178856 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861747    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 00:54:53.178856 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861749    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 00:54:53.178856 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861752    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 00:54:53.178856 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861754    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 00:54:53.178856 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861757    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 00:54:53.178856 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861759    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 00:54:53.178856 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861761    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 00:54:53.178856 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861766    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 00:54:53.178856 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861769    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 00:54:53.178856 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861772    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 00:54:53.178856 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861774    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 00:54:53.178856 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861777    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 00:54:53.178856 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861780    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 00:54:53.179491 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861783    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 00:54:53.179491 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861785    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 00:54:53.179491 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861788    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 00:54:53.179491 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861790    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 00:54:53.179491 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861792    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 00:54:53.179491 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861795    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 00:54:53.179491 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861798    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 00:54:53.179491 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861800    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 00:54:53.179491 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861803    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 00:54:53.179491 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861806    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 00:54:53.179491 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861810    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 00:54:53.179491 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861814    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 00:54:53.179491 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861817    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 00:54:53.179491 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861819    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 00:54:53.179491 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861822    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 00:54:53.179491 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861824    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 00:54:53.179491 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861827    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 00:54:53.179491 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861831    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 00:54:53.179491 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861834    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 00:54:53.180174 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861837    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 00:54:53.180174 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861840    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 00:54:53.180174 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861842    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 00:54:53.180174 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861844    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 00:54:53.180174 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861847    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 00:54:53.180174 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861850    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 00:54:53.180174 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861852    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 00:54:53.180174 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861859    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 00:54:53.180174 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861861    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 00:54:53.180174 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861864    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 00:54:53.180174 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861866    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 00:54:53.180174 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861869    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 00:54:53.180174 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861873    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 00:54:53.180174 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861875    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 00:54:53.180174 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861878    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 00:54:53.180174 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861880    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 00:54:53.180174 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861883    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 00:54:53.180174 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861885    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 00:54:53.180174 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861888    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 00:54:53.180174 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861890    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 00:54:53.180757 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861893    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 00:54:53.180757 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861895    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 00:54:53.180757 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861898    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 00:54:53.180757 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861900    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 00:54:53.180757 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861903    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 00:54:53.180757 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861906    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 00:54:53.180757 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861909    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 00:54:53.180757 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861911    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 00:54:53.180757 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861914    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 00:54:53.180757 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861916    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 00:54:53.180757 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861919    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 00:54:53.180757 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861921    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 00:54:53.180757 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861924    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 00:54:53.180757 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861926    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 00:54:53.180757 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861929    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 00:54:53.180757 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861931    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 00:54:53.180757 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861934    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 00:54:53.180757 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861936    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 00:54:53.180757 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861939    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 00:54:53.180757 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861942    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 00:54:53.181383 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861945    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 00:54:53.181383 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861947    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 00:54:53.181383 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861950    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 00:54:53.181383 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861953    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 00:54:53.181383 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861957    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 00:54:53.181383 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861960    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 00:54:53.181383 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861962    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 00:54:53.181383 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861965    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 00:54:53.181383 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861967    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 00:54:53.181383 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861970    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 00:54:53.181383 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861973    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 00:54:53.181383 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861976    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 00:54:53.181383 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861980    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 00:54:53.181383 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861983    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 00:54:53.181383 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861986    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 00:54:53.181383 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861988    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 00:54:53.181383 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861991    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 00:54:53.181383 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.861993    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 00:54:53.181917 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.861999    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 00:54:53.181917 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.870545    2557 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 09 00:54:53.181917 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.870564    2557 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 09 00:54:53.181917 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.871486    2557 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 09 00:54:53.181917 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.871503    2557 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 09 00:54:53.181917 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871569    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 00:54:53.181917 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871575    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 00:54:53.181917 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871578    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 00:54:53.181917 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871581    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 00:54:53.181917 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871584    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 00:54:53.181917 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871586    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 00:54:53.181917 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871589    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 00:54:53.181917 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871592    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 00:54:53.181917 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871595    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 00:54:53.181917 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871597    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 00:54:53.182678 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871600    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 00:54:53.182678 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871603    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 00:54:53.182678 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871606    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 00:54:53.182678 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871608    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 00:54:53.182678 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871611    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 00:54:53.182678 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871614    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 00:54:53.182678 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871617    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 00:54:53.182678 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871619    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 00:54:53.182678 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871622    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 00:54:53.182678 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871624    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 00:54:53.182678 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871627    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 00:54:53.182678 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871630    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 00:54:53.182678 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871633    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 00:54:53.182678 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871635    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 00:54:53.182678 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871638    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 00:54:53.182678 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871641    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 00:54:53.182678 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871644    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 00:54:53.182678 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871649    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 00:54:53.182678 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871653    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 00:54:53.182678 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871656    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 00:54:53.183489 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871659    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 00:54:53.183489 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871662    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 00:54:53.183489 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871664    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 00:54:53.183489 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871667    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 00:54:53.183489 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871669    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 00:54:53.183489 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871672    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 00:54:53.183489 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871675    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 00:54:53.183489 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871677    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 00:54:53.183489 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871680    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 00:54:53.183489 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871682    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 00:54:53.183489 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871685    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 00:54:53.183489 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871687    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 00:54:53.183489 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871690    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 00:54:53.183489 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871694    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 00:54:53.183489 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871698    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 00:54:53.183489 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871702    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 00:54:53.183489 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871705    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 00:54:53.183489 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871709    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 00:54:53.183489 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871712    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 00:54:53.184070 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871714    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 00:54:53.184070 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871717    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 00:54:53.184070 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871720    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 00:54:53.184070 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871723    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 00:54:53.184070 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871726    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 00:54:53.184070 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871729    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 00:54:53.184070 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871731    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 00:54:53.184070 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871734    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 00:54:53.184070 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871736    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 00:54:53.184070 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871739    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 00:54:53.184070 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871743    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 00:54:53.184070 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871746    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 00:54:53.184070 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871748    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 00:54:53.184070 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871752    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 00:54:53.184070 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871756    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 00:54:53.184070 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871759    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 00:54:53.184070 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871762    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 00:54:53.184070 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871764    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 00:54:53.184070 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871767    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 00:54:53.184070 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871769    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 00:54:53.184717 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871772    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 00:54:53.184717 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871774    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 00:54:53.184717 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871777    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 00:54:53.184717 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871780    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 00:54:53.184717 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871782    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 00:54:53.184717 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871785    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 00:54:53.184717 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871788    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 00:54:53.184717 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871793    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 00:54:53.184717 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871795    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 00:54:53.184717 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871798    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 00:54:53.184717 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871801    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 00:54:53.184717 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871804    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 00:54:53.184717 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871806    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 00:54:53.184717 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871809    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 00:54:53.184717 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871811    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 00:54:53.184717 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871814    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 00:54:53.184717 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871816    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 00:54:53.184717 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871820    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 00:54:53.184717 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871824    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 00:54:53.184717 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871827    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 00:54:53.185340 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871830    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 00:54:53.185340 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871833    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 00:54:53.185340 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871837    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 00:54:53.185340 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871840    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 00:54:53.185340 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871842    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 00:54:53.185340 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871845    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 00:54:53.185340 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871847    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 00:54:53.185340 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871850    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 00:54:53.185340 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871852    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 00:54:53.185340 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.871855    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 00:54:53.185340 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.871860    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 00:54:53.185340 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872000    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 00:54:53.185340 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872007    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 00:54:53.185340 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872010    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 00:54:53.185340 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872013    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 00:54:53.185792 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872015    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 00:54:53.185792 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872018    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 00:54:53.185792 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872020    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 00:54:53.185792 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872023    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 00:54:53.185792 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872026    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 00:54:53.185792 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872031    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 00:54:53.185792 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872034    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 00:54:53.185792 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872036    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 00:54:53.185792 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872039    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 00:54:53.185792 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872042    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 00:54:53.185792 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872045    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 00:54:53.185792 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872047    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 00:54:53.185792 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872050    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 00:54:53.185792 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872052    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 00:54:53.185792 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872055    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 00:54:53.185792 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872058    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 00:54:53.185792 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872060    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 00:54:53.185792 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872064    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 00:54:53.185792 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872068    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 00:54:53.186467 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872072    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 00:54:53.186467 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872075    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 00:54:53.186467 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872078    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 00:54:53.186467 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872080    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 00:54:53.186467 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872083    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 00:54:53.186467 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872085    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 00:54:53.186467 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872088    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 00:54:53.186467 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872091    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 00:54:53.186467 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872093    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 00:54:53.186467 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872095    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 00:54:53.186467 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872098    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 00:54:53.186467 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872101    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 00:54:53.186467 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872103    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 00:54:53.186467 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872106    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 00:54:53.186467 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872108    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 00:54:53.186467 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872111    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 00:54:53.186467 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872114    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 00:54:53.186467 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872116    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 00:54:53.186467 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872120    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 00:54:53.186467 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872123    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 00:54:53.187031 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872125    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 00:54:53.187031 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872128    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 00:54:53.187031 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872131    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 00:54:53.187031 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872134    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 00:54:53.187031 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872136    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 00:54:53.187031 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872139    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 00:54:53.187031 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872142    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 00:54:53.187031 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872144    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 00:54:53.187031 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872147    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 00:54:53.187031 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872149    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 00:54:53.187031 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872152    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 00:54:53.187031 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872155    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 00:54:53.187031 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872159    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 00:54:53.187031 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872161    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 00:54:53.187031 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872164    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 00:54:53.187031 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872166    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 00:54:53.187031 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872169    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 00:54:53.187031 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872171    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 00:54:53.187031 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872174    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 00:54:53.187031 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872176    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 00:54:53.187776 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872180    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 00:54:53.187776 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872184    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 00:54:53.187776 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872187    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 00:54:53.187776 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872189    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 00:54:53.187776 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872192    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 00:54:53.187776 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872195    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 00:54:53.187776 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872198    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 00:54:53.187776 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872201    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 00:54:53.187776 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872204    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 00:54:53.187776 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872220    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 00:54:53.187776 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872225    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 00:54:53.187776 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872228    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 00:54:53.187776 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872231    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 00:54:53.187776 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872234    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 00:54:53.187776 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872237    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 00:54:53.187776 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872240    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 00:54:53.187776 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872243    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 00:54:53.187776 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872246    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 00:54:53.187776 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872248    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 00:54:53.340671 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872251    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 00:54:53.340671 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872253    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 00:54:53.340671 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872256    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 00:54:53.340671 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872259    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 00:54:53.340671 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872261    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 00:54:53.340671 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872265    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 00:54:53.340671 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872268    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 00:54:53.340671 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872271    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 00:54:53.340671 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872273    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 00:54:53.340671 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872276    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 00:54:53.340671 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872278    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 00:54:53.340671 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872281    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 00:54:53.340671 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872283    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 00:54:53.340671 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872288    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 00:54:53.340671 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872291    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 00:54:53.340671 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872294    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 00:54:53.340671 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:52.872297    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 00:54:53.341797 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.872302    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 00:54:53.341797 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.872435    2557 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 09 00:54:53.341797 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.874947    2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 09 00:54:53.341797 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.876558    2557 server.go:1019] "Starting client certificate rotation"
Jul 09 00:54:53.341797 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.876662    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 00:54:53.341797 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.876701    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 00:54:53.341797 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.879287    2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 00:54:53.341797 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.886632    2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 00:54:53.341797 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.896070    2557 log.go:25] "Validated CRI v1 runtime API"
Jul 09 00:54:53.341797 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.898497    2557 log.go:25] "Validated CRI v1 image API"
Jul 09 00:54:53.341797 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.899236    2557 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 09 00:54:53.341797 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.902077    2557 fs.go:135] Filesystem UUIDs: map[4cf698a8-283e-4085-bab4-48cedc1c6371:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 7f5edb99-5195-4c40-bfa7-722a12397fea:/dev/nvme0n1p3]
Jul 09 00:54:53.342442 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.902106    2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 09 00:54:53.342442 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.908976    2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 00:54:53.343084 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.911149    2557 manager.go:216] Machine: {Timestamp:2026-07-09 00:54:52.909658882 +0000 UTC m=+0.379801603 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099522 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2398628e7691783346fe8641749f04 SystemUUID:ec239862-8e76-9178-3346-fe8641749f04 BootID:981e008f-9ce0-467f-8606-97e660145747 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:94:f9:51:f3:af Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:94:f9:51:f3:af Speed:0 Mtu:9001} {Name:ovs-system MacAddress:de:73:b5:c0:68:3a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 09 00:54:53.343084 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.911277    2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 09 00:54:53.343084 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.911363    2557 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 09 00:54:53.343084 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.914966    2557 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 09 00:54:53.343084 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.914991    2557 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-31.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 09 00:54:53.343084 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.916545    2557 topology_manager.go:138] "Creating topology manager with none policy"
Jul 09 00:54:53.343084 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.916558    2557 container_manager_linux.go:309] "Creating device plugin manager"
Jul 09 00:54:53.343084 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.916565    2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 00:54:53.343084 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.917310    2557 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 00:54:53.343084 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.919268    2557 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 09 00:54:53.343084 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.928746    2557 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 00:54:53.343084 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.929020    2557 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 09 00:54:53.343084 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.929057    2557 kubelet.go:486] "Attempting to sync node with API server"
Jul 09 00:54:53.343084 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.929495    2557 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 09 00:54:53.343084 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.929513    2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 09 00:54:53.343084 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.929527    2557 kubelet.go:398] "Adding apiserver pod source"
Jul 09 00:54:53.343084 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.929550    2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 09 00:54:53.343084 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.933280    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 00:54:53.344057 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.933306    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 00:54:53.344057 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.936075    2557 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 09 00:54:53.344057 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.939748    2557 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 09 00:54:53.344057 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.939776    2557 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 09 00:54:53.344057 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.941266    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 09 00:54:53.344057 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.941280    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 09 00:54:53.344057 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.941287    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 09 00:54:53.344057 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.941292    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 09 00:54:53.344057 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.941300    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 09 00:54:53.344057 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.941306    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 09 00:54:53.344057 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.941318    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 09 00:54:53.344057 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.941325    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 09 00:54:53.344057 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.941332    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 09 00:54:53.344057 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.941337    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 09 00:54:53.344057 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.941345    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 09 00:54:53.344057 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.941351    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 09 00:54:53.344057 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.942288    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 09 00:54:53.344057 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.942297    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 09 00:54:53.344057 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:52.942923    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-31.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 09 00:54:53.344057 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:52.942923    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 09 00:54:53.344057 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.945746    2557 server.go:1268] "Started kubelet"
Jul 09 00:54:53.344057 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.946074    2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 09 00:54:53.344057 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.946057    2557 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 09 00:54:53.344057 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.946378    2557 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 09 00:54:53.344057 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.948184    2557 server.go:310] "Adding debug handlers to kubelet server"
Jul 09 00:54:53.344057 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.948341    2557 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 09 00:54:53.344057 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.951339    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8zsh9"
Jul 09 00:54:53.344057 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:52.952363    2557 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 09 00:54:53.344057 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:52.952324    2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-31.ec2.internal.18c078ffe8291913  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-31.ec2.internal,UID:ip-10-0-133-31.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-31.ec2.internal,},FirstTimestamp:2026-07-09 00:54:52.945717523 +0000 UTC m=+0.415860243,LastTimestamp:2026-07-09 00:54:52.945717523 +0000 UTC m=+0.415860243,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-31.ec2.internal,}"
Jul 09 00:54:53.344057 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.957327    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8zsh9"
Jul 09 00:54:53.344057 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.958178    2557 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-31.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 09 00:54:53.344057 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.959282    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 09 00:54:53.344057 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.959286    2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 09 00:54:53.344057 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:52.959554    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-31.ec2.internal\" not found"
Jul 09 00:54:53.344057 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.961156    2557 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 09 00:54:53.344057 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.961500    2557 factory.go:55] Registering systemd factory
Jul 09 00:54:53.344057 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.961516    2557 factory.go:223] Registration of the systemd container factory successfully
Jul 09 00:54:53.344057 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.961568    2557 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 09 00:54:53.344057 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.961581    2557 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 09 00:54:53.344057 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.961808    2557 reconstruct.go:97] "Volume reconstruction finished"
Jul 09 00:54:53.346063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.961817    2557 reconciler.go:29] "Reconciler: start to sync state"
Jul 09 00:54:53.346063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.961938    2557 factory.go:153] Registering CRI-O factory
Jul 09 00:54:53.346063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.961955    2557 factory.go:223] Registration of the crio container factory successfully
Jul 09 00:54:53.346063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.962025    2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 09 00:54:53.346063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.962052    2557 factory.go:103] Registering Raw factory
Jul 09 00:54:53.346063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.962073    2557 manager.go:1196] Started watching for new ooms in manager
Jul 09 00:54:53.346063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.962650    2557 manager.go:349] Starting recovery of all containers
Jul 09 00:54:53.346063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.964355    2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 00:54:53.346063 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:52.970150    2557 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-133-31.ec2.internal\" not found" node="ip-10-0-133-31.ec2.internal"
Jul 09 00:54:53.346063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.979887    2557 manager.go:354] Recovery completed
Jul 09 00:54:53.346063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.984367    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 00:54:53.346063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.986330    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-31.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 00:54:53.346063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.986358    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-31.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 00:54:53.346063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.986369    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-31.ec2.internal" event="NodeHasSufficientPID"
Jul 09 00:54:53.346063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.986940    2557 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 09 00:54:53.346063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.986952    2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 09 00:54:53.346063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.986956    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 00:54:53.346063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.986972    2557 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 00:54:53.346063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.987699    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-31.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 00:54:53.346063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.987721    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-31.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 00:54:53.346063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.987731    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-31.ec2.internal" event="NodeHasSufficientPID"
Jul 09 00:54:53.346063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.989077    2557 policy_none.go:49] "None policy: Start"
Jul 09 00:54:53.346063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.989089    2557 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 09 00:54:53.346063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:52.989099    2557 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 09 00:54:53.346063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.031920    2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 09 00:54:53.346063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.033123    2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 09 00:54:53.346063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.033167    2557 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 09 00:54:53.346063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.033192    2557 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 09 00:54:53.346063 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:53.033290    2557 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Jul 09 00:54:53.346063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.035145    2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 00:54:53.346063 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:53.059983    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-31.ec2.internal\" not found"
Jul 09 00:54:53.346063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.132111    2557 policy_none.go:47] "Start"
Jul 09 00:54:53.346063 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:53.133665    2557 kubelet.go:2472] "Skipping pod synchronization" err="container runtime status check may not have completed yet"
Jul 09 00:54:53.346063 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:53.160250    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-31.ec2.internal\" not found"
Jul 09 00:54:53.346063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.182003    2557 manager.go:337] "Starting Device Plugin manager"
Jul 09 00:54:53.346063 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:53.182043    2557 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 09 00:54:53.346063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.182058    2557 server.go:87] "Starting device plugin registration server"
Jul 09 00:54:53.346063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.182357    2557 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 09 00:54:53.346063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.182383    2557 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 09 00:54:53.346063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.182491    2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 09 00:54:53.346063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.182607    2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 09 00:54:53.346063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.182617    2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 09 00:54:53.346063 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:53.183201    2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 09 00:54:53.346063 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:53.183292    2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-31.ec2.internal\" not found"
Jul 09 00:54:53.346063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.283385    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 00:54:53.346063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.284450    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-31.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 00:54:53.346063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.284487    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-31.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 00:54:53.346063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.284504    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-31.ec2.internal" event="NodeHasSufficientPID"
Jul 09 00:54:53.346063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.284536    2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-31.ec2.internal"
Jul 09 00:54:53.348063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.292949    2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-31.ec2.internal"
Jul 09 00:54:53.348063 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:53.292967    2557 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-31.ec2.internal\": node \"ip-10-0-133-31.ec2.internal\" not found"
Jul 09 00:54:53.348063 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:53.316504    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-31.ec2.internal\" not found"
Jul 09 00:54:53.348063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.334556    2557 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-31.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-31.ec2.internal"]
Jul 09 00:54:53.348063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.334635    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 00:54:53.348063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.336306    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-31.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 00:54:53.348063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.336341    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-31.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 00:54:53.348063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.336351    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-31.ec2.internal" event="NodeHasSufficientPID"
Jul 09 00:54:53.348063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.338566    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 00:54:53.348063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.338685    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-31.ec2.internal"
Jul 09 00:54:53.348063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.338717    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 00:54:53.348063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.339312    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-31.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 00:54:53.348063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.339334    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-31.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 00:54:53.348063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.339344    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-31.ec2.internal" event="NodeHasSufficientPID"
Jul 09 00:54:53.348063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.340980    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-31.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 00:54:53.348063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.341005    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-31.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 00:54:53.348063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.341016    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-31.ec2.internal" event="NodeHasSufficientPID"
Jul 09 00:54:53.348063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.343052    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-31.ec2.internal"
Jul 09 00:54:53.348063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.343074    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 00:54:53.348063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.343675    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-31.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 00:54:53.348063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.343700    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-31.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 00:54:53.348063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.343713    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-31.ec2.internal" event="NodeHasSufficientPID"
Jul 09 00:54:53.521479 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.364194    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f0b2c6c86433a657dbf3a43f7bc9a86a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-31.ec2.internal\" (UID: \"f0b2c6c86433a657dbf3a43f7bc9a86a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-31.ec2.internal"
Jul 09 00:54:53.521479 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.364245    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0b2c6c86433a657dbf3a43f7bc9a86a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-31.ec2.internal\" (UID: \"f0b2c6c86433a657dbf3a43f7bc9a86a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-31.ec2.internal"
Jul 09 00:54:53.521479 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.364272    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d799c3ef85e5886492cae7cd2485596a-config\") pod \"kube-apiserver-proxy-ip-10-0-133-31.ec2.internal\" (UID: \"d799c3ef85e5886492cae7cd2485596a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-31.ec2.internal"
Jul 09 00:54:53.521479 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:53.377825    2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-31.ec2.internal\" not found" node="ip-10-0-133-31.ec2.internal"
Jul 09 00:54:53.521479 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:53.386329    2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-31.ec2.internal\" not found" node="ip-10-0-133-31.ec2.internal"
Jul 09 00:54:53.521479 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:53.416895    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-31.ec2.internal\" not found"
Jul 09 00:54:53.521479 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.465377    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f0b2c6c86433a657dbf3a43f7bc9a86a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-31.ec2.internal\" (UID: \"f0b2c6c86433a657dbf3a43f7bc9a86a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-31.ec2.internal"
Jul 09 00:54:53.521479 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.465408    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0b2c6c86433a657dbf3a43f7bc9a86a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-31.ec2.internal\" (UID: \"f0b2c6c86433a657dbf3a43f7bc9a86a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-31.ec2.internal"
Jul 09 00:54:53.521479 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.465424    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d799c3ef85e5886492cae7cd2485596a-config\") pod \"kube-apiserver-proxy-ip-10-0-133-31.ec2.internal\" (UID: \"d799c3ef85e5886492cae7cd2485596a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-31.ec2.internal"
Jul 09 00:54:53.521479 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.465471    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f0b2c6c86433a657dbf3a43f7bc9a86a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-31.ec2.internal\" (UID: \"f0b2c6c86433a657dbf3a43f7bc9a86a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-31.ec2.internal"
Jul 09 00:54:53.521479 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.465521    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d799c3ef85e5886492cae7cd2485596a-config\") pod \"kube-apiserver-proxy-ip-10-0-133-31.ec2.internal\" (UID: \"d799c3ef85e5886492cae7cd2485596a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-31.ec2.internal"
Jul 09 00:54:53.521479 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.465546    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0b2c6c86433a657dbf3a43f7bc9a86a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-31.ec2.internal\" (UID: \"f0b2c6c86433a657dbf3a43f7bc9a86a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-31.ec2.internal"
Jul 09 00:54:53.521479 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:53.517508    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-31.ec2.internal\" not found"
Jul 09 00:54:53.675751 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:53.618015    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-31.ec2.internal\" not found"
Jul 09 00:54:53.820189 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.682454    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-31.ec2.internal"
Jul 09 00:54:53.820189 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.690481    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-31.ec2.internal"
Jul 09 00:54:53.820189 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:53.722287    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-31.ec2.internal\" not found"
Jul 09 00:54:53.820189 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.804032    2557 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 00:54:53.822986 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:53.822386    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-31.ec2.internal\" not found"
Jul 09 00:54:53.942501 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.875319    2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 09 00:54:53.942501 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.875535    2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 00:54:53.942501 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.875547    2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 00:54:53.942501 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.875547    2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 00:54:53.942501 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:53.922548    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-31.ec2.internal\" not found"
Jul 09 00:54:54.059802 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.957875    2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 00:54:54.059802 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.960282    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 09 00:54:54.059802 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.960303    2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-31.ec2.internal"
Jul 09 00:54:54.059802 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.960288    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 00:49:52 +0000 UTC" deadline="2028-04-17 07:32:13.033789818 +0000 UTC"
Jul 09 00:54:54.059802 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.960431    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15558h37m19.07336308s"
Jul 09 00:54:54.059802 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.968630    2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 00:54:54.059802 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.972184    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 00:54:54.059802 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.973259    2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-31.ec2.internal"
Jul 09 00:54:54.059802 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.980955    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 00:54:54.059802 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.990888    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2wbgc"
Jul 09 00:54:54.059802 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:53.996310    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2wbgc"
Jul 09 00:54:54.376557 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:54.356879    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0b2c6c86433a657dbf3a43f7bc9a86a.slice/crio-dbd68cc6b7be3130f9c3aeca3c74e057adffa2e3dc4745c555c07a767d803247 WatchSource:0}: Error finding container dbd68cc6b7be3130f9c3aeca3c74e057adffa2e3dc4745c555c07a767d803247: Status 404 returned error can't find the container with id dbd68cc6b7be3130f9c3aeca3c74e057adffa2e3dc4745c555c07a767d803247
Jul 09 00:54:54.376557 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:54.357419    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd799c3ef85e5886492cae7cd2485596a.slice/crio-64ab7cdac702da2dab23eaa949da54f076ac2cb956e1a8f958c333f589d931f1 WatchSource:0}: Error finding container 64ab7cdac702da2dab23eaa949da54f076ac2cb956e1a8f958c333f589d931f1: Status 404 returned error can't find the container with id 64ab7cdac702da2dab23eaa949da54f076ac2cb956e1a8f958c333f589d931f1
Jul 09 00:54:54.376557 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.367634    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 00:54:54.932100 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.932025    2557 apiserver.go:52] "Watching apiserver"
Jul 09 00:54:54.938910 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.938884    2557 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 09 00:54:54.939274 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.939249    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-31.ec2.internal","openshift-cluster-node-tuning-operator/tuned-drbjw","openshift-multus/multus-7wcz6","openshift-multus/multus-additional-cni-plugins-dhpcm","openshift-network-diagnostics/network-check-target-dvvxg","openshift-network-operator/iptables-alerter-bwnrj","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8t57","openshift-dns/node-resolver-tkg22","openshift-image-registry/node-ca-xnxng","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-31.ec2.internal","openshift-multus/network-metrics-daemon-dgrzs","openshift-ovn-kubernetes/ovnkube-node-bp8t6","kube-system/global-pull-secret-syncer-8p4px","kube-system/konnectivity-agent-pg99d"]
Jul 09 00:54:54.941494 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.941477    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-drbjw"
Jul 09 00:54:54.943838 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.943508    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:54.943838 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.943592    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 09 00:54:54.944437 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.943847    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-v6tkk\""
Jul 09 00:54:54.944437 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.943868    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 09 00:54:54.945302 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.945218    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 09 00:54:54.945388 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.945338    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 09 00:54:54.946614 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.945758    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dhpcm"
Jul 09 00:54:54.946614 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.945774    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hk7z7\""
Jul 09 00:54:54.946614 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.945944    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 09 00:54:54.946614 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.946393    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 09 00:54:54.947738 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.947687    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 09 00:54:54.947738 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.947725    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 09 00:54:54.947874 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.947746    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-s29xf\""
Jul 09 00:54:54.948982 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.948932    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvvxg"
Jul 09 00:54:54.949054 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:54.949005    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvvxg" podUID="dcdf29b1-919a-48db-88d5-8cb2e105bb01"
Jul 09 00:54:54.950886 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.950871    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bwnrj"
Jul 09 00:54:54.952910 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.952892    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 09 00:54:54.953127 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.953027    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-t6w65\""
Jul 09 00:54:54.953127 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.953036    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8t57"
Jul 09 00:54:54.953345 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.953323    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 09 00:54:54.953423 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.953374    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 09 00:54:54.954827 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.954790    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 09 00:54:54.954908 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.954895    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-28wfm\""
Jul 09 00:54:54.955138 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.955010    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 09 00:54:54.955138 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.955090    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 09 00:54:54.955314 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.955295    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tkg22"
Jul 09 00:54:54.957313 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.957080    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 09 00:54:54.957313 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.957193    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 09 00:54:54.958517 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.957463    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wksbq\""
Jul 09 00:54:54.959078 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.959060    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xnxng"
Jul 09 00:54:54.961013 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.960827    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 09 00:54:54.961013 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.960915    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 09 00:54:54.961013 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.960944    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 09 00:54:54.961190 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.961030    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-v9fsd\""
Jul 09 00:54:54.961686 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.961433    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dgrzs"
Jul 09 00:54:54.961686 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:54.961497    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dgrzs" podUID="518d8542-a147-4718-9ae0-eda6710ea1a4"
Jul 09 00:54:54.963857 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.963838    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:54.965789 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.965769    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 09 00:54:54.966071 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.966040    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 09 00:54:54.966122 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.966071    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 09 00:54:54.966122 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.966113    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 09 00:54:54.966198 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.966162    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 09 00:54:54.966331 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.966316    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 09 00:54:54.966407 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.966393    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p4px"
Jul 09 00:54:54.966475 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:54.966455    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p4px" podUID="65de29a1-ee8f-4539-8e6d-997a7889fc85"
Jul 09 00:54:54.966528 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.966398    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bp4xs\""
Jul 09 00:54:54.968373 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.968358    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pg99d"
Jul 09 00:54:54.970186 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.970169    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ccsk5\""
Jul 09 00:54:54.970769 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.970753    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 09 00:54:54.970856 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.970786    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 09 00:54:54.972862 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.972836    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3b8f52dc-405f-4c16-b837-97ea642f9341-host-slash\") pod \"iptables-alerter-bwnrj\" (UID: \"3b8f52dc-405f-4c16-b837-97ea642f9341\") " pod="openshift-network-operator/iptables-alerter-bwnrj"
Jul 09 00:54:54.972962 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.972869    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f91dc32b-758b-4085-b67b-a916f208c474-registration-dir\") pod \"aws-ebs-csi-driver-node-l8t57\" (UID: \"f91dc32b-758b-4085-b67b-a916f208c474\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8t57"
Jul 09 00:54:54.972962 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.972886    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48d74\" (UniqueName: \"kubernetes.io/projected/f4dbea2c-28f9-4405-b905-f740dbe64a09-kube-api-access-48d74\") pod \"multus-additional-cni-plugins-dhpcm\" (UID: \"f4dbea2c-28f9-4405-b905-f740dbe64a09\") " pod="openshift-multus/multus-additional-cni-plugins-dhpcm"
Jul 09 00:54:54.972962 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.972909    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj6pd\" (UniqueName: \"kubernetes.io/projected/fc7293e1-bc7a-4d70-9cd2-2dd0b1b5c231-kube-api-access-zj6pd\") pod \"node-ca-xnxng\" (UID: \"fc7293e1-bc7a-4d70-9cd2-2dd0b1b5c231\") " pod="openshift-image-registry/node-ca-xnxng"
Jul 09 00:54:54.972962 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.972932    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8efa0274-9674-4514-812d-ca9d8e004993-host-var-lib-cni-bin\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:54.972962 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.972946    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8efa0274-9674-4514-812d-ca9d8e004993-hostroot\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:54.972962 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.972961    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8efa0274-9674-4514-812d-ca9d8e004993-host-run-multus-certs\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:54.973222 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.972981    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f91dc32b-758b-4085-b67b-a916f208c474-sys-fs\") pod \"aws-ebs-csi-driver-node-l8t57\" (UID: \"f91dc32b-758b-4085-b67b-a916f208c474\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8t57"
Jul 09 00:54:54.973222 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.973000    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/09e68ce7-10cf-4906-a88c-6f93268fc0bd-sys\") pod \"tuned-drbjw\" (UID: \"09e68ce7-10cf-4906-a88c-6f93268fc0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-drbjw"
Jul 09 00:54:54.973222 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.973022    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f4dbea2c-28f9-4405-b905-f740dbe64a09-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dhpcm\" (UID: \"f4dbea2c-28f9-4405-b905-f740dbe64a09\") " pod="openshift-multus/multus-additional-cni-plugins-dhpcm"
Jul 09 00:54:54.973222 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.973037    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26cbq\" (UniqueName: \"kubernetes.io/projected/868053ea-aa08-4c9f-a2f6-05351b70b539-kube-api-access-26cbq\") pod \"node-resolver-tkg22\" (UID: \"868053ea-aa08-4c9f-a2f6-05351b70b539\") " pod="openshift-dns/node-resolver-tkg22"
Jul 09 00:54:54.973222 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.973091    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fc7293e1-bc7a-4d70-9cd2-2dd0b1b5c231-host\") pod \"node-ca-xnxng\" (UID: \"fc7293e1-bc7a-4d70-9cd2-2dd0b1b5c231\") " pod="openshift-image-registry/node-ca-xnxng"
Jul 09 00:54:54.973222 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.973128    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8efa0274-9674-4514-812d-ca9d8e004993-multus-socket-dir-parent\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:54.973222 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.973151    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3b8f52dc-405f-4c16-b837-97ea642f9341-iptables-alerter-script\") pod \"iptables-alerter-bwnrj\" (UID: \"3b8f52dc-405f-4c16-b837-97ea642f9341\") " pod="openshift-network-operator/iptables-alerter-bwnrj"
Jul 09 00:54:54.973222 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.973177    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8efa0274-9674-4514-812d-ca9d8e004993-host-run-k8s-cni-cncf-io\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:54.973544 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.973191    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8efa0274-9674-4514-812d-ca9d8e004993-host-run-netns\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:54.973544 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.973246    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8efa0274-9674-4514-812d-ca9d8e004993-multus-daemon-config\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:54.973544 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.973266    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/868053ea-aa08-4c9f-a2f6-05351b70b539-hosts-file\") pod \"node-resolver-tkg22\" (UID: \"868053ea-aa08-4c9f-a2f6-05351b70b539\") " pod="openshift-dns/node-resolver-tkg22"
Jul 09 00:54:54.973544 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.973282    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f4dbea2c-28f9-4405-b905-f740dbe64a09-system-cni-dir\") pod \"multus-additional-cni-plugins-dhpcm\" (UID: \"f4dbea2c-28f9-4405-b905-f740dbe64a09\") " pod="openshift-multus/multus-additional-cni-plugins-dhpcm"
Jul 09 00:54:54.973544 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.973304    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8efa0274-9674-4514-812d-ca9d8e004993-system-cni-dir\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:54.973544 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.973329    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8efa0274-9674-4514-812d-ca9d8e004993-multus-cni-dir\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:54.973544 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.973360    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8efa0274-9674-4514-812d-ca9d8e004993-cni-binary-copy\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:54.973544 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.973382    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09e68ce7-10cf-4906-a88c-6f93268fc0bd-tmp\") pod \"tuned-drbjw\" (UID: \"09e68ce7-10cf-4906-a88c-6f93268fc0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-drbjw"
Jul 09 00:54:54.973544 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.973413    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcqr5\" (UniqueName: \"kubernetes.io/projected/dcdf29b1-919a-48db-88d5-8cb2e105bb01-kube-api-access-zcqr5\") pod \"network-check-target-dvvxg\" (UID: \"dcdf29b1-919a-48db-88d5-8cb2e105bb01\") " pod="openshift-network-diagnostics/network-check-target-dvvxg"
Jul 09 00:54:54.973544 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.973444    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/09e68ce7-10cf-4906-a88c-6f93268fc0bd-etc-sysconfig\") pod \"tuned-drbjw\" (UID: \"09e68ce7-10cf-4906-a88c-6f93268fc0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-drbjw"
Jul 09 00:54:54.973544 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.973471    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/09e68ce7-10cf-4906-a88c-6f93268fc0bd-etc-sysctl-conf\") pod \"tuned-drbjw\" (UID: \"09e68ce7-10cf-4906-a88c-6f93268fc0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-drbjw"
Jul 09 00:54:54.973544 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.973491    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/09e68ce7-10cf-4906-a88c-6f93268fc0bd-host\") pod \"tuned-drbjw\" (UID: \"09e68ce7-10cf-4906-a88c-6f93268fc0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-drbjw"
Jul 09 00:54:54.973544 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.973512    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f4dbea2c-28f9-4405-b905-f740dbe64a09-cnibin\") pod \"multus-additional-cni-plugins-dhpcm\" (UID: \"f4dbea2c-28f9-4405-b905-f740dbe64a09\") " pod="openshift-multus/multus-additional-cni-plugins-dhpcm"
Jul 09 00:54:54.973544 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.973536    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f4dbea2c-28f9-4405-b905-f740dbe64a09-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dhpcm\" (UID: \"f4dbea2c-28f9-4405-b905-f740dbe64a09\") " pod="openshift-multus/multus-additional-cni-plugins-dhpcm"
Jul 09 00:54:54.974114 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.973562    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4p7jb\" (UniqueName: \"kubernetes.io/projected/3b8f52dc-405f-4c16-b837-97ea642f9341-kube-api-access-4p7jb\") pod \"iptables-alerter-bwnrj\" (UID: \"3b8f52dc-405f-4c16-b837-97ea642f9341\") " pod="openshift-network-operator/iptables-alerter-bwnrj"
Jul 09 00:54:54.974114 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.973581    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mbm7\" (UniqueName: \"kubernetes.io/projected/f91dc32b-758b-4085-b67b-a916f208c474-kube-api-access-2mbm7\") pod \"aws-ebs-csi-driver-node-l8t57\" (UID: \"f91dc32b-758b-4085-b67b-a916f208c474\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8t57"
Jul 09 00:54:54.974114 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.973596    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/518d8542-a147-4718-9ae0-eda6710ea1a4-metrics-certs\") pod \"network-metrics-daemon-dgrzs\" (UID: \"518d8542-a147-4718-9ae0-eda6710ea1a4\") " pod="openshift-multus/network-metrics-daemon-dgrzs"
Jul 09 00:54:54.974114 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.973608    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/09e68ce7-10cf-4906-a88c-6f93268fc0bd-run\") pod \"tuned-drbjw\" (UID: \"09e68ce7-10cf-4906-a88c-6f93268fc0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-drbjw"
Jul 09 00:54:54.974114 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.973643    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f91dc32b-758b-4085-b67b-a916f208c474-device-dir\") pod \"aws-ebs-csi-driver-node-l8t57\" (UID: \"f91dc32b-758b-4085-b67b-a916f208c474\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8t57"
Jul 09 00:54:54.974114 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.973662    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhmnb\" (UniqueName: \"kubernetes.io/projected/09e68ce7-10cf-4906-a88c-6f93268fc0bd-kube-api-access-jhmnb\") pod \"tuned-drbjw\" (UID: \"09e68ce7-10cf-4906-a88c-6f93268fc0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-drbjw"
Jul 09 00:54:54.974114 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.973675    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8efa0274-9674-4514-812d-ca9d8e004993-cnibin\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:54.974114 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.973699    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgwfb\" (UniqueName: \"kubernetes.io/projected/518d8542-a147-4718-9ae0-eda6710ea1a4-kube-api-access-qgwfb\") pod \"network-metrics-daemon-dgrzs\" (UID: \"518d8542-a147-4718-9ae0-eda6710ea1a4\") " pod="openshift-multus/network-metrics-daemon-dgrzs"
Jul 09 00:54:54.974114 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.973726    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09e68ce7-10cf-4906-a88c-6f93268fc0bd-var-lib-kubelet\") pod \"tuned-drbjw\" (UID: \"09e68ce7-10cf-4906-a88c-6f93268fc0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-drbjw"
Jul 09 00:54:54.974114 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.973765    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/09e68ce7-10cf-4906-a88c-6f93268fc0bd-etc-tuned\") pod \"tuned-drbjw\" (UID: \"09e68ce7-10cf-4906-a88c-6f93268fc0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-drbjw"
Jul 09 00:54:54.974114 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.973781    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f4dbea2c-28f9-4405-b905-f740dbe64a09-cni-binary-copy\") pod \"multus-additional-cni-plugins-dhpcm\" (UID: \"f4dbea2c-28f9-4405-b905-f740dbe64a09\") " pod="openshift-multus/multus-additional-cni-plugins-dhpcm"
Jul 09 00:54:54.974114 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.973796    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/868053ea-aa08-4c9f-a2f6-05351b70b539-tmp-dir\") pod \"node-resolver-tkg22\" (UID: \"868053ea-aa08-4c9f-a2f6-05351b70b539\") " pod="openshift-dns/node-resolver-tkg22"
Jul 09 00:54:54.974114 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.973830    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/09e68ce7-10cf-4906-a88c-6f93268fc0bd-etc-systemd\") pod \"tuned-drbjw\" (UID: \"09e68ce7-10cf-4906-a88c-6f93268fc0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-drbjw"
Jul 09 00:54:54.974114 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.973859    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f4dbea2c-28f9-4405-b905-f740dbe64a09-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dhpcm\" (UID: \"f4dbea2c-28f9-4405-b905-f740dbe64a09\") " pod="openshift-multus/multus-additional-cni-plugins-dhpcm"
Jul 09 00:54:54.974114 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.973875    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8efa0274-9674-4514-812d-ca9d8e004993-host-var-lib-cni-multus\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:54.974114 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.973893    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8efa0274-9674-4514-812d-ca9d8e004993-host-var-lib-kubelet\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:54.974760 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.973905    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f91dc32b-758b-4085-b67b-a916f208c474-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l8t57\" (UID: \"f91dc32b-758b-4085-b67b-a916f208c474\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8t57"
Jul 09 00:54:54.974760 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.973919    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fc7293e1-bc7a-4d70-9cd2-2dd0b1b5c231-serviceca\") pod \"node-ca-xnxng\" (UID: \"fc7293e1-bc7a-4d70-9cd2-2dd0b1b5c231\") " pod="openshift-image-registry/node-ca-xnxng"
Jul 09 00:54:54.974760 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.973930    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8efa0274-9674-4514-812d-ca9d8e004993-etc-kubernetes\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:54.974760 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.973953    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkz2k\" (UniqueName: \"kubernetes.io/projected/8efa0274-9674-4514-812d-ca9d8e004993-kube-api-access-wkz2k\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:54.974760 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.973973    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f91dc32b-758b-4085-b67b-a916f208c474-socket-dir\") pod \"aws-ebs-csi-driver-node-l8t57\" (UID: \"f91dc32b-758b-4085-b67b-a916f208c474\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8t57"
Jul 09 00:54:54.974760 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.973986    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f91dc32b-758b-4085-b67b-a916f208c474-etc-selinux\") pod \"aws-ebs-csi-driver-node-l8t57\" (UID: \"f91dc32b-758b-4085-b67b-a916f208c474\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8t57"
Jul 09 00:54:54.974760 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.974007    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/09e68ce7-10cf-4906-a88c-6f93268fc0bd-etc-sysctl-d\") pod \"tuned-drbjw\" (UID: \"09e68ce7-10cf-4906-a88c-6f93268fc0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-drbjw"
Jul 09 00:54:54.974760 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.974018    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/09e68ce7-10cf-4906-a88c-6f93268fc0bd-lib-modules\") pod \"tuned-drbjw\" (UID: \"09e68ce7-10cf-4906-a88c-6f93268fc0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-drbjw"
Jul 09 00:54:54.974760 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.974041    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/09e68ce7-10cf-4906-a88c-6f93268fc0bd-etc-modprobe-d\") pod \"tuned-drbjw\" (UID: \"09e68ce7-10cf-4906-a88c-6f93268fc0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-drbjw"
Jul 09 00:54:54.974760 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.974062    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f4dbea2c-28f9-4405-b905-f740dbe64a09-os-release\") pod \"multus-additional-cni-plugins-dhpcm\" (UID: \"f4dbea2c-28f9-4405-b905-f740dbe64a09\") " pod="openshift-multus/multus-additional-cni-plugins-dhpcm"
Jul 09 00:54:54.974760 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.974086    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8efa0274-9674-4514-812d-ca9d8e004993-os-release\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:54.974760 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.974103    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8efa0274-9674-4514-812d-ca9d8e004993-multus-conf-dir\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:54.974760 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.974123    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09e68ce7-10cf-4906-a88c-6f93268fc0bd-etc-kubernetes\") pod \"tuned-drbjw\" (UID: \"09e68ce7-10cf-4906-a88c-6f93268fc0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-drbjw"
Jul 09 00:54:54.978108 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.978094    2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 00:54:54.998889 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.998862    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 00:49:53 +0000 UTC" deadline="2028-01-14 10:46:24.28971037 +0000 UTC"
Jul 09 00:54:54.999024 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:54.998889    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13305h51m29.290825238s"
Jul 09 00:54:55.037986 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.037924    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-31.ec2.internal" event={"ID":"d799c3ef85e5886492cae7cd2485596a","Type":"ContainerStarted","Data":"64ab7cdac702da2dab23eaa949da54f076ac2cb956e1a8f958c333f589d931f1"}
Jul 09 00:54:55.039241 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.039198    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-31.ec2.internal" event={"ID":"f0b2c6c86433a657dbf3a43f7bc9a86a","Type":"ContainerStarted","Data":"dbd68cc6b7be3130f9c3aeca3c74e057adffa2e3dc4745c555c07a767d803247"}
Jul 09 00:54:55.062290 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.062257    2557 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 09 00:54:55.075359 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.075250    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/09e68ce7-10cf-4906-a88c-6f93268fc0bd-run\") pod \"tuned-drbjw\" (UID: \"09e68ce7-10cf-4906-a88c-6f93268fc0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-drbjw"
Jul 09 00:54:55.075359 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.075290    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f91dc32b-758b-4085-b67b-a916f208c474-device-dir\") pod \"aws-ebs-csi-driver-node-l8t57\" (UID: \"f91dc32b-758b-4085-b67b-a916f208c474\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8t57"
Jul 09 00:54:55.075359 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.075317    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c0e400e4-1dce-4323-b09c-2ec402e5c312-run-openvswitch\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.075359 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.075338    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhmnb\" (UniqueName: \"kubernetes.io/projected/09e68ce7-10cf-4906-a88c-6f93268fc0bd-kube-api-access-jhmnb\") pod \"tuned-drbjw\" (UID: \"09e68ce7-10cf-4906-a88c-6f93268fc0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-drbjw"
Jul 09 00:54:55.075359 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.075359    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8efa0274-9674-4514-812d-ca9d8e004993-cnibin\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:55.075683 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.075410    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c0e400e4-1dce-4323-b09c-2ec402e5c312-host-run-netns\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.075683 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.075424    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/09e68ce7-10cf-4906-a88c-6f93268fc0bd-run\") pod \"tuned-drbjw\" (UID: \"09e68ce7-10cf-4906-a88c-6f93268fc0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-drbjw"
Jul 09 00:54:55.075683 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.075446    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c0e400e4-1dce-4323-b09c-2ec402e5c312-var-lib-openvswitch\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.075683 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.075417    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8efa0274-9674-4514-812d-ca9d8e004993-cnibin\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:55.075683 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.075484    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c0e400e4-1dce-4323-b09c-2ec402e5c312-host-run-ovn-kubernetes\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.075683 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.075536    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f91dc32b-758b-4085-b67b-a916f208c474-device-dir\") pod \"aws-ebs-csi-driver-node-l8t57\" (UID: \"f91dc32b-758b-4085-b67b-a916f208c474\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8t57"
Jul 09 00:54:55.075683 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.075566    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgwfb\" (UniqueName: \"kubernetes.io/projected/518d8542-a147-4718-9ae0-eda6710ea1a4-kube-api-access-qgwfb\") pod \"network-metrics-daemon-dgrzs\" (UID: \"518d8542-a147-4718-9ae0-eda6710ea1a4\") " pod="openshift-multus/network-metrics-daemon-dgrzs"
Jul 09 00:54:55.075683 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.075620    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09e68ce7-10cf-4906-a88c-6f93268fc0bd-var-lib-kubelet\") pod \"tuned-drbjw\" (UID: \"09e68ce7-10cf-4906-a88c-6f93268fc0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-drbjw"
Jul 09 00:54:55.075683 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.075657    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/09e68ce7-10cf-4906-a88c-6f93268fc0bd-etc-tuned\") pod \"tuned-drbjw\" (UID: \"09e68ce7-10cf-4906-a88c-6f93268fc0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-drbjw"
Jul 09 00:54:55.075683 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.075687    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f4dbea2c-28f9-4405-b905-f740dbe64a09-cni-binary-copy\") pod \"multus-additional-cni-plugins-dhpcm\" (UID: \"f4dbea2c-28f9-4405-b905-f740dbe64a09\") " pod="openshift-multus/multus-additional-cni-plugins-dhpcm"
Jul 09 00:54:55.076125 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.075694    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09e68ce7-10cf-4906-a88c-6f93268fc0bd-var-lib-kubelet\") pod \"tuned-drbjw\" (UID: \"09e68ce7-10cf-4906-a88c-6f93268fc0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-drbjw"
Jul 09 00:54:55.076125 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.075746    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/868053ea-aa08-4c9f-a2f6-05351b70b539-tmp-dir\") pod \"node-resolver-tkg22\" (UID: \"868053ea-aa08-4c9f-a2f6-05351b70b539\") " pod="openshift-dns/node-resolver-tkg22"
Jul 09 00:54:55.076125 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.075766    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/09e68ce7-10cf-4906-a88c-6f93268fc0bd-etc-systemd\") pod \"tuned-drbjw\" (UID: \"09e68ce7-10cf-4906-a88c-6f93268fc0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-drbjw"
Jul 09 00:54:55.076125 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.075785    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f4dbea2c-28f9-4405-b905-f740dbe64a09-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dhpcm\" (UID: \"f4dbea2c-28f9-4405-b905-f740dbe64a09\") " pod="openshift-multus/multus-additional-cni-plugins-dhpcm"
Jul 09 00:54:55.076125 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.075831    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8efa0274-9674-4514-812d-ca9d8e004993-host-var-lib-cni-multus\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:55.076125 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.075851    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8efa0274-9674-4514-812d-ca9d8e004993-host-var-lib-kubelet\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:55.076125 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.075872    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f91dc32b-758b-4085-b67b-a916f208c474-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l8t57\" (UID: \"f91dc32b-758b-4085-b67b-a916f208c474\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8t57"
Jul 09 00:54:55.076125 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.075915    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fc7293e1-bc7a-4d70-9cd2-2dd0b1b5c231-serviceca\") pod \"node-ca-xnxng\" (UID: \"fc7293e1-bc7a-4d70-9cd2-2dd0b1b5c231\") " pod="openshift-image-registry/node-ca-xnxng"
Jul 09 00:54:55.076125 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.075932    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8efa0274-9674-4514-812d-ca9d8e004993-etc-kubernetes\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:55.076125 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.075979    2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 09 00:54:55.076125 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.075988    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkz2k\" (UniqueName: \"kubernetes.io/projected/8efa0274-9674-4514-812d-ca9d8e004993-kube-api-access-wkz2k\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:55.076125 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.076009    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f91dc32b-758b-4085-b67b-a916f208c474-socket-dir\") pod \"aws-ebs-csi-driver-node-l8t57\" (UID: \"f91dc32b-758b-4085-b67b-a916f208c474\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8t57"
Jul 09 00:54:55.076125 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.076031    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f91dc32b-758b-4085-b67b-a916f208c474-etc-selinux\") pod \"aws-ebs-csi-driver-node-l8t57\" (UID: \"f91dc32b-758b-4085-b67b-a916f208c474\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8t57"
Jul 09 00:54:55.076125 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.076051    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c0e400e4-1dce-4323-b09c-2ec402e5c312-systemd-units\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.076125 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.076064    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c0e400e4-1dce-4323-b09c-2ec402e5c312-log-socket\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.076125 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.076084    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/09e68ce7-10cf-4906-a88c-6f93268fc0bd-etc-sysctl-d\") pod \"tuned-drbjw\" (UID: \"09e68ce7-10cf-4906-a88c-6f93268fc0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-drbjw"
Jul 09 00:54:55.076125 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.076105    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/09e68ce7-10cf-4906-a88c-6f93268fc0bd-lib-modules\") pod \"tuned-drbjw\" (UID: \"09e68ce7-10cf-4906-a88c-6f93268fc0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-drbjw"
Jul 09 00:54:55.076125 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.076126    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c0e400e4-1dce-4323-b09c-2ec402e5c312-ovnkube-script-lib\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.076920 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.076136    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8efa0274-9674-4514-812d-ca9d8e004993-host-var-lib-kubelet\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:55.076920 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.076146    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f00d32fa-a646-4c75-8c89-3b282d512750-agent-certs\") pod \"konnectivity-agent-pg99d\" (UID: \"f00d32fa-a646-4c75-8c89-3b282d512750\") " pod="kube-system/konnectivity-agent-pg99d"
Jul 09 00:54:55.076920 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.076222    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/09e68ce7-10cf-4906-a88c-6f93268fc0bd-etc-modprobe-d\") pod \"tuned-drbjw\" (UID: \"09e68ce7-10cf-4906-a88c-6f93268fc0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-drbjw"
Jul 09 00:54:55.076920 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.076245    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f4dbea2c-28f9-4405-b905-f740dbe64a09-os-release\") pod \"multus-additional-cni-plugins-dhpcm\" (UID: \"f4dbea2c-28f9-4405-b905-f740dbe64a09\") " pod="openshift-multus/multus-additional-cni-plugins-dhpcm"
Jul 09 00:54:55.076920 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.076268    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8efa0274-9674-4514-812d-ca9d8e004993-os-release\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:55.076920 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.076289    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8efa0274-9674-4514-812d-ca9d8e004993-multus-conf-dir\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:55.076920 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.076292    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/09e68ce7-10cf-4906-a88c-6f93268fc0bd-etc-sysctl-d\") pod \"tuned-drbjw\" (UID: \"09e68ce7-10cf-4906-a88c-6f93268fc0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-drbjw"
Jul 09 00:54:55.076920 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.076306    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f91dc32b-758b-4085-b67b-a916f208c474-socket-dir\") pod \"aws-ebs-csi-driver-node-l8t57\" (UID: \"f91dc32b-758b-4085-b67b-a916f208c474\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8t57"
Jul 09 00:54:55.076920 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.076381    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f91dc32b-758b-4085-b67b-a916f208c474-etc-selinux\") pod \"aws-ebs-csi-driver-node-l8t57\" (UID: \"f91dc32b-758b-4085-b67b-a916f208c474\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8t57"
Jul 09 00:54:55.076920 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.076394    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8efa0274-9674-4514-812d-ca9d8e004993-os-release\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:55.076920 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.076388    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/09e68ce7-10cf-4906-a88c-6f93268fc0bd-lib-modules\") pod \"tuned-drbjw\" (UID: \"09e68ce7-10cf-4906-a88c-6f93268fc0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-drbjw"
Jul 09 00:54:55.076920 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.076426    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8efa0274-9674-4514-812d-ca9d8e004993-multus-conf-dir\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:55.076920 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.076461    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f91dc32b-758b-4085-b67b-a916f208c474-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l8t57\" (UID: \"f91dc32b-758b-4085-b67b-a916f208c474\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8t57"
Jul 09 00:54:55.076920 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.076517    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f4dbea2c-28f9-4405-b905-f740dbe64a09-os-release\") pod \"multus-additional-cni-plugins-dhpcm\" (UID: \"f4dbea2c-28f9-4405-b905-f740dbe64a09\") " pod="openshift-multus/multus-additional-cni-plugins-dhpcm"
Jul 09 00:54:55.076920 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.076554    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8efa0274-9674-4514-812d-ca9d8e004993-etc-kubernetes\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:55.076920 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.076571    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/868053ea-aa08-4c9f-a2f6-05351b70b539-tmp-dir\") pod \"node-resolver-tkg22\" (UID: \"868053ea-aa08-4c9f-a2f6-05351b70b539\") " pod="openshift-dns/node-resolver-tkg22"
Jul 09 00:54:55.076920 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.076627    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8efa0274-9674-4514-812d-ca9d8e004993-host-var-lib-cni-multus\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:55.076920 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.076630    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/09e68ce7-10cf-4906-a88c-6f93268fc0bd-etc-modprobe-d\") pod \"tuned-drbjw\" (UID: \"09e68ce7-10cf-4906-a88c-6f93268fc0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-drbjw"
Jul 09 00:54:55.077774 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.076644    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/09e68ce7-10cf-4906-a88c-6f93268fc0bd-etc-systemd\") pod \"tuned-drbjw\" (UID: \"09e68ce7-10cf-4906-a88c-6f93268fc0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-drbjw"
Jul 09 00:54:55.077774 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.076719    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c0e400e4-1dce-4323-b09c-2ec402e5c312-ovnkube-config\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.077774 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.076735    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c0e400e4-1dce-4323-b09c-2ec402e5c312-node-log\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.077774 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.076752    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fc7293e1-bc7a-4d70-9cd2-2dd0b1b5c231-serviceca\") pod \"node-ca-xnxng\" (UID: \"fc7293e1-bc7a-4d70-9cd2-2dd0b1b5c231\") " pod="openshift-image-registry/node-ca-xnxng"
Jul 09 00:54:55.077774 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.076753    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f00d32fa-a646-4c75-8c89-3b282d512750-konnectivity-ca\") pod \"konnectivity-agent-pg99d\" (UID: \"f00d32fa-a646-4c75-8c89-3b282d512750\") " pod="kube-system/konnectivity-agent-pg99d"
Jul 09 00:54:55.077774 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.076815    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09e68ce7-10cf-4906-a88c-6f93268fc0bd-etc-kubernetes\") pod \"tuned-drbjw\" (UID: \"09e68ce7-10cf-4906-a88c-6f93268fc0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-drbjw"
Jul 09 00:54:55.077774 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.076837    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f4dbea2c-28f9-4405-b905-f740dbe64a09-cni-binary-copy\") pod \"multus-additional-cni-plugins-dhpcm\" (UID: \"f4dbea2c-28f9-4405-b905-f740dbe64a09\") " pod="openshift-multus/multus-additional-cni-plugins-dhpcm"
Jul 09 00:54:55.077774 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.076858    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3b8f52dc-405f-4c16-b837-97ea642f9341-host-slash\") pod \"iptables-alerter-bwnrj\" (UID: \"3b8f52dc-405f-4c16-b837-97ea642f9341\") " pod="openshift-network-operator/iptables-alerter-bwnrj"
Jul 09 00:54:55.077774 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.076876    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09e68ce7-10cf-4906-a88c-6f93268fc0bd-etc-kubernetes\") pod \"tuned-drbjw\" (UID: \"09e68ce7-10cf-4906-a88c-6f93268fc0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-drbjw"
Jul 09 00:54:55.077774 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.076912    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f91dc32b-758b-4085-b67b-a916f208c474-registration-dir\") pod \"aws-ebs-csi-driver-node-l8t57\" (UID: \"f91dc32b-758b-4085-b67b-a916f208c474\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8t57"
Jul 09 00:54:55.077774 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.076936    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c0e400e4-1dce-4323-b09c-2ec402e5c312-run-systemd\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.077774 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.076957    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c0e400e4-1dce-4323-b09c-2ec402e5c312-host-cni-netd\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.077774 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.076981    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c0e400e4-1dce-4323-b09c-2ec402e5c312-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.077774 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.076987    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f91dc32b-758b-4085-b67b-a916f208c474-registration-dir\") pod \"aws-ebs-csi-driver-node-l8t57\" (UID: \"f91dc32b-758b-4085-b67b-a916f208c474\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8t57"
Jul 09 00:54:55.077774 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.077001    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f4dbea2c-28f9-4405-b905-f740dbe64a09-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dhpcm\" (UID: \"f4dbea2c-28f9-4405-b905-f740dbe64a09\") " pod="openshift-multus/multus-additional-cni-plugins-dhpcm"
Jul 09 00:54:55.077774 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.077020    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c0e400e4-1dce-4323-b09c-2ec402e5c312-env-overrides\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.077774 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.077027    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3b8f52dc-405f-4c16-b837-97ea642f9341-host-slash\") pod \"iptables-alerter-bwnrj\" (UID: \"3b8f52dc-405f-4c16-b837-97ea642f9341\") " pod="openshift-network-operator/iptables-alerter-bwnrj"
Jul 09 00:54:55.078532 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.077050    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48d74\" (UniqueName: \"kubernetes.io/projected/f4dbea2c-28f9-4405-b905-f740dbe64a09-kube-api-access-48d74\") pod \"multus-additional-cni-plugins-dhpcm\" (UID: \"f4dbea2c-28f9-4405-b905-f740dbe64a09\") " pod="openshift-multus/multus-additional-cni-plugins-dhpcm"
Jul 09 00:54:55.078532 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.077068    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj6pd\" (UniqueName: \"kubernetes.io/projected/fc7293e1-bc7a-4d70-9cd2-2dd0b1b5c231-kube-api-access-zj6pd\") pod \"node-ca-xnxng\" (UID: \"fc7293e1-bc7a-4d70-9cd2-2dd0b1b5c231\") " pod="openshift-image-registry/node-ca-xnxng"
Jul 09 00:54:55.078532 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.077089    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8efa0274-9674-4514-812d-ca9d8e004993-host-var-lib-cni-bin\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:55.078532 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.077109    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8efa0274-9674-4514-812d-ca9d8e004993-hostroot\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:55.078532 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.077146    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8efa0274-9674-4514-812d-ca9d8e004993-hostroot\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:55.078532 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.077287    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8efa0274-9674-4514-812d-ca9d8e004993-host-var-lib-cni-bin\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:55.078532 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.077294    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8efa0274-9674-4514-812d-ca9d8e004993-host-run-multus-certs\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:55.078532 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.077336    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f91dc32b-758b-4085-b67b-a916f208c474-sys-fs\") pod \"aws-ebs-csi-driver-node-l8t57\" (UID: \"f91dc32b-758b-4085-b67b-a916f208c474\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8t57"
Jul 09 00:54:55.078532 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.077336    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8efa0274-9674-4514-812d-ca9d8e004993-host-run-multus-certs\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:55.078532 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.077362    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c0e400e4-1dce-4323-b09c-2ec402e5c312-run-ovn\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.078532 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.077384    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/09e68ce7-10cf-4906-a88c-6f93268fc0bd-sys\") pod \"tuned-drbjw\" (UID: \"09e68ce7-10cf-4906-a88c-6f93268fc0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-drbjw"
Jul 09 00:54:55.078532 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.077408    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f91dc32b-758b-4085-b67b-a916f208c474-sys-fs\") pod \"aws-ebs-csi-driver-node-l8t57\" (UID: \"f91dc32b-758b-4085-b67b-a916f208c474\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8t57"
Jul 09 00:54:55.078532 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.077405    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f4dbea2c-28f9-4405-b905-f740dbe64a09-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dhpcm\" (UID: \"f4dbea2c-28f9-4405-b905-f740dbe64a09\") " pod="openshift-multus/multus-additional-cni-plugins-dhpcm"
Jul 09 00:54:55.078532 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.077448    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/09e68ce7-10cf-4906-a88c-6f93268fc0bd-sys\") pod \"tuned-drbjw\" (UID: \"09e68ce7-10cf-4906-a88c-6f93268fc0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-drbjw"
Jul 09 00:54:55.078532 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.077470    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26cbq\" (UniqueName: \"kubernetes.io/projected/868053ea-aa08-4c9f-a2f6-05351b70b539-kube-api-access-26cbq\") pod \"node-resolver-tkg22\" (UID: \"868053ea-aa08-4c9f-a2f6-05351b70b539\") " pod="openshift-dns/node-resolver-tkg22"
Jul 09 00:54:55.078532 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.077494    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c0e400e4-1dce-4323-b09c-2ec402e5c312-host-slash\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.078532 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.077518    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/65de29a1-ee8f-4539-8e6d-997a7889fc85-original-pull-secret\") pod \"global-pull-secret-syncer-8p4px\" (UID: \"65de29a1-ee8f-4539-8e6d-997a7889fc85\") " pod="kube-system/global-pull-secret-syncer-8p4px"
Jul 09 00:54:55.079281 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.077543    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fc7293e1-bc7a-4d70-9cd2-2dd0b1b5c231-host\") pod \"node-ca-xnxng\" (UID: \"fc7293e1-bc7a-4d70-9cd2-2dd0b1b5c231\") " pod="openshift-image-registry/node-ca-xnxng"
Jul 09 00:54:55.079281 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.077564    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8efa0274-9674-4514-812d-ca9d8e004993-multus-socket-dir-parent\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:55.079281 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.077587    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3b8f52dc-405f-4c16-b837-97ea642f9341-iptables-alerter-script\") pod \"iptables-alerter-bwnrj\" (UID: \"3b8f52dc-405f-4c16-b837-97ea642f9341\") " pod="openshift-network-operator/iptables-alerter-bwnrj"
Jul 09 00:54:55.079281 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.077616    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c0e400e4-1dce-4323-b09c-2ec402e5c312-host-cni-bin\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.079281 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.077643    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srslm\" (UniqueName: \"kubernetes.io/projected/c0e400e4-1dce-4323-b09c-2ec402e5c312-kube-api-access-srslm\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.079281 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.077667    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/65de29a1-ee8f-4539-8e6d-997a7889fc85-kubelet-config\") pod \"global-pull-secret-syncer-8p4px\" (UID: \"65de29a1-ee8f-4539-8e6d-997a7889fc85\") " pod="kube-system/global-pull-secret-syncer-8p4px"
Jul 09 00:54:55.079281 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.077670    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8efa0274-9674-4514-812d-ca9d8e004993-multus-socket-dir-parent\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:55.079281 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.077768    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8efa0274-9674-4514-812d-ca9d8e004993-host-run-k8s-cni-cncf-io\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:55.079281 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.077790    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8efa0274-9674-4514-812d-ca9d8e004993-host-run-netns\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:55.079281 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.077799    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f4dbea2c-28f9-4405-b905-f740dbe64a09-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dhpcm\" (UID: \"f4dbea2c-28f9-4405-b905-f740dbe64a09\") " pod="openshift-multus/multus-additional-cni-plugins-dhpcm"
Jul 09 00:54:55.079281 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.077810    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8efa0274-9674-4514-812d-ca9d8e004993-multus-daemon-config\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:55.079281 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.077845    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/868053ea-aa08-4c9f-a2f6-05351b70b539-hosts-file\") pod \"node-resolver-tkg22\" (UID: \"868053ea-aa08-4c9f-a2f6-05351b70b539\") " pod="openshift-dns/node-resolver-tkg22"
Jul 09 00:54:55.079281 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.077860    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8efa0274-9674-4514-812d-ca9d8e004993-host-run-k8s-cni-cncf-io\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:55.079281 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.077876    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f4dbea2c-28f9-4405-b905-f740dbe64a09-system-cni-dir\") pod \"multus-additional-cni-plugins-dhpcm\" (UID: \"f4dbea2c-28f9-4405-b905-f740dbe64a09\") " pod="openshift-multus/multus-additional-cni-plugins-dhpcm"
Jul 09 00:54:55.079281 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.077894    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8efa0274-9674-4514-812d-ca9d8e004993-system-cni-dir\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:55.079281 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.077899    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fc7293e1-bc7a-4d70-9cd2-2dd0b1b5c231-host\") pod \"node-ca-xnxng\" (UID: \"fc7293e1-bc7a-4d70-9cd2-2dd0b1b5c231\") " pod="openshift-image-registry/node-ca-xnxng"
Jul 09 00:54:55.079281 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.077912    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8efa0274-9674-4514-812d-ca9d8e004993-multus-cni-dir\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:55.079993 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.077934    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8efa0274-9674-4514-812d-ca9d8e004993-cni-binary-copy\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:55.079993 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.077947    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/868053ea-aa08-4c9f-a2f6-05351b70b539-hosts-file\") pod \"node-resolver-tkg22\" (UID: \"868053ea-aa08-4c9f-a2f6-05351b70b539\") " pod="openshift-dns/node-resolver-tkg22"
Jul 09 00:54:55.079993 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.077951    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c0e400e4-1dce-4323-b09c-2ec402e5c312-etc-openvswitch\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.079993 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.077982    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8efa0274-9674-4514-812d-ca9d8e004993-host-run-netns\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:55.079993 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.077997    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f4dbea2c-28f9-4405-b905-f740dbe64a09-system-cni-dir\") pod \"multus-additional-cni-plugins-dhpcm\" (UID: \"f4dbea2c-28f9-4405-b905-f740dbe64a09\") " pod="openshift-multus/multus-additional-cni-plugins-dhpcm"
Jul 09 00:54:55.079993 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.078009    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c0e400e4-1dce-4323-b09c-2ec402e5c312-ovn-node-metrics-cert\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.079993 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.078036    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09e68ce7-10cf-4906-a88c-6f93268fc0bd-tmp\") pod \"tuned-drbjw\" (UID: \"09e68ce7-10cf-4906-a88c-6f93268fc0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-drbjw"
Jul 09 00:54:55.079993 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.078039    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8efa0274-9674-4514-812d-ca9d8e004993-system-cni-dir\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:55.079993 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.078060    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcqr5\" (UniqueName: \"kubernetes.io/projected/dcdf29b1-919a-48db-88d5-8cb2e105bb01-kube-api-access-zcqr5\") pod \"network-check-target-dvvxg\" (UID: \"dcdf29b1-919a-48db-88d5-8cb2e105bb01\") " pod="openshift-network-diagnostics/network-check-target-dvvxg"
Jul 09 00:54:55.079993 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.078084    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/65de29a1-ee8f-4539-8e6d-997a7889fc85-dbus\") pod \"global-pull-secret-syncer-8p4px\" (UID: \"65de29a1-ee8f-4539-8e6d-997a7889fc85\") " pod="kube-system/global-pull-secret-syncer-8p4px"
Jul 09 00:54:55.079993 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.078105    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/09e68ce7-10cf-4906-a88c-6f93268fc0bd-etc-sysconfig\") pod \"tuned-drbjw\" (UID: \"09e68ce7-10cf-4906-a88c-6f93268fc0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-drbjw"
Jul 09 00:54:55.079993 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.078127    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/09e68ce7-10cf-4906-a88c-6f93268fc0bd-etc-sysctl-conf\") pod \"tuned-drbjw\" (UID: \"09e68ce7-10cf-4906-a88c-6f93268fc0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-drbjw"
Jul 09 00:54:55.079993 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.078152    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8efa0274-9674-4514-812d-ca9d8e004993-multus-cni-dir\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:55.079993 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.078155    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/09e68ce7-10cf-4906-a88c-6f93268fc0bd-host\") pod \"tuned-drbjw\" (UID: \"09e68ce7-10cf-4906-a88c-6f93268fc0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-drbjw"
Jul 09 00:54:55.079993 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.078191    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f4dbea2c-28f9-4405-b905-f740dbe64a09-cnibin\") pod \"multus-additional-cni-plugins-dhpcm\" (UID: \"f4dbea2c-28f9-4405-b905-f740dbe64a09\") " pod="openshift-multus/multus-additional-cni-plugins-dhpcm"
Jul 09 00:54:55.079993 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.078193    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/09e68ce7-10cf-4906-a88c-6f93268fc0bd-host\") pod \"tuned-drbjw\" (UID: \"09e68ce7-10cf-4906-a88c-6f93268fc0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-drbjw"
Jul 09 00:54:55.079993 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.078235    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f4dbea2c-28f9-4405-b905-f740dbe64a09-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dhpcm\" (UID: \"f4dbea2c-28f9-4405-b905-f740dbe64a09\") " pod="openshift-multus/multus-additional-cni-plugins-dhpcm"
Jul 09 00:54:55.080744 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.078259    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4p7jb\" (UniqueName: \"kubernetes.io/projected/3b8f52dc-405f-4c16-b837-97ea642f9341-kube-api-access-4p7jb\") pod \"iptables-alerter-bwnrj\" (UID: \"3b8f52dc-405f-4c16-b837-97ea642f9341\") " pod="openshift-network-operator/iptables-alerter-bwnrj"
Jul 09 00:54:55.080744 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.078282    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mbm7\" (UniqueName: \"kubernetes.io/projected/f91dc32b-758b-4085-b67b-a916f208c474-kube-api-access-2mbm7\") pod \"aws-ebs-csi-driver-node-l8t57\" (UID: \"f91dc32b-758b-4085-b67b-a916f208c474\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8t57"
Jul 09 00:54:55.080744 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.078308    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c0e400e4-1dce-4323-b09c-2ec402e5c312-host-kubelet\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.080744 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.078330    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/518d8542-a147-4718-9ae0-eda6710ea1a4-metrics-certs\") pod \"network-metrics-daemon-dgrzs\" (UID: \"518d8542-a147-4718-9ae0-eda6710ea1a4\") " pod="openshift-multus/network-metrics-daemon-dgrzs"
Jul 09 00:54:55.080744 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:55.078442    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 00:54:55.080744 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.078444    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/09e68ce7-10cf-4906-a88c-6f93268fc0bd-etc-sysconfig\") pod \"tuned-drbjw\" (UID: \"09e68ce7-10cf-4906-a88c-6f93268fc0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-drbjw"
Jul 09 00:54:55.080744 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.078105    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3b8f52dc-405f-4c16-b837-97ea642f9341-iptables-alerter-script\") pod \"iptables-alerter-bwnrj\" (UID: \"3b8f52dc-405f-4c16-b837-97ea642f9341\") " pod="openshift-network-operator/iptables-alerter-bwnrj"
Jul 09 00:54:55.080744 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.078460    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f4dbea2c-28f9-4405-b905-f740dbe64a09-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dhpcm\" (UID: \"f4dbea2c-28f9-4405-b905-f740dbe64a09\") " pod="openshift-multus/multus-additional-cni-plugins-dhpcm"
Jul 09 00:54:55.080744 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:55.078524    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/518d8542-a147-4718-9ae0-eda6710ea1a4-metrics-certs podName:518d8542-a147-4718-9ae0-eda6710ea1a4 nodeName:}" failed. No retries permitted until 2026-07-09 00:54:55.578496073 +0000 UTC m=+3.048638794 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/518d8542-a147-4718-9ae0-eda6710ea1a4-metrics-certs") pod "network-metrics-daemon-dgrzs" (UID: "518d8542-a147-4718-9ae0-eda6710ea1a4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 00:54:55.080744 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.078568    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/09e68ce7-10cf-4906-a88c-6f93268fc0bd-etc-sysctl-conf\") pod \"tuned-drbjw\" (UID: \"09e68ce7-10cf-4906-a88c-6f93268fc0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-drbjw"
Jul 09 00:54:55.080744 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.078952    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8efa0274-9674-4514-812d-ca9d8e004993-cni-binary-copy\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:55.080744 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.078978    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f4dbea2c-28f9-4405-b905-f740dbe64a09-cnibin\") pod \"multus-additional-cni-plugins-dhpcm\" (UID: \"f4dbea2c-28f9-4405-b905-f740dbe64a09\") " pod="openshift-multus/multus-additional-cni-plugins-dhpcm"
Jul 09 00:54:55.080744 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.079015    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8efa0274-9674-4514-812d-ca9d8e004993-multus-daemon-config\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:55.081933 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.081913    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/09e68ce7-10cf-4906-a88c-6f93268fc0bd-etc-tuned\") pod \"tuned-drbjw\" (UID: \"09e68ce7-10cf-4906-a88c-6f93268fc0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-drbjw"
Jul 09 00:54:55.082065 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.082048    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09e68ce7-10cf-4906-a88c-6f93268fc0bd-tmp\") pod \"tuned-drbjw\" (UID: \"09e68ce7-10cf-4906-a88c-6f93268fc0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-drbjw"
Jul 09 00:54:55.083806 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.083747    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhmnb\" (UniqueName: \"kubernetes.io/projected/09e68ce7-10cf-4906-a88c-6f93268fc0bd-kube-api-access-jhmnb\") pod \"tuned-drbjw\" (UID: \"09e68ce7-10cf-4906-a88c-6f93268fc0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-drbjw"
Jul 09 00:54:55.085763 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.085725    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgwfb\" (UniqueName: \"kubernetes.io/projected/518d8542-a147-4718-9ae0-eda6710ea1a4-kube-api-access-qgwfb\") pod \"network-metrics-daemon-dgrzs\" (UID: \"518d8542-a147-4718-9ae0-eda6710ea1a4\") " pod="openshift-multus/network-metrics-daemon-dgrzs"
Jul 09 00:54:55.086608 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:55.086578    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 00:54:55.086703 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:55.086617    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 00:54:55.086703 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:55.086629    2557 projected.go:196] Error preparing data for projected volume kube-api-access-zcqr5 for pod openshift-network-diagnostics/network-check-target-dvvxg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 00:54:55.086703 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:55.086679    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dcdf29b1-919a-48db-88d5-8cb2e105bb01-kube-api-access-zcqr5 podName:dcdf29b1-919a-48db-88d5-8cb2e105bb01 nodeName:}" failed. No retries permitted until 2026-07-09 00:54:55.586663316 +0000 UTC m=+3.056806024 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zcqr5" (UniqueName: "kubernetes.io/projected/dcdf29b1-919a-48db-88d5-8cb2e105bb01-kube-api-access-zcqr5") pod "network-check-target-dvvxg" (UID: "dcdf29b1-919a-48db-88d5-8cb2e105bb01") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 00:54:55.089542 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.089503    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48d74\" (UniqueName: \"kubernetes.io/projected/f4dbea2c-28f9-4405-b905-f740dbe64a09-kube-api-access-48d74\") pod \"multus-additional-cni-plugins-dhpcm\" (UID: \"f4dbea2c-28f9-4405-b905-f740dbe64a09\") " pod="openshift-multus/multus-additional-cni-plugins-dhpcm"
Jul 09 00:54:55.089822 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.089785    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkz2k\" (UniqueName: \"kubernetes.io/projected/8efa0274-9674-4514-812d-ca9d8e004993-kube-api-access-wkz2k\") pod \"multus-7wcz6\" (UID: \"8efa0274-9674-4514-812d-ca9d8e004993\") " pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:55.089905 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.089851    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mbm7\" (UniqueName: \"kubernetes.io/projected/f91dc32b-758b-4085-b67b-a916f208c474-kube-api-access-2mbm7\") pod \"aws-ebs-csi-driver-node-l8t57\" (UID: \"f91dc32b-758b-4085-b67b-a916f208c474\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8t57"
Jul 09 00:54:55.090009 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.089988    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26cbq\" (UniqueName: \"kubernetes.io/projected/868053ea-aa08-4c9f-a2f6-05351b70b539-kube-api-access-26cbq\") pod \"node-resolver-tkg22\" (UID: \"868053ea-aa08-4c9f-a2f6-05351b70b539\") " pod="openshift-dns/node-resolver-tkg22"
Jul 09 00:54:55.090271 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.090197    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj6pd\" (UniqueName: \"kubernetes.io/projected/fc7293e1-bc7a-4d70-9cd2-2dd0b1b5c231-kube-api-access-zj6pd\") pod \"node-ca-xnxng\" (UID: \"fc7293e1-bc7a-4d70-9cd2-2dd0b1b5c231\") " pod="openshift-image-registry/node-ca-xnxng"
Jul 09 00:54:55.090372 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.090348    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4p7jb\" (UniqueName: \"kubernetes.io/projected/3b8f52dc-405f-4c16-b837-97ea642f9341-kube-api-access-4p7jb\") pod \"iptables-alerter-bwnrj\" (UID: \"3b8f52dc-405f-4c16-b837-97ea642f9341\") " pod="openshift-network-operator/iptables-alerter-bwnrj"
Jul 09 00:54:55.179514 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.179481    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c0e400e4-1dce-4323-b09c-2ec402e5c312-host-run-netns\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.179669 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.179523    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c0e400e4-1dce-4323-b09c-2ec402e5c312-var-lib-openvswitch\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.179669 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.179548    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c0e400e4-1dce-4323-b09c-2ec402e5c312-host-run-ovn-kubernetes\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.179669 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.179583    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c0e400e4-1dce-4323-b09c-2ec402e5c312-systemd-units\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.179669 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.179607    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c0e400e4-1dce-4323-b09c-2ec402e5c312-log-socket\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.179669 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.179629    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c0e400e4-1dce-4323-b09c-2ec402e5c312-ovnkube-script-lib\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.179669 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.179649    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f00d32fa-a646-4c75-8c89-3b282d512750-agent-certs\") pod \"konnectivity-agent-pg99d\" (UID: \"f00d32fa-a646-4c75-8c89-3b282d512750\") " pod="kube-system/konnectivity-agent-pg99d"
Jul 09 00:54:55.179942 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.179684    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c0e400e4-1dce-4323-b09c-2ec402e5c312-ovnkube-config\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.179942 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.179716    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c0e400e4-1dce-4323-b09c-2ec402e5c312-node-log\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.179942 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.179739    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f00d32fa-a646-4c75-8c89-3b282d512750-konnectivity-ca\") pod \"konnectivity-agent-pg99d\" (UID: \"f00d32fa-a646-4c75-8c89-3b282d512750\") " pod="kube-system/konnectivity-agent-pg99d"
Jul 09 00:54:55.179942 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.179810    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c0e400e4-1dce-4323-b09c-2ec402e5c312-run-systemd\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.179942 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.179857    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c0e400e4-1dce-4323-b09c-2ec402e5c312-host-run-netns\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.179942 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.179888    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c0e400e4-1dce-4323-b09c-2ec402e5c312-var-lib-openvswitch\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.179942 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.179921    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c0e400e4-1dce-4323-b09c-2ec402e5c312-host-run-ovn-kubernetes\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.180270 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.179952    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c0e400e4-1dce-4323-b09c-2ec402e5c312-systemd-units\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.180270 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.179986    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c0e400e4-1dce-4323-b09c-2ec402e5c312-log-socket\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.180877 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.180545    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c0e400e4-1dce-4323-b09c-2ec402e5c312-ovnkube-script-lib\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.180877 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.180857    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c0e400e4-1dce-4323-b09c-2ec402e5c312-run-systemd\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.181042 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.180900    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c0e400e4-1dce-4323-b09c-2ec402e5c312-host-cni-netd\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.181042 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.180926    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c0e400e4-1dce-4323-b09c-2ec402e5c312-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.181042 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.180952    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c0e400e4-1dce-4323-b09c-2ec402e5c312-env-overrides\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.181042 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.180980    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c0e400e4-1dce-4323-b09c-2ec402e5c312-run-ovn\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.181042 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.181003    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c0e400e4-1dce-4323-b09c-2ec402e5c312-host-slash\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.181042 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.181037    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/65de29a1-ee8f-4539-8e6d-997a7889fc85-original-pull-secret\") pod \"global-pull-secret-syncer-8p4px\" (UID: \"65de29a1-ee8f-4539-8e6d-997a7889fc85\") " pod="kube-system/global-pull-secret-syncer-8p4px"
Jul 09 00:54:55.181342 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.181067    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c0e400e4-1dce-4323-b09c-2ec402e5c312-host-cni-bin\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.181342 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.181090    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srslm\" (UniqueName: \"kubernetes.io/projected/c0e400e4-1dce-4323-b09c-2ec402e5c312-kube-api-access-srslm\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.181342 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.181111    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/65de29a1-ee8f-4539-8e6d-997a7889fc85-kubelet-config\") pod \"global-pull-secret-syncer-8p4px\" (UID: \"65de29a1-ee8f-4539-8e6d-997a7889fc85\") " pod="kube-system/global-pull-secret-syncer-8p4px"
Jul 09 00:54:55.181342 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.181141    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c0e400e4-1dce-4323-b09c-2ec402e5c312-etc-openvswitch\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.181342 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.181166    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c0e400e4-1dce-4323-b09c-2ec402e5c312-ovn-node-metrics-cert\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.181342 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.181224    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/65de29a1-ee8f-4539-8e6d-997a7889fc85-dbus\") pod \"global-pull-secret-syncer-8p4px\" (UID: \"65de29a1-ee8f-4539-8e6d-997a7889fc85\") " pod="kube-system/global-pull-secret-syncer-8p4px"
Jul 09 00:54:55.181342 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.181253    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c0e400e4-1dce-4323-b09c-2ec402e5c312-host-kubelet\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.181342 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.181290    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c0e400e4-1dce-4323-b09c-2ec402e5c312-run-openvswitch\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.181342 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.181327    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c0e400e4-1dce-4323-b09c-2ec402e5c312-ovnkube-config\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.181724 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.181363    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c0e400e4-1dce-4323-b09c-2ec402e5c312-run-openvswitch\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.181724 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.181387    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c0e400e4-1dce-4323-b09c-2ec402e5c312-node-log\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.181724 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.181416    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c0e400e4-1dce-4323-b09c-2ec402e5c312-host-cni-netd\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.181724 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.181453    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c0e400e4-1dce-4323-b09c-2ec402e5c312-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.181899 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.181816    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c0e400e4-1dce-4323-b09c-2ec402e5c312-env-overrides\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.181899 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.181860    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f00d32fa-a646-4c75-8c89-3b282d512750-konnectivity-ca\") pod \"konnectivity-agent-pg99d\" (UID: \"f00d32fa-a646-4c75-8c89-3b282d512750\") " pod="kube-system/konnectivity-agent-pg99d"
Jul 09 00:54:55.181899 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.181873    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/65de29a1-ee8f-4539-8e6d-997a7889fc85-kubelet-config\") pod \"global-pull-secret-syncer-8p4px\" (UID: \"65de29a1-ee8f-4539-8e6d-997a7889fc85\") " pod="kube-system/global-pull-secret-syncer-8p4px"
Jul 09 00:54:55.182030 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.181922    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c0e400e4-1dce-4323-b09c-2ec402e5c312-host-slash\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.182030 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.181932    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/65de29a1-ee8f-4539-8e6d-997a7889fc85-dbus\") pod \"global-pull-secret-syncer-8p4px\" (UID: \"65de29a1-ee8f-4539-8e6d-997a7889fc85\") " pod="kube-system/global-pull-secret-syncer-8p4px"
Jul 09 00:54:55.182030 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.181966    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c0e400e4-1dce-4323-b09c-2ec402e5c312-host-kubelet\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.182030 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:55.182028    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 00:54:55.182286 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:55.182078    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65de29a1-ee8f-4539-8e6d-997a7889fc85-original-pull-secret podName:65de29a1-ee8f-4539-8e6d-997a7889fc85 nodeName:}" failed. No retries permitted until 2026-07-09 00:54:55.682061063 +0000 UTC m=+3.152203774 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/65de29a1-ee8f-4539-8e6d-997a7889fc85-original-pull-secret") pod "global-pull-secret-syncer-8p4px" (UID: "65de29a1-ee8f-4539-8e6d-997a7889fc85") : object "kube-system"/"original-pull-secret" not registered
Jul 09 00:54:55.182286 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.182077    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c0e400e4-1dce-4323-b09c-2ec402e5c312-host-cni-bin\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.182286 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.182135    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c0e400e4-1dce-4323-b09c-2ec402e5c312-run-ovn\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.182286 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.182169    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c0e400e4-1dce-4323-b09c-2ec402e5c312-etc-openvswitch\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.185275 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.185253    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c0e400e4-1dce-4323-b09c-2ec402e5c312-ovn-node-metrics-cert\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.187024 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.186980    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f00d32fa-a646-4c75-8c89-3b282d512750-agent-certs\") pod \"konnectivity-agent-pg99d\" (UID: \"f00d32fa-a646-4c75-8c89-3b282d512750\") " pod="kube-system/konnectivity-agent-pg99d"
Jul 09 00:54:55.194790 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.194744    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srslm\" (UniqueName: \"kubernetes.io/projected/c0e400e4-1dce-4323-b09c-2ec402e5c312-kube-api-access-srslm\") pod \"ovnkube-node-bp8t6\" (UID: \"c0e400e4-1dce-4323-b09c-2ec402e5c312\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.252542 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.252509    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-drbjw"
Jul 09 00:54:55.260832 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.260673    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7wcz6"
Jul 09 00:54:55.261822 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.261654    2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 00:54:55.264938 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:55.264676    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09e68ce7_10cf_4906_a88c_6f93268fc0bd.slice/crio-0406519642b258845f448bb7a1e862d68d6529b18ba1587899923f46beb88f4d WatchSource:0}: Error finding container 0406519642b258845f448bb7a1e862d68d6529b18ba1587899923f46beb88f4d: Status 404 returned error can't find the container with id 0406519642b258845f448bb7a1e862d68d6529b18ba1587899923f46beb88f4d
Jul 09 00:54:55.269580 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.269426    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dhpcm"
Jul 09 00:54:55.270402 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:55.270310    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8efa0274_9674_4514_812d_ca9d8e004993.slice/crio-857f2aefe5dce404538930c8069db99275151993b7e5748893f0e62573cd4abd WatchSource:0}: Error finding container 857f2aefe5dce404538930c8069db99275151993b7e5748893f0e62573cd4abd: Status 404 returned error can't find the container with id 857f2aefe5dce404538930c8069db99275151993b7e5748893f0e62573cd4abd
Jul 09 00:54:55.275688 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.275668    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bwnrj"
Jul 09 00:54:55.281581 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.281561    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8t57"
Jul 09 00:54:55.282228 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:55.282183    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4dbea2c_28f9_4405_b905_f740dbe64a09.slice/crio-d570c6ecc56160e9e6bb036a373a4928ecdc3646cf0314c2a723443d86e0e21a WatchSource:0}: Error finding container d570c6ecc56160e9e6bb036a373a4928ecdc3646cf0314c2a723443d86e0e21a: Status 404 returned error can't find the container with id d570c6ecc56160e9e6bb036a373a4928ecdc3646cf0314c2a723443d86e0e21a
Jul 09 00:54:55.288024 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.288005    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tkg22"
Jul 09 00:54:55.289954 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:55.289933    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b8f52dc_405f_4c16_b837_97ea642f9341.slice/crio-8e2f8c16ab800cdf5c3908704d609aa107c2f6161529a7bc588ea15ec4f8632b WatchSource:0}: Error finding container 8e2f8c16ab800cdf5c3908704d609aa107c2f6161529a7bc588ea15ec4f8632b: Status 404 returned error can't find the container with id 8e2f8c16ab800cdf5c3908704d609aa107c2f6161529a7bc588ea15ec4f8632b
Jul 09 00:54:55.293293 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.293251    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xnxng"
Jul 09 00:54:55.295423 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:55.295399    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf91dc32b_758b_4085_b67b_a916f208c474.slice/crio-663465da6fb6e209edb2b0e3c84f0fc342d58b6d3fb5e8c9d58b661cc3e9aee8 WatchSource:0}: Error finding container 663465da6fb6e209edb2b0e3c84f0fc342d58b6d3fb5e8c9d58b661cc3e9aee8: Status 404 returned error can't find the container with id 663465da6fb6e209edb2b0e3c84f0fc342d58b6d3fb5e8c9d58b661cc3e9aee8
Jul 09 00:54:55.298191 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:55.298170    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod868053ea_aa08_4c9f_a2f6_05351b70b539.slice/crio-526733ab977e6668c2dd95e797e95229e01152a188869cf0511c38d138c88745 WatchSource:0}: Error finding container 526733ab977e6668c2dd95e797e95229e01152a188869cf0511c38d138c88745: Status 404 returned error can't find the container with id 526733ab977e6668c2dd95e797e95229e01152a188869cf0511c38d138c88745
Jul 09 00:54:55.300072 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.300053    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:54:55.304685 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.304669    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pg99d"
Jul 09 00:54:55.307044 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:55.307022    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc7293e1_bc7a_4d70_9cd2_2dd0b1b5c231.slice/crio-55188db74e7db3b788aa7a4e8a60b81e0e5f6be3c4967c0748c66bcf132e1fa6 WatchSource:0}: Error finding container 55188db74e7db3b788aa7a4e8a60b81e0e5f6be3c4967c0748c66bcf132e1fa6: Status 404 returned error can't find the container with id 55188db74e7db3b788aa7a4e8a60b81e0e5f6be3c4967c0748c66bcf132e1fa6
Jul 09 00:54:55.312294 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:55.312237    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0e400e4_1dce_4323_b09c_2ec402e5c312.slice/crio-1081b67d021f60e28fca2b5a9b8e21fe51ba3faee2839aef9d4ab9254d589598 WatchSource:0}: Error finding container 1081b67d021f60e28fca2b5a9b8e21fe51ba3faee2839aef9d4ab9254d589598: Status 404 returned error can't find the container with id 1081b67d021f60e28fca2b5a9b8e21fe51ba3faee2839aef9d4ab9254d589598
Jul 09 00:54:55.315640 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:54:55.315609    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf00d32fa_a646_4c75_8c89_3b282d512750.slice/crio-01e2a52683d40dd2a85e7c73c7a287ba4a4f33d952d52c43f0cf972f5f1d8359 WatchSource:0}: Error finding container 01e2a52683d40dd2a85e7c73c7a287ba4a4f33d952d52c43f0cf972f5f1d8359: Status 404 returned error can't find the container with id 01e2a52683d40dd2a85e7c73c7a287ba4a4f33d952d52c43f0cf972f5f1d8359
Jul 09 00:54:55.584454 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.584372    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/518d8542-a147-4718-9ae0-eda6710ea1a4-metrics-certs\") pod \"network-metrics-daemon-dgrzs\" (UID: \"518d8542-a147-4718-9ae0-eda6710ea1a4\") " pod="openshift-multus/network-metrics-daemon-dgrzs"
Jul 09 00:54:55.584595 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:55.584523    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 00:54:55.584595 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:55.584594    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/518d8542-a147-4718-9ae0-eda6710ea1a4-metrics-certs podName:518d8542-a147-4718-9ae0-eda6710ea1a4 nodeName:}" failed. No retries permitted until 2026-07-09 00:54:56.584574909 +0000 UTC m=+4.054717616 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/518d8542-a147-4718-9ae0-eda6710ea1a4-metrics-certs") pod "network-metrics-daemon-dgrzs" (UID: "518d8542-a147-4718-9ae0-eda6710ea1a4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 00:54:55.685189 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.685145    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/65de29a1-ee8f-4539-8e6d-997a7889fc85-original-pull-secret\") pod \"global-pull-secret-syncer-8p4px\" (UID: \"65de29a1-ee8f-4539-8e6d-997a7889fc85\") " pod="kube-system/global-pull-secret-syncer-8p4px"
Jul 09 00:54:55.685376 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.685227    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcqr5\" (UniqueName: \"kubernetes.io/projected/dcdf29b1-919a-48db-88d5-8cb2e105bb01-kube-api-access-zcqr5\") pod \"network-check-target-dvvxg\" (UID: \"dcdf29b1-919a-48db-88d5-8cb2e105bb01\") " pod="openshift-network-diagnostics/network-check-target-dvvxg"
Jul 09 00:54:55.685376 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:55.685338    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 00:54:55.685480 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:55.685401    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 00:54:55.685480 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:55.685412    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65de29a1-ee8f-4539-8e6d-997a7889fc85-original-pull-secret podName:65de29a1-ee8f-4539-8e6d-997a7889fc85 nodeName:}" failed. No retries permitted until 2026-07-09 00:54:56.685392702 +0000 UTC m=+4.155535423 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/65de29a1-ee8f-4539-8e6d-997a7889fc85-original-pull-secret") pod "global-pull-secret-syncer-8p4px" (UID: "65de29a1-ee8f-4539-8e6d-997a7889fc85") : object "kube-system"/"original-pull-secret" not registered
Jul 09 00:54:55.685480 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:55.685420    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 00:54:55.685480 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:55.685431    2557 projected.go:196] Error preparing data for projected volume kube-api-access-zcqr5 for pod openshift-network-diagnostics/network-check-target-dvvxg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 00:54:55.685480 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:55.685476    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dcdf29b1-919a-48db-88d5-8cb2e105bb01-kube-api-access-zcqr5 podName:dcdf29b1-919a-48db-88d5-8cb2e105bb01 nodeName:}" failed. No retries permitted until 2026-07-09 00:54:56.685464391 +0000 UTC m=+4.155607098 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zcqr5" (UniqueName: "kubernetes.io/projected/dcdf29b1-919a-48db-88d5-8cb2e105bb01-kube-api-access-zcqr5") pod "network-check-target-dvvxg" (UID: "dcdf29b1-919a-48db-88d5-8cb2e105bb01") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 00:54:55.999356 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.999249    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 00:49:53 +0000 UTC" deadline="2028-04-04 01:01:03.420864362 +0000 UTC"
Jul 09 00:54:55.999356 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:55.999309    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15240h6m7.421559265s"
Jul 09 00:54:56.033520 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:56.033485    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvvxg"
Jul 09 00:54:56.033698 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:56.033620    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvvxg" podUID="dcdf29b1-919a-48db-88d5-8cb2e105bb01"
Jul 09 00:54:56.042051 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:56.042016    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7wcz6" event={"ID":"8efa0274-9674-4514-812d-ca9d8e004993","Type":"ContainerStarted","Data":"857f2aefe5dce404538930c8069db99275151993b7e5748893f0e62573cd4abd"}
Jul 09 00:54:56.043185 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:56.043162    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-drbjw" event={"ID":"09e68ce7-10cf-4906-a88c-6f93268fc0bd","Type":"ContainerStarted","Data":"0406519642b258845f448bb7a1e862d68d6529b18ba1587899923f46beb88f4d"}
Jul 09 00:54:56.044287 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:56.044267    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pg99d" event={"ID":"f00d32fa-a646-4c75-8c89-3b282d512750","Type":"ContainerStarted","Data":"01e2a52683d40dd2a85e7c73c7a287ba4a4f33d952d52c43f0cf972f5f1d8359"}
Jul 09 00:54:56.045516 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:56.045489    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6" event={"ID":"c0e400e4-1dce-4323-b09c-2ec402e5c312","Type":"ContainerStarted","Data":"1081b67d021f60e28fca2b5a9b8e21fe51ba3faee2839aef9d4ab9254d589598"}
Jul 09 00:54:56.046625 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:56.046599    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tkg22" event={"ID":"868053ea-aa08-4c9f-a2f6-05351b70b539","Type":"ContainerStarted","Data":"526733ab977e6668c2dd95e797e95229e01152a188869cf0511c38d138c88745"}
Jul 09 00:54:56.047800 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:56.047779    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xnxng" event={"ID":"fc7293e1-bc7a-4d70-9cd2-2dd0b1b5c231","Type":"ContainerStarted","Data":"55188db74e7db3b788aa7a4e8a60b81e0e5f6be3c4967c0748c66bcf132e1fa6"}
Jul 09 00:54:56.048921 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:56.048897    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8t57" event={"ID":"f91dc32b-758b-4085-b67b-a916f208c474","Type":"ContainerStarted","Data":"663465da6fb6e209edb2b0e3c84f0fc342d58b6d3fb5e8c9d58b661cc3e9aee8"}
Jul 09 00:54:56.050086 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:56.050060    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bwnrj" event={"ID":"3b8f52dc-405f-4c16-b837-97ea642f9341","Type":"ContainerStarted","Data":"8e2f8c16ab800cdf5c3908704d609aa107c2f6161529a7bc588ea15ec4f8632b"}
Jul 09 00:54:56.051151 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:56.051130    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dhpcm" event={"ID":"f4dbea2c-28f9-4405-b905-f740dbe64a09","Type":"ContainerStarted","Data":"d570c6ecc56160e9e6bb036a373a4928ecdc3646cf0314c2a723443d86e0e21a"}
Jul 09 00:54:56.512744 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:56.512712    2557 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 00:54:56.592568 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:56.592533    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/518d8542-a147-4718-9ae0-eda6710ea1a4-metrics-certs\") pod \"network-metrics-daemon-dgrzs\" (UID: \"518d8542-a147-4718-9ae0-eda6710ea1a4\") " pod="openshift-multus/network-metrics-daemon-dgrzs"
Jul 09 00:54:56.592743 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:56.592672    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 00:54:56.592804 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:56.592754    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/518d8542-a147-4718-9ae0-eda6710ea1a4-metrics-certs podName:518d8542-a147-4718-9ae0-eda6710ea1a4 nodeName:}" failed. No retries permitted until 2026-07-09 00:54:58.592731899 +0000 UTC m=+6.062874618 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/518d8542-a147-4718-9ae0-eda6710ea1a4-metrics-certs") pod "network-metrics-daemon-dgrzs" (UID: "518d8542-a147-4718-9ae0-eda6710ea1a4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 00:54:56.693709 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:56.693678    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcqr5\" (UniqueName: \"kubernetes.io/projected/dcdf29b1-919a-48db-88d5-8cb2e105bb01-kube-api-access-zcqr5\") pod \"network-check-target-dvvxg\" (UID: \"dcdf29b1-919a-48db-88d5-8cb2e105bb01\") " pod="openshift-network-diagnostics/network-check-target-dvvxg"
Jul 09 00:54:56.693835 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:56.693771    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/65de29a1-ee8f-4539-8e6d-997a7889fc85-original-pull-secret\") pod \"global-pull-secret-syncer-8p4px\" (UID: \"65de29a1-ee8f-4539-8e6d-997a7889fc85\") " pod="kube-system/global-pull-secret-syncer-8p4px"
Jul 09 00:54:56.693905 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:56.693883    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 00:54:56.693958 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:56.693943    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65de29a1-ee8f-4539-8e6d-997a7889fc85-original-pull-secret podName:65de29a1-ee8f-4539-8e6d-997a7889fc85 nodeName:}" failed. No retries permitted until 2026-07-09 00:54:58.69392469 +0000 UTC m=+6.164067400 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/65de29a1-ee8f-4539-8e6d-997a7889fc85-original-pull-secret") pod "global-pull-secret-syncer-8p4px" (UID: "65de29a1-ee8f-4539-8e6d-997a7889fc85") : object "kube-system"/"original-pull-secret" not registered
Jul 09 00:54:56.694385 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:56.694365    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 00:54:56.694481 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:56.694393    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 00:54:56.694481 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:56.694406    2557 projected.go:196] Error preparing data for projected volume kube-api-access-zcqr5 for pod openshift-network-diagnostics/network-check-target-dvvxg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 00:54:56.694481 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:56.694449    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dcdf29b1-919a-48db-88d5-8cb2e105bb01-kube-api-access-zcqr5 podName:dcdf29b1-919a-48db-88d5-8cb2e105bb01 nodeName:}" failed. No retries permitted until 2026-07-09 00:54:58.694434834 +0000 UTC m=+6.164577555 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zcqr5" (UniqueName: "kubernetes.io/projected/dcdf29b1-919a-48db-88d5-8cb2e105bb01-kube-api-access-zcqr5") pod "network-check-target-dvvxg" (UID: "dcdf29b1-919a-48db-88d5-8cb2e105bb01") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 00:54:57.037267 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:57.036820    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dgrzs"
Jul 09 00:54:57.037267 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:57.037156    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dgrzs" podUID="518d8542-a147-4718-9ae0-eda6710ea1a4"
Jul 09 00:54:57.037764 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:57.037569    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p4px"
Jul 09 00:54:57.037764 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:57.037666    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p4px" podUID="65de29a1-ee8f-4539-8e6d-997a7889fc85"
Jul 09 00:54:57.063633 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:57.063593    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-31.ec2.internal" event={"ID":"d799c3ef85e5886492cae7cd2485596a","Type":"ContainerStarted","Data":"6fe55fcb50365a02a6298ab7716dab1f6081210733b837cc92c634a4f65f5df7"}
Jul 09 00:54:58.034178 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:58.034100    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvvxg"
Jul 09 00:54:58.034351 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:58.034253    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvvxg" podUID="dcdf29b1-919a-48db-88d5-8cb2e105bb01"
Jul 09 00:54:58.080243 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:58.080192    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-31.ec2.internal" event={"ID":"f0b2c6c86433a657dbf3a43f7bc9a86a","Type":"ContainerStarted","Data":"ae39c51050abf63d01b561e11ca2b4879ed5ef28334c1dec25de0b37c7bf84c2"}
Jul 09 00:54:58.094651 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:58.094598    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-31.ec2.internal" podStartSLOduration=5.094576226 podStartE2EDuration="5.094576226s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 00:54:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:54:57.078784368 +0000 UTC m=+4.548927098" watchObservedRunningTime="2026-07-09 00:54:58.094576226 +0000 UTC m=+5.564718951"
Jul 09 00:54:58.609609 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:58.609561    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/518d8542-a147-4718-9ae0-eda6710ea1a4-metrics-certs\") pod \"network-metrics-daemon-dgrzs\" (UID: \"518d8542-a147-4718-9ae0-eda6710ea1a4\") " pod="openshift-multus/network-metrics-daemon-dgrzs"
Jul 09 00:54:58.609781 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:58.609716    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 00:54:58.609781 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:58.609779    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/518d8542-a147-4718-9ae0-eda6710ea1a4-metrics-certs podName:518d8542-a147-4718-9ae0-eda6710ea1a4 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:02.609760333 +0000 UTC m=+10.079903047 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/518d8542-a147-4718-9ae0-eda6710ea1a4-metrics-certs") pod "network-metrics-daemon-dgrzs" (UID: "518d8542-a147-4718-9ae0-eda6710ea1a4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 00:54:58.710625 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:58.710584    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/65de29a1-ee8f-4539-8e6d-997a7889fc85-original-pull-secret\") pod \"global-pull-secret-syncer-8p4px\" (UID: \"65de29a1-ee8f-4539-8e6d-997a7889fc85\") " pod="kube-system/global-pull-secret-syncer-8p4px"
Jul 09 00:54:58.710799 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:58.710653    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcqr5\" (UniqueName: \"kubernetes.io/projected/dcdf29b1-919a-48db-88d5-8cb2e105bb01-kube-api-access-zcqr5\") pod \"network-check-target-dvvxg\" (UID: \"dcdf29b1-919a-48db-88d5-8cb2e105bb01\") " pod="openshift-network-diagnostics/network-check-target-dvvxg"
Jul 09 00:54:58.710933 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:58.710849    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 00:54:58.710933 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:58.710873    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 00:54:58.710933 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:58.710893    2557 projected.go:196] Error preparing data for projected volume kube-api-access-zcqr5 for pod openshift-network-diagnostics/network-check-target-dvvxg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 00:54:58.711096 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:58.710953    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dcdf29b1-919a-48db-88d5-8cb2e105bb01-kube-api-access-zcqr5 podName:dcdf29b1-919a-48db-88d5-8cb2e105bb01 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:02.710934025 +0000 UTC m=+10.181076747 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zcqr5" (UniqueName: "kubernetes.io/projected/dcdf29b1-919a-48db-88d5-8cb2e105bb01-kube-api-access-zcqr5") pod "network-check-target-dvvxg" (UID: "dcdf29b1-919a-48db-88d5-8cb2e105bb01") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 00:54:58.711395 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:58.711372    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 00:54:58.711485 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:58.711432    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65de29a1-ee8f-4539-8e6d-997a7889fc85-original-pull-secret podName:65de29a1-ee8f-4539-8e6d-997a7889fc85 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:02.711415739 +0000 UTC m=+10.181558453 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/65de29a1-ee8f-4539-8e6d-997a7889fc85-original-pull-secret") pod "global-pull-secret-syncer-8p4px" (UID: "65de29a1-ee8f-4539-8e6d-997a7889fc85") : object "kube-system"/"original-pull-secret" not registered
Jul 09 00:54:59.033827 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:59.033744    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p4px"
Jul 09 00:54:59.033979 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:59.033887    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p4px" podUID="65de29a1-ee8f-4539-8e6d-997a7889fc85"
Jul 09 00:54:59.034377 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:54:59.034345    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dgrzs"
Jul 09 00:54:59.034536 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:54:59.034484    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dgrzs" podUID="518d8542-a147-4718-9ae0-eda6710ea1a4"
Jul 09 00:55:00.034191 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:00.034112    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvvxg"
Jul 09 00:55:00.034652 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:00.034261    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvvxg" podUID="dcdf29b1-919a-48db-88d5-8cb2e105bb01"
Jul 09 00:55:00.088787 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:00.088350    2557 generic.go:356] "Generic (PLEG): container finished" podID="f0b2c6c86433a657dbf3a43f7bc9a86a" containerID="ae39c51050abf63d01b561e11ca2b4879ed5ef28334c1dec25de0b37c7bf84c2" exitCode=0
Jul 09 00:55:00.088787 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:00.088395    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-31.ec2.internal" event={"ID":"f0b2c6c86433a657dbf3a43f7bc9a86a","Type":"ContainerDied","Data":"ae39c51050abf63d01b561e11ca2b4879ed5ef28334c1dec25de0b37c7bf84c2"}
Jul 09 00:55:01.034058 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:01.033976    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dgrzs"
Jul 09 00:55:01.034058 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:01.034021    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p4px"
Jul 09 00:55:01.034589 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:01.034125    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dgrzs" podUID="518d8542-a147-4718-9ae0-eda6710ea1a4"
Jul 09 00:55:01.034589 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:01.034301    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p4px" podUID="65de29a1-ee8f-4539-8e6d-997a7889fc85"
Jul 09 00:55:02.034278 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:02.034244    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvvxg"
Jul 09 00:55:02.034678 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:02.034352    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvvxg" podUID="dcdf29b1-919a-48db-88d5-8cb2e105bb01"
Jul 09 00:55:02.641549 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:02.641502    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/518d8542-a147-4718-9ae0-eda6710ea1a4-metrics-certs\") pod \"network-metrics-daemon-dgrzs\" (UID: \"518d8542-a147-4718-9ae0-eda6710ea1a4\") " pod="openshift-multus/network-metrics-daemon-dgrzs"
Jul 09 00:55:02.641739 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:02.641662    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 00:55:02.641739 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:02.641734    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/518d8542-a147-4718-9ae0-eda6710ea1a4-metrics-certs podName:518d8542-a147-4718-9ae0-eda6710ea1a4 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:10.641714769 +0000 UTC m=+18.111857501 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/518d8542-a147-4718-9ae0-eda6710ea1a4-metrics-certs") pod "network-metrics-daemon-dgrzs" (UID: "518d8542-a147-4718-9ae0-eda6710ea1a4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 00:55:02.742776 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:02.742738    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/65de29a1-ee8f-4539-8e6d-997a7889fc85-original-pull-secret\") pod \"global-pull-secret-syncer-8p4px\" (UID: \"65de29a1-ee8f-4539-8e6d-997a7889fc85\") " pod="kube-system/global-pull-secret-syncer-8p4px"
Jul 09 00:55:02.742943 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:02.742787    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcqr5\" (UniqueName: \"kubernetes.io/projected/dcdf29b1-919a-48db-88d5-8cb2e105bb01-kube-api-access-zcqr5\") pod \"network-check-target-dvvxg\" (UID: \"dcdf29b1-919a-48db-88d5-8cb2e105bb01\") " pod="openshift-network-diagnostics/network-check-target-dvvxg"
Jul 09 00:55:02.742943 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:02.742912    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 00:55:02.742943 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:02.742927    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 00:55:02.743091 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:02.742950    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 00:55:02.743091 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:02.742963    2557 projected.go:196] Error preparing data for projected volume kube-api-access-zcqr5 for pod openshift-network-diagnostics/network-check-target-dvvxg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 00:55:02.743091 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:02.742996    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65de29a1-ee8f-4539-8e6d-997a7889fc85-original-pull-secret podName:65de29a1-ee8f-4539-8e6d-997a7889fc85 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:10.742974597 +0000 UTC m=+18.213117320 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/65de29a1-ee8f-4539-8e6d-997a7889fc85-original-pull-secret") pod "global-pull-secret-syncer-8p4px" (UID: "65de29a1-ee8f-4539-8e6d-997a7889fc85") : object "kube-system"/"original-pull-secret" not registered
Jul 09 00:55:02.743091 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:02.743017    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dcdf29b1-919a-48db-88d5-8cb2e105bb01-kube-api-access-zcqr5 podName:dcdf29b1-919a-48db-88d5-8cb2e105bb01 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:10.743006863 +0000 UTC m=+18.213149577 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zcqr5" (UniqueName: "kubernetes.io/projected/dcdf29b1-919a-48db-88d5-8cb2e105bb01-kube-api-access-zcqr5") pod "network-check-target-dvvxg" (UID: "dcdf29b1-919a-48db-88d5-8cb2e105bb01") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 00:55:03.035305 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:03.035193    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dgrzs"
Jul 09 00:55:03.035737 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:03.035331    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dgrzs" podUID="518d8542-a147-4718-9ae0-eda6710ea1a4"
Jul 09 00:55:03.035800 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:03.035772    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p4px"
Jul 09 00:55:03.035905 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:03.035879    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p4px" podUID="65de29a1-ee8f-4539-8e6d-997a7889fc85"
Jul 09 00:55:04.033834 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:04.033700    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvvxg"
Jul 09 00:55:04.034005 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:04.033834    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvvxg" podUID="dcdf29b1-919a-48db-88d5-8cb2e105bb01"
Jul 09 00:55:05.033974 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:05.033937    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dgrzs"
Jul 09 00:55:05.034523 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:05.034073    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dgrzs" podUID="518d8542-a147-4718-9ae0-eda6710ea1a4"
Jul 09 00:55:05.034523 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:05.034105    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p4px"
Jul 09 00:55:05.034523 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:05.034237    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p4px" podUID="65de29a1-ee8f-4539-8e6d-997a7889fc85"
Jul 09 00:55:06.033668 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:06.033502    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvvxg"
Jul 09 00:55:06.033818 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:06.033742    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvvxg" podUID="dcdf29b1-919a-48db-88d5-8cb2e105bb01"
Jul 09 00:55:06.105091 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:06.105058    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-31.ec2.internal" event={"ID":"f0b2c6c86433a657dbf3a43f7bc9a86a","Type":"ContainerStarted","Data":"89e75de3192c8cf703af777d5ee3130a760493ff101f29e645693fd1f9fd076d"}
Jul 09 00:55:06.107699 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:06.107670    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xnxng" event={"ID":"fc7293e1-bc7a-4d70-9cd2-2dd0b1b5c231","Type":"ContainerStarted","Data":"997c818338e802eb4a66abb7763599ea1bc4a11898684030b0879afccc8d3e56"}
Jul 09 00:55:06.109594 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:06.109539    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8t57" event={"ID":"f91dc32b-758b-4085-b67b-a916f208c474","Type":"ContainerStarted","Data":"a3d9b2114ffd2195029bd31a046c078c6dd0d9ba1e673cb9411b8846baa44938"}
Jul 09 00:55:06.111908 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:06.111882    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dhpcm" event={"ID":"f4dbea2c-28f9-4405-b905-f740dbe64a09","Type":"ContainerStarted","Data":"306571ea1bcaece42a0b6e3cb86b4086945a5557a7b014c59fc0a61d060adcf9"}
Jul 09 00:55:06.115474 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:06.115444    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-drbjw" event={"ID":"09e68ce7-10cf-4906-a88c-6f93268fc0bd","Type":"ContainerStarted","Data":"7d874403195af1551576679c5f96d85086678892443d8a22ac20435eecbd910e"}
Jul 09 00:55:06.117741 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:06.117717    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pg99d" event={"ID":"f00d32fa-a646-4c75-8c89-3b282d512750","Type":"ContainerStarted","Data":"745c7d4ff9c90d15fb2789664ef5ac1deb07f41cc9b3427ca4f2d9ef8090a260"}
Jul 09 00:55:06.119479 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:06.119454    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tkg22" event={"ID":"868053ea-aa08-4c9f-a2f6-05351b70b539","Type":"ContainerStarted","Data":"a5848a2d217641f958c52c23397bb7860dffc6b85e7bad07ab4333c1491e01b6"}
Jul 09 00:55:06.120496 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:06.120451    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-31.ec2.internal" podStartSLOduration=13.120432977 podStartE2EDuration="13.120432977s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 00:54:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:55:06.119946792 +0000 UTC m=+13.590089522" watchObservedRunningTime="2026-07-09 00:55:06.120432977 +0000 UTC m=+13.590575703"
Jul 09 00:55:06.132734 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:06.132695    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pg99d" podStartSLOduration=2.908500863 podStartE2EDuration="13.132676302s" totalImagesPullingTime="10.224175439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 00:54:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:55:06.132620842 +0000 UTC m=+13.602763577" watchObservedRunningTime="2026-07-09 00:55:06.132676302 +0000 UTC m=+13.602819031"
Jul 09 00:55:06.149152 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:06.149098    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xnxng" podStartSLOduration=2.9182617090000003 podStartE2EDuration="13.149079116s" totalImagesPullingTime="10.230817407s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 00:54:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:55:06.148314492 +0000 UTC m=+13.618457218" watchObservedRunningTime="2026-07-09 00:55:06.149079116 +0000 UTC m=+13.619221847"
Jul 09 00:55:06.165149 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:06.165100    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-drbjw" podStartSLOduration=2.80936802 podStartE2EDuration="13.165080955s" totalImagesPullingTime="10.355712935s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 00:54:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:55:06.165000077 +0000 UTC m=+13.635142809" watchObservedRunningTime="2026-07-09 00:55:06.165080955 +0000 UTC m=+13.635223686"
Jul 09 00:55:06.208845 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:06.208788    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-tkg22" podStartSLOduration=2.965347007 podStartE2EDuration="13.208765527s" totalImagesPullingTime="10.24341852s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 00:54:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:55:06.20806211 +0000 UTC m=+13.678204839" watchObservedRunningTime="2026-07-09 00:55:06.208765527 +0000 UTC m=+13.678908256"
Jul 09 00:55:06.873133 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:06.873045    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pg99d"
Jul 09 00:55:06.873735 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:06.873711    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pg99d"
Jul 09 00:55:07.034477 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:07.034438    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dgrzs"
Jul 09 00:55:07.034477 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:07.034473    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p4px"
Jul 09 00:55:07.034716 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:07.034589    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dgrzs" podUID="518d8542-a147-4718-9ae0-eda6710ea1a4"
Jul 09 00:55:07.034777 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:07.034726    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p4px" podUID="65de29a1-ee8f-4539-8e6d-997a7889fc85"
Jul 09 00:55:07.123371 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:07.123287    2557 generic.go:356] "Generic (PLEG): container finished" podID="f4dbea2c-28f9-4405-b905-f740dbe64a09" containerID="306571ea1bcaece42a0b6e3cb86b4086945a5557a7b014c59fc0a61d060adcf9" exitCode=0
Jul 09 00:55:07.123884 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:07.123402    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dhpcm" event={"ID":"f4dbea2c-28f9-4405-b905-f740dbe64a09","Type":"ContainerDied","Data":"306571ea1bcaece42a0b6e3cb86b4086945a5557a7b014c59fc0a61d060adcf9"}
Jul 09 00:55:08.034225 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:08.034173    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvvxg"
Jul 09 00:55:08.034393 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:08.034317    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvvxg" podUID="dcdf29b1-919a-48db-88d5-8cb2e105bb01"
Jul 09 00:55:08.127663 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:08.127634    2557 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 09 00:55:08.128075 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:08.127921    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bwnrj" event={"ID":"3b8f52dc-405f-4c16-b837-97ea642f9341","Type":"ContainerStarted","Data":"3ffabcee5aac901f15344b44e70c8dc82ed9f68f1c6abc2fb735ac786dab5b2e"}
Jul 09 00:55:08.143187 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:08.143122    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-bwnrj" podStartSLOduration=4.838317192 podStartE2EDuration="15.143100817s" totalImagesPullingTime="10.304783625s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 00:54:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:55:08.142751429 +0000 UTC m=+15.612894160" watchObservedRunningTime="2026-07-09 00:55:08.143100817 +0000 UTC m=+15.613243547"
Jul 09 00:55:09.034429 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:09.034394    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dgrzs"
Jul 09 00:55:09.034602 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:09.034399    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p4px"
Jul 09 00:55:09.034602 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:09.034546    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dgrzs" podUID="518d8542-a147-4718-9ae0-eda6710ea1a4"
Jul 09 00:55:09.034717 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:09.034596    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p4px" podUID="65de29a1-ee8f-4539-8e6d-997a7889fc85"
Jul 09 00:55:09.447966 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:09.447860    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pg99d"
Jul 09 00:55:09.448552 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:09.447995    2557 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 09 00:55:09.448622 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:09.448551    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pg99d"
Jul 09 00:55:10.033688 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:10.033656    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvvxg"
Jul 09 00:55:10.033884 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:10.033787    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvvxg" podUID="dcdf29b1-919a-48db-88d5-8cb2e105bb01"
Jul 09 00:55:10.704340 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:10.704304    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/518d8542-a147-4718-9ae0-eda6710ea1a4-metrics-certs\") pod \"network-metrics-daemon-dgrzs\" (UID: \"518d8542-a147-4718-9ae0-eda6710ea1a4\") " pod="openshift-multus/network-metrics-daemon-dgrzs"
Jul 09 00:55:10.704931 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:10.704446    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 00:55:10.704931 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:10.704529    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/518d8542-a147-4718-9ae0-eda6710ea1a4-metrics-certs podName:518d8542-a147-4718-9ae0-eda6710ea1a4 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:26.704506865 +0000 UTC m=+34.174649628 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/518d8542-a147-4718-9ae0-eda6710ea1a4-metrics-certs") pod "network-metrics-daemon-dgrzs" (UID: "518d8542-a147-4718-9ae0-eda6710ea1a4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 00:55:10.805557 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:10.805449    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/65de29a1-ee8f-4539-8e6d-997a7889fc85-original-pull-secret\") pod \"global-pull-secret-syncer-8p4px\" (UID: \"65de29a1-ee8f-4539-8e6d-997a7889fc85\") " pod="kube-system/global-pull-secret-syncer-8p4px"
Jul 09 00:55:10.805557 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:10.805509    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcqr5\" (UniqueName: \"kubernetes.io/projected/dcdf29b1-919a-48db-88d5-8cb2e105bb01-kube-api-access-zcqr5\") pod \"network-check-target-dvvxg\" (UID: \"dcdf29b1-919a-48db-88d5-8cb2e105bb01\") " pod="openshift-network-diagnostics/network-check-target-dvvxg"
Jul 09 00:55:10.805769 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:10.805621    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 00:55:10.805769 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:10.805663    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 00:55:10.805769 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:10.805688    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 00:55:10.805769 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:10.805701    2557 projected.go:196] Error preparing data for projected volume kube-api-access-zcqr5 for pod openshift-network-diagnostics/network-check-target-dvvxg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 00:55:10.805769 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:10.805701    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65de29a1-ee8f-4539-8e6d-997a7889fc85-original-pull-secret podName:65de29a1-ee8f-4539-8e6d-997a7889fc85 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:26.805679395 +0000 UTC m=+34.275822105 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/65de29a1-ee8f-4539-8e6d-997a7889fc85-original-pull-secret") pod "global-pull-secret-syncer-8p4px" (UID: "65de29a1-ee8f-4539-8e6d-997a7889fc85") : object "kube-system"/"original-pull-secret" not registered
Jul 09 00:55:10.805769 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:10.805765    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dcdf29b1-919a-48db-88d5-8cb2e105bb01-kube-api-access-zcqr5 podName:dcdf29b1-919a-48db-88d5-8cb2e105bb01 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:26.805748892 +0000 UTC m=+34.275891605 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zcqr5" (UniqueName: "kubernetes.io/projected/dcdf29b1-919a-48db-88d5-8cb2e105bb01-kube-api-access-zcqr5") pod "network-check-target-dvvxg" (UID: "dcdf29b1-919a-48db-88d5-8cb2e105bb01") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 00:55:11.033799 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:11.033770    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dgrzs"
Jul 09 00:55:11.033799 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:11.033795    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p4px"
Jul 09 00:55:11.034044 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:11.033904    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dgrzs" podUID="518d8542-a147-4718-9ae0-eda6710ea1a4"
Jul 09 00:55:11.034044 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:11.034023    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p4px" podUID="65de29a1-ee8f-4539-8e6d-997a7889fc85"
Jul 09 00:55:12.034437 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:12.034221    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvvxg"
Jul 09 00:55:12.034886 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:12.034541    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvvxg" podUID="dcdf29b1-919a-48db-88d5-8cb2e105bb01"
Jul 09 00:55:13.035196 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:13.035102    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dgrzs"
Jul 09 00:55:13.035678 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:13.035245    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p4px"
Jul 09 00:55:13.035678 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:13.035251    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dgrzs" podUID="518d8542-a147-4718-9ae0-eda6710ea1a4"
Jul 09 00:55:13.035678 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:13.035373    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p4px" podUID="65de29a1-ee8f-4539-8e6d-997a7889fc85"
Jul 09 00:55:14.033359 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:14.033323    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvvxg"
Jul 09 00:55:14.033545 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:14.033434    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvvxg" podUID="dcdf29b1-919a-48db-88d5-8cb2e105bb01"
Jul 09 00:55:15.034167 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:15.034135    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p4px"
Jul 09 00:55:15.034624 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:15.034272    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p4px" podUID="65de29a1-ee8f-4539-8e6d-997a7889fc85"
Jul 09 00:55:15.034775 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:15.034701    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dgrzs"
Jul 09 00:55:15.034848 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:15.034815    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dgrzs" podUID="518d8542-a147-4718-9ae0-eda6710ea1a4"
Jul 09 00:55:15.227569 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:15.227531    2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 09 00:55:16.034575 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:16.034397    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvvxg"
Jul 09 00:55:16.035182 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:16.034688    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvvxg" podUID="dcdf29b1-919a-48db-88d5-8cb2e105bb01"
Jul 09 00:55:16.153220 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:16.153171    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8t57" event={"ID":"f91dc32b-758b-4085-b67b-a916f208c474","Type":"ContainerStarted","Data":"018eee2737fb7fdbf523f958e5f14c5f94f39ba94989f780c90f0c6db611ec75"}
Jul 09 00:55:16.154629 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:16.154600    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7wcz6" event={"ID":"8efa0274-9674-4514-812d-ca9d8e004993","Type":"ContainerStarted","Data":"4c27fdddf6980b557e5fafe93235aa034e826ea6d6e76e6400466ec00b91e181"}
Jul 09 00:55:16.157500 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:16.157481    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6" event={"ID":"c0e400e4-1dce-4323-b09c-2ec402e5c312","Type":"ContainerStarted","Data":"4816af2cfc5c2e039a1bd3dd6c8d47fa87b5beb2509d113911528b64e5dfc742"}
Jul 09 00:55:16.157625 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:16.157555    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6" event={"ID":"c0e400e4-1dce-4323-b09c-2ec402e5c312","Type":"ContainerStarted","Data":"0098290efe221a76d729be8021d64f642a825e6806a519d68ebbb9c743afc3b3"}
Jul 09 00:55:16.157625 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:16.157604    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6" event={"ID":"c0e400e4-1dce-4323-b09c-2ec402e5c312","Type":"ContainerStarted","Data":"0c1ba6274de01570885ce0f81f4d529e0aac1ce5d81c27c1e44d86c1a17a99fc"}
Jul 09 00:55:16.157733 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:16.157640    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6" event={"ID":"c0e400e4-1dce-4323-b09c-2ec402e5c312","Type":"ContainerStarted","Data":"aa4e38d2460a20812d564aa0d80f5e09395a7f2df57e69533ede7f51b9ecc91b"}
Jul 09 00:55:16.157733 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:16.157669    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6" event={"ID":"c0e400e4-1dce-4323-b09c-2ec402e5c312","Type":"ContainerStarted","Data":"ccde97d5f6bd0667d202bd17bab3341036c09cb77f48237e8d839ffc3358c079"}
Jul 09 00:55:16.157733 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:16.157710    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6" event={"ID":"c0e400e4-1dce-4323-b09c-2ec402e5c312","Type":"ContainerStarted","Data":"97ec1dafe635538be111ed03674a26a4cf0c571b969f4def945103aaa513950e"}
Jul 09 00:55:16.172741 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:16.172700    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7wcz6" podStartSLOduration=3.383122976 podStartE2EDuration="23.1726839s" totalImagesPullingTime="19.789560924s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 00:54:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:55:16.17237082 +0000 UTC m=+23.642513549" watchObservedRunningTime="2026-07-09 00:55:16.1726839 +0000 UTC m=+23.642826630"
Jul 09 00:55:16.194529 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:16.194401    2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T00:55:15.227554315Z","UUID":"4990f779-cf37-46f6-a158-b75946469aa3","Handler":null,"Name":"","Endpoint":""}
Jul 09 00:55:16.195901 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:16.195881    2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 09 00:55:16.195977 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:16.195921    2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 09 00:55:17.034046 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:17.034014    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p4px"
Jul 09 00:55:17.034284 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:17.034171    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dgrzs"
Jul 09 00:55:17.034284 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:17.034173    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p4px" podUID="65de29a1-ee8f-4539-8e6d-997a7889fc85"
Jul 09 00:55:17.034401 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:17.034303    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dgrzs" podUID="518d8542-a147-4718-9ae0-eda6710ea1a4"
Jul 09 00:55:17.164748 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:17.164711    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8t57" event={"ID":"f91dc32b-758b-4085-b67b-a916f208c474","Type":"ContainerStarted","Data":"ed20a69347dbb99e9210fd833c28bbc154e1dc171f886afeb39bb3061556f703"}
Jul 09 00:55:17.181930 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:17.181890    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8t57" podStartSLOduration=3.525676801 podStartE2EDuration="24.181876745s" totalImagesPullingTime="20.656199944s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 00:54:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:55:17.180620556 +0000 UTC m=+24.650763287" watchObservedRunningTime="2026-07-09 00:55:17.181876745 +0000 UTC m=+24.652019474"
Jul 09 00:55:18.033840 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:18.033763    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvvxg"
Jul 09 00:55:18.034007 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:18.033868    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvvxg" podUID="dcdf29b1-919a-48db-88d5-8cb2e105bb01"
Jul 09 00:55:18.169973 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:18.169938    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6" event={"ID":"c0e400e4-1dce-4323-b09c-2ec402e5c312","Type":"ContainerStarted","Data":"2b81dad298835ce88c3e6393f6c6db764b1a28f19a7446792b9527cea4bd6bb2"}
Jul 09 00:55:19.033675 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:19.033639    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dgrzs"
Jul 09 00:55:19.033843 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:19.033761    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dgrzs" podUID="518d8542-a147-4718-9ae0-eda6710ea1a4"
Jul 09 00:55:19.033843 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:19.033811    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p4px"
Jul 09 00:55:19.033923 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:19.033894    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p4px" podUID="65de29a1-ee8f-4539-8e6d-997a7889fc85"
Jul 09 00:55:20.033777 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:20.033738    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvvxg"
Jul 09 00:55:20.034188 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:20.033862    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvvxg" podUID="dcdf29b1-919a-48db-88d5-8cb2e105bb01"
Jul 09 00:55:21.036679 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:21.036649    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dgrzs"
Jul 09 00:55:21.037096 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:21.036784    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dgrzs" podUID="518d8542-a147-4718-9ae0-eda6710ea1a4"
Jul 09 00:55:21.037096 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:21.036834    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p4px"
Jul 09 00:55:21.037096 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:21.036910    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p4px" podUID="65de29a1-ee8f-4539-8e6d-997a7889fc85"
Jul 09 00:55:21.180078 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:21.179899    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6" event={"ID":"c0e400e4-1dce-4323-b09c-2ec402e5c312","Type":"ContainerStarted","Data":"741a725b4a1ae26d690eff93a3690f0b9ab551701cb3b256266e9639d3d55eab"}
Jul 09 00:55:21.180266 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:21.180146    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:55:21.180266 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:21.180195    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:55:21.180266 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:21.180258    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:55:21.195025 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:21.194996    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:55:21.195145 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:21.195099    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:55:21.204720 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:21.204673    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6" podStartSLOduration=8.41645748 podStartE2EDuration="28.204657496s" totalImagesPullingTime="19.788200016s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 00:54:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:55:21.20462547 +0000 UTC m=+28.674768200" watchObservedRunningTime="2026-07-09 00:55:21.204657496 +0000 UTC m=+28.674800216"
Jul 09 00:55:22.034364 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:22.034331    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvvxg"
Jul 09 00:55:22.034567 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:22.034449    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvvxg" podUID="dcdf29b1-919a-48db-88d5-8cb2e105bb01"
Jul 09 00:55:22.184266 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:22.184229    2557 generic.go:356] "Generic (PLEG): container finished" podID="f4dbea2c-28f9-4405-b905-f740dbe64a09" containerID="eca3e675ad6c411abf519dccdc8e0ce297be9ab64f4099bbd3ac0268aa0e1f0d" exitCode=0
Jul 09 00:55:22.184713 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:22.184317    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dhpcm" event={"ID":"f4dbea2c-28f9-4405-b905-f740dbe64a09","Type":"ContainerDied","Data":"eca3e675ad6c411abf519dccdc8e0ce297be9ab64f4099bbd3ac0268aa0e1f0d"}
Jul 09 00:55:23.034166 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:23.034129    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p4px"
Jul 09 00:55:23.034349 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:23.034311    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p4px" podUID="65de29a1-ee8f-4539-8e6d-997a7889fc85"
Jul 09 00:55:23.034427 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:23.034349    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dgrzs"
Jul 09 00:55:23.034483 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:23.034455    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dgrzs" podUID="518d8542-a147-4718-9ae0-eda6710ea1a4"
Jul 09 00:55:23.330291 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:23.330196    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dvvxg"]
Jul 09 00:55:23.330697 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:23.330366    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvvxg"
Jul 09 00:55:23.330697 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:23.330459    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvvxg" podUID="dcdf29b1-919a-48db-88d5-8cb2e105bb01"
Jul 09 00:55:23.333071 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:23.333046    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8p4px"]
Jul 09 00:55:23.333237 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:23.333142    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p4px"
Jul 09 00:55:23.333316 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:23.333240    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p4px" podUID="65de29a1-ee8f-4539-8e6d-997a7889fc85"
Jul 09 00:55:23.333618 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:23.333598    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dgrzs"]
Jul 09 00:55:23.333694 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:23.333684    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dgrzs"
Jul 09 00:55:23.333782 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:23.333757    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dgrzs" podUID="518d8542-a147-4718-9ae0-eda6710ea1a4"
Jul 09 00:55:24.193719 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:24.193681    2557 generic.go:356] "Generic (PLEG): container finished" podID="f4dbea2c-28f9-4405-b905-f740dbe64a09" containerID="38768db5ee7ae8284c4abb8b8f9cf1cb43ddd3a994b1b1f553fc826692543842" exitCode=0
Jul 09 00:55:24.193884 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:24.193732    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dhpcm" event={"ID":"f4dbea2c-28f9-4405-b905-f740dbe64a09","Type":"ContainerDied","Data":"38768db5ee7ae8284c4abb8b8f9cf1cb43ddd3a994b1b1f553fc826692543842"}
Jul 09 00:55:25.034147 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:25.034109    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p4px"
Jul 09 00:55:25.034147 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:25.034131    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dgrzs"
Jul 09 00:55:25.034640 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:25.034130    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvvxg"
Jul 09 00:55:25.034640 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:25.034241    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p4px" podUID="65de29a1-ee8f-4539-8e6d-997a7889fc85"
Jul 09 00:55:25.034640 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:25.034291    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dgrzs" podUID="518d8542-a147-4718-9ae0-eda6710ea1a4"
Jul 09 00:55:25.034640 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:25.034343    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvvxg" podUID="dcdf29b1-919a-48db-88d5-8cb2e105bb01"
Jul 09 00:55:26.201034 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:26.200985    2557 generic.go:356] "Generic (PLEG): container finished" podID="f4dbea2c-28f9-4405-b905-f740dbe64a09" containerID="62d66c6118173bd4750b7380eba36b69f91ed3c6416a27935cba5814d9624f0c" exitCode=0
Jul 09 00:55:26.201034 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:26.201018    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dhpcm" event={"ID":"f4dbea2c-28f9-4405-b905-f740dbe64a09","Type":"ContainerDied","Data":"62d66c6118173bd4750b7380eba36b69f91ed3c6416a27935cba5814d9624f0c"}
Jul 09 00:55:26.726566 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:26.726535    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/518d8542-a147-4718-9ae0-eda6710ea1a4-metrics-certs\") pod \"network-metrics-daemon-dgrzs\" (UID: \"518d8542-a147-4718-9ae0-eda6710ea1a4\") " pod="openshift-multus/network-metrics-daemon-dgrzs"
Jul 09 00:55:26.726753 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:26.726681    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 00:55:26.726753 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:26.726740    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/518d8542-a147-4718-9ae0-eda6710ea1a4-metrics-certs podName:518d8542-a147-4718-9ae0-eda6710ea1a4 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:58.726726174 +0000 UTC m=+66.196868885 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/518d8542-a147-4718-9ae0-eda6710ea1a4-metrics-certs") pod "network-metrics-daemon-dgrzs" (UID: "518d8542-a147-4718-9ae0-eda6710ea1a4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 00:55:26.827575 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:26.827540    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/65de29a1-ee8f-4539-8e6d-997a7889fc85-original-pull-secret\") pod \"global-pull-secret-syncer-8p4px\" (UID: \"65de29a1-ee8f-4539-8e6d-997a7889fc85\") " pod="kube-system/global-pull-secret-syncer-8p4px"
Jul 09 00:55:26.827793 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:26.827586    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcqr5\" (UniqueName: \"kubernetes.io/projected/dcdf29b1-919a-48db-88d5-8cb2e105bb01-kube-api-access-zcqr5\") pod \"network-check-target-dvvxg\" (UID: \"dcdf29b1-919a-48db-88d5-8cb2e105bb01\") " pod="openshift-network-diagnostics/network-check-target-dvvxg"
Jul 09 00:55:26.827793 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:26.827696    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 00:55:26.827793 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:26.827706    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 00:55:26.827793 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:26.827723    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 00:55:26.827793 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:26.827735    2557 projected.go:196] Error preparing data for projected volume kube-api-access-zcqr5 for pod openshift-network-diagnostics/network-check-target-dvvxg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 00:55:26.827793 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:26.827762    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65de29a1-ee8f-4539-8e6d-997a7889fc85-original-pull-secret podName:65de29a1-ee8f-4539-8e6d-997a7889fc85 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:58.827744883 +0000 UTC m=+66.297887609 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/65de29a1-ee8f-4539-8e6d-997a7889fc85-original-pull-secret") pod "global-pull-secret-syncer-8p4px" (UID: "65de29a1-ee8f-4539-8e6d-997a7889fc85") : object "kube-system"/"original-pull-secret" not registered
Jul 09 00:55:26.827793 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:26.827779    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dcdf29b1-919a-48db-88d5-8cb2e105bb01-kube-api-access-zcqr5 podName:dcdf29b1-919a-48db-88d5-8cb2e105bb01 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:58.827771937 +0000 UTC m=+66.297914655 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-zcqr5" (UniqueName: "kubernetes.io/projected/dcdf29b1-919a-48db-88d5-8cb2e105bb01-kube-api-access-zcqr5") pod "network-check-target-dvvxg" (UID: "dcdf29b1-919a-48db-88d5-8cb2e105bb01") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 00:55:27.034094 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.034013    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvvxg"
Jul 09 00:55:27.034326 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.034017    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dgrzs"
Jul 09 00:55:27.034326 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:27.034140    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvvxg" podUID="dcdf29b1-919a-48db-88d5-8cb2e105bb01"
Jul 09 00:55:27.034326 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.034017    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p4px"
Jul 09 00:55:27.034326 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:27.034245    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dgrzs" podUID="518d8542-a147-4718-9ae0-eda6710ea1a4"
Jul 09 00:55:27.034326 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:27.034316    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p4px" podUID="65de29a1-ee8f-4539-8e6d-997a7889fc85"
Jul 09 00:55:27.781276 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.781167    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-31.ec2.internal" event="NodeReady"
Jul 09 00:55:27.781751 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.781358    2557 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 09 00:55:27.813300 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.813268    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6dff8c759c-g4p6l"]
Jul 09 00:55:27.817084 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.817060    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jkklf"]
Jul 09 00:55:27.817248 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.817188    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dff8c759c-g4p6l"
Jul 09 00:55:27.819646 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.819619    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 09 00:55:27.819646 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.819640    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tqqbn\""
Jul 09 00:55:27.819646 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.819648    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 09 00:55:27.819853 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.819644    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 09 00:55:27.820827 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.820807    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-g9tpr"]
Jul 09 00:55:27.820917 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.820907    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jkklf"
Jul 09 00:55:27.823239 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.823219    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 09 00:55:27.823499 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.823480    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 09 00:55:27.823913 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.823896    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-z2klz\""
Jul 09 00:55:27.824330 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.824308    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-g9tpr"
Jul 09 00:55:27.824481 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.824464    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 09 00:55:27.824977 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.824665    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 09 00:55:27.829063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.827867    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 09 00:55:27.829063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.828555    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-qmzjq\""
Jul 09 00:55:27.829063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.828896    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 09 00:55:27.830304 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.830199    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-zbnc6"]
Jul 09 00:55:27.831805 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.831755    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 09 00:55:27.833972 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.833952    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rw5s7"]
Jul 09 00:55:27.834202 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.834184    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-zbnc6"
Jul 09 00:55:27.836757 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.836729    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 09 00:55:27.836757 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.836744    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 09 00:55:27.836901 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.836823    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-kgmtj\""
Jul 09 00:55:27.836961 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.836893    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 09 00:55:27.837061 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.837044    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 09 00:55:27.837491 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.837475    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kj27l"]
Jul 09 00:55:27.837578 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.837565    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rw5s7"
Jul 09 00:55:27.840142 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.840126    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 09 00:55:27.840422 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.840406    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 09 00:55:27.840514 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.840434    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 09 00:55:27.840822 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.840793    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 09 00:55:27.841008 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.840991    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-qvrzr\""
Jul 09 00:55:27.841136 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.841092    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-z6kj2"]
Jul 09 00:55:27.841369 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.841277    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kj27l"
Jul 09 00:55:27.843157 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.843135    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 09 00:55:27.843475 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.843455    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 09 00:55:27.844198 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.844177    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 09 00:55:27.844974 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.844883    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-g9tpr"]
Jul 09 00:55:27.844974 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.844916    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jkklf"]
Jul 09 00:55:27.844974 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.844948    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6dff8c759c-g4p6l"]
Jul 09 00:55:27.844974 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.844969    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-zbnc6"]
Jul 09 00:55:27.845670 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.844337    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 09 00:55:27.845670 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.845054    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-z6kj2"
Jul 09 00:55:27.845670 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.844988    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rw5s7"]
Jul 09 00:55:27.845670 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.844484    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-mq5n2\""
Jul 09 00:55:27.845670 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.845134    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kj27l"]
Jul 09 00:55:27.847410 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.847390    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 09 00:55:27.847497 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.847392    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 09 00:55:27.847566 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.847552    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 09 00:55:27.847617 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.847591    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 09 00:55:27.847970 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.847953    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-sn9rs\""
Jul 09 00:55:27.851121 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.851104    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-59b7486ffc-xdjvw"]
Jul 09 00:55:27.854546 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.854527    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7bwv9"]
Jul 09 00:55:27.855827 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.855800    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-59b7486ffc-xdjvw"
Jul 09 00:55:27.857323 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.857303    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 09 00:55:27.859087 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.859066    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-22rnw"]
Jul 09 00:55:27.859569 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.859547    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7bwv9"
Jul 09 00:55:27.859757 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.859736    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 09 00:55:27.860256 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.860238    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 09 00:55:27.860338 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.860308    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 09 00:55:27.860408 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.860274    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 09 00:55:27.860408 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.860242    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-72snf\""
Jul 09 00:55:27.860514 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.860286    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 09 00:55:27.860514 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.860284    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 09 00:55:27.861762 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.861745    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 09 00:55:27.862455 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.862396    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 09 00:55:27.862663 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.862645    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 09 00:55:27.862663 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.862661    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-5mtv8"]
Jul 09 00:55:27.862838 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.862689    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7p7kq\""
Jul 09 00:55:27.862937 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.862923    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-22rnw"
Jul 09 00:55:27.864900 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.864883    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4kshp\""
Jul 09 00:55:27.864900 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.864901    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 09 00:55:27.865144 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.865124    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 09 00:55:27.866849 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.866827    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qrrdm"]
Jul 09 00:55:27.866947 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.866917    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-5mtv8"
Jul 09 00:55:27.869157 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.869137    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 00:55:27.869357 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.869337    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 00:55:27.869688 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.869671    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-tps4f\""
Jul 09 00:55:27.872178 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.872156    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-z6kj2"]
Jul 09 00:55:27.872301 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.872201    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-5mtv8"]
Jul 09 00:55:27.872301 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.872249    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7bwv9"]
Jul 09 00:55:27.872525 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.872316    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qrrdm"]
Jul 09 00:55:27.872525 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.872340    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-22rnw"]
Jul 09 00:55:27.872525 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.872367    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-59b7486ffc-xdjvw"]
Jul 09 00:55:27.872525 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.872499    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qrrdm"
Jul 09 00:55:27.875187 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.875167    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 09 00:55:27.875343 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.875322    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 09 00:55:27.875555 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.875539    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 09 00:55:27.875627 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.875604    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-t6jdp\""
Jul 09 00:55:27.875983 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.875964    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 09 00:55:27.934070 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.934045    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjcxq\" (UniqueName: \"kubernetes.io/projected/b0927f8c-f098-4c8e-b680-1caccc77226d-kube-api-access-zjcxq\") pod \"volume-data-source-validator-5d456fdbcd-g9tpr\" (UID: \"b0927f8c-f098-4c8e-b680-1caccc77226d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-g9tpr"
Jul 09 00:55:27.934195 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.934076    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f822d78-fd3b-44d1-ab1d-310f77a80e56-bound-sa-token\") pod \"image-registry-6dff8c759c-g4p6l\" (UID: \"8f822d78-fd3b-44d1-ab1d-310f77a80e56\") " pod="openshift-image-registry/image-registry-6dff8c759c-g4p6l"
Jul 09 00:55:27.934195 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.934112    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0-metrics-tls\") pod \"dns-default-22rnw\" (UID: \"d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0\") " pod="openshift-dns/dns-default-22rnw"
Jul 09 00:55:27.934195 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.934163    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mbz7\" (UniqueName: \"kubernetes.io/projected/17f6664f-1f4d-4e8d-ad1d-da46c799b51d-kube-api-access-2mbz7\") pod \"insights-operator-5c847dcfc4-zbnc6\" (UID: \"17f6664f-1f4d-4e8d-ad1d-da46c799b51d\") " pod="openshift-insights/insights-operator-5c847dcfc4-zbnc6"
Jul 09 00:55:27.934319 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.934199    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a5fbbb22-3d60-42aa-bbb0-8426d37e945c-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-rw5s7\" (UID: \"a5fbbb22-3d60-42aa-bbb0-8426d37e945c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rw5s7"
Jul 09 00:55:27.934319 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.934233    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7dc12511-b804-4ebc-8646-4d070d93a8cf-serving-cert\") pod \"console-operator-68b757fb67-z6kj2\" (UID: \"7dc12511-b804-4ebc-8646-4d070d93a8cf\") " pod="openshift-console-operator/console-operator-68b757fb67-z6kj2"
Jul 09 00:55:27.934319 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.934248    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/569c1037-0058-4b97-9ebf-3fd77e9f72c3-metrics-certs\") pod \"router-default-59b7486ffc-xdjvw\" (UID: \"569c1037-0058-4b97-9ebf-3fd77e9f72c3\") " pod="openshift-ingress/router-default-59b7486ffc-xdjvw"
Jul 09 00:55:27.934319 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.934279    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8f822d78-fd3b-44d1-ab1d-310f77a80e56-registry-certificates\") pod \"image-registry-6dff8c759c-g4p6l\" (UID: \"8f822d78-fd3b-44d1-ab1d-310f77a80e56\") " pod="openshift-image-registry/image-registry-6dff8c759c-g4p6l"
Jul 09 00:55:27.934319 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.934307    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/37664234-8f03-4849-b53b-ec22d49b8e31-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-jkklf\" (UID: \"37664234-8f03-4849-b53b-ec22d49b8e31\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jkklf"
Jul 09 00:55:27.934466 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.934335    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/569c1037-0058-4b97-9ebf-3fd77e9f72c3-service-ca-bundle\") pod \"router-default-59b7486ffc-xdjvw\" (UID: \"569c1037-0058-4b97-9ebf-3fd77e9f72c3\") " pod="openshift-ingress/router-default-59b7486ffc-xdjvw"
Jul 09 00:55:27.934466 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.934366    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8f822d78-fd3b-44d1-ab1d-310f77a80e56-image-registry-private-configuration\") pod \"image-registry-6dff8c759c-g4p6l\" (UID: \"8f822d78-fd3b-44d1-ab1d-310f77a80e56\") " pod="openshift-image-registry/image-registry-6dff8c759c-g4p6l"
Jul 09 00:55:27.934466 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.934385    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjnrv\" (UniqueName: \"kubernetes.io/projected/4f1d4fff-34fd-47cf-a632-07d976f8beec-kube-api-access-pjnrv\") pod \"ingress-canary-7bwv9\" (UID: \"4f1d4fff-34fd-47cf-a632-07d976f8beec\") " pod="openshift-ingress-canary/ingress-canary-7bwv9"
Jul 09 00:55:27.934466 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.934402    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqk98\" (UniqueName: \"kubernetes.io/projected/a5fbbb22-3d60-42aa-bbb0-8426d37e945c-kube-api-access-nqk98\") pod \"service-ca-operator-5d46d9ffd4-rw5s7\" (UID: \"a5fbbb22-3d60-42aa-bbb0-8426d37e945c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rw5s7"
Jul 09 00:55:27.934466 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.934424    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/37664234-8f03-4849-b53b-ec22d49b8e31-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-jkklf\" (UID: \"37664234-8f03-4849-b53b-ec22d49b8e31\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jkklf"
Jul 09 00:55:27.934466 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.934455    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/569c1037-0058-4b97-9ebf-3fd77e9f72c3-stats-auth\") pod \"router-default-59b7486ffc-xdjvw\" (UID: \"569c1037-0058-4b97-9ebf-3fd77e9f72c3\") " pod="openshift-ingress/router-default-59b7486ffc-xdjvw"
Jul 09 00:55:27.934721 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.934478    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8f822d78-fd3b-44d1-ab1d-310f77a80e56-installation-pull-secrets\") pod \"image-registry-6dff8c759c-g4p6l\" (UID: \"8f822d78-fd3b-44d1-ab1d-310f77a80e56\") " pod="openshift-image-registry/image-registry-6dff8c759c-g4p6l"
Jul 09 00:55:27.934721 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.934500    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/17f6664f-1f4d-4e8d-ad1d-da46c799b51d-snapshots\") pod \"insights-operator-5c847dcfc4-zbnc6\" (UID: \"17f6664f-1f4d-4e8d-ad1d-da46c799b51d\") " pod="openshift-insights/insights-operator-5c847dcfc4-zbnc6"
Jul 09 00:55:27.934721 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.934525    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwqpv\" (UniqueName: \"kubernetes.io/projected/d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0-kube-api-access-pwqpv\") pod \"dns-default-22rnw\" (UID: \"d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0\") " pod="openshift-dns/dns-default-22rnw"
Jul 09 00:55:27.934721 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.934549    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/17f6664f-1f4d-4e8d-ad1d-da46c799b51d-serving-cert\") pod \"insights-operator-5c847dcfc4-zbnc6\" (UID: \"17f6664f-1f4d-4e8d-ad1d-da46c799b51d\") " pod="openshift-insights/insights-operator-5c847dcfc4-zbnc6"
Jul 09 00:55:27.934721 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.934570    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7dc12511-b804-4ebc-8646-4d070d93a8cf-config\") pod \"console-operator-68b757fb67-z6kj2\" (UID: \"7dc12511-b804-4ebc-8646-4d070d93a8cf\") " pod="openshift-console-operator/console-operator-68b757fb67-z6kj2"
Jul 09 00:55:27.934721 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.934595    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66czl\" (UniqueName: \"kubernetes.io/projected/709e8d4f-0df9-4ba4-84f0-d47ed2257f9d-kube-api-access-66czl\") pod \"cluster-samples-operator-56fcf86bf-kj27l\" (UID: \"709e8d4f-0df9-4ba4-84f0-d47ed2257f9d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kj27l"
Jul 09 00:55:27.934721 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.934618    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4f1d4fff-34fd-47cf-a632-07d976f8beec-cert\") pod \"ingress-canary-7bwv9\" (UID: \"4f1d4fff-34fd-47cf-a632-07d976f8beec\") " pod="openshift-ingress-canary/ingress-canary-7bwv9"
Jul 09 00:55:27.934721 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.934664    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17f6664f-1f4d-4e8d-ad1d-da46c799b51d-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-zbnc6\" (UID: \"17f6664f-1f4d-4e8d-ad1d-da46c799b51d\") " pod="openshift-insights/insights-operator-5c847dcfc4-zbnc6"
Jul 09 00:55:27.935110 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.934743    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/569c1037-0058-4b97-9ebf-3fd77e9f72c3-default-certificate\") pod \"router-default-59b7486ffc-xdjvw\" (UID: \"569c1037-0058-4b97-9ebf-3fd77e9f72c3\") " pod="openshift-ingress/router-default-59b7486ffc-xdjvw"
Jul 09 00:55:27.935110 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.934802    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4lmn\" (UniqueName: \"kubernetes.io/projected/8f822d78-fd3b-44d1-ab1d-310f77a80e56-kube-api-access-s4lmn\") pod \"image-registry-6dff8c759c-g4p6l\" (UID: \"8f822d78-fd3b-44d1-ab1d-310f77a80e56\") " pod="openshift-image-registry/image-registry-6dff8c759c-g4p6l"
Jul 09 00:55:27.935110 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.934830    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0-tmp-dir\") pod \"dns-default-22rnw\" (UID: \"d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0\") " pod="openshift-dns/dns-default-22rnw"
Jul 09 00:55:27.935110 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.934861    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8f822d78-fd3b-44d1-ab1d-310f77a80e56-ca-trust-extracted\") pod \"image-registry-6dff8c759c-g4p6l\" (UID: \"8f822d78-fd3b-44d1-ab1d-310f77a80e56\") " pod="openshift-image-registry/image-registry-6dff8c759c-g4p6l"
Jul 09 00:55:27.935110 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.934888    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0-config-volume\") pod \"dns-default-22rnw\" (UID: \"d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0\") " pod="openshift-dns/dns-default-22rnw"
Jul 09 00:55:27.935110 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.934972    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfhkx\" (UniqueName: \"kubernetes.io/projected/7dc12511-b804-4ebc-8646-4d070d93a8cf-kube-api-access-nfhkx\") pod \"console-operator-68b757fb67-z6kj2\" (UID: \"7dc12511-b804-4ebc-8646-4d070d93a8cf\") " pod="openshift-console-operator/console-operator-68b757fb67-z6kj2"
Jul 09 00:55:27.935110 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.935032    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/709e8d4f-0df9-4ba4-84f0-d47ed2257f9d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-kj27l\" (UID: \"709e8d4f-0df9-4ba4-84f0-d47ed2257f9d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kj27l"
Jul 09 00:55:27.935110 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.935057    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17f6664f-1f4d-4e8d-ad1d-da46c799b51d-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-zbnc6\" (UID: \"17f6664f-1f4d-4e8d-ad1d-da46c799b51d\") " pod="openshift-insights/insights-operator-5c847dcfc4-zbnc6"
Jul 09 00:55:27.935110 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.935082    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7dc12511-b804-4ebc-8646-4d070d93a8cf-trusted-ca\") pod \"console-operator-68b757fb67-z6kj2\" (UID: \"7dc12511-b804-4ebc-8646-4d070d93a8cf\") " pod="openshift-console-operator/console-operator-68b757fb67-z6kj2"
Jul 09 00:55:27.935431 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.935119    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f822d78-fd3b-44d1-ab1d-310f77a80e56-registry-tls\") pod \"image-registry-6dff8c759c-g4p6l\" (UID: \"8f822d78-fd3b-44d1-ab1d-310f77a80e56\") " pod="openshift-image-registry/image-registry-6dff8c759c-g4p6l"
Jul 09 00:55:27.935431 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.935147    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8f822d78-fd3b-44d1-ab1d-310f77a80e56-trusted-ca\") pod \"image-registry-6dff8c759c-g4p6l\" (UID: \"8f822d78-fd3b-44d1-ab1d-310f77a80e56\") " pod="openshift-image-registry/image-registry-6dff8c759c-g4p6l"
Jul 09 00:55:27.935431 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.935171    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jmb5\" (UniqueName: \"kubernetes.io/projected/37664234-8f03-4849-b53b-ec22d49b8e31-kube-api-access-2jmb5\") pod \"kube-storage-version-migrator-operator-846bf668f7-jkklf\" (UID: \"37664234-8f03-4849-b53b-ec22d49b8e31\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jkklf"
Jul 09 00:55:27.935431 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.935198    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/17f6664f-1f4d-4e8d-ad1d-da46c799b51d-tmp\") pod \"insights-operator-5c847dcfc4-zbnc6\" (UID: \"17f6664f-1f4d-4e8d-ad1d-da46c799b51d\") " pod="openshift-insights/insights-operator-5c847dcfc4-zbnc6"
Jul 09 00:55:27.935431 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.935232    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bzhs\" (UniqueName: \"kubernetes.io/projected/569c1037-0058-4b97-9ebf-3fd77e9f72c3-kube-api-access-5bzhs\") pod \"router-default-59b7486ffc-xdjvw\" (UID: \"569c1037-0058-4b97-9ebf-3fd77e9f72c3\") " pod="openshift-ingress/router-default-59b7486ffc-xdjvw"
Jul 09 00:55:27.935431 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:27.935249    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a5fbbb22-3d60-42aa-bbb0-8426d37e945c-config\") pod \"service-ca-operator-5d46d9ffd4-rw5s7\" (UID: \"a5fbbb22-3d60-42aa-bbb0-8426d37e945c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rw5s7"
Jul 09 00:55:28.035949 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.035851    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jmb5\" (UniqueName: \"kubernetes.io/projected/37664234-8f03-4849-b53b-ec22d49b8e31-kube-api-access-2jmb5\") pod \"kube-storage-version-migrator-operator-846bf668f7-jkklf\" (UID: \"37664234-8f03-4849-b53b-ec22d49b8e31\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jkklf"
Jul 09 00:55:28.035949 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.035902    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/17f6664f-1f4d-4e8d-ad1d-da46c799b51d-tmp\") pod \"insights-operator-5c847dcfc4-zbnc6\" (UID: \"17f6664f-1f4d-4e8d-ad1d-da46c799b51d\") " pod="openshift-insights/insights-operator-5c847dcfc4-zbnc6"
Jul 09 00:55:28.035949 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.035932    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bzhs\" (UniqueName: \"kubernetes.io/projected/569c1037-0058-4b97-9ebf-3fd77e9f72c3-kube-api-access-5bzhs\") pod \"router-default-59b7486ffc-xdjvw\" (UID: \"569c1037-0058-4b97-9ebf-3fd77e9f72c3\") " pod="openshift-ingress/router-default-59b7486ffc-xdjvw"
Jul 09 00:55:28.036244 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.035958    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a5fbbb22-3d60-42aa-bbb0-8426d37e945c-config\") pod \"service-ca-operator-5d46d9ffd4-rw5s7\" (UID: \"a5fbbb22-3d60-42aa-bbb0-8426d37e945c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rw5s7"
Jul 09 00:55:28.036244 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.035983    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjcxq\" (UniqueName: \"kubernetes.io/projected/b0927f8c-f098-4c8e-b680-1caccc77226d-kube-api-access-zjcxq\") pod \"volume-data-source-validator-5d456fdbcd-g9tpr\" (UID: \"b0927f8c-f098-4c8e-b680-1caccc77226d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-g9tpr"
Jul 09 00:55:28.036244 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.036161    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f822d78-fd3b-44d1-ab1d-310f77a80e56-bound-sa-token\") pod \"image-registry-6dff8c759c-g4p6l\" (UID: \"8f822d78-fd3b-44d1-ab1d-310f77a80e56\") " pod="openshift-image-registry/image-registry-6dff8c759c-g4p6l"
Jul 09 00:55:28.036244 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.036234    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0-metrics-tls\") pod \"dns-default-22rnw\" (UID: \"d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0\") " pod="openshift-dns/dns-default-22rnw"
Jul 09 00:55:28.036446 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.036263    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mbz7\" (UniqueName: \"kubernetes.io/projected/17f6664f-1f4d-4e8d-ad1d-da46c799b51d-kube-api-access-2mbz7\") pod \"insights-operator-5c847dcfc4-zbnc6\" (UID: \"17f6664f-1f4d-4e8d-ad1d-da46c799b51d\") " pod="openshift-insights/insights-operator-5c847dcfc4-zbnc6"
Jul 09 00:55:28.036446 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.036292    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a5fbbb22-3d60-42aa-bbb0-8426d37e945c-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-rw5s7\" (UID: \"a5fbbb22-3d60-42aa-bbb0-8426d37e945c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rw5s7"
Jul 09 00:55:28.036446 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:28.036374    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 00:55:28.036585 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.036449    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/17f6664f-1f4d-4e8d-ad1d-da46c799b51d-tmp\") pod \"insights-operator-5c847dcfc4-zbnc6\" (UID: \"17f6664f-1f4d-4e8d-ad1d-da46c799b51d\") " pod="openshift-insights/insights-operator-5c847dcfc4-zbnc6"
Jul 09 00:55:28.036585 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:28.036464    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0-metrics-tls podName:d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:28.53644505 +0000 UTC m=+36.006587759 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0-metrics-tls") pod "dns-default-22rnw" (UID: "d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0") : secret "dns-default-metrics-tls" not found
Jul 09 00:55:28.036585 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.036501    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7dc12511-b804-4ebc-8646-4d070d93a8cf-serving-cert\") pod \"console-operator-68b757fb67-z6kj2\" (UID: \"7dc12511-b804-4ebc-8646-4d070d93a8cf\") " pod="openshift-console-operator/console-operator-68b757fb67-z6kj2"
Jul 09 00:55:28.036585 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.036528    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/569c1037-0058-4b97-9ebf-3fd77e9f72c3-metrics-certs\") pod \"router-default-59b7486ffc-xdjvw\" (UID: \"569c1037-0058-4b97-9ebf-3fd77e9f72c3\") " pod="openshift-ingress/router-default-59b7486ffc-xdjvw"
Jul 09 00:55:28.036585 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.036555    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e907cd7-ed51-4737-a088-df3d9597489d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-qrrdm\" (UID: \"7e907cd7-ed51-4737-a088-df3d9597489d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qrrdm"
Jul 09 00:55:28.036820 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.036592    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8f822d78-fd3b-44d1-ab1d-310f77a80e56-registry-certificates\") pod \"image-registry-6dff8c759c-g4p6l\" (UID: \"8f822d78-fd3b-44d1-ab1d-310f77a80e56\") " pod="openshift-image-registry/image-registry-6dff8c759c-g4p6l"
Jul 09 00:55:28.036820 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.036608    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a5fbbb22-3d60-42aa-bbb0-8426d37e945c-config\") pod \"service-ca-operator-5d46d9ffd4-rw5s7\" (UID: \"a5fbbb22-3d60-42aa-bbb0-8426d37e945c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rw5s7"
Jul 09 00:55:28.036820 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.036621    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/37664234-8f03-4849-b53b-ec22d49b8e31-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-jkklf\" (UID: \"37664234-8f03-4849-b53b-ec22d49b8e31\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jkklf"
Jul 09 00:55:28.036820 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.036671    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/569c1037-0058-4b97-9ebf-3fd77e9f72c3-service-ca-bundle\") pod \"router-default-59b7486ffc-xdjvw\" (UID: \"569c1037-0058-4b97-9ebf-3fd77e9f72c3\") " pod="openshift-ingress/router-default-59b7486ffc-xdjvw"
Jul 09 00:55:28.036820 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.036710    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8f822d78-fd3b-44d1-ab1d-310f77a80e56-image-registry-private-configuration\") pod \"image-registry-6dff8c759c-g4p6l\" (UID: \"8f822d78-fd3b-44d1-ab1d-310f77a80e56\") " pod="openshift-image-registry/image-registry-6dff8c759c-g4p6l"
Jul 09 00:55:28.036820 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:28.036699    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 09 00:55:28.036820 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.036740    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjnrv\" (UniqueName: \"kubernetes.io/projected/4f1d4fff-34fd-47cf-a632-07d976f8beec-kube-api-access-pjnrv\") pod \"ingress-canary-7bwv9\" (UID: \"4f1d4fff-34fd-47cf-a632-07d976f8beec\") " pod="openshift-ingress-canary/ingress-canary-7bwv9"
Jul 09 00:55:28.036820 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.036767    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqk98\" (UniqueName: \"kubernetes.io/projected/a5fbbb22-3d60-42aa-bbb0-8426d37e945c-kube-api-access-nqk98\") pod \"service-ca-operator-5d46d9ffd4-rw5s7\" (UID: \"a5fbbb22-3d60-42aa-bbb0-8426d37e945c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rw5s7"
Jul 09 00:55:28.036820 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:28.036800    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/569c1037-0058-4b97-9ebf-3fd77e9f72c3-metrics-certs podName:569c1037-0058-4b97-9ebf-3fd77e9f72c3 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:28.536765831 +0000 UTC m=+36.006908551 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/569c1037-0058-4b97-9ebf-3fd77e9f72c3-metrics-certs") pod "router-default-59b7486ffc-xdjvw" (UID: "569c1037-0058-4b97-9ebf-3fd77e9f72c3") : secret "router-metrics-certs-default" not found
Jul 09 00:55:28.037289 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.036839    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/37664234-8f03-4849-b53b-ec22d49b8e31-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-jkklf\" (UID: \"37664234-8f03-4849-b53b-ec22d49b8e31\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jkklf"
Jul 09 00:55:28.037289 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.036887    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/569c1037-0058-4b97-9ebf-3fd77e9f72c3-stats-auth\") pod \"router-default-59b7486ffc-xdjvw\" (UID: \"569c1037-0058-4b97-9ebf-3fd77e9f72c3\") " pod="openshift-ingress/router-default-59b7486ffc-xdjvw"
Jul 09 00:55:28.037289 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.036928    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8f822d78-fd3b-44d1-ab1d-310f77a80e56-installation-pull-secrets\") pod \"image-registry-6dff8c759c-g4p6l\" (UID: \"8f822d78-fd3b-44d1-ab1d-310f77a80e56\") " pod="openshift-image-registry/image-registry-6dff8c759c-g4p6l"
Jul 09 00:55:28.037289 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.036952    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/17f6664f-1f4d-4e8d-ad1d-da46c799b51d-snapshots\") pod \"insights-operator-5c847dcfc4-zbnc6\" (UID: \"17f6664f-1f4d-4e8d-ad1d-da46c799b51d\") " pod="openshift-insights/insights-operator-5c847dcfc4-zbnc6"
Jul 09 00:55:28.037289 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.036995    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwqpv\" (UniqueName: \"kubernetes.io/projected/d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0-kube-api-access-pwqpv\") pod \"dns-default-22rnw\" (UID: \"d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0\") " pod="openshift-dns/dns-default-22rnw"
Jul 09 00:55:28.037289 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.037020    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/17f6664f-1f4d-4e8d-ad1d-da46c799b51d-serving-cert\") pod \"insights-operator-5c847dcfc4-zbnc6\" (UID: \"17f6664f-1f4d-4e8d-ad1d-da46c799b51d\") " pod="openshift-insights/insights-operator-5c847dcfc4-zbnc6"
Jul 09 00:55:28.037289 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.037044    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7dc12511-b804-4ebc-8646-4d070d93a8cf-config\") pod \"console-operator-68b757fb67-z6kj2\" (UID: \"7dc12511-b804-4ebc-8646-4d070d93a8cf\") " pod="openshift-console-operator/console-operator-68b757fb67-z6kj2"
Jul 09 00:55:28.037289 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.037075    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66czl\" (UniqueName: \"kubernetes.io/projected/709e8d4f-0df9-4ba4-84f0-d47ed2257f9d-kube-api-access-66czl\") pod \"cluster-samples-operator-56fcf86bf-kj27l\" (UID: \"709e8d4f-0df9-4ba4-84f0-d47ed2257f9d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kj27l"
Jul 09 00:55:28.037289 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.037105    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/37664234-8f03-4849-b53b-ec22d49b8e31-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-jkklf\" (UID: \"37664234-8f03-4849-b53b-ec22d49b8e31\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jkklf"
Jul 09 00:55:28.037289 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.037116    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4f1d4fff-34fd-47cf-a632-07d976f8beec-cert\") pod \"ingress-canary-7bwv9\" (UID: \"4f1d4fff-34fd-47cf-a632-07d976f8beec\") " pod="openshift-ingress-canary/ingress-canary-7bwv9"
Jul 09 00:55:28.037289 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.037141    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17f6664f-1f4d-4e8d-ad1d-da46c799b51d-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-zbnc6\" (UID: \"17f6664f-1f4d-4e8d-ad1d-da46c799b51d\") " pod="openshift-insights/insights-operator-5c847dcfc4-zbnc6"
Jul 09 00:55:28.037289 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.037167    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/569c1037-0058-4b97-9ebf-3fd77e9f72c3-default-certificate\") pod \"router-default-59b7486ffc-xdjvw\" (UID: \"569c1037-0058-4b97-9ebf-3fd77e9f72c3\") " pod="openshift-ingress/router-default-59b7486ffc-xdjvw"
Jul 09 00:55:28.037289 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.037200    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4lmn\" (UniqueName: \"kubernetes.io/projected/8f822d78-fd3b-44d1-ab1d-310f77a80e56-kube-api-access-s4lmn\") pod \"image-registry-6dff8c759c-g4p6l\" (UID: \"8f822d78-fd3b-44d1-ab1d-310f77a80e56\") " pod="openshift-image-registry/image-registry-6dff8c759c-g4p6l"
Jul 09 00:55:28.037289 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:28.037235    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/569c1037-0058-4b97-9ebf-3fd77e9f72c3-service-ca-bundle podName:569c1037-0058-4b97-9ebf-3fd77e9f72c3 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:28.53719937 +0000 UTC m=+36.007342094 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/569c1037-0058-4b97-9ebf-3fd77e9f72c3-service-ca-bundle") pod "router-default-59b7486ffc-xdjvw" (UID: "569c1037-0058-4b97-9ebf-3fd77e9f72c3") : configmap references non-existent config key: service-ca.crt
Jul 09 00:55:28.037289 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.037279    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7e907cd7-ed51-4737-a088-df3d9597489d-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-qrrdm\" (UID: \"7e907cd7-ed51-4737-a088-df3d9597489d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qrrdm"
Jul 09 00:55:28.038011 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.037291    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8f822d78-fd3b-44d1-ab1d-310f77a80e56-registry-certificates\") pod \"image-registry-6dff8c759c-g4p6l\" (UID: \"8f822d78-fd3b-44d1-ab1d-310f77a80e56\") " pod="openshift-image-registry/image-registry-6dff8c759c-g4p6l"
Jul 09 00:55:28.038011 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.037306    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0-tmp-dir\") pod \"dns-default-22rnw\" (UID: \"d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0\") " pod="openshift-dns/dns-default-22rnw"
Jul 09 00:55:28.038011 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.037361    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8f822d78-fd3b-44d1-ab1d-310f77a80e56-ca-trust-extracted\") pod \"image-registry-6dff8c759c-g4p6l\" (UID: \"8f822d78-fd3b-44d1-ab1d-310f77a80e56\") " pod="openshift-image-registry/image-registry-6dff8c759c-g4p6l"
Jul 09 00:55:28.038011 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.037394    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0-config-volume\") pod \"dns-default-22rnw\" (UID: \"d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0\") " pod="openshift-dns/dns-default-22rnw"
Jul 09 00:55:28.038011 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.037457    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgb85\" (UniqueName: \"kubernetes.io/projected/7e907cd7-ed51-4737-a088-df3d9597489d-kube-api-access-rgb85\") pod \"cluster-monitoring-operator-64786d9cbb-qrrdm\" (UID: \"7e907cd7-ed51-4737-a088-df3d9597489d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qrrdm"
Jul 09 00:55:28.038011 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.037464    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/17f6664f-1f4d-4e8d-ad1d-da46c799b51d-snapshots\") pod \"insights-operator-5c847dcfc4-zbnc6\" (UID: \"17f6664f-1f4d-4e8d-ad1d-da46c799b51d\") " pod="openshift-insights/insights-operator-5c847dcfc4-zbnc6"
Jul 09 00:55:28.038011 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.037497    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfhkx\" (UniqueName: \"kubernetes.io/projected/7dc12511-b804-4ebc-8646-4d070d93a8cf-kube-api-access-nfhkx\") pod \"console-operator-68b757fb67-z6kj2\" (UID: \"7dc12511-b804-4ebc-8646-4d070d93a8cf\") " pod="openshift-console-operator/console-operator-68b757fb67-z6kj2"
Jul 09 00:55:28.038011 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.037536    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/709e8d4f-0df9-4ba4-84f0-d47ed2257f9d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-kj27l\" (UID: \"709e8d4f-0df9-4ba4-84f0-d47ed2257f9d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kj27l"
Jul 09 00:55:28.038011 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.037557    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17f6664f-1f4d-4e8d-ad1d-da46c799b51d-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-zbnc6\" (UID: \"17f6664f-1f4d-4e8d-ad1d-da46c799b51d\") " pod="openshift-insights/insights-operator-5c847dcfc4-zbnc6"
Jul 09 00:55:28.038011 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.037584    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7dc12511-b804-4ebc-8646-4d070d93a8cf-trusted-ca\") pod \"console-operator-68b757fb67-z6kj2\" (UID: \"7dc12511-b804-4ebc-8646-4d070d93a8cf\") " pod="openshift-console-operator/console-operator-68b757fb67-z6kj2"
Jul 09 00:55:28.038011 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.037605    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbtrz\" (UniqueName: \"kubernetes.io/projected/6a67ca23-3c37-4b4c-8980-8c20c4386ada-kube-api-access-dbtrz\") pod \"network-check-source-989f8b8dc-5mtv8\" (UID: \"6a67ca23-3c37-4b4c-8980-8c20c4386ada\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-5mtv8"
Jul 09 00:55:28.038011 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.037608    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0-tmp-dir\") pod \"dns-default-22rnw\" (UID: \"d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0\") " pod="openshift-dns/dns-default-22rnw"
Jul 09 00:55:28.038011 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.037641    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f822d78-fd3b-44d1-ab1d-310f77a80e56-registry-tls\") pod \"image-registry-6dff8c759c-g4p6l\" (UID: \"8f822d78-fd3b-44d1-ab1d-310f77a80e56\") " pod="openshift-image-registry/image-registry-6dff8c759c-g4p6l"
Jul 09 00:55:28.038011 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:28.037740    2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 09 00:55:28.038011 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:28.037776    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/709e8d4f-0df9-4ba4-84f0-d47ed2257f9d-samples-operator-tls podName:709e8d4f-0df9-4ba4-84f0-d47ed2257f9d nodeName:}" failed. No retries permitted until 2026-07-09 00:55:28.537764193 +0000 UTC m=+36.007906903 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/709e8d4f-0df9-4ba4-84f0-d47ed2257f9d-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-kj27l" (UID: "709e8d4f-0df9-4ba4-84f0-d47ed2257f9d") : secret "samples-operator-tls" not found
Jul 09 00:55:28.038758 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.038323    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7dc12511-b804-4ebc-8646-4d070d93a8cf-config\") pod \"console-operator-68b757fb67-z6kj2\" (UID: \"7dc12511-b804-4ebc-8646-4d070d93a8cf\") " pod="openshift-console-operator/console-operator-68b757fb67-z6kj2"
Jul 09 00:55:28.038758 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.038567    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17f6664f-1f4d-4e8d-ad1d-da46c799b51d-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-zbnc6\" (UID: \"17f6664f-1f4d-4e8d-ad1d-da46c799b51d\") " pod="openshift-insights/insights-operator-5c847dcfc4-zbnc6"
Jul 09 00:55:28.038758 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.038610    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8f822d78-fd3b-44d1-ab1d-310f77a80e56-ca-trust-extracted\") pod \"image-registry-6dff8c759c-g4p6l\" (UID: \"8f822d78-fd3b-44d1-ab1d-310f77a80e56\") " pod="openshift-image-registry/image-registry-6dff8c759c-g4p6l"
Jul 09 00:55:28.042655 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.041465    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a5fbbb22-3d60-42aa-bbb0-8426d37e945c-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-rw5s7\" (UID: \"a5fbbb22-3d60-42aa-bbb0-8426d37e945c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rw5s7"
Jul 09 00:55:28.042655 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.041478    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/37664234-8f03-4849-b53b-ec22d49b8e31-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-jkklf\" (UID: \"37664234-8f03-4849-b53b-ec22d49b8e31\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jkklf"
Jul 09 00:55:28.042655 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.041700    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/569c1037-0058-4b97-9ebf-3fd77e9f72c3-stats-auth\") pod \"router-default-59b7486ffc-xdjvw\" (UID: \"569c1037-0058-4b97-9ebf-3fd77e9f72c3\") " pod="openshift-ingress/router-default-59b7486ffc-xdjvw"
Jul 09 00:55:28.042655 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.041725    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8f822d78-fd3b-44d1-ab1d-310f77a80e56-installation-pull-secrets\") pod \"image-registry-6dff8c759c-g4p6l\" (UID: \"8f822d78-fd3b-44d1-ab1d-310f77a80e56\") " pod="openshift-image-registry/image-registry-6dff8c759c-g4p6l"
Jul 09 00:55:28.042655 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.041781    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8f822d78-fd3b-44d1-ab1d-310f77a80e56-trusted-ca\") pod \"image-registry-6dff8c759c-g4p6l\" (UID: \"8f822d78-fd3b-44d1-ab1d-310f77a80e56\") " pod="openshift-image-registry/image-registry-6dff8c759c-g4p6l"
Jul 09 00:55:28.042655 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.041933    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0-config-volume\") pod \"dns-default-22rnw\" (UID: \"d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0\") " pod="openshift-dns/dns-default-22rnw"
Jul 09 00:55:28.042655 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.041944    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8f822d78-fd3b-44d1-ab1d-310f77a80e56-image-registry-private-configuration\") pod \"image-registry-6dff8c759c-g4p6l\" (UID: \"8f822d78-fd3b-44d1-ab1d-310f77a80e56\") " pod="openshift-image-registry/image-registry-6dff8c759c-g4p6l"
Jul 09 00:55:28.042655 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:28.042015    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 00:55:28.042655 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:28.042029    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dff8c759c-g4p6l: secret "image-registry-tls" not found
Jul 09 00:55:28.042655 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:28.042132    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f822d78-fd3b-44d1-ab1d-310f77a80e56-registry-tls podName:8f822d78-fd3b-44d1-ab1d-310f77a80e56 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:28.542116675 +0000 UTC m=+36.012259384 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8f822d78-fd3b-44d1-ab1d-310f77a80e56-registry-tls") pod "image-registry-6dff8c759c-g4p6l" (UID: "8f822d78-fd3b-44d1-ab1d-310f77a80e56") : secret "image-registry-tls" not found
Jul 09 00:55:28.042655 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.042197    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17f6664f-1f4d-4e8d-ad1d-da46c799b51d-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-zbnc6\" (UID: \"17f6664f-1f4d-4e8d-ad1d-da46c799b51d\") " pod="openshift-insights/insights-operator-5c847dcfc4-zbnc6"
Jul 09 00:55:28.042655 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.042304    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7dc12511-b804-4ebc-8646-4d070d93a8cf-serving-cert\") pod \"console-operator-68b757fb67-z6kj2\" (UID: \"7dc12511-b804-4ebc-8646-4d070d93a8cf\") " pod="openshift-console-operator/console-operator-68b757fb67-z6kj2"
Jul 09 00:55:28.042655 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.042586    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/17f6664f-1f4d-4e8d-ad1d-da46c799b51d-serving-cert\") pod \"insights-operator-5c847dcfc4-zbnc6\" (UID: \"17f6664f-1f4d-4e8d-ad1d-da46c799b51d\") " pod="openshift-insights/insights-operator-5c847dcfc4-zbnc6"
Jul 09 00:55:28.042655 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.042619    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7dc12511-b804-4ebc-8646-4d070d93a8cf-trusted-ca\") pod \"console-operator-68b757fb67-z6kj2\" (UID: \"7dc12511-b804-4ebc-8646-4d070d93a8cf\") " pod="openshift-console-operator/console-operator-68b757fb67-z6kj2"
Jul 09 00:55:28.043138 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.042694    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8f822d78-fd3b-44d1-ab1d-310f77a80e56-trusted-ca\") pod \"image-registry-6dff8c759c-g4p6l\" (UID: \"8f822d78-fd3b-44d1-ab1d-310f77a80e56\") " pod="openshift-image-registry/image-registry-6dff8c759c-g4p6l"
Jul 09 00:55:28.043138 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.042805    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/569c1037-0058-4b97-9ebf-3fd77e9f72c3-default-certificate\") pod \"router-default-59b7486ffc-xdjvw\" (UID: \"569c1037-0058-4b97-9ebf-3fd77e9f72c3\") " pod="openshift-ingress/router-default-59b7486ffc-xdjvw"
Jul 09 00:55:28.043903 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.043886    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4f1d4fff-34fd-47cf-a632-07d976f8beec-cert\") pod \"ingress-canary-7bwv9\" (UID: \"4f1d4fff-34fd-47cf-a632-07d976f8beec\") " pod="openshift-ingress-canary/ingress-canary-7bwv9"
Jul 09 00:55:28.048560 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.048075    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mbz7\" (UniqueName: \"kubernetes.io/projected/17f6664f-1f4d-4e8d-ad1d-da46c799b51d-kube-api-access-2mbz7\") pod \"insights-operator-5c847dcfc4-zbnc6\" (UID: \"17f6664f-1f4d-4e8d-ad1d-da46c799b51d\") " pod="openshift-insights/insights-operator-5c847dcfc4-zbnc6"
Jul 09 00:55:28.048560 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.048301    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bzhs\" (UniqueName: \"kubernetes.io/projected/569c1037-0058-4b97-9ebf-3fd77e9f72c3-kube-api-access-5bzhs\") pod \"router-default-59b7486ffc-xdjvw\" (UID: \"569c1037-0058-4b97-9ebf-3fd77e9f72c3\") " pod="openshift-ingress/router-default-59b7486ffc-xdjvw"
Jul 09 00:55:28.048560 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.048346    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqk98\" (UniqueName: \"kubernetes.io/projected/a5fbbb22-3d60-42aa-bbb0-8426d37e945c-kube-api-access-nqk98\") pod \"service-ca-operator-5d46d9ffd4-rw5s7\" (UID: \"a5fbbb22-3d60-42aa-bbb0-8426d37e945c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rw5s7"
Jul 09 00:55:28.048560 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.048533    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f822d78-fd3b-44d1-ab1d-310f77a80e56-bound-sa-token\") pod \"image-registry-6dff8c759c-g4p6l\" (UID: \"8f822d78-fd3b-44d1-ab1d-310f77a80e56\") " pod="openshift-image-registry/image-registry-6dff8c759c-g4p6l"
Jul 09 00:55:28.048560 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.048548    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjcxq\" (UniqueName: \"kubernetes.io/projected/b0927f8c-f098-4c8e-b680-1caccc77226d-kube-api-access-zjcxq\") pod \"volume-data-source-validator-5d456fdbcd-g9tpr\" (UID: \"b0927f8c-f098-4c8e-b680-1caccc77226d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-g9tpr"
Jul 09 00:55:28.048966 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.048913    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjnrv\" (UniqueName: \"kubernetes.io/projected/4f1d4fff-34fd-47cf-a632-07d976f8beec-kube-api-access-pjnrv\") pod \"ingress-canary-7bwv9\" (UID: \"4f1d4fff-34fd-47cf-a632-07d976f8beec\") " pod="openshift-ingress-canary/ingress-canary-7bwv9"
Jul 09 00:55:28.049275 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.049258    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4lmn\" (UniqueName: \"kubernetes.io/projected/8f822d78-fd3b-44d1-ab1d-310f77a80e56-kube-api-access-s4lmn\") pod \"image-registry-6dff8c759c-g4p6l\" (UID: \"8f822d78-fd3b-44d1-ab1d-310f77a80e56\") " pod="openshift-image-registry/image-registry-6dff8c759c-g4p6l"
Jul 09 00:55:28.050602 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.050581    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwqpv\" (UniqueName: \"kubernetes.io/projected/d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0-kube-api-access-pwqpv\") pod \"dns-default-22rnw\" (UID: \"d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0\") " pod="openshift-dns/dns-default-22rnw"
Jul 09 00:55:28.050696 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.050648    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfhkx\" (UniqueName: \"kubernetes.io/projected/7dc12511-b804-4ebc-8646-4d070d93a8cf-kube-api-access-nfhkx\") pod \"console-operator-68b757fb67-z6kj2\" (UID: \"7dc12511-b804-4ebc-8646-4d070d93a8cf\") " pod="openshift-console-operator/console-operator-68b757fb67-z6kj2"
Jul 09 00:55:28.050838 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.050816    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jmb5\" (UniqueName: \"kubernetes.io/projected/37664234-8f03-4849-b53b-ec22d49b8e31-kube-api-access-2jmb5\") pod \"kube-storage-version-migrator-operator-846bf668f7-jkklf\" (UID: \"37664234-8f03-4849-b53b-ec22d49b8e31\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jkklf"
Jul 09 00:55:28.051032 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.051019    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66czl\" (UniqueName: \"kubernetes.io/projected/709e8d4f-0df9-4ba4-84f0-d47ed2257f9d-kube-api-access-66czl\") pod \"cluster-samples-operator-56fcf86bf-kj27l\" (UID: \"709e8d4f-0df9-4ba4-84f0-d47ed2257f9d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kj27l"
Jul 09 00:55:28.139104 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.139071    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jkklf"
Jul 09 00:55:28.142443 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.142413    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbtrz\" (UniqueName: \"kubernetes.io/projected/6a67ca23-3c37-4b4c-8980-8c20c4386ada-kube-api-access-dbtrz\") pod \"network-check-source-989f8b8dc-5mtv8\" (UID: \"6a67ca23-3c37-4b4c-8980-8c20c4386ada\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-5mtv8"
Jul 09 00:55:28.142592 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.142481    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e907cd7-ed51-4737-a088-df3d9597489d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-qrrdm\" (UID: \"7e907cd7-ed51-4737-a088-df3d9597489d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qrrdm"
Jul 09 00:55:28.142592 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.142576    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7e907cd7-ed51-4737-a088-df3d9597489d-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-qrrdm\" (UID: \"7e907cd7-ed51-4737-a088-df3d9597489d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qrrdm"
Jul 09 00:55:28.142722 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.142610    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgb85\" (UniqueName: \"kubernetes.io/projected/7e907cd7-ed51-4737-a088-df3d9597489d-kube-api-access-rgb85\") pod \"cluster-monitoring-operator-64786d9cbb-qrrdm\" (UID: \"7e907cd7-ed51-4737-a088-df3d9597489d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qrrdm"
Jul 09 00:55:28.142722 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:28.142577    2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 00:55:28.142722 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:28.142720    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e907cd7-ed51-4737-a088-df3d9597489d-cluster-monitoring-operator-tls podName:7e907cd7-ed51-4737-a088-df3d9597489d nodeName:}" failed. No retries permitted until 2026-07-09 00:55:28.642697633 +0000 UTC m=+36.112840357 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7e907cd7-ed51-4737-a088-df3d9597489d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-qrrdm" (UID: "7e907cd7-ed51-4737-a088-df3d9597489d") : secret "cluster-monitoring-operator-tls" not found
Jul 09 00:55:28.143332 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.143311    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7e907cd7-ed51-4737-a088-df3d9597489d-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-qrrdm\" (UID: \"7e907cd7-ed51-4737-a088-df3d9597489d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qrrdm"
Jul 09 00:55:28.148138 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.148117    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-g9tpr"
Jul 09 00:55:28.151057 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.151037    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbtrz\" (UniqueName: \"kubernetes.io/projected/6a67ca23-3c37-4b4c-8980-8c20c4386ada-kube-api-access-dbtrz\") pod \"network-check-source-989f8b8dc-5mtv8\" (UID: \"6a67ca23-3c37-4b4c-8980-8c20c4386ada\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-5mtv8"
Jul 09 00:55:28.151259 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.151193    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgb85\" (UniqueName: \"kubernetes.io/projected/7e907cd7-ed51-4737-a088-df3d9597489d-kube-api-access-rgb85\") pod \"cluster-monitoring-operator-64786d9cbb-qrrdm\" (UID: \"7e907cd7-ed51-4737-a088-df3d9597489d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qrrdm"
Jul 09 00:55:28.160082 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.160059    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-zbnc6"
Jul 09 00:55:28.167664 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.167455    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rw5s7"
Jul 09 00:55:28.183283 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.183169    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-z6kj2"
Jul 09 00:55:28.195391 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.195137    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7bwv9"
Jul 09 00:55:28.205874 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.205716    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-5mtv8"
Jul 09 00:55:28.380527 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.376793    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jkklf"]
Jul 09 00:55:28.385975 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:55:28.385921    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37664234_8f03_4849_b53b_ec22d49b8e31.slice/crio-af4eccb7cfe4c1c481cd5eb7ff185f28a5bd4b8647fee96bbef7a9dac7f29bd3 WatchSource:0}: Error finding container af4eccb7cfe4c1c481cd5eb7ff185f28a5bd4b8647fee96bbef7a9dac7f29bd3: Status 404 returned error can't find the container with id af4eccb7cfe4c1c481cd5eb7ff185f28a5bd4b8647fee96bbef7a9dac7f29bd3
Jul 09 00:55:28.412736 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.412705    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-g9tpr"]
Jul 09 00:55:28.416680 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:55:28.416657    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0927f8c_f098_4c8e_b680_1caccc77226d.slice/crio-9763c377817e574ce401cf02203bf7c1d5c708b05b26b143799f03c42060f696 WatchSource:0}: Error finding container 9763c377817e574ce401cf02203bf7c1d5c708b05b26b143799f03c42060f696: Status 404 returned error can't find the container with id 9763c377817e574ce401cf02203bf7c1d5c708b05b26b143799f03c42060f696
Jul 09 00:55:28.423320 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.423296    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-zbnc6"]
Jul 09 00:55:28.426805 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:55:28.426782    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17f6664f_1f4d_4e8d_ad1d_da46c799b51d.slice/crio-9fb663c0a096e0936cdc2bb866d0b174a05a8f750729cc1abcb64d486b03df97 WatchSource:0}: Error finding container 9fb663c0a096e0936cdc2bb866d0b174a05a8f750729cc1abcb64d486b03df97: Status 404 returned error can't find the container with id 9fb663c0a096e0936cdc2bb866d0b174a05a8f750729cc1abcb64d486b03df97
Jul 09 00:55:28.431505 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.431184    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rw5s7"]
Jul 09 00:55:28.437381 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:55:28.437314    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5fbbb22_3d60_42aa_bbb0_8426d37e945c.slice/crio-c9e56185972122dd8cecd4adea8609c50e160377a794f502548e2937cb02b963 WatchSource:0}: Error finding container c9e56185972122dd8cecd4adea8609c50e160377a794f502548e2937cb02b963: Status 404 returned error can't find the container with id c9e56185972122dd8cecd4adea8609c50e160377a794f502548e2937cb02b963
Jul 09 00:55:28.454756 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.454583    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-5mtv8"]
Jul 09 00:55:28.457898 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:55:28.457754    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a67ca23_3c37_4b4c_8980_8c20c4386ada.slice/crio-3c9a09154ff0ae8370d3fc8c0ded3d13da4c0abecd86c0879ccd6c28fdafaea3 WatchSource:0}: Error finding container 3c9a09154ff0ae8370d3fc8c0ded3d13da4c0abecd86c0879ccd6c28fdafaea3: Status 404 returned error can't find the container with id 3c9a09154ff0ae8370d3fc8c0ded3d13da4c0abecd86c0879ccd6c28fdafaea3
Jul 09 00:55:28.458922 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.458732    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7bwv9"]
Jul 09 00:55:28.461715 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:55:28.461679    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f1d4fff_34fd_47cf_a632_07d976f8beec.slice/crio-8cd7c1a2ef093cdfc5ce41ba9fc51428bfdf8b7d4a4db1810ebbd574bd172299 WatchSource:0}: Error finding container 8cd7c1a2ef093cdfc5ce41ba9fc51428bfdf8b7d4a4db1810ebbd574bd172299: Status 404 returned error can't find the container with id 8cd7c1a2ef093cdfc5ce41ba9fc51428bfdf8b7d4a4db1810ebbd574bd172299
Jul 09 00:55:28.469079 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.469054    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-z6kj2"]
Jul 09 00:55:28.473202 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:55:28.473176    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dc12511_b804_4ebc_8646_4d070d93a8cf.slice/crio-92627eac0cbc93d1f880f72b719a710709fb8aa2a28166f4a8ac83bba202432e WatchSource:0}: Error finding container 92627eac0cbc93d1f880f72b719a710709fb8aa2a28166f4a8ac83bba202432e: Status 404 returned error can't find the container with id 92627eac0cbc93d1f880f72b719a710709fb8aa2a28166f4a8ac83bba202432e
Jul 09 00:55:28.549267 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.549234    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/709e8d4f-0df9-4ba4-84f0-d47ed2257f9d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-kj27l\" (UID: \"709e8d4f-0df9-4ba4-84f0-d47ed2257f9d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kj27l"
Jul 09 00:55:28.549470 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.549276    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f822d78-fd3b-44d1-ab1d-310f77a80e56-registry-tls\") pod \"image-registry-6dff8c759c-g4p6l\" (UID: \"8f822d78-fd3b-44d1-ab1d-310f77a80e56\") " pod="openshift-image-registry/image-registry-6dff8c759c-g4p6l"
Jul 09 00:55:28.549470 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:28.549376    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 00:55:28.549470 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:28.549386    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dff8c759c-g4p6l: secret "image-registry-tls" not found
Jul 09 00:55:28.549470 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:28.549403    2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 09 00:55:28.549470 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.549417    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0-metrics-tls\") pod \"dns-default-22rnw\" (UID: \"d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0\") " pod="openshift-dns/dns-default-22rnw"
Jul 09 00:55:28.549470 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:28.549437    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f822d78-fd3b-44d1-ab1d-310f77a80e56-registry-tls podName:8f822d78-fd3b-44d1-ab1d-310f77a80e56 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:29.549420031 +0000 UTC m=+37.019562760 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8f822d78-fd3b-44d1-ab1d-310f77a80e56-registry-tls") pod "image-registry-6dff8c759c-g4p6l" (UID: "8f822d78-fd3b-44d1-ab1d-310f77a80e56") : secret "image-registry-tls" not found
Jul 09 00:55:28.549470 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:28.549461    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/709e8d4f-0df9-4ba4-84f0-d47ed2257f9d-samples-operator-tls podName:709e8d4f-0df9-4ba4-84f0-d47ed2257f9d nodeName:}" failed. No retries permitted until 2026-07-09 00:55:29.549445008 +0000 UTC m=+37.019587718 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/709e8d4f-0df9-4ba4-84f0-d47ed2257f9d-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-kj27l" (UID: "709e8d4f-0df9-4ba4-84f0-d47ed2257f9d") : secret "samples-operator-tls" not found
Jul 09 00:55:28.549770 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:28.549491    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 00:55:28.549770 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.549501    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/569c1037-0058-4b97-9ebf-3fd77e9f72c3-metrics-certs\") pod \"router-default-59b7486ffc-xdjvw\" (UID: \"569c1037-0058-4b97-9ebf-3fd77e9f72c3\") " pod="openshift-ingress/router-default-59b7486ffc-xdjvw"
Jul 09 00:55:28.549770 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:28.549523    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0-metrics-tls podName:d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:29.549513735 +0000 UTC m=+37.019656442 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0-metrics-tls") pod "dns-default-22rnw" (UID: "d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0") : secret "dns-default-metrics-tls" not found
Jul 09 00:55:28.549770 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.549553    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/569c1037-0058-4b97-9ebf-3fd77e9f72c3-service-ca-bundle\") pod \"router-default-59b7486ffc-xdjvw\" (UID: \"569c1037-0058-4b97-9ebf-3fd77e9f72c3\") " pod="openshift-ingress/router-default-59b7486ffc-xdjvw"
Jul 09 00:55:28.549770 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:28.549579    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 09 00:55:28.549770 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:28.549616    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/569c1037-0058-4b97-9ebf-3fd77e9f72c3-metrics-certs podName:569c1037-0058-4b97-9ebf-3fd77e9f72c3 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:29.549603694 +0000 UTC m=+37.019746403 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/569c1037-0058-4b97-9ebf-3fd77e9f72c3-metrics-certs") pod "router-default-59b7486ffc-xdjvw" (UID: "569c1037-0058-4b97-9ebf-3fd77e9f72c3") : secret "router-metrics-certs-default" not found
Jul 09 00:55:28.549770 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:28.549676    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/569c1037-0058-4b97-9ebf-3fd77e9f72c3-service-ca-bundle podName:569c1037-0058-4b97-9ebf-3fd77e9f72c3 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:29.549665248 +0000 UTC m=+37.019807955 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/569c1037-0058-4b97-9ebf-3fd77e9f72c3-service-ca-bundle") pod "router-default-59b7486ffc-xdjvw" (UID: "569c1037-0058-4b97-9ebf-3fd77e9f72c3") : configmap references non-existent config key: service-ca.crt
Jul 09 00:55:28.651035 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:28.650952    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e907cd7-ed51-4737-a088-df3d9597489d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-qrrdm\" (UID: \"7e907cd7-ed51-4737-a088-df3d9597489d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qrrdm"
Jul 09 00:55:28.651168 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:28.651107    2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 00:55:28.651226 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:28.651175    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e907cd7-ed51-4737-a088-df3d9597489d-cluster-monitoring-operator-tls podName:7e907cd7-ed51-4737-a088-df3d9597489d nodeName:}" failed. No retries permitted until 2026-07-09 00:55:29.651158852 +0000 UTC m=+37.121301558 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7e907cd7-ed51-4737-a088-df3d9597489d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-qrrdm" (UID: "7e907cd7-ed51-4737-a088-df3d9597489d") : secret "cluster-monitoring-operator-tls" not found
Jul 09 00:55:29.033963 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:29.033925    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvvxg"
Jul 09 00:55:29.034575 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:29.033925    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dgrzs"
Jul 09 00:55:29.034575 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:29.034047    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p4px"
Jul 09 00:55:29.036416 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:29.036384    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 00:55:29.036536 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:29.036435    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jpd88\""
Jul 09 00:55:29.036536 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:29.036435    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 00:55:29.036536 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:29.036440    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-htn6x\""
Jul 09 00:55:29.222874 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:29.222646    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-g9tpr" event={"ID":"b0927f8c-f098-4c8e-b680-1caccc77226d","Type":"ContainerStarted","Data":"9763c377817e574ce401cf02203bf7c1d5c708b05b26b143799f03c42060f696"}
Jul 09 00:55:29.226906 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:29.226814    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jkklf" event={"ID":"37664234-8f03-4849-b53b-ec22d49b8e31","Type":"ContainerStarted","Data":"af4eccb7cfe4c1c481cd5eb7ff185f28a5bd4b8647fee96bbef7a9dac7f29bd3"}
Jul 09 00:55:29.234367 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:29.234332    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rw5s7" event={"ID":"a5fbbb22-3d60-42aa-bbb0-8426d37e945c","Type":"ContainerStarted","Data":"c9e56185972122dd8cecd4adea8609c50e160377a794f502548e2937cb02b963"}
Jul 09 00:55:29.236522 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:29.236449    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-5mtv8" event={"ID":"6a67ca23-3c37-4b4c-8980-8c20c4386ada","Type":"ContainerStarted","Data":"3c9a09154ff0ae8370d3fc8c0ded3d13da4c0abecd86c0879ccd6c28fdafaea3"}
Jul 09 00:55:29.239492 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:29.239412    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-z6kj2" event={"ID":"7dc12511-b804-4ebc-8646-4d070d93a8cf","Type":"ContainerStarted","Data":"92627eac0cbc93d1f880f72b719a710709fb8aa2a28166f4a8ac83bba202432e"}
Jul 09 00:55:29.241530 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:29.241475    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-zbnc6" event={"ID":"17f6664f-1f4d-4e8d-ad1d-da46c799b51d","Type":"ContainerStarted","Data":"9fb663c0a096e0936cdc2bb866d0b174a05a8f750729cc1abcb64d486b03df97"}
Jul 09 00:55:29.253655 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:29.250873    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7bwv9" event={"ID":"4f1d4fff-34fd-47cf-a632-07d976f8beec","Type":"ContainerStarted","Data":"8cd7c1a2ef093cdfc5ce41ba9fc51428bfdf8b7d4a4db1810ebbd574bd172299"}
Jul 09 00:55:29.561023 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:29.560913    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/709e8d4f-0df9-4ba4-84f0-d47ed2257f9d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-kj27l\" (UID: \"709e8d4f-0df9-4ba4-84f0-d47ed2257f9d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kj27l"
Jul 09 00:55:29.561023 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:29.560973    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f822d78-fd3b-44d1-ab1d-310f77a80e56-registry-tls\") pod \"image-registry-6dff8c759c-g4p6l\" (UID: \"8f822d78-fd3b-44d1-ab1d-310f77a80e56\") " pod="openshift-image-registry/image-registry-6dff8c759c-g4p6l"
Jul 09 00:55:29.561023 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:29.561026    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0-metrics-tls\") pod \"dns-default-22rnw\" (UID: \"d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0\") " pod="openshift-dns/dns-default-22rnw"
Jul 09 00:55:29.561023 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:29.561055    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/569c1037-0058-4b97-9ebf-3fd77e9f72c3-metrics-certs\") pod \"router-default-59b7486ffc-xdjvw\" (UID: \"569c1037-0058-4b97-9ebf-3fd77e9f72c3\") " pod="openshift-ingress/router-default-59b7486ffc-xdjvw"
Jul 09 00:55:29.561023 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:29.561097    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/569c1037-0058-4b97-9ebf-3fd77e9f72c3-service-ca-bundle\") pod \"router-default-59b7486ffc-xdjvw\" (UID: \"569c1037-0058-4b97-9ebf-3fd77e9f72c3\") " pod="openshift-ingress/router-default-59b7486ffc-xdjvw"
Jul 09 00:55:29.561023 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:29.561303    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/569c1037-0058-4b97-9ebf-3fd77e9f72c3-service-ca-bundle podName:569c1037-0058-4b97-9ebf-3fd77e9f72c3 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:31.561283797 +0000 UTC m=+39.031426518 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/569c1037-0058-4b97-9ebf-3fd77e9f72c3-service-ca-bundle") pod "router-default-59b7486ffc-xdjvw" (UID: "569c1037-0058-4b97-9ebf-3fd77e9f72c3") : configmap references non-existent config key: service-ca.crt
Jul 09 00:55:29.561023 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:29.561330    2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 09 00:55:29.561023 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:29.561397    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/709e8d4f-0df9-4ba4-84f0-d47ed2257f9d-samples-operator-tls podName:709e8d4f-0df9-4ba4-84f0-d47ed2257f9d nodeName:}" failed. No retries permitted until 2026-07-09 00:55:31.561378858 +0000 UTC m=+39.031521567 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/709e8d4f-0df9-4ba4-84f0-d47ed2257f9d-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-kj27l" (UID: "709e8d4f-0df9-4ba4-84f0-d47ed2257f9d") : secret "samples-operator-tls" not found
Jul 09 00:55:29.561023 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:29.561465    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 09 00:55:29.561023 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:29.561500    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/569c1037-0058-4b97-9ebf-3fd77e9f72c3-metrics-certs podName:569c1037-0058-4b97-9ebf-3fd77e9f72c3 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:31.561489 +0000 UTC m=+39.031631710 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/569c1037-0058-4b97-9ebf-3fd77e9f72c3-metrics-certs") pod "router-default-59b7486ffc-xdjvw" (UID: "569c1037-0058-4b97-9ebf-3fd77e9f72c3") : secret "router-metrics-certs-default" not found
Jul 09 00:55:29.561023 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:29.561561    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 00:55:29.561023 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:29.561590    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0-metrics-tls podName:d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:31.561580236 +0000 UTC m=+39.031722947 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0-metrics-tls") pod "dns-default-22rnw" (UID: "d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0") : secret "dns-default-metrics-tls" not found
Jul 09 00:55:29.562634 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:29.562313    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 00:55:29.562634 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:29.562333    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dff8c759c-g4p6l: secret "image-registry-tls" not found
Jul 09 00:55:29.562634 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:29.562383    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f822d78-fd3b-44d1-ab1d-310f77a80e56-registry-tls podName:8f822d78-fd3b-44d1-ab1d-310f77a80e56 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:31.562367924 +0000 UTC m=+39.032510643 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8f822d78-fd3b-44d1-ab1d-310f77a80e56-registry-tls") pod "image-registry-6dff8c759c-g4p6l" (UID: "8f822d78-fd3b-44d1-ab1d-310f77a80e56") : secret "image-registry-tls" not found
Jul 09 00:55:29.662472 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:29.662430    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e907cd7-ed51-4737-a088-df3d9597489d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-qrrdm\" (UID: \"7e907cd7-ed51-4737-a088-df3d9597489d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qrrdm"
Jul 09 00:55:29.662727 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:29.662705    2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 00:55:29.662838 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:29.662781    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e907cd7-ed51-4737-a088-df3d9597489d-cluster-monitoring-operator-tls podName:7e907cd7-ed51-4737-a088-df3d9597489d nodeName:}" failed. No retries permitted until 2026-07-09 00:55:31.66276171 +0000 UTC m=+39.132904422 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7e907cd7-ed51-4737-a088-df3d9597489d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-qrrdm" (UID: "7e907cd7-ed51-4737-a088-df3d9597489d") : secret "cluster-monitoring-operator-tls" not found
Jul 09 00:55:31.263751 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:31.263675    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-g9tpr" event={"ID":"b0927f8c-f098-4c8e-b680-1caccc77226d","Type":"ContainerStarted","Data":"fa5d10031349452ccf1b382da235239ad8aac9ef8feaf9617b98ddc55f247d8a"}
Jul 09 00:55:31.281034 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:31.280976    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-g9tpr" podStartSLOduration=3.8814999329999997 podStartE2EDuration="6.280956449s" totalImagesPullingTime="2.399456516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 00:55:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:55:31.279615946 +0000 UTC m=+38.749758677" watchObservedRunningTime="2026-07-09 00:55:31.280956449 +0000 UTC m=+38.751099173"
Jul 09 00:55:31.429605 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:31.429530    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pg99d_f00d32fa-a646-4c75-8c89-3b282d512750/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:31.514325 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:31.513894    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pg99d_f00d32fa-a646-4c75-8c89-3b282d512750/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:31.586057 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:31.585892    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0-metrics-tls\") pod \"dns-default-22rnw\" (UID: \"d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0\") " pod="openshift-dns/dns-default-22rnw"
Jul 09 00:55:31.586057 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:31.585942    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/569c1037-0058-4b97-9ebf-3fd77e9f72c3-metrics-certs\") pod \"router-default-59b7486ffc-xdjvw\" (UID: \"569c1037-0058-4b97-9ebf-3fd77e9f72c3\") " pod="openshift-ingress/router-default-59b7486ffc-xdjvw"
Jul 09 00:55:31.586057 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:31.585990    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/569c1037-0058-4b97-9ebf-3fd77e9f72c3-service-ca-bundle\") pod \"router-default-59b7486ffc-xdjvw\" (UID: \"569c1037-0058-4b97-9ebf-3fd77e9f72c3\") " pod="openshift-ingress/router-default-59b7486ffc-xdjvw"
Jul 09 00:55:31.586398 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:31.586092    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 00:55:31.586398 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:31.586092    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/709e8d4f-0df9-4ba4-84f0-d47ed2257f9d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-kj27l\" (UID: \"709e8d4f-0df9-4ba4-84f0-d47ed2257f9d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kj27l"
Jul 09 00:55:31.586398 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:31.586092    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 09 00:55:31.586398 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:31.586171    2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 09 00:55:31.586398 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:31.586178    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0-metrics-tls podName:d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:35.58615687 +0000 UTC m=+43.056299599 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0-metrics-tls") pod "dns-default-22rnw" (UID: "d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0") : secret "dns-default-metrics-tls" not found
Jul 09 00:55:31.586398 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:31.586245    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/569c1037-0058-4b97-9ebf-3fd77e9f72c3-metrics-certs podName:569c1037-0058-4b97-9ebf-3fd77e9f72c3 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:35.586228233 +0000 UTC m=+43.056370944 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/569c1037-0058-4b97-9ebf-3fd77e9f72c3-metrics-certs") pod "router-default-59b7486ffc-xdjvw" (UID: "569c1037-0058-4b97-9ebf-3fd77e9f72c3") : secret "router-metrics-certs-default" not found
Jul 09 00:55:31.586398 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:31.586264    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/569c1037-0058-4b97-9ebf-3fd77e9f72c3-service-ca-bundle podName:569c1037-0058-4b97-9ebf-3fd77e9f72c3 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:35.586256131 +0000 UTC m=+43.056398844 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/569c1037-0058-4b97-9ebf-3fd77e9f72c3-service-ca-bundle") pod "router-default-59b7486ffc-xdjvw" (UID: "569c1037-0058-4b97-9ebf-3fd77e9f72c3") : configmap references non-existent config key: service-ca.crt
Jul 09 00:55:31.586398 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:31.586278    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/709e8d4f-0df9-4ba4-84f0-d47ed2257f9d-samples-operator-tls podName:709e8d4f-0df9-4ba4-84f0-d47ed2257f9d nodeName:}" failed. No retries permitted until 2026-07-09 00:55:35.58627076 +0000 UTC m=+43.056413468 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/709e8d4f-0df9-4ba4-84f0-d47ed2257f9d-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-kj27l" (UID: "709e8d4f-0df9-4ba4-84f0-d47ed2257f9d") : secret "samples-operator-tls" not found
Jul 09 00:55:31.586398 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:31.586296    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f822d78-fd3b-44d1-ab1d-310f77a80e56-registry-tls\") pod \"image-registry-6dff8c759c-g4p6l\" (UID: \"8f822d78-fd3b-44d1-ab1d-310f77a80e56\") " pod="openshift-image-registry/image-registry-6dff8c759c-g4p6l"
Jul 09 00:55:31.586398 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:31.586405    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 00:55:31.586867 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:31.586417    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dff8c759c-g4p6l: secret "image-registry-tls" not found
Jul 09 00:55:31.586867 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:31.586454    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f822d78-fd3b-44d1-ab1d-310f77a80e56-registry-tls podName:8f822d78-fd3b-44d1-ab1d-310f77a80e56 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:35.58644283 +0000 UTC m=+43.056585538 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8f822d78-fd3b-44d1-ab1d-310f77a80e56-registry-tls") pod "image-registry-6dff8c759c-g4p6l" (UID: "8f822d78-fd3b-44d1-ab1d-310f77a80e56") : secret "image-registry-tls" not found
Jul 09 00:55:31.598629 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:31.598580    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-m9dnr"]
Jul 09 00:55:31.609793 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:31.609615    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-m9dnr"
Jul 09 00:55:31.612117 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:31.612092    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 09 00:55:31.612397 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:31.612379    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-br65f\""
Jul 09 00:55:31.613898 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:31.612822    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 09 00:55:31.615309 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:31.615250    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-m9dnr"]
Jul 09 00:55:31.687071 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:31.687034    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e907cd7-ed51-4737-a088-df3d9597489d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-qrrdm\" (UID: \"7e907cd7-ed51-4737-a088-df3d9597489d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qrrdm"
Jul 09 00:55:31.687278 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:31.687226    2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 00:55:31.687392 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:31.687310    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e907cd7-ed51-4737-a088-df3d9597489d-cluster-monitoring-operator-tls podName:7e907cd7-ed51-4737-a088-df3d9597489d nodeName:}" failed. No retries permitted until 2026-07-09 00:55:35.687286693 +0000 UTC m=+43.157429423 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7e907cd7-ed51-4737-a088-df3d9597489d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-qrrdm" (UID: "7e907cd7-ed51-4737-a088-df3d9597489d") : secret "cluster-monitoring-operator-tls" not found
Jul 09 00:55:31.721968 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:31.721934    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pg99d_f00d32fa-a646-4c75-8c89-3b282d512750/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:31.787859 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:31.787775    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/24f30d79-7850-4f7f-8208-86aa1ee58a82-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-m9dnr\" (UID: \"24f30d79-7850-4f7f-8208-86aa1ee58a82\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-m9dnr"
Jul 09 00:55:31.788032 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:31.787883    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/24f30d79-7850-4f7f-8208-86aa1ee58a82-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-m9dnr\" (UID: \"24f30d79-7850-4f7f-8208-86aa1ee58a82\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-m9dnr"
Jul 09 00:55:31.826577 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:31.826516    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pg99d_f00d32fa-a646-4c75-8c89-3b282d512750/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:31.877991 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:31.877957    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pg99d_f00d32fa-a646-4c75-8c89-3b282d512750/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:31.889190 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:31.889165    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/24f30d79-7850-4f7f-8208-86aa1ee58a82-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-m9dnr\" (UID: \"24f30d79-7850-4f7f-8208-86aa1ee58a82\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-m9dnr"
Jul 09 00:55:31.889338 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:31.889225    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/24f30d79-7850-4f7f-8208-86aa1ee58a82-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-m9dnr\" (UID: \"24f30d79-7850-4f7f-8208-86aa1ee58a82\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-m9dnr"
Jul 09 00:55:31.889338 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:31.889316    2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 09 00:55:31.889423 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:31.889381    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24f30d79-7850-4f7f-8208-86aa1ee58a82-networking-console-plugin-cert podName:24f30d79-7850-4f7f-8208-86aa1ee58a82 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:32.389364728 +0000 UTC m=+39.859507435 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/24f30d79-7850-4f7f-8208-86aa1ee58a82-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-m9dnr" (UID: "24f30d79-7850-4f7f-8208-86aa1ee58a82") : secret "networking-console-plugin-cert" not found
Jul 09 00:55:31.889808 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:31.889791    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/24f30d79-7850-4f7f-8208-86aa1ee58a82-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-m9dnr\" (UID: \"24f30d79-7850-4f7f-8208-86aa1ee58a82\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-m9dnr"
Jul 09 00:55:31.940291 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:31.940261    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pg99d_f00d32fa-a646-4c75-8c89-3b282d512750/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:32.361808 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:32.361763    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pg99d_f00d32fa-a646-4c75-8c89-3b282d512750/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:32.394643 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:32.394604    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/24f30d79-7850-4f7f-8208-86aa1ee58a82-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-m9dnr\" (UID: \"24f30d79-7850-4f7f-8208-86aa1ee58a82\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-m9dnr"
Jul 09 00:55:32.394822 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:32.394768    2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 09 00:55:32.394881 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:32.394851    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24f30d79-7850-4f7f-8208-86aa1ee58a82-networking-console-plugin-cert podName:24f30d79-7850-4f7f-8208-86aa1ee58a82 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:33.394825208 +0000 UTC m=+40.864967928 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/24f30d79-7850-4f7f-8208-86aa1ee58a82-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-m9dnr" (UID: "24f30d79-7850-4f7f-8208-86aa1ee58a82") : secret "networking-console-plugin-cert" not found
Jul 09 00:55:32.462889 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:32.462846    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pg99d_f00d32fa-a646-4c75-8c89-3b282d512750/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:33.403832 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:33.403782    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/24f30d79-7850-4f7f-8208-86aa1ee58a82-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-m9dnr\" (UID: \"24f30d79-7850-4f7f-8208-86aa1ee58a82\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-m9dnr"
Jul 09 00:55:33.404331 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:33.403968    2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 09 00:55:33.404331 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:33.404057    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24f30d79-7850-4f7f-8208-86aa1ee58a82-networking-console-plugin-cert podName:24f30d79-7850-4f7f-8208-86aa1ee58a82 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:35.404034394 +0000 UTC m=+42.874177121 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/24f30d79-7850-4f7f-8208-86aa1ee58a82-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-m9dnr" (UID: "24f30d79-7850-4f7f-8208-86aa1ee58a82") : secret "networking-console-plugin-cert" not found
Jul 09 00:55:35.419919 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:35.419879    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/24f30d79-7850-4f7f-8208-86aa1ee58a82-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-m9dnr\" (UID: \"24f30d79-7850-4f7f-8208-86aa1ee58a82\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-m9dnr"
Jul 09 00:55:35.420398 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:35.420034    2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 09 00:55:35.420398 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:35.420122    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24f30d79-7850-4f7f-8208-86aa1ee58a82-networking-console-plugin-cert podName:24f30d79-7850-4f7f-8208-86aa1ee58a82 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:39.420097627 +0000 UTC m=+46.890240345 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/24f30d79-7850-4f7f-8208-86aa1ee58a82-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-m9dnr" (UID: "24f30d79-7850-4f7f-8208-86aa1ee58a82") : secret "networking-console-plugin-cert" not found
Jul 09 00:55:35.622783 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:35.622743    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f822d78-fd3b-44d1-ab1d-310f77a80e56-registry-tls\") pod \"image-registry-6dff8c759c-g4p6l\" (UID: \"8f822d78-fd3b-44d1-ab1d-310f77a80e56\") " pod="openshift-image-registry/image-registry-6dff8c759c-g4p6l"
Jul 09 00:55:35.622959 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:35.622818    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0-metrics-tls\") pod \"dns-default-22rnw\" (UID: \"d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0\") " pod="openshift-dns/dns-default-22rnw"
Jul 09 00:55:35.622959 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:35.622861    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/569c1037-0058-4b97-9ebf-3fd77e9f72c3-metrics-certs\") pod \"router-default-59b7486ffc-xdjvw\" (UID: \"569c1037-0058-4b97-9ebf-3fd77e9f72c3\") " pod="openshift-ingress/router-default-59b7486ffc-xdjvw"
Jul 09 00:55:35.622959 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:35.622902    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/569c1037-0058-4b97-9ebf-3fd77e9f72c3-service-ca-bundle\") pod \"router-default-59b7486ffc-xdjvw\" (UID: \"569c1037-0058-4b97-9ebf-3fd77e9f72c3\") " pod="openshift-ingress/router-default-59b7486ffc-xdjvw"
Jul 09 00:55:35.623103 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:35.622981    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 00:55:35.623103 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:35.623009    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dff8c759c-g4p6l: secret "image-registry-tls" not found
Jul 09 00:55:35.623103 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:35.623068    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f822d78-fd3b-44d1-ab1d-310f77a80e56-registry-tls podName:8f822d78-fd3b-44d1-ab1d-310f77a80e56 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:43.623049593 +0000 UTC m=+51.093192307 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8f822d78-fd3b-44d1-ab1d-310f77a80e56-registry-tls") pod "image-registry-6dff8c759c-g4p6l" (UID: "8f822d78-fd3b-44d1-ab1d-310f77a80e56") : secret "image-registry-tls" not found
Jul 09 00:55:35.623258 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:35.622989    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/709e8d4f-0df9-4ba4-84f0-d47ed2257f9d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-kj27l\" (UID: \"709e8d4f-0df9-4ba4-84f0-d47ed2257f9d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kj27l"
Jul 09 00:55:35.623258 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:35.623137    2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 09 00:55:35.623258 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:35.623193    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/709e8d4f-0df9-4ba4-84f0-d47ed2257f9d-samples-operator-tls podName:709e8d4f-0df9-4ba4-84f0-d47ed2257f9d nodeName:}" failed. No retries permitted until 2026-07-09 00:55:43.623178435 +0000 UTC m=+51.093321145 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/709e8d4f-0df9-4ba4-84f0-d47ed2257f9d-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-kj27l" (UID: "709e8d4f-0df9-4ba4-84f0-d47ed2257f9d") : secret "samples-operator-tls" not found
Jul 09 00:55:35.623416 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:35.623288    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 00:55:35.623416 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:35.623304    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/569c1037-0058-4b97-9ebf-3fd77e9f72c3-service-ca-bundle podName:569c1037-0058-4b97-9ebf-3fd77e9f72c3 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:43.623284601 +0000 UTC m=+51.093427311 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/569c1037-0058-4b97-9ebf-3fd77e9f72c3-service-ca-bundle") pod "router-default-59b7486ffc-xdjvw" (UID: "569c1037-0058-4b97-9ebf-3fd77e9f72c3") : configmap references non-existent config key: service-ca.crt
Jul 09 00:55:35.623416 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:35.623289    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 09 00:55:35.623416 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:35.623349    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0-metrics-tls podName:d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:43.623333216 +0000 UTC m=+51.093475929 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0-metrics-tls") pod "dns-default-22rnw" (UID: "d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0") : secret "dns-default-metrics-tls" not found
Jul 09 00:55:35.623416 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:35.623366    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/569c1037-0058-4b97-9ebf-3fd77e9f72c3-metrics-certs podName:569c1037-0058-4b97-9ebf-3fd77e9f72c3 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:43.62335804 +0000 UTC m=+51.093500759 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/569c1037-0058-4b97-9ebf-3fd77e9f72c3-metrics-certs") pod "router-default-59b7486ffc-xdjvw" (UID: "569c1037-0058-4b97-9ebf-3fd77e9f72c3") : secret "router-metrics-certs-default" not found
Jul 09 00:55:35.724566 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:35.724534    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e907cd7-ed51-4737-a088-df3d9597489d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-qrrdm\" (UID: \"7e907cd7-ed51-4737-a088-df3d9597489d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qrrdm"
Jul 09 00:55:35.724736 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:35.724714    2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 00:55:35.724804 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:35.724795    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e907cd7-ed51-4737-a088-df3d9597489d-cluster-monitoring-operator-tls podName:7e907cd7-ed51-4737-a088-df3d9597489d nodeName:}" failed. No retries permitted until 2026-07-09 00:55:43.724777255 +0000 UTC m=+51.194919962 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7e907cd7-ed51-4737-a088-df3d9597489d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-qrrdm" (UID: "7e907cd7-ed51-4737-a088-df3d9597489d") : secret "cluster-monitoring-operator-tls" not found
Jul 09 00:55:37.041398 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:37.041356    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pg99d_f00d32fa-a646-4c75-8c89-3b282d512750/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:37.093519 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:37.093485    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pg99d_f00d32fa-a646-4c75-8c89-3b282d512750/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:37.176224 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:37.176179    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pg99d_f00d32fa-a646-4c75-8c89-3b282d512750/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:37.244829 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:37.244798    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pg99d_f00d32fa-a646-4c75-8c89-3b282d512750/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:37.303254 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:37.303149    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pg99d_f00d32fa-a646-4c75-8c89-3b282d512750/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:38.005746 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:38.005718    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pg99d_f00d32fa-a646-4c75-8c89-3b282d512750/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:38.106509 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:38.106473    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pg99d_f00d32fa-a646-4c75-8c89-3b282d512750/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:38.411328 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:38.411005    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pg99d_f00d32fa-a646-4c75-8c89-3b282d512750/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:38.515333 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:38.515271    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pg99d_f00d32fa-a646-4c75-8c89-3b282d512750/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:39.290179 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:39.290145    2557 generic.go:356] "Generic (PLEG): container finished" podID="f4dbea2c-28f9-4405-b905-f740dbe64a09" containerID="8d3095ad823a324f3b537d33b7a64ca7da12683193548008fbb65dfe0afaa999" exitCode=0
Jul 09 00:55:39.290856 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:39.290243    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dhpcm" event={"ID":"f4dbea2c-28f9-4405-b905-f740dbe64a09","Type":"ContainerDied","Data":"8d3095ad823a324f3b537d33b7a64ca7da12683193548008fbb65dfe0afaa999"}
Jul 09 00:55:39.291971 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:39.291945    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7bwv9" event={"ID":"4f1d4fff-34fd-47cf-a632-07d976f8beec","Type":"ContainerStarted","Data":"fc2d9b56a2962627e93cb39e9dff802643a3a593eebca55810fb245c34398f8f"}
Jul 09 00:55:39.293617 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:39.293590    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jkklf" event={"ID":"37664234-8f03-4849-b53b-ec22d49b8e31","Type":"ContainerStarted","Data":"c8a8f667948ab8b939be77e8f82c25b5a4ad911df5cb5bac214dcb3d4cc4fb86"}
Jul 09 00:55:39.295355 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:39.295308    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rw5s7" event={"ID":"a5fbbb22-3d60-42aa-bbb0-8426d37e945c","Type":"ContainerStarted","Data":"3a5acccaff90db9f1ec147f5958344ebf656fc5ef21d3893d752af4a2add57f6"}
Jul 09 00:55:39.297059 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:39.297037    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-5mtv8" event={"ID":"6a67ca23-3c37-4b4c-8980-8c20c4386ada","Type":"ContainerStarted","Data":"8c70b6ae1be6c15a34f5dd0368253fc1ed8fe81e40255a041aa1699829278542"}
Jul 09 00:55:39.298733 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:39.298712    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z6kj2_7dc12511-b804-4ebc-8646-4d070d93a8cf/console-operator/0.log"
Jul 09 00:55:39.298840 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:39.298749    2557 generic.go:356] "Generic (PLEG): container finished" podID="7dc12511-b804-4ebc-8646-4d070d93a8cf" containerID="67cdafd248acefbdfb251f7a020474fa10e657c090a1b2bd6671b0a56994e13c" exitCode=255
Jul 09 00:55:39.298992 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:39.298943    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-z6kj2" event={"ID":"7dc12511-b804-4ebc-8646-4d070d93a8cf","Type":"ContainerDied","Data":"67cdafd248acefbdfb251f7a020474fa10e657c090a1b2bd6671b0a56994e13c"}
Jul 09 00:55:39.299091 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:39.299057    2557 scope.go:117] "RemoveContainer" containerID="67cdafd248acefbdfb251f7a020474fa10e657c090a1b2bd6671b0a56994e13c"
Jul 09 00:55:39.300529 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:39.300504    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-zbnc6" event={"ID":"17f6664f-1f4d-4e8d-ad1d-da46c799b51d","Type":"ContainerStarted","Data":"420daaa97d3de6532718549e2f3d62fcb65b3b35f463d9b013ace9ca693c27d9"}
Jul 09 00:55:39.370959 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:39.370844    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rw5s7" podStartSLOduration=4.632598127 podStartE2EDuration="14.370810497s" totalImagesPullingTime="9.73821237s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 00:55:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:55:39.353996899 +0000 UTC m=+46.824139634" watchObservedRunningTime="2026-07-09 00:55:39.370810497 +0000 UTC m=+46.840953221"
Jul 09 00:55:39.372126 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:39.371989    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jkklf" podStartSLOduration=4.58248999 podStartE2EDuration="14.371970623s" totalImagesPullingTime="9.789480633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 00:55:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:55:39.371894172 +0000 UTC m=+46.842036906" watchObservedRunningTime="2026-07-09 00:55:39.371970623 +0000 UTC m=+46.842113334"
Jul 09 00:55:39.391819 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:39.391768    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7bwv9" podStartSLOduration=2.677284743 podStartE2EDuration="12.391750488s" totalImagesPullingTime="9.714465745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 00:55:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:55:39.390552794 +0000 UTC m=+46.860695525" watchObservedRunningTime="2026-07-09 00:55:39.391750488 +0000 UTC m=+46.861893218"
Jul 09 00:55:39.407959 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:39.407904    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-5mtv8" podStartSLOduration=4.678313221 podStartE2EDuration="14.407884135s" totalImagesPullingTime="9.729570914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 00:55:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:55:39.40676348 +0000 UTC m=+46.876906209" watchObservedRunningTime="2026-07-09 00:55:39.407884135 +0000 UTC m=+46.878026865"
Jul 09 00:55:39.424249 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:39.422326    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-zbnc6" podStartSLOduration=4.674028895 podStartE2EDuration="14.4223059s" totalImagesPullingTime="9.748277005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 00:55:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:55:39.422073549 +0000 UTC m=+46.892216278" watchObservedRunningTime="2026-07-09 00:55:39.4223059 +0000 UTC m=+46.892448634"
Jul 09 00:55:39.462579 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:39.462461    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/24f30d79-7850-4f7f-8208-86aa1ee58a82-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-m9dnr\" (UID: \"24f30d79-7850-4f7f-8208-86aa1ee58a82\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-m9dnr"
Jul 09 00:55:39.462745 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:39.462611    2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 09 00:55:39.462745 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:39.462705    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24f30d79-7850-4f7f-8208-86aa1ee58a82-networking-console-plugin-cert podName:24f30d79-7850-4f7f-8208-86aa1ee58a82 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:47.462684067 +0000 UTC m=+54.932826788 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/24f30d79-7850-4f7f-8208-86aa1ee58a82-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-m9dnr" (UID: "24f30d79-7850-4f7f-8208-86aa1ee58a82") : secret "networking-console-plugin-cert" not found
Jul 09 00:55:40.028040 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:40.028000    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-n2dk7"]
Jul 09 00:55:40.061381 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:40.061349    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-n2dk7"]
Jul 09 00:55:40.061564 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:40.061491    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-n2dk7"
Jul 09 00:55:40.063990 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:40.063966    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-vhhmd\""
Jul 09 00:55:40.063990 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:40.063984    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 09 00:55:40.064300 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:40.064284    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 09 00:55:40.169532 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:40.169484    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4dgn\" (UniqueName: \"kubernetes.io/projected/4f6d7535-7152-4fa0-a3c8-71cd2e9f7b8c-kube-api-access-k4dgn\") pod \"migrator-d57d58cc9-n2dk7\" (UID: \"4f6d7535-7152-4fa0-a3c8-71cd2e9f7b8c\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-n2dk7"
Jul 09 00:55:40.270613 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:40.270577    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4dgn\" (UniqueName: \"kubernetes.io/projected/4f6d7535-7152-4fa0-a3c8-71cd2e9f7b8c-kube-api-access-k4dgn\") pod \"migrator-d57d58cc9-n2dk7\" (UID: \"4f6d7535-7152-4fa0-a3c8-71cd2e9f7b8c\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-n2dk7"
Jul 09 00:55:40.279972 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:40.279907    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4dgn\" (UniqueName: \"kubernetes.io/projected/4f6d7535-7152-4fa0-a3c8-71cd2e9f7b8c-kube-api-access-k4dgn\") pod \"migrator-d57d58cc9-n2dk7\" (UID: \"4f6d7535-7152-4fa0-a3c8-71cd2e9f7b8c\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-n2dk7"
Jul 09 00:55:40.306165 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:40.306136    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z6kj2_7dc12511-b804-4ebc-8646-4d070d93a8cf/console-operator/1.log"
Jul 09 00:55:40.306568 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:40.306553    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z6kj2_7dc12511-b804-4ebc-8646-4d070d93a8cf/console-operator/0.log"
Jul 09 00:55:40.306611 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:40.306586    2557 generic.go:356] "Generic (PLEG): container finished" podID="7dc12511-b804-4ebc-8646-4d070d93a8cf" containerID="3a940a9ec26f7402f27cc23e87162f8b79aea38bf91cb82d766f5aa7c62afa47" exitCode=255
Jul 09 00:55:40.306644 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:40.306617    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-z6kj2" event={"ID":"7dc12511-b804-4ebc-8646-4d070d93a8cf","Type":"ContainerDied","Data":"3a940a9ec26f7402f27cc23e87162f8b79aea38bf91cb82d766f5aa7c62afa47"}
Jul 09 00:55:40.306703 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:40.306688    2557 scope.go:117] "RemoveContainer" containerID="67cdafd248acefbdfb251f7a020474fa10e657c090a1b2bd6671b0a56994e13c"
Jul 09 00:55:40.306981 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:40.306960    2557 scope.go:117] "RemoveContainer" containerID="3a940a9ec26f7402f27cc23e87162f8b79aea38bf91cb82d766f5aa7c62afa47"
Jul 09 00:55:40.307192 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:40.307169    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-z6kj2_openshift-console-operator(7dc12511-b804-4ebc-8646-4d070d93a8cf)\"" pod="openshift-console-operator/console-operator-68b757fb67-z6kj2" podUID="7dc12511-b804-4ebc-8646-4d070d93a8cf"
Jul 09 00:55:40.310101 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:40.310079    2557 generic.go:356] "Generic (PLEG): container finished" podID="f4dbea2c-28f9-4405-b905-f740dbe64a09" containerID="5920edee69c813062728931803a5d39b0936344301ab2bde61957d93539dd79d" exitCode=0
Jul 09 00:55:40.310201 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:40.310171    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dhpcm" event={"ID":"f4dbea2c-28f9-4405-b905-f740dbe64a09","Type":"ContainerDied","Data":"5920edee69c813062728931803a5d39b0936344301ab2bde61957d93539dd79d"}
Jul 09 00:55:40.373085 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:40.372460    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-n2dk7"
Jul 09 00:55:40.530747 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:40.530654    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-n2dk7"]
Jul 09 00:55:40.533612 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:55:40.533570    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f6d7535_7152_4fa0_a3c8_71cd2e9f7b8c.slice/crio-11b3ff9831fda4f0e159a0d0d2bc0f0d3d7dc9d12c019a60deb769e4f83508f1 WatchSource:0}: Error finding container 11b3ff9831fda4f0e159a0d0d2bc0f0d3d7dc9d12c019a60deb769e4f83508f1: Status 404 returned error can't find the container with id 11b3ff9831fda4f0e159a0d0d2bc0f0d3d7dc9d12c019a60deb769e4f83508f1
Jul 09 00:55:40.943326 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:40.943235    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6p4b2"]
Jul 09 00:55:40.962583 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:40.962552    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6p4b2"]
Jul 09 00:55:40.962741 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:40.962703    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6p4b2"
Jul 09 00:55:40.964881 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:40.964849    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 09 00:55:40.965020 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:40.965002    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 09 00:55:40.965071 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:40.965023    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-95w8r\""
Jul 09 00:55:41.077768 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:41.077737    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m82nm\" (UniqueName: \"kubernetes.io/projected/195a8fee-b2b7-45f7-96be-7bb884ae0db1-kube-api-access-m82nm\") pod \"insights-runtime-extractor-6p4b2\" (UID: \"195a8fee-b2b7-45f7-96be-7bb884ae0db1\") " pod="openshift-insights/insights-runtime-extractor-6p4b2"
Jul 09 00:55:41.077945 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:41.077788    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/195a8fee-b2b7-45f7-96be-7bb884ae0db1-data-volume\") pod \"insights-runtime-extractor-6p4b2\" (UID: \"195a8fee-b2b7-45f7-96be-7bb884ae0db1\") " pod="openshift-insights/insights-runtime-extractor-6p4b2"
Jul 09 00:55:41.077945 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:41.077868    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/195a8fee-b2b7-45f7-96be-7bb884ae0db1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6p4b2\" (UID: \"195a8fee-b2b7-45f7-96be-7bb884ae0db1\") " pod="openshift-insights/insights-runtime-extractor-6p4b2"
Jul 09 00:55:41.077945 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:41.077938    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/195a8fee-b2b7-45f7-96be-7bb884ae0db1-crio-socket\") pod \"insights-runtime-extractor-6p4b2\" (UID: \"195a8fee-b2b7-45f7-96be-7bb884ae0db1\") " pod="openshift-insights/insights-runtime-extractor-6p4b2"
Jul 09 00:55:41.078051 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:41.077973    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/195a8fee-b2b7-45f7-96be-7bb884ae0db1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6p4b2\" (UID: \"195a8fee-b2b7-45f7-96be-7bb884ae0db1\") " pod="openshift-insights/insights-runtime-extractor-6p4b2"
Jul 09 00:55:41.179175 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:41.179139    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m82nm\" (UniqueName: \"kubernetes.io/projected/195a8fee-b2b7-45f7-96be-7bb884ae0db1-kube-api-access-m82nm\") pod \"insights-runtime-extractor-6p4b2\" (UID: \"195a8fee-b2b7-45f7-96be-7bb884ae0db1\") " pod="openshift-insights/insights-runtime-extractor-6p4b2"
Jul 09 00:55:41.179359 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:41.179191    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/195a8fee-b2b7-45f7-96be-7bb884ae0db1-data-volume\") pod \"insights-runtime-extractor-6p4b2\" (UID: \"195a8fee-b2b7-45f7-96be-7bb884ae0db1\") " pod="openshift-insights/insights-runtime-extractor-6p4b2"
Jul 09 00:55:41.179437 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:41.179414    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/195a8fee-b2b7-45f7-96be-7bb884ae0db1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6p4b2\" (UID: \"195a8fee-b2b7-45f7-96be-7bb884ae0db1\") " pod="openshift-insights/insights-runtime-extractor-6p4b2"
Jul 09 00:55:41.179500 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:41.179484    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/195a8fee-b2b7-45f7-96be-7bb884ae0db1-data-volume\") pod \"insights-runtime-extractor-6p4b2\" (UID: \"195a8fee-b2b7-45f7-96be-7bb884ae0db1\") " pod="openshift-insights/insights-runtime-extractor-6p4b2"
Jul 09 00:55:41.179553 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:41.179511    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/195a8fee-b2b7-45f7-96be-7bb884ae0db1-crio-socket\") pod \"insights-runtime-extractor-6p4b2\" (UID: \"195a8fee-b2b7-45f7-96be-7bb884ae0db1\") " pod="openshift-insights/insights-runtime-extractor-6p4b2"
Jul 09 00:55:41.179597 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:41.179547    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 00:55:41.179597 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:41.179561    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/195a8fee-b2b7-45f7-96be-7bb884ae0db1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6p4b2\" (UID: \"195a8fee-b2b7-45f7-96be-7bb884ae0db1\") " pod="openshift-insights/insights-runtime-extractor-6p4b2"
Jul 09 00:55:41.179690 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:41.179617    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/195a8fee-b2b7-45f7-96be-7bb884ae0db1-kube-rbac-proxy-cm podName:195a8fee-b2b7-45f7-96be-7bb884ae0db1 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:41.679595966 +0000 UTC m=+49.149738694 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/195a8fee-b2b7-45f7-96be-7bb884ae0db1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6p4b2" (UID: "195a8fee-b2b7-45f7-96be-7bb884ae0db1") : configmap "kube-rbac-proxy" not found
Jul 09 00:55:41.179690 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:41.179631    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/195a8fee-b2b7-45f7-96be-7bb884ae0db1-crio-socket\") pod \"insights-runtime-extractor-6p4b2\" (UID: \"195a8fee-b2b7-45f7-96be-7bb884ae0db1\") " pod="openshift-insights/insights-runtime-extractor-6p4b2"
Jul 09 00:55:41.179690 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:41.179662    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 00:55:41.179840 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:41.179713    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/195a8fee-b2b7-45f7-96be-7bb884ae0db1-insights-runtime-extractor-tls podName:195a8fee-b2b7-45f7-96be-7bb884ae0db1 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:41.679702453 +0000 UTC m=+49.149845165 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/195a8fee-b2b7-45f7-96be-7bb884ae0db1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6p4b2" (UID: "195a8fee-b2b7-45f7-96be-7bb884ae0db1") : secret "insights-runtime-extractor-tls" not found
Jul 09 00:55:41.190430 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:41.190407    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m82nm\" (UniqueName: \"kubernetes.io/projected/195a8fee-b2b7-45f7-96be-7bb884ae0db1-kube-api-access-m82nm\") pod \"insights-runtime-extractor-6p4b2\" (UID: \"195a8fee-b2b7-45f7-96be-7bb884ae0db1\") " pod="openshift-insights/insights-runtime-extractor-6p4b2"
Jul 09 00:55:41.315074 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:41.315050    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z6kj2_7dc12511-b804-4ebc-8646-4d070d93a8cf/console-operator/1.log"
Jul 09 00:55:41.315495 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:41.315421    2557 scope.go:117] "RemoveContainer" containerID="3a940a9ec26f7402f27cc23e87162f8b79aea38bf91cb82d766f5aa7c62afa47"
Jul 09 00:55:41.315611 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:41.315590    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-z6kj2_openshift-console-operator(7dc12511-b804-4ebc-8646-4d070d93a8cf)\"" pod="openshift-console-operator/console-operator-68b757fb67-z6kj2" podUID="7dc12511-b804-4ebc-8646-4d070d93a8cf"
Jul 09 00:55:41.318753 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:41.318729    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dhpcm" event={"ID":"f4dbea2c-28f9-4405-b905-f740dbe64a09","Type":"ContainerStarted","Data":"524458342a4987918434446f95ba0c22ed390b71ff2a01556620a30d0cb606ac"}
Jul 09 00:55:41.319767 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:41.319742    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-n2dk7" event={"ID":"4f6d7535-7152-4fa0-a3c8-71cd2e9f7b8c","Type":"ContainerStarted","Data":"11b3ff9831fda4f0e159a0d0d2bc0f0d3d7dc9d12c019a60deb769e4f83508f1"}
Jul 09 00:55:41.349480 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:41.349437    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dhpcm" podStartSLOduration=9.515192656 podStartE2EDuration="48.349423782s" totalImagesPullingTime="38.834231126s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 00:54:53 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:55:41.347897319 +0000 UTC m=+48.818040047" watchObservedRunningTime="2026-07-09 00:55:41.349423782 +0000 UTC m=+48.819566510"
Jul 09 00:55:41.686408 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:41.686332    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/195a8fee-b2b7-45f7-96be-7bb884ae0db1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6p4b2\" (UID: \"195a8fee-b2b7-45f7-96be-7bb884ae0db1\") " pod="openshift-insights/insights-runtime-extractor-6p4b2"
Jul 09 00:55:41.686574 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:41.686466    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/195a8fee-b2b7-45f7-96be-7bb884ae0db1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6p4b2\" (UID: \"195a8fee-b2b7-45f7-96be-7bb884ae0db1\") " pod="openshift-insights/insights-runtime-extractor-6p4b2"
Jul 09 00:55:41.686574 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:41.686523    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 00:55:41.686699 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:41.686586    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 00:55:41.686699 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:41.686605    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/195a8fee-b2b7-45f7-96be-7bb884ae0db1-insights-runtime-extractor-tls podName:195a8fee-b2b7-45f7-96be-7bb884ae0db1 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:42.686584893 +0000 UTC m=+50.156727602 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/195a8fee-b2b7-45f7-96be-7bb884ae0db1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6p4b2" (UID: "195a8fee-b2b7-45f7-96be-7bb884ae0db1") : secret "insights-runtime-extractor-tls" not found
Jul 09 00:55:41.686699 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:41.686642    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/195a8fee-b2b7-45f7-96be-7bb884ae0db1-kube-rbac-proxy-cm podName:195a8fee-b2b7-45f7-96be-7bb884ae0db1 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:42.686626241 +0000 UTC m=+50.156768952 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/195a8fee-b2b7-45f7-96be-7bb884ae0db1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6p4b2" (UID: "195a8fee-b2b7-45f7-96be-7bb884ae0db1") : configmap "kube-rbac-proxy" not found
Jul 09 00:55:42.409626 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:42.409598    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-mp9sl"]
Jul 09 00:55:42.425455 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:42.425428    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-mp9sl"]
Jul 09 00:55:42.425612 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:42.425531    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-mp9sl"
Jul 09 00:55:42.427858 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:42.427833    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 09 00:55:42.427997 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:42.427833    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 09 00:55:42.428710 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:42.428690    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 09 00:55:42.428818 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:42.428713    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-zb7r2\""
Jul 09 00:55:42.428818 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:42.428752    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 09 00:55:42.495356 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:42.495321    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e227bd2b-4a1b-48ff-ae76-1d6b4ba4b2c2-signing-key\") pod \"service-ca-758f599c5-mp9sl\" (UID: \"e227bd2b-4a1b-48ff-ae76-1d6b4ba4b2c2\") " pod="openshift-service-ca/service-ca-758f599c5-mp9sl"
Jul 09 00:55:42.495356 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:42.495356    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e227bd2b-4a1b-48ff-ae76-1d6b4ba4b2c2-signing-cabundle\") pod \"service-ca-758f599c5-mp9sl\" (UID: \"e227bd2b-4a1b-48ff-ae76-1d6b4ba4b2c2\") " pod="openshift-service-ca/service-ca-758f599c5-mp9sl"
Jul 09 00:55:42.495561 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:42.495418    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcqcd\" (UniqueName: \"kubernetes.io/projected/e227bd2b-4a1b-48ff-ae76-1d6b4ba4b2c2-kube-api-access-qcqcd\") pod \"service-ca-758f599c5-mp9sl\" (UID: \"e227bd2b-4a1b-48ff-ae76-1d6b4ba4b2c2\") " pod="openshift-service-ca/service-ca-758f599c5-mp9sl"
Jul 09 00:55:42.596345 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:42.596320    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e227bd2b-4a1b-48ff-ae76-1d6b4ba4b2c2-signing-key\") pod \"service-ca-758f599c5-mp9sl\" (UID: \"e227bd2b-4a1b-48ff-ae76-1d6b4ba4b2c2\") " pod="openshift-service-ca/service-ca-758f599c5-mp9sl"
Jul 09 00:55:42.596434 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:42.596350    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e227bd2b-4a1b-48ff-ae76-1d6b4ba4b2c2-signing-cabundle\") pod \"service-ca-758f599c5-mp9sl\" (UID: \"e227bd2b-4a1b-48ff-ae76-1d6b4ba4b2c2\") " pod="openshift-service-ca/service-ca-758f599c5-mp9sl"
Jul 09 00:55:42.596434 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:42.596411    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcqcd\" (UniqueName: \"kubernetes.io/projected/e227bd2b-4a1b-48ff-ae76-1d6b4ba4b2c2-kube-api-access-qcqcd\") pod \"service-ca-758f599c5-mp9sl\" (UID: \"e227bd2b-4a1b-48ff-ae76-1d6b4ba4b2c2\") " pod="openshift-service-ca/service-ca-758f599c5-mp9sl"
Jul 09 00:55:42.597097 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:42.597075    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e227bd2b-4a1b-48ff-ae76-1d6b4ba4b2c2-signing-cabundle\") pod \"service-ca-758f599c5-mp9sl\" (UID: \"e227bd2b-4a1b-48ff-ae76-1d6b4ba4b2c2\") " pod="openshift-service-ca/service-ca-758f599c5-mp9sl"
Jul 09 00:55:42.598525 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:42.598504    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e227bd2b-4a1b-48ff-ae76-1d6b4ba4b2c2-signing-key\") pod \"service-ca-758f599c5-mp9sl\" (UID: \"e227bd2b-4a1b-48ff-ae76-1d6b4ba4b2c2\") " pod="openshift-service-ca/service-ca-758f599c5-mp9sl"
Jul 09 00:55:42.603959 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:42.603938    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcqcd\" (UniqueName: \"kubernetes.io/projected/e227bd2b-4a1b-48ff-ae76-1d6b4ba4b2c2-kube-api-access-qcqcd\") pod \"service-ca-758f599c5-mp9sl\" (UID: \"e227bd2b-4a1b-48ff-ae76-1d6b4ba4b2c2\") " pod="openshift-service-ca/service-ca-758f599c5-mp9sl"
Jul 09 00:55:42.697544 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:42.697508    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/195a8fee-b2b7-45f7-96be-7bb884ae0db1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6p4b2\" (UID: \"195a8fee-b2b7-45f7-96be-7bb884ae0db1\") " pod="openshift-insights/insights-runtime-extractor-6p4b2"
Jul 09 00:55:42.697700 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:42.697663    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 00:55:42.697700 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:42.697676    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/195a8fee-b2b7-45f7-96be-7bb884ae0db1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6p4b2\" (UID: \"195a8fee-b2b7-45f7-96be-7bb884ae0db1\") " pod="openshift-insights/insights-runtime-extractor-6p4b2"
Jul 09 00:55:42.697802 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:42.697736    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/195a8fee-b2b7-45f7-96be-7bb884ae0db1-insights-runtime-extractor-tls podName:195a8fee-b2b7-45f7-96be-7bb884ae0db1 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:44.697715975 +0000 UTC m=+52.167858696 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/195a8fee-b2b7-45f7-96be-7bb884ae0db1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6p4b2" (UID: "195a8fee-b2b7-45f7-96be-7bb884ae0db1") : secret "insights-runtime-extractor-tls" not found
Jul 09 00:55:42.697865 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:42.697839    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 00:55:42.697917 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:42.697897    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/195a8fee-b2b7-45f7-96be-7bb884ae0db1-kube-rbac-proxy-cm podName:195a8fee-b2b7-45f7-96be-7bb884ae0db1 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:44.697884422 +0000 UTC m=+52.168027128 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/195a8fee-b2b7-45f7-96be-7bb884ae0db1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6p4b2" (UID: "195a8fee-b2b7-45f7-96be-7bb884ae0db1") : configmap "kube-rbac-proxy" not found
Jul 09 00:55:42.734951 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:42.734932    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-mp9sl"
Jul 09 00:55:42.877521 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:42.877488    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-mp9sl"]
Jul 09 00:55:42.880343 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:55:42.880315    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode227bd2b_4a1b_48ff_ae76_1d6b4ba4b2c2.slice/crio-8eb12428b1a1e7c8ccfd4cb7418561a2fbe802ce238a3a4dcc02293fc3f3eeb9 WatchSource:0}: Error finding container 8eb12428b1a1e7c8ccfd4cb7418561a2fbe802ce238a3a4dcc02293fc3f3eeb9: Status 404 returned error can't find the container with id 8eb12428b1a1e7c8ccfd4cb7418561a2fbe802ce238a3a4dcc02293fc3f3eeb9
Jul 09 00:55:43.138616 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:43.138591    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tkg22_868053ea-aa08-4c9f-a2f6-05351b70b539/dns-node-resolver/0.log"
Jul 09 00:55:43.329162 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:43.329122    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-mp9sl" event={"ID":"e227bd2b-4a1b-48ff-ae76-1d6b4ba4b2c2","Type":"ContainerStarted","Data":"1d6233b09f3c267765de6fe2826b37e467f6a2da6f71ac3848c7181ad8cd50c7"}
Jul 09 00:55:43.329368 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:43.329179    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-mp9sl" event={"ID":"e227bd2b-4a1b-48ff-ae76-1d6b4ba4b2c2","Type":"ContainerStarted","Data":"8eb12428b1a1e7c8ccfd4cb7418561a2fbe802ce238a3a4dcc02293fc3f3eeb9"}
Jul 09 00:55:43.331025 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:43.330997    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-n2dk7" event={"ID":"4f6d7535-7152-4fa0-a3c8-71cd2e9f7b8c","Type":"ContainerStarted","Data":"3660805ef7fd30b671d73520d3d77c811824d5aa61c3a0b26c27512ca986e714"}
Jul 09 00:55:43.331121 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:43.331050    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-n2dk7" event={"ID":"4f6d7535-7152-4fa0-a3c8-71cd2e9f7b8c","Type":"ContainerStarted","Data":"a266d3434166462c460662204508964edd9fd52b2aa949cdaa53465af14879e4"}
Jul 09 00:55:43.348528 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:43.348471    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-mp9sl" podStartSLOduration=1.348450547 podStartE2EDuration="1.348450547s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 00:55:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:55:43.346277701 +0000 UTC m=+50.816420430" watchObservedRunningTime="2026-07-09 00:55:43.348450547 +0000 UTC m=+50.818593278"
Jul 09 00:55:43.365150 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:43.365100    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-n2dk7" podStartSLOduration=1.360174018 podStartE2EDuration="3.365084216s" totalImagesPullingTime="2.004910198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 00:55:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:55:43.364300492 +0000 UTC m=+50.834443221" watchObservedRunningTime="2026-07-09 00:55:43.365084216 +0000 UTC m=+50.835226945"
Jul 09 00:55:43.706840 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:43.706743    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/709e8d4f-0df9-4ba4-84f0-d47ed2257f9d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-kj27l\" (UID: \"709e8d4f-0df9-4ba4-84f0-d47ed2257f9d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kj27l"
Jul 09 00:55:43.706840 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:43.706789    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f822d78-fd3b-44d1-ab1d-310f77a80e56-registry-tls\") pod \"image-registry-6dff8c759c-g4p6l\" (UID: \"8f822d78-fd3b-44d1-ab1d-310f77a80e56\") " pod="openshift-image-registry/image-registry-6dff8c759c-g4p6l"
Jul 09 00:55:43.706840 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:43.706823    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0-metrics-tls\") pod \"dns-default-22rnw\" (UID: \"d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0\") " pod="openshift-dns/dns-default-22rnw"
Jul 09 00:55:43.707385 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:43.706900    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 00:55:43.707385 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:43.706906    2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 09 00:55:43.707385 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:43.706940    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 00:55:43.707385 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:43.706958    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dff8c759c-g4p6l: secret "image-registry-tls" not found
Jul 09 00:55:43.707385 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:43.706947    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0-metrics-tls podName:d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:59.706934503 +0000 UTC m=+67.177077210 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0-metrics-tls") pod "dns-default-22rnw" (UID: "d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0") : secret "dns-default-metrics-tls" not found
Jul 09 00:55:43.707385 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:43.707016    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/709e8d4f-0df9-4ba4-84f0-d47ed2257f9d-samples-operator-tls podName:709e8d4f-0df9-4ba4-84f0-d47ed2257f9d nodeName:}" failed. No retries permitted until 2026-07-09 00:55:59.707000195 +0000 UTC m=+67.177142902 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/709e8d4f-0df9-4ba4-84f0-d47ed2257f9d-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-kj27l" (UID: "709e8d4f-0df9-4ba4-84f0-d47ed2257f9d") : secret "samples-operator-tls" not found
Jul 09 00:55:43.707385 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:43.707062    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/569c1037-0058-4b97-9ebf-3fd77e9f72c3-metrics-certs\") pod \"router-default-59b7486ffc-xdjvw\" (UID: \"569c1037-0058-4b97-9ebf-3fd77e9f72c3\") " pod="openshift-ingress/router-default-59b7486ffc-xdjvw"
Jul 09 00:55:43.707385 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:43.707094    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/569c1037-0058-4b97-9ebf-3fd77e9f72c3-service-ca-bundle\") pod \"router-default-59b7486ffc-xdjvw\" (UID: \"569c1037-0058-4b97-9ebf-3fd77e9f72c3\") " pod="openshift-ingress/router-default-59b7486ffc-xdjvw"
Jul 09 00:55:43.707385 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:43.707112    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f822d78-fd3b-44d1-ab1d-310f77a80e56-registry-tls podName:8f822d78-fd3b-44d1-ab1d-310f77a80e56 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:59.707094172 +0000 UTC m=+67.177236881 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8f822d78-fd3b-44d1-ab1d-310f77a80e56-registry-tls") pod "image-registry-6dff8c759c-g4p6l" (UID: "8f822d78-fd3b-44d1-ab1d-310f77a80e56") : secret "image-registry-tls" not found
Jul 09 00:55:43.707385 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:43.707175    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 09 00:55:43.707385 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:43.707271    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/569c1037-0058-4b97-9ebf-3fd77e9f72c3-metrics-certs podName:569c1037-0058-4b97-9ebf-3fd77e9f72c3 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:59.707244623 +0000 UTC m=+67.177387338 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/569c1037-0058-4b97-9ebf-3fd77e9f72c3-metrics-certs") pod "router-default-59b7486ffc-xdjvw" (UID: "569c1037-0058-4b97-9ebf-3fd77e9f72c3") : secret "router-metrics-certs-default" not found
Jul 09 00:55:43.707385 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:43.707290    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/569c1037-0058-4b97-9ebf-3fd77e9f72c3-service-ca-bundle podName:569c1037-0058-4b97-9ebf-3fd77e9f72c3 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:59.707281085 +0000 UTC m=+67.177423799 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/569c1037-0058-4b97-9ebf-3fd77e9f72c3-service-ca-bundle") pod "router-default-59b7486ffc-xdjvw" (UID: "569c1037-0058-4b97-9ebf-3fd77e9f72c3") : configmap references non-existent config key: service-ca.crt
Jul 09 00:55:43.808127 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:43.808093    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e907cd7-ed51-4737-a088-df3d9597489d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-qrrdm\" (UID: \"7e907cd7-ed51-4737-a088-df3d9597489d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qrrdm"
Jul 09 00:55:43.808304 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:43.808279    2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 00:55:43.808369 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:43.808358    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e907cd7-ed51-4737-a088-df3d9597489d-cluster-monitoring-operator-tls podName:7e907cd7-ed51-4737-a088-df3d9597489d nodeName:}" failed. No retries permitted until 2026-07-09 00:55:59.80833779 +0000 UTC m=+67.278480513 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7e907cd7-ed51-4737-a088-df3d9597489d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-qrrdm" (UID: "7e907cd7-ed51-4737-a088-df3d9597489d") : secret "cluster-monitoring-operator-tls" not found
Jul 09 00:55:44.154724 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:44.154692    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xnxng_fc7293e1-bc7a-4d70-9cd2-2dd0b1b5c231/node-ca/0.log"
Jul 09 00:55:44.536998 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:44.536964    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7bwv9_4f1d4fff-34fd-47cf-a632-07d976f8beec/serve-healthcheck-canary/0.log"
Jul 09 00:55:44.717365 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:44.717333    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/195a8fee-b2b7-45f7-96be-7bb884ae0db1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6p4b2\" (UID: \"195a8fee-b2b7-45f7-96be-7bb884ae0db1\") " pod="openshift-insights/insights-runtime-extractor-6p4b2"
Jul 09 00:55:44.717834 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:44.717485    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/195a8fee-b2b7-45f7-96be-7bb884ae0db1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6p4b2\" (UID: \"195a8fee-b2b7-45f7-96be-7bb884ae0db1\") " pod="openshift-insights/insights-runtime-extractor-6p4b2"
Jul 09 00:55:44.717834 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:44.717517    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 00:55:44.717834 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:44.717592    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/195a8fee-b2b7-45f7-96be-7bb884ae0db1-insights-runtime-extractor-tls podName:195a8fee-b2b7-45f7-96be-7bb884ae0db1 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:48.717569682 +0000 UTC m=+56.187712394 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/195a8fee-b2b7-45f7-96be-7bb884ae0db1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6p4b2" (UID: "195a8fee-b2b7-45f7-96be-7bb884ae0db1") : secret "insights-runtime-extractor-tls" not found
Jul 09 00:55:44.717834 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:44.717603    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 00:55:44.717834 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:44.717659    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/195a8fee-b2b7-45f7-96be-7bb884ae0db1-kube-rbac-proxy-cm podName:195a8fee-b2b7-45f7-96be-7bb884ae0db1 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:48.717642968 +0000 UTC m=+56.187785676 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/195a8fee-b2b7-45f7-96be-7bb884ae0db1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6p4b2" (UID: "195a8fee-b2b7-45f7-96be-7bb884ae0db1") : configmap "kube-rbac-proxy" not found
Jul 09 00:55:44.755551 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:44.755439    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-n2dk7_4f6d7535-7152-4fa0-a3c8-71cd2e9f7b8c/migrator/0.log"
Jul 09 00:55:44.937750 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:44.937712    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-n2dk7_4f6d7535-7152-4fa0-a3c8-71cd2e9f7b8c/graceful-termination/0.log"
Jul 09 00:55:45.140396 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:45.140320    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-jkklf_37664234-8f03-4849-b53b-ec22d49b8e31/kube-storage-version-migrator-operator/0.log"
Jul 09 00:55:47.545454 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:47.545408    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/24f30d79-7850-4f7f-8208-86aa1ee58a82-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-m9dnr\" (UID: \"24f30d79-7850-4f7f-8208-86aa1ee58a82\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-m9dnr"
Jul 09 00:55:47.545915 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:47.545556    2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 09 00:55:47.545915 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:47.545624    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24f30d79-7850-4f7f-8208-86aa1ee58a82-networking-console-plugin-cert podName:24f30d79-7850-4f7f-8208-86aa1ee58a82 nodeName:}" failed. No retries permitted until 2026-07-09 00:56:03.545607139 +0000 UTC m=+71.015749846 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/24f30d79-7850-4f7f-8208-86aa1ee58a82-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-m9dnr" (UID: "24f30d79-7850-4f7f-8208-86aa1ee58a82") : secret "networking-console-plugin-cert" not found
Jul 09 00:55:48.184396 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:48.184360    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-z6kj2"
Jul 09 00:55:48.184557 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:48.184411    2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-z6kj2"
Jul 09 00:55:48.184799 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:48.184782    2557 scope.go:117] "RemoveContainer" containerID="3a940a9ec26f7402f27cc23e87162f8b79aea38bf91cb82d766f5aa7c62afa47"
Jul 09 00:55:48.184972 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:48.184951    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-z6kj2_openshift-console-operator(7dc12511-b804-4ebc-8646-4d070d93a8cf)\"" pod="openshift-console-operator/console-operator-68b757fb67-z6kj2" podUID="7dc12511-b804-4ebc-8646-4d070d93a8cf"
Jul 09 00:55:48.757968 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:48.757912    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/195a8fee-b2b7-45f7-96be-7bb884ae0db1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6p4b2\" (UID: \"195a8fee-b2b7-45f7-96be-7bb884ae0db1\") " pod="openshift-insights/insights-runtime-extractor-6p4b2"
Jul 09 00:55:48.758523 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:48.758061    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 00:55:48.758523 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:48.758124    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/195a8fee-b2b7-45f7-96be-7bb884ae0db1-insights-runtime-extractor-tls podName:195a8fee-b2b7-45f7-96be-7bb884ae0db1 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:56.758108049 +0000 UTC m=+64.228250759 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/195a8fee-b2b7-45f7-96be-7bb884ae0db1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6p4b2" (UID: "195a8fee-b2b7-45f7-96be-7bb884ae0db1") : secret "insights-runtime-extractor-tls" not found
Jul 09 00:55:48.758523 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:48.758064    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/195a8fee-b2b7-45f7-96be-7bb884ae0db1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6p4b2\" (UID: \"195a8fee-b2b7-45f7-96be-7bb884ae0db1\") " pod="openshift-insights/insights-runtime-extractor-6p4b2"
Jul 09 00:55:48.758523 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:48.758133    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 00:55:48.758523 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:55:48.758225    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/195a8fee-b2b7-45f7-96be-7bb884ae0db1-kube-rbac-proxy-cm podName:195a8fee-b2b7-45f7-96be-7bb884ae0db1 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:56.758190692 +0000 UTC m=+64.228333413 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/195a8fee-b2b7-45f7-96be-7bb884ae0db1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6p4b2" (UID: "195a8fee-b2b7-45f7-96be-7bb884ae0db1") : configmap "kube-rbac-proxy" not found
Jul 09 00:55:53.207202 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:53.207176    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bp8t6"
Jul 09 00:55:56.835266 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:56.835191    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/195a8fee-b2b7-45f7-96be-7bb884ae0db1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6p4b2\" (UID: \"195a8fee-b2b7-45f7-96be-7bb884ae0db1\") " pod="openshift-insights/insights-runtime-extractor-6p4b2"
Jul 09 00:55:56.835686 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:56.835327    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/195a8fee-b2b7-45f7-96be-7bb884ae0db1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6p4b2\" (UID: \"195a8fee-b2b7-45f7-96be-7bb884ae0db1\") " pod="openshift-insights/insights-runtime-extractor-6p4b2"
Jul 09 00:55:56.835736 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:56.835707    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/195a8fee-b2b7-45f7-96be-7bb884ae0db1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6p4b2\" (UID: \"195a8fee-b2b7-45f7-96be-7bb884ae0db1\") " pod="openshift-insights/insights-runtime-extractor-6p4b2"
Jul 09 00:55:56.837538 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:56.837515    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/195a8fee-b2b7-45f7-96be-7bb884ae0db1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6p4b2\" (UID: \"195a8fee-b2b7-45f7-96be-7bb884ae0db1\") " pod="openshift-insights/insights-runtime-extractor-6p4b2"
Jul 09 00:55:56.874954 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:56.874930    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-95w8r\""
Jul 09 00:55:56.882902 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:56.882879    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6p4b2"
Jul 09 00:55:57.004074 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:57.004044    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6p4b2"]
Jul 09 00:55:57.006940 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:55:57.006921    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod195a8fee_b2b7_45f7_96be_7bb884ae0db1.slice/crio-73d83794b4786e2a9dda1da5d70d6f35a95cd4d375424104ca332c2452a97a5f WatchSource:0}: Error finding container 73d83794b4786e2a9dda1da5d70d6f35a95cd4d375424104ca332c2452a97a5f: Status 404 returned error can't find the container with id 73d83794b4786e2a9dda1da5d70d6f35a95cd4d375424104ca332c2452a97a5f
Jul 09 00:55:57.386081 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:57.386038    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6p4b2" event={"ID":"195a8fee-b2b7-45f7-96be-7bb884ae0db1","Type":"ContainerStarted","Data":"73d83794b4786e2a9dda1da5d70d6f35a95cd4d375424104ca332c2452a97a5f"}
Jul 09 00:55:58.755139 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:58.755100    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/518d8542-a147-4718-9ae0-eda6710ea1a4-metrics-certs\") pod \"network-metrics-daemon-dgrzs\" (UID: \"518d8542-a147-4718-9ae0-eda6710ea1a4\") " pod="openshift-multus/network-metrics-daemon-dgrzs"
Jul 09 00:55:58.757808 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:58.757789    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 00:55:58.768305 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:58.768281    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/518d8542-a147-4718-9ae0-eda6710ea1a4-metrics-certs\") pod \"network-metrics-daemon-dgrzs\" (UID: \"518d8542-a147-4718-9ae0-eda6710ea1a4\") " pod="openshift-multus/network-metrics-daemon-dgrzs"
Jul 09 00:55:58.856345 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:58.856301    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/65de29a1-ee8f-4539-8e6d-997a7889fc85-original-pull-secret\") pod \"global-pull-secret-syncer-8p4px\" (UID: \"65de29a1-ee8f-4539-8e6d-997a7889fc85\") " pod="kube-system/global-pull-secret-syncer-8p4px"
Jul 09 00:55:58.856572 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:58.856410    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcqr5\" (UniqueName: \"kubernetes.io/projected/dcdf29b1-919a-48db-88d5-8cb2e105bb01-kube-api-access-zcqr5\") pod \"network-check-target-dvvxg\" (UID: \"dcdf29b1-919a-48db-88d5-8cb2e105bb01\") " pod="openshift-network-diagnostics/network-check-target-dvvxg"
Jul 09 00:55:58.858974 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:58.858946    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 00:55:58.859395 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:58.859372    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcqr5\" (UniqueName: \"kubernetes.io/projected/dcdf29b1-919a-48db-88d5-8cb2e105bb01-kube-api-access-zcqr5\") pod \"network-check-target-dvvxg\" (UID: \"dcdf29b1-919a-48db-88d5-8cb2e105bb01\") " pod="openshift-network-diagnostics/network-check-target-dvvxg"
Jul 09 00:55:58.868823 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:58.868800    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/65de29a1-ee8f-4539-8e6d-997a7889fc85-original-pull-secret\") pod \"global-pull-secret-syncer-8p4px\" (UID: \"65de29a1-ee8f-4539-8e6d-997a7889fc85\") " pod="kube-system/global-pull-secret-syncer-8p4px"
Jul 09 00:55:59.060824 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:59.060734    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-htn6x\""
Jul 09 00:55:59.065933 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:59.065907    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jpd88\""
Jul 09 00:55:59.068629 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:59.068591    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvvxg"
Jul 09 00:55:59.068629 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:59.068618    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p4px"
Jul 09 00:55:59.074795 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:59.074773    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dgrzs"
Jul 09 00:55:59.765883 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:59.765843    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/709e8d4f-0df9-4ba4-84f0-d47ed2257f9d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-kj27l\" (UID: \"709e8d4f-0df9-4ba4-84f0-d47ed2257f9d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kj27l"
Jul 09 00:55:59.766401 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:59.765905    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f822d78-fd3b-44d1-ab1d-310f77a80e56-registry-tls\") pod \"image-registry-6dff8c759c-g4p6l\" (UID: \"8f822d78-fd3b-44d1-ab1d-310f77a80e56\") " pod="openshift-image-registry/image-registry-6dff8c759c-g4p6l"
Jul 09 00:55:59.766401 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:59.765945    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0-metrics-tls\") pod \"dns-default-22rnw\" (UID: \"d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0\") " pod="openshift-dns/dns-default-22rnw"
Jul 09 00:55:59.766401 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:59.765988    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/569c1037-0058-4b97-9ebf-3fd77e9f72c3-metrics-certs\") pod \"router-default-59b7486ffc-xdjvw\" (UID: \"569c1037-0058-4b97-9ebf-3fd77e9f72c3\") " pod="openshift-ingress/router-default-59b7486ffc-xdjvw"
Jul 09 00:55:59.766401 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:59.766032    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/569c1037-0058-4b97-9ebf-3fd77e9f72c3-service-ca-bundle\") pod \"router-default-59b7486ffc-xdjvw\" (UID: \"569c1037-0058-4b97-9ebf-3fd77e9f72c3\") " pod="openshift-ingress/router-default-59b7486ffc-xdjvw"
Jul 09 00:55:59.766742 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:59.766713    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/569c1037-0058-4b97-9ebf-3fd77e9f72c3-service-ca-bundle\") pod \"router-default-59b7486ffc-xdjvw\" (UID: \"569c1037-0058-4b97-9ebf-3fd77e9f72c3\") " pod="openshift-ingress/router-default-59b7486ffc-xdjvw"
Jul 09 00:55:59.768875 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:59.768826    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0-metrics-tls\") pod \"dns-default-22rnw\" (UID: \"d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0\") " pod="openshift-dns/dns-default-22rnw"
Jul 09 00:55:59.768982 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:59.768901    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/709e8d4f-0df9-4ba4-84f0-d47ed2257f9d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-kj27l\" (UID: \"709e8d4f-0df9-4ba4-84f0-d47ed2257f9d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kj27l"
Jul 09 00:55:59.769030 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:59.769008    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f822d78-fd3b-44d1-ab1d-310f77a80e56-registry-tls\") pod \"image-registry-6dff8c759c-g4p6l\" (UID: \"8f822d78-fd3b-44d1-ab1d-310f77a80e56\") " pod="openshift-image-registry/image-registry-6dff8c759c-g4p6l"
Jul 09 00:55:59.769082 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:59.769058    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/569c1037-0058-4b97-9ebf-3fd77e9f72c3-metrics-certs\") pod \"router-default-59b7486ffc-xdjvw\" (UID: \"569c1037-0058-4b97-9ebf-3fd77e9f72c3\") " pod="openshift-ingress/router-default-59b7486ffc-xdjvw"
Jul 09 00:55:59.867810 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:59.867770    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e907cd7-ed51-4737-a088-df3d9597489d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-qrrdm\" (UID: \"7e907cd7-ed51-4737-a088-df3d9597489d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qrrdm"
Jul 09 00:55:59.870693 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:59.870656    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e907cd7-ed51-4737-a088-df3d9597489d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-qrrdm\" (UID: \"7e907cd7-ed51-4737-a088-df3d9597489d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qrrdm"
Jul 09 00:55:59.933038 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:59.933003    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tqqbn\""
Jul 09 00:55:59.940932 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:59.940906    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dff8c759c-g4p6l"
Jul 09 00:55:59.979695 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:59.979668    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-mq5n2\""
Jul 09 00:55:59.988623 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:59.988581    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kj27l"
Jul 09 00:55:59.991956 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:59.991930    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-72snf\""
Jul 09 00:55:59.999887 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:55:59.999866    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-59b7486ffc-xdjvw"
Jul 09 00:56:00.001822 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:00.001804    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4kshp\""
Jul 09 00:56:00.010161 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:00.010138    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-22rnw"
Jul 09 00:56:00.012399 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:00.012372    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-t6jdp\""
Jul 09 00:56:00.020308 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:00.020249    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qrrdm"
Jul 09 00:56:00.811829 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:00.804486    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dvvxg"]
Jul 09 00:56:00.861356 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:00.861081    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8p4px"]
Jul 09 00:56:00.926775 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:00.926702    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dgrzs"]
Jul 09 00:56:00.929664 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:00.929638    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-59b7486ffc-xdjvw"]
Jul 09 00:56:00.936408 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:56:00.936377    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod518d8542_a147_4718_9ae0_eda6710ea1a4.slice/crio-f5b194cc6cfa3a488b5d769d0d1a3271300bc96b431dc2301678af539fd9f68f WatchSource:0}: Error finding container f5b194cc6cfa3a488b5d769d0d1a3271300bc96b431dc2301678af539fd9f68f: Status 404 returned error can't find the container with id f5b194cc6cfa3a488b5d769d0d1a3271300bc96b431dc2301678af539fd9f68f
Jul 09 00:56:00.945138 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:56:00.945111    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod569c1037_0058_4b97_9ebf_3fd77e9f72c3.slice/crio-1a53f395e3d997a7876b65a83f4d4a31446f0ec1bfac8409a06d411d466fb1b1 WatchSource:0}: Error finding container 1a53f395e3d997a7876b65a83f4d4a31446f0ec1bfac8409a06d411d466fb1b1: Status 404 returned error can't find the container with id 1a53f395e3d997a7876b65a83f4d4a31446f0ec1bfac8409a06d411d466fb1b1
Jul 09 00:56:00.954689 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:00.954267    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kj27l"]
Jul 09 00:56:00.980031 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:00.979993    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-22rnw"]
Jul 09 00:56:00.982990 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:56:00.982959    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8416ea4_9f33_4c30_aa0d_3cb9efd1a0d0.slice/crio-1bc276a8bf6d84c80346d0616e44259ccb15ed3b06c6a1b6dcaa8d99ddbd477b WatchSource:0}: Error finding container 1bc276a8bf6d84c80346d0616e44259ccb15ed3b06c6a1b6dcaa8d99ddbd477b: Status 404 returned error can't find the container with id 1bc276a8bf6d84c80346d0616e44259ccb15ed3b06c6a1b6dcaa8d99ddbd477b
Jul 09 00:56:01.000113 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:01.000077    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6dff8c759c-g4p6l"]
Jul 09 00:56:01.005351 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:56:01.005323    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f822d78_fd3b_44d1_ab1d_310f77a80e56.slice/crio-9c13d7f0e28865bd9c795d0e885ddaf8b387a74e19d9c860cb55f66e1460558f WatchSource:0}: Error finding container 9c13d7f0e28865bd9c795d0e885ddaf8b387a74e19d9c860cb55f66e1460558f: Status 404 returned error can't find the container with id 9c13d7f0e28865bd9c795d0e885ddaf8b387a74e19d9c860cb55f66e1460558f
Jul 09 00:56:01.197947 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:01.197866    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qrrdm"]
Jul 09 00:56:01.201653 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:56:01.201617    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e907cd7_ed51_4737_a088_df3d9597489d.slice/crio-96699844cd2b1712564b17015770229f5d8cec39639770a44e5c96e507857c81 WatchSource:0}: Error finding container 96699844cd2b1712564b17015770229f5d8cec39639770a44e5c96e507857c81: Status 404 returned error can't find the container with id 96699844cd2b1712564b17015770229f5d8cec39639770a44e5c96e507857c81
Jul 09 00:56:01.400413 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:01.400370    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8p4px" event={"ID":"65de29a1-ee8f-4539-8e6d-997a7889fc85","Type":"ContainerStarted","Data":"e5e33d8cf9ffa5c63ac534cbd58fcef5fcb9db820cc80264a32cc90b9feaa5a5"}
Jul 09 00:56:01.402186 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:01.402124    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-59b7486ffc-xdjvw" event={"ID":"569c1037-0058-4b97-9ebf-3fd77e9f72c3","Type":"ContainerStarted","Data":"6b9e3733234843c02a036a2b5c70575d610194fcb3892b05d23c48aa72a1c545"}
Jul 09 00:56:01.402186 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:01.402170    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-59b7486ffc-xdjvw" event={"ID":"569c1037-0058-4b97-9ebf-3fd77e9f72c3","Type":"ContainerStarted","Data":"1a53f395e3d997a7876b65a83f4d4a31446f0ec1bfac8409a06d411d466fb1b1"}
Jul 09 00:56:01.403555 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:01.403528    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-22rnw" event={"ID":"d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0","Type":"ContainerStarted","Data":"1bc276a8bf6d84c80346d0616e44259ccb15ed3b06c6a1b6dcaa8d99ddbd477b"}
Jul 09 00:56:01.404961 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:01.404929    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qrrdm" event={"ID":"7e907cd7-ed51-4737-a088-df3d9597489d","Type":"ContainerStarted","Data":"96699844cd2b1712564b17015770229f5d8cec39639770a44e5c96e507857c81"}
Jul 09 00:56:01.406390 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:01.406366    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dgrzs" event={"ID":"518d8542-a147-4718-9ae0-eda6710ea1a4","Type":"ContainerStarted","Data":"f5b194cc6cfa3a488b5d769d0d1a3271300bc96b431dc2301678af539fd9f68f"}
Jul 09 00:56:01.407710 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:01.407684    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kj27l" event={"ID":"709e8d4f-0df9-4ba4-84f0-d47ed2257f9d","Type":"ContainerStarted","Data":"cc2895c947637233e65831dcede6e9989bb02a836d57a39ec419ba77570ac798"}
Jul 09 00:56:01.409393 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:01.409370    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6p4b2" event={"ID":"195a8fee-b2b7-45f7-96be-7bb884ae0db1","Type":"ContainerStarted","Data":"b0e473a8845ff748534d6bbbea22fff6d161022fe6bb7d21c6fc7bb49eecc355"}
Jul 09 00:56:01.411153 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:01.411130    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6dff8c759c-g4p6l" event={"ID":"8f822d78-fd3b-44d1-ab1d-310f77a80e56","Type":"ContainerStarted","Data":"986d52e446f4cc030710904d553a8481487c7286257326c363284fa12959fd64"}
Jul 09 00:56:01.411268 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:01.411169    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6dff8c759c-g4p6l" event={"ID":"8f822d78-fd3b-44d1-ab1d-310f77a80e56","Type":"ContainerStarted","Data":"9c13d7f0e28865bd9c795d0e885ddaf8b387a74e19d9c860cb55f66e1460558f"}
Jul 09 00:56:01.411268 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:01.411197    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6dff8c759c-g4p6l"
Jul 09 00:56:01.412717 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:01.412694    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dvvxg" event={"ID":"dcdf29b1-919a-48db-88d5-8cb2e105bb01","Type":"ContainerStarted","Data":"a4b11e0702641ff89dfc4017cca237b31f7fd077d76fcd3db442c2562451855c"}
Jul 09 00:56:01.412807 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:01.412733    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dvvxg" event={"ID":"dcdf29b1-919a-48db-88d5-8cb2e105bb01","Type":"ContainerStarted","Data":"deaf676953ed9711280a2200be295ca0f9cf153f5e3948a59b2fa4116f20c76b"}
Jul 09 00:56:01.412868 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:01.412852    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dvvxg"
Jul 09 00:56:01.420132 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:01.420090    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-59b7486ffc-xdjvw" podStartSLOduration=36.420076653 podStartE2EDuration="36.420076653s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 00:55:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:56:01.419129735 +0000 UTC m=+68.889272459" watchObservedRunningTime="2026-07-09 00:56:01.420076653 +0000 UTC m=+68.890219382"
Jul 09 00:56:01.432760 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:01.432716    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dvvxg" podStartSLOduration=68.432702223 podStartE2EDuration="1m8.432702223s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 00:54:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:56:01.43195832 +0000 UTC m=+68.902101049" watchObservedRunningTime="2026-07-09 00:56:01.432702223 +0000 UTC m=+68.902844952"
Jul 09 00:56:01.449080 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:01.448995    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6dff8c759c-g4p6l" podStartSLOduration=68.448976306 podStartE2EDuration="1m8.448976306s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 00:54:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:56:01.448608658 +0000 UTC m=+68.918751389" watchObservedRunningTime="2026-07-09 00:56:01.448976306 +0000 UTC m=+68.919119037"
Jul 09 00:56:02.000964 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:02.000933    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-59b7486ffc-xdjvw"
Jul 09 00:56:02.004343 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:02.004105    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-59b7486ffc-xdjvw"
Jul 09 00:56:02.423113 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:02.422468    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6p4b2" event={"ID":"195a8fee-b2b7-45f7-96be-7bb884ae0db1","Type":"ContainerStarted","Data":"c1698107ab39f337c56dad6091b355e57f3f4ccb0368f470faae66a4da355ea7"}
Jul 09 00:56:02.423113 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:02.423018    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-59b7486ffc-xdjvw"
Jul 09 00:56:02.424573 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:02.424310    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-59b7486ffc-xdjvw"
Jul 09 00:56:03.435977 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:03.435906    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dgrzs" event={"ID":"518d8542-a147-4718-9ae0-eda6710ea1a4","Type":"ContainerStarted","Data":"8b4e573bfb636d00a253cbe0320f3bb3a862c6626fa8caacd559db246f350d6f"}
Jul 09 00:56:03.436453 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:03.436004    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dgrzs" event={"ID":"518d8542-a147-4718-9ae0-eda6710ea1a4","Type":"ContainerStarted","Data":"1c67d95bd594791192775a6674a20e8640bebcab77b26515b26baa79977a6118"}
Jul 09 00:56:03.452591 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:03.451869    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dgrzs" podStartSLOduration=68.862896498 podStartE2EDuration="1m10.451847302s" totalImagesPullingTime="1.588950804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 00:54:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:56:03.450927473 +0000 UTC m=+70.921070203" watchObservedRunningTime="2026-07-09 00:56:03.451847302 +0000 UTC m=+70.921990034"
Jul 09 00:56:03.604237 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:03.603309    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/24f30d79-7850-4f7f-8208-86aa1ee58a82-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-m9dnr\" (UID: \"24f30d79-7850-4f7f-8208-86aa1ee58a82\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-m9dnr"
Jul 09 00:56:03.609783 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:03.609716    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/24f30d79-7850-4f7f-8208-86aa1ee58a82-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-m9dnr\" (UID: \"24f30d79-7850-4f7f-8208-86aa1ee58a82\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-m9dnr"
Jul 09 00:56:03.728786 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:03.728759    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-br65f\""
Jul 09 00:56:03.736756 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:03.736725    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-m9dnr"
Jul 09 00:56:04.034311 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:04.034199    2557 scope.go:117] "RemoveContainer" containerID="3a940a9ec26f7402f27cc23e87162f8b79aea38bf91cb82d766f5aa7c62afa47"
Jul 09 00:56:05.530600 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.530571    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-f7df9577c-4nw85"]
Jul 09 00:56:05.544518 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.544485    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f9f54d8-k9cvq"]
Jul 09 00:56:05.544679 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.544611    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f7df9577c-4nw85"
Jul 09 00:56:05.551017 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.550991    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 09 00:56:05.551325 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.551284    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 09 00:56:05.551440 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.551165    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 09 00:56:05.551781 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.551058    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 09 00:56:05.573974 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.573944    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-744f99454d-5m6pn"]
Jul 09 00:56:05.574581 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.574445    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f9f54d8-k9cvq"
Jul 09 00:56:05.577124 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.577103    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 09 00:56:05.577263 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.577199    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 09 00:56:05.577339 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.577292    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 09 00:56:05.577463 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.577440    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 09 00:56:05.593182 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.593160    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-f7df9577c-4nw85"]
Jul 09 00:56:05.593329 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.593199    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-744f99454d-5m6pn"]
Jul 09 00:56:05.593329 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.593228    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f9f54d8-k9cvq"]
Jul 09 00:56:05.593439 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.593328    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-744f99454d-5m6pn"
Jul 09 00:56:05.595607 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.595584    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-g7b7h\""
Jul 09 00:56:05.595722 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.595661    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 09 00:56:05.721499 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.721460    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0e1ca1df-1f3a-44b5-94b3-5daf9b26e5a7-hub\") pod \"cluster-proxy-proxy-agent-68f9f54d8-k9cvq\" (UID: \"0e1ca1df-1f3a-44b5-94b3-5daf9b26e5a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f9f54d8-k9cvq"
Jul 09 00:56:05.721685 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.721505    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0e1ca1df-1f3a-44b5-94b3-5daf9b26e5a7-ca\") pod \"cluster-proxy-proxy-agent-68f9f54d8-k9cvq\" (UID: \"0e1ca1df-1f3a-44b5-94b3-5daf9b26e5a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f9f54d8-k9cvq"
Jul 09 00:56:05.721685 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.721555    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8g8c\" (UniqueName: \"kubernetes.io/projected/62484457-5e59-488d-8bf1-3043247fd5e4-kube-api-access-s8g8c\") pod \"klusterlet-addon-workmgr-f7df9577c-4nw85\" (UID: \"62484457-5e59-488d-8bf1-3043247fd5e4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f7df9577c-4nw85"
Jul 09 00:56:05.721685 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.721624    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/91be5384-720c-42e3-89ad-b0cd98f089b7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-744f99454d-5m6pn\" (UID: \"91be5384-720c-42e3-89ad-b0cd98f089b7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-744f99454d-5m6pn"
Jul 09 00:56:05.721827 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.721691    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0e1ca1df-1f3a-44b5-94b3-5daf9b26e5a7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-68f9f54d8-k9cvq\" (UID: \"0e1ca1df-1f3a-44b5-94b3-5daf9b26e5a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f9f54d8-k9cvq"
Jul 09 00:56:05.721827 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.721728    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0e1ca1df-1f3a-44b5-94b3-5daf9b26e5a7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-68f9f54d8-k9cvq\" (UID: \"0e1ca1df-1f3a-44b5-94b3-5daf9b26e5a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f9f54d8-k9cvq"
Jul 09 00:56:05.721827 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.721756    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2s6l\" (UniqueName: \"kubernetes.io/projected/91be5384-720c-42e3-89ad-b0cd98f089b7-kube-api-access-v2s6l\") pod \"managed-serviceaccount-addon-agent-744f99454d-5m6pn\" (UID: \"91be5384-720c-42e3-89ad-b0cd98f089b7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-744f99454d-5m6pn"
Jul 09 00:56:05.721827 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.721783    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e1ca1df-1f3a-44b5-94b3-5daf9b26e5a7-additional-service-ca\") pod \"cluster-proxy-proxy-agent-68f9f54d8-k9cvq\" (UID: \"0e1ca1df-1f3a-44b5-94b3-5daf9b26e5a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f9f54d8-k9cvq"
Jul 09 00:56:05.721827 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.721809    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62484457-5e59-488d-8bf1-3043247fd5e4-tmp\") pod \"klusterlet-addon-workmgr-f7df9577c-4nw85\" (UID: \"62484457-5e59-488d-8bf1-3043247fd5e4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f7df9577c-4nw85"
Jul 09 00:56:05.722021 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.721834    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpg29\" (UniqueName: \"kubernetes.io/projected/0e1ca1df-1f3a-44b5-94b3-5daf9b26e5a7-kube-api-access-xpg29\") pod \"cluster-proxy-proxy-agent-68f9f54d8-k9cvq\" (UID: \"0e1ca1df-1f3a-44b5-94b3-5daf9b26e5a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f9f54d8-k9cvq"
Jul 09 00:56:05.722021 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.721858    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/62484457-5e59-488d-8bf1-3043247fd5e4-klusterlet-config\") pod \"klusterlet-addon-workmgr-f7df9577c-4nw85\" (UID: \"62484457-5e59-488d-8bf1-3043247fd5e4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f7df9577c-4nw85"
Jul 09 00:56:05.822942 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.822850    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0e1ca1df-1f3a-44b5-94b3-5daf9b26e5a7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-68f9f54d8-k9cvq\" (UID: \"0e1ca1df-1f3a-44b5-94b3-5daf9b26e5a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f9f54d8-k9cvq"
Jul 09 00:56:05.822942 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.822910    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2s6l\" (UniqueName: \"kubernetes.io/projected/91be5384-720c-42e3-89ad-b0cd98f089b7-kube-api-access-v2s6l\") pod \"managed-serviceaccount-addon-agent-744f99454d-5m6pn\" (UID: \"91be5384-720c-42e3-89ad-b0cd98f089b7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-744f99454d-5m6pn"
Jul 09 00:56:05.822942 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.822940    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e1ca1df-1f3a-44b5-94b3-5daf9b26e5a7-additional-service-ca\") pod \"cluster-proxy-proxy-agent-68f9f54d8-k9cvq\" (UID: \"0e1ca1df-1f3a-44b5-94b3-5daf9b26e5a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f9f54d8-k9cvq"
Jul 09 00:56:05.823203 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.823011    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62484457-5e59-488d-8bf1-3043247fd5e4-tmp\") pod \"klusterlet-addon-workmgr-f7df9577c-4nw85\" (UID: \"62484457-5e59-488d-8bf1-3043247fd5e4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f7df9577c-4nw85"
Jul 09 00:56:05.823203 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.823066    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpg29\" (UniqueName: \"kubernetes.io/projected/0e1ca1df-1f3a-44b5-94b3-5daf9b26e5a7-kube-api-access-xpg29\") pod \"cluster-proxy-proxy-agent-68f9f54d8-k9cvq\" (UID: \"0e1ca1df-1f3a-44b5-94b3-5daf9b26e5a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f9f54d8-k9cvq"
Jul 09 00:56:05.823203 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.823097    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/62484457-5e59-488d-8bf1-3043247fd5e4-klusterlet-config\") pod \"klusterlet-addon-workmgr-f7df9577c-4nw85\" (UID: \"62484457-5e59-488d-8bf1-3043247fd5e4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f7df9577c-4nw85"
Jul 09 00:56:05.823203 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.823123    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0e1ca1df-1f3a-44b5-94b3-5daf9b26e5a7-hub\") pod \"cluster-proxy-proxy-agent-68f9f54d8-k9cvq\" (UID: \"0e1ca1df-1f3a-44b5-94b3-5daf9b26e5a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f9f54d8-k9cvq"
Jul 09 00:56:05.823203 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.823150    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0e1ca1df-1f3a-44b5-94b3-5daf9b26e5a7-ca\") pod \"cluster-proxy-proxy-agent-68f9f54d8-k9cvq\" (UID: \"0e1ca1df-1f3a-44b5-94b3-5daf9b26e5a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f9f54d8-k9cvq"
Jul 09 00:56:05.824618 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.823225    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8g8c\" (UniqueName: \"kubernetes.io/projected/62484457-5e59-488d-8bf1-3043247fd5e4-kube-api-access-s8g8c\") pod \"klusterlet-addon-workmgr-f7df9577c-4nw85\" (UID: \"62484457-5e59-488d-8bf1-3043247fd5e4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f7df9577c-4nw85"
Jul 09 00:56:05.824618 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.823484    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62484457-5e59-488d-8bf1-3043247fd5e4-tmp\") pod \"klusterlet-addon-workmgr-f7df9577c-4nw85\" (UID: \"62484457-5e59-488d-8bf1-3043247fd5e4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f7df9577c-4nw85"
Jul 09 00:56:05.824618 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.823665    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/91be5384-720c-42e3-89ad-b0cd98f089b7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-744f99454d-5m6pn\" (UID: \"91be5384-720c-42e3-89ad-b0cd98f089b7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-744f99454d-5m6pn"
Jul 09 00:56:05.824618 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.823730    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0e1ca1df-1f3a-44b5-94b3-5daf9b26e5a7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-68f9f54d8-k9cvq\" (UID: \"0e1ca1df-1f3a-44b5-94b3-5daf9b26e5a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f9f54d8-k9cvq"
Jul 09 00:56:05.825088 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.825035    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e1ca1df-1f3a-44b5-94b3-5daf9b26e5a7-additional-service-ca\") pod \"cluster-proxy-proxy-agent-68f9f54d8-k9cvq\" (UID: \"0e1ca1df-1f3a-44b5-94b3-5daf9b26e5a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f9f54d8-k9cvq"
Jul 09 00:56:05.826078 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.826034    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/62484457-5e59-488d-8bf1-3043247fd5e4-klusterlet-config\") pod \"klusterlet-addon-workmgr-f7df9577c-4nw85\" (UID: \"62484457-5e59-488d-8bf1-3043247fd5e4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f7df9577c-4nw85"
Jul 09 00:56:05.826247 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.826224    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0e1ca1df-1f3a-44b5-94b3-5daf9b26e5a7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-68f9f54d8-k9cvq\" (UID: \"0e1ca1df-1f3a-44b5-94b3-5daf9b26e5a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f9f54d8-k9cvq"
Jul 09 00:56:05.826410 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.826389    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0e1ca1df-1f3a-44b5-94b3-5daf9b26e5a7-hub\") pod \"cluster-proxy-proxy-agent-68f9f54d8-k9cvq\" (UID: \"0e1ca1df-1f3a-44b5-94b3-5daf9b26e5a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f9f54d8-k9cvq"
Jul 09 00:56:05.827057 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.827036    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/91be5384-720c-42e3-89ad-b0cd98f089b7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-744f99454d-5m6pn\" (UID: \"91be5384-720c-42e3-89ad-b0cd98f089b7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-744f99454d-5m6pn"
Jul 09 00:56:05.834222 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.834180    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2s6l\" (UniqueName: \"kubernetes.io/projected/91be5384-720c-42e3-89ad-b0cd98f089b7-kube-api-access-v2s6l\") pod \"managed-serviceaccount-addon-agent-744f99454d-5m6pn\" (UID: \"91be5384-720c-42e3-89ad-b0cd98f089b7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-744f99454d-5m6pn"
Jul 09 00:56:05.834965 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.834920    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8g8c\" (UniqueName: \"kubernetes.io/projected/62484457-5e59-488d-8bf1-3043247fd5e4-kube-api-access-s8g8c\") pod \"klusterlet-addon-workmgr-f7df9577c-4nw85\" (UID: \"62484457-5e59-488d-8bf1-3043247fd5e4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f7df9577c-4nw85"
Jul 09 00:56:05.835179 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.835153    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpg29\" (UniqueName: \"kubernetes.io/projected/0e1ca1df-1f3a-44b5-94b3-5daf9b26e5a7-kube-api-access-xpg29\") pod \"cluster-proxy-proxy-agent-68f9f54d8-k9cvq\" (UID: \"0e1ca1df-1f3a-44b5-94b3-5daf9b26e5a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f9f54d8-k9cvq"
Jul 09 00:56:05.849486 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.849464    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0e1ca1df-1f3a-44b5-94b3-5daf9b26e5a7-ca\") pod \"cluster-proxy-proxy-agent-68f9f54d8-k9cvq\" (UID: \"0e1ca1df-1f3a-44b5-94b3-5daf9b26e5a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f9f54d8-k9cvq"
Jul 09 00:56:05.849601 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.849553    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0e1ca1df-1f3a-44b5-94b3-5daf9b26e5a7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-68f9f54d8-k9cvq\" (UID: \"0e1ca1df-1f3a-44b5-94b3-5daf9b26e5a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f9f54d8-k9cvq"
Jul 09 00:56:05.862131 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.862105    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f7df9577c-4nw85"
Jul 09 00:56:05.895462 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.895435    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f9f54d8-k9cvq"
Jul 09 00:56:05.903541 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:05.903517    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-744f99454d-5m6pn"
Jul 09 00:56:08.429202 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:08.429019    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-m9dnr"]
Jul 09 00:56:08.456654 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:08.456597    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kj27l" event={"ID":"709e8d4f-0df9-4ba4-84f0-d47ed2257f9d","Type":"ContainerStarted","Data":"339e8de98457ef5de56f7064ea8204ca885f74830976465319c319b1f69944cc"}
Jul 09 00:56:08.459841 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:08.459809    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6p4b2" event={"ID":"195a8fee-b2b7-45f7-96be-7bb884ae0db1","Type":"ContainerStarted","Data":"b7b974a96c66f60da736692cc2a5605e02d44a8c8d3bba814fdeeee26ba2d4f8"}
Jul 09 00:56:08.462178 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:08.462156    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z6kj2_7dc12511-b804-4ebc-8646-4d070d93a8cf/console-operator/1.log"
Jul 09 00:56:08.462342 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:08.462247    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-z6kj2" event={"ID":"7dc12511-b804-4ebc-8646-4d070d93a8cf","Type":"ContainerStarted","Data":"a57c7cd6de3de2c97b4ee4b01a92955de18dedc090c03feda418de0ad1a22f5b"}
Jul 09 00:56:08.462732 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:08.462698    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-z6kj2"
Jul 09 00:56:08.463629 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:08.463528    2557 patch_prober.go:28] interesting pod/console-operator-68b757fb67-z6kj2 container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.12:8443/readyz\": dial tcp 10.132.0.12:8443: connect: connection refused" start-of-body=
Jul 09 00:56:08.463629 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:08.463574    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-68b757fb67-z6kj2" podUID="7dc12511-b804-4ebc-8646-4d070d93a8cf" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.12:8443/readyz\": dial tcp 10.132.0.12:8443: connect: connection refused"
Jul 09 00:56:08.464229 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:08.464159    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qrrdm" event={"ID":"7e907cd7-ed51-4737-a088-df3d9597489d","Type":"ContainerStarted","Data":"3417e1c688e715665fa8a04d5604fc8edfeb9b09cee1c304b97a7c09421345f4"}
Jul 09 00:56:08.478394 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:08.478336    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-z6kj2" podStartSLOduration=33.774937674 podStartE2EDuration="43.478314609s" totalImagesPullingTime="9.703376935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 00:55:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:56:08.478308287 +0000 UTC m=+75.948451016" watchObservedRunningTime="2026-07-09 00:56:08.478314609 +0000 UTC m=+75.948457340"
Jul 09 00:56:08.496033 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:08.495986    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qrrdm" podStartSLOduration=36.472131506 podStartE2EDuration="43.495956573s" totalImagesPullingTime="7.023825067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 00:55:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:56:08.495084919 +0000 UTC m=+75.965227649" watchObservedRunningTime="2026-07-09 00:56:08.495956573 +0000 UTC m=+75.966099296"
Jul 09 00:56:08.556171 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:56:08.556130    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24f30d79_7850_4f7f_8208_86aa1ee58a82.slice/crio-3ffeb0375c9e6a7eb6c2ea0924cc25eff1c2123a9fa536652076729f8223876b WatchSource:0}: Error finding container 3ffeb0375c9e6a7eb6c2ea0924cc25eff1c2123a9fa536652076729f8223876b: Status 404 returned error can't find the container with id 3ffeb0375c9e6a7eb6c2ea0924cc25eff1c2123a9fa536652076729f8223876b
Jul 09 00:56:08.691220 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:08.690272    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-744f99454d-5m6pn"]
Jul 09 00:56:08.695143 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:08.695083    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f9f54d8-k9cvq"]
Jul 09 00:56:08.697357 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:08.697330    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-f7df9577c-4nw85"]
Jul 09 00:56:09.470964 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:09.470922    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-m9dnr" event={"ID":"24f30d79-7850-4f7f-8208-86aa1ee58a82","Type":"ContainerStarted","Data":"3ffeb0375c9e6a7eb6c2ea0924cc25eff1c2123a9fa536652076729f8223876b"}
Jul 09 00:56:09.472891 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:09.472861    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-22rnw" event={"ID":"d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0","Type":"ContainerStarted","Data":"5469be11e41c28182c47ed9fe408600779745b0681886969d0deb0b8cf499dbe"}
Jul 09 00:56:09.473036 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:09.472916    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-22rnw" event={"ID":"d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0","Type":"ContainerStarted","Data":"a7c0a054dac39133054b584e3a9ffc97bc2c8b591076ec18cdd65ee87520d6a7"}
Jul 09 00:56:09.473036 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:09.472971    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-22rnw"
Jul 09 00:56:09.474096 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:09.474074    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f7df9577c-4nw85" event={"ID":"62484457-5e59-488d-8bf1-3043247fd5e4","Type":"ContainerStarted","Data":"c9e5db2ed1b1b1e13d5872c3682435df10d2a91a6f9693086624c42386e69c55"}
Jul 09 00:56:09.475972 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:09.475945    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kj27l" event={"ID":"709e8d4f-0df9-4ba4-84f0-d47ed2257f9d","Type":"ContainerStarted","Data":"3771bec238875f0380f6e9e1cff84c80d350ce636f650287dc35288644fd718f"}
Jul 09 00:56:09.477258 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:09.477234    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f9f54d8-k9cvq" event={"ID":"0e1ca1df-1f3a-44b5-94b3-5daf9b26e5a7","Type":"ContainerStarted","Data":"2b857dc6da3bfdb5dfca2be51f3ca53e7a029f888d5cc4c36a31ca61a8a4ed1a"}
Jul 09 00:56:09.478320 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:09.478291    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-744f99454d-5m6pn" event={"ID":"91be5384-720c-42e3-89ad-b0cd98f089b7","Type":"ContainerStarted","Data":"4a9d2fa94beaf57f2d02872003a7d63ffe9149a6c2f85406140d15acb07fc812"}
Jul 09 00:56:09.480126 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:09.479835    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8p4px" event={"ID":"65de29a1-ee8f-4539-8e6d-997a7889fc85","Type":"ContainerStarted","Data":"6f6af7fdfd98f9c66f614bf765d63eba9cd61d6ee16ac63ba0a0e85d3631d6cf"}
Jul 09 00:56:09.490476 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:09.490421    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-22rnw" podStartSLOduration=35.249113261 podStartE2EDuration="42.490403165s" totalImagesPullingTime="7.241289904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 00:55:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:56:09.487770423 +0000 UTC m=+76.957913152" watchObservedRunningTime="2026-07-09 00:56:09.490403165 +0000 UTC m=+76.960545896"
Jul 09 00:56:09.501465 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:09.501418    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8p4px" podStartSLOduration=68.78289222 podStartE2EDuration="1m16.501399556s" totalImagesPullingTime="7.718507336s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 00:54:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:56:09.500756833 +0000 UTC m=+76.970899565" watchObservedRunningTime="2026-07-09 00:56:09.501399556 +0000 UTC m=+76.971542288"
Jul 09 00:56:09.515522 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:09.515468    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kj27l" podStartSLOduration=37.324037442 podStartE2EDuration="44.515452768s" totalImagesPullingTime="7.191415326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 00:55:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:56:09.514658636 +0000 UTC m=+76.984801366" watchObservedRunningTime="2026-07-09 00:56:09.515452768 +0000 UTC m=+76.985595497"
Jul 09 00:56:09.531895 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:09.531594    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6p4b2" podStartSLOduration=18.561295679 podStartE2EDuration="29.53157318s" totalImagesPullingTime="10.970277501s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 00:55:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:56:09.529759496 +0000 UTC m=+76.999902224" watchObservedRunningTime="2026-07-09 00:56:09.53157318 +0000 UTC m=+77.001715910"
Jul 09 00:56:09.750820 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:09.750719    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-z6kj2"
Jul 09 00:56:15.515530 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:15.515426    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-m9dnr" event={"ID":"24f30d79-7850-4f7f-8208-86aa1ee58a82","Type":"ContainerStarted","Data":"37134dda0318991a75ef21f6327ee3a055e09ac6d528413371b4809e105e353e"}
Jul 09 00:56:15.516899 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:15.516869    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f7df9577c-4nw85" event={"ID":"62484457-5e59-488d-8bf1-3043247fd5e4","Type":"ContainerStarted","Data":"70af9b29a901b888374ae3c352d14154d1a9f9b638877bded99826c9049d74b0"}
Jul 09 00:56:15.517037 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:15.517022    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f7df9577c-4nw85"
Jul 09 00:56:15.519020 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:15.518986    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f9f54d8-k9cvq" event={"ID":"0e1ca1df-1f3a-44b5-94b3-5daf9b26e5a7","Type":"ContainerStarted","Data":"e253a53446186bde8b874da937cb64382641909e55b2d7580cc7b48ecb181679"}
Jul 09 00:56:15.519126 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:15.519039    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f9f54d8-k9cvq" event={"ID":"0e1ca1df-1f3a-44b5-94b3-5daf9b26e5a7","Type":"ContainerStarted","Data":"3d73ff28fede82ce4bbd09c65d48d58ad2ef2e7ed52ecd728a4ee7560fe317c5"}
Jul 09 00:56:15.519126 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:15.519061    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f9f54d8-k9cvq" event={"ID":"0e1ca1df-1f3a-44b5-94b3-5daf9b26e5a7","Type":"ContainerStarted","Data":"aa70639abaa9dcfc7df2146c67acdaf7314af758cc6582a95cd76aac01b1900c"}
Jul 09 00:56:15.519126 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:15.519112    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f7df9577c-4nw85"
Jul 09 00:56:15.520480 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:15.520448    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-744f99454d-5m6pn" event={"ID":"91be5384-720c-42e3-89ad-b0cd98f089b7","Type":"ContainerStarted","Data":"0b0302a88e0d0b344540d3faab58a4b89443efb9e4aa3a74791696b808011441"}
Jul 09 00:56:15.530194 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:15.530152    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-m9dnr" podStartSLOduration=38.063195007 podStartE2EDuration="44.530134988s" totalImagesPullingTime="6.466939981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 00:55:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:56:15.529487095 +0000 UTC m=+82.999629823" watchObservedRunningTime="2026-07-09 00:56:15.530134988 +0000 UTC m=+83.000277717"
Jul 09 00:56:15.543150 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:15.542857    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-744f99454d-5m6pn" podStartSLOduration=4.209036571 podStartE2EDuration="10.542839314s" totalImagesPullingTime="6.333802743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 00:56:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:56:15.54283676 +0000 UTC m=+83.012979490" watchObservedRunningTime="2026-07-09 00:56:15.542839314 +0000 UTC m=+83.012982041"
Jul 09 00:56:15.559473 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:15.559323    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f7df9577c-4nw85" podStartSLOduration=4.20025667 podStartE2EDuration="10.559303586s" totalImagesPullingTime="6.359046916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 00:56:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:56:15.558849118 +0000 UTC m=+83.028991848" watchObservedRunningTime="2026-07-09 00:56:15.559303586 +0000 UTC m=+83.029446315"
Jul 09 00:56:15.579416 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:15.579367    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f9f54d8-k9cvq" podStartSLOduration=4.227955808 podStartE2EDuration="10.579350067s" totalImagesPullingTime="6.351394259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 00:56:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:56:15.578246406 +0000 UTC m=+83.048389135" watchObservedRunningTime="2026-07-09 00:56:15.579350067 +0000 UTC m=+83.049492795"
Jul 09 00:56:19.490482 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:19.490452    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-22rnw"
Jul 09 00:56:19.945812 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:19.945724    2557 patch_prober.go:28] interesting pod/image-registry-6dff8c759c-g4p6l container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 09 00:56:19.945812 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:19.945784    2557 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6dff8c759c-g4p6l" podUID="8f822d78-fd3b-44d1-ab1d-310f77a80e56" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 09 00:56:22.427399 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:22.427371    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6dff8c759c-g4p6l"
Jul 09 00:56:26.316597 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:26.316552    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8p2xd"]
Jul 09 00:56:26.321868 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:26.321838    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8p2xd"
Jul 09 00:56:26.324605 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:26.324580    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 09 00:56:26.324833 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:26.324622    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 09 00:56:26.325487 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:26.325466    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 09 00:56:26.325704 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:26.325688    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 09 00:56:26.325801 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:26.325469    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-q82vn\""
Jul 09 00:56:26.398137 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:26.398058    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbq5g\" (UniqueName: \"kubernetes.io/projected/643314ab-915e-4dbf-83e1-0d159126856d-kube-api-access-rbq5g\") pod \"node-exporter-8p2xd\" (UID: \"643314ab-915e-4dbf-83e1-0d159126856d\") " pod="openshift-monitoring/node-exporter-8p2xd"
Jul 09 00:56:26.398137 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:26.398110    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/643314ab-915e-4dbf-83e1-0d159126856d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8p2xd\" (UID: \"643314ab-915e-4dbf-83e1-0d159126856d\") " pod="openshift-monitoring/node-exporter-8p2xd"
Jul 09 00:56:26.398137 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:26.398137    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/643314ab-915e-4dbf-83e1-0d159126856d-node-exporter-tls\") pod \"node-exporter-8p2xd\" (UID: \"643314ab-915e-4dbf-83e1-0d159126856d\") " pod="openshift-monitoring/node-exporter-8p2xd"
Jul 09 00:56:26.398441 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:26.398186    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/643314ab-915e-4dbf-83e1-0d159126856d-node-exporter-textfile\") pod \"node-exporter-8p2xd\" (UID: \"643314ab-915e-4dbf-83e1-0d159126856d\") " pod="openshift-monitoring/node-exporter-8p2xd"
Jul 09 00:56:26.398441 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:26.398233    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/643314ab-915e-4dbf-83e1-0d159126856d-node-exporter-wtmp\") pod \"node-exporter-8p2xd\" (UID: \"643314ab-915e-4dbf-83e1-0d159126856d\") " pod="openshift-monitoring/node-exporter-8p2xd"
Jul 09 00:56:26.398441 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:26.398262    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/643314ab-915e-4dbf-83e1-0d159126856d-root\") pod \"node-exporter-8p2xd\" (UID: \"643314ab-915e-4dbf-83e1-0d159126856d\") " pod="openshift-monitoring/node-exporter-8p2xd"
Jul 09 00:56:26.398441 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:26.398287    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/643314ab-915e-4dbf-83e1-0d159126856d-metrics-client-ca\") pod \"node-exporter-8p2xd\" (UID: \"643314ab-915e-4dbf-83e1-0d159126856d\") " pod="openshift-monitoring/node-exporter-8p2xd"
Jul 09 00:56:26.398441 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:26.398326    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/643314ab-915e-4dbf-83e1-0d159126856d-sys\") pod \"node-exporter-8p2xd\" (UID: \"643314ab-915e-4dbf-83e1-0d159126856d\") " pod="openshift-monitoring/node-exporter-8p2xd"
Jul 09 00:56:26.398441 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:26.398351    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/643314ab-915e-4dbf-83e1-0d159126856d-node-exporter-accelerators-collector-config\") pod \"node-exporter-8p2xd\" (UID: \"643314ab-915e-4dbf-83e1-0d159126856d\") " pod="openshift-monitoring/node-exporter-8p2xd"
Jul 09 00:56:26.499571 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:26.499533    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/643314ab-915e-4dbf-83e1-0d159126856d-node-exporter-textfile\") pod \"node-exporter-8p2xd\" (UID: \"643314ab-915e-4dbf-83e1-0d159126856d\") " pod="openshift-monitoring/node-exporter-8p2xd"
Jul 09 00:56:26.499767 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:26.499637    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/643314ab-915e-4dbf-83e1-0d159126856d-node-exporter-wtmp\") pod \"node-exporter-8p2xd\" (UID: \"643314ab-915e-4dbf-83e1-0d159126856d\") " pod="openshift-monitoring/node-exporter-8p2xd"
Jul 09 00:56:26.499767 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:26.499672    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/643314ab-915e-4dbf-83e1-0d159126856d-root\") pod \"node-exporter-8p2xd\" (UID: \"643314ab-915e-4dbf-83e1-0d159126856d\") " pod="openshift-monitoring/node-exporter-8p2xd"
Jul 09 00:56:26.499767 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:26.499699    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/643314ab-915e-4dbf-83e1-0d159126856d-metrics-client-ca\") pod \"node-exporter-8p2xd\" (UID: \"643314ab-915e-4dbf-83e1-0d159126856d\") " pod="openshift-monitoring/node-exporter-8p2xd"
Jul 09 00:56:26.499767 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:26.499740    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/643314ab-915e-4dbf-83e1-0d159126856d-sys\") pod \"node-exporter-8p2xd\" (UID: \"643314ab-915e-4dbf-83e1-0d159126856d\") " pod="openshift-monitoring/node-exporter-8p2xd"
Jul 09 00:56:26.499767 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:26.499763    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/643314ab-915e-4dbf-83e1-0d159126856d-node-exporter-accelerators-collector-config\") pod \"node-exporter-8p2xd\" (UID: \"643314ab-915e-4dbf-83e1-0d159126856d\") " pod="openshift-monitoring/node-exporter-8p2xd"
Jul 09 00:56:26.500019 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:26.499826    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbq5g\" (UniqueName: \"kubernetes.io/projected/643314ab-915e-4dbf-83e1-0d159126856d-kube-api-access-rbq5g\") pod \"node-exporter-8p2xd\" (UID: \"643314ab-915e-4dbf-83e1-0d159126856d\") " pod="openshift-monitoring/node-exporter-8p2xd"
Jul 09 00:56:26.500019 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:26.499865    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/643314ab-915e-4dbf-83e1-0d159126856d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8p2xd\" (UID: \"643314ab-915e-4dbf-83e1-0d159126856d\") " pod="openshift-monitoring/node-exporter-8p2xd"
Jul 09 00:56:26.500019 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:26.499893    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/643314ab-915e-4dbf-83e1-0d159126856d-node-exporter-tls\") pod \"node-exporter-8p2xd\" (UID: \"643314ab-915e-4dbf-83e1-0d159126856d\") " pod="openshift-monitoring/node-exporter-8p2xd"
Jul 09 00:56:26.500159 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:56:26.500035    2557 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 09 00:56:26.500159 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:56:26.500101    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/643314ab-915e-4dbf-83e1-0d159126856d-node-exporter-tls podName:643314ab-915e-4dbf-83e1-0d159126856d nodeName:}" failed. No retries permitted until 2026-07-09 00:56:27.000079596 +0000 UTC m=+94.470222326 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/643314ab-915e-4dbf-83e1-0d159126856d-node-exporter-tls") pod "node-exporter-8p2xd" (UID: "643314ab-915e-4dbf-83e1-0d159126856d") : secret "node-exporter-tls" not found
Jul 09 00:56:26.500899 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:26.500866    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/643314ab-915e-4dbf-83e1-0d159126856d-node-exporter-wtmp\") pod \"node-exporter-8p2xd\" (UID: \"643314ab-915e-4dbf-83e1-0d159126856d\") " pod="openshift-monitoring/node-exporter-8p2xd"
Jul 09 00:56:26.501110 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:26.501085    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/643314ab-915e-4dbf-83e1-0d159126856d-root\") pod \"node-exporter-8p2xd\" (UID: \"643314ab-915e-4dbf-83e1-0d159126856d\") " pod="openshift-monitoring/node-exporter-8p2xd"
Jul 09 00:56:26.501278 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:26.501128    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/643314ab-915e-4dbf-83e1-0d159126856d-node-exporter-textfile\") pod \"node-exporter-8p2xd\" (UID: \"643314ab-915e-4dbf-83e1-0d159126856d\") " pod="openshift-monitoring/node-exporter-8p2xd"
Jul 09 00:56:26.501657 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:26.501638    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/643314ab-915e-4dbf-83e1-0d159126856d-node-exporter-accelerators-collector-config\") pod \"node-exporter-8p2xd\" (UID: \"643314ab-915e-4dbf-83e1-0d159126856d\") " pod="openshift-monitoring/node-exporter-8p2xd"
Jul 09 00:56:26.501796 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:26.501638    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/643314ab-915e-4dbf-83e1-0d159126856d-metrics-client-ca\") pod \"node-exporter-8p2xd\" (UID: \"643314ab-915e-4dbf-83e1-0d159126856d\") " pod="openshift-monitoring/node-exporter-8p2xd"
Jul 09 00:56:26.501951 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:26.501932    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/643314ab-915e-4dbf-83e1-0d159126856d-sys\") pod \"node-exporter-8p2xd\" (UID: \"643314ab-915e-4dbf-83e1-0d159126856d\") " pod="openshift-monitoring/node-exporter-8p2xd"
Jul 09 00:56:26.503640 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:26.503610    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/643314ab-915e-4dbf-83e1-0d159126856d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8p2xd\" (UID: \"643314ab-915e-4dbf-83e1-0d159126856d\") " pod="openshift-monitoring/node-exporter-8p2xd"
Jul 09 00:56:26.511301 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:26.511278    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbq5g\" (UniqueName: \"kubernetes.io/projected/643314ab-915e-4dbf-83e1-0d159126856d-kube-api-access-rbq5g\") pod \"node-exporter-8p2xd\" (UID: \"643314ab-915e-4dbf-83e1-0d159126856d\") " pod="openshift-monitoring/node-exporter-8p2xd"
Jul 09 00:56:27.005774 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:27.005724    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/643314ab-915e-4dbf-83e1-0d159126856d-node-exporter-tls\") pod \"node-exporter-8p2xd\" (UID: \"643314ab-915e-4dbf-83e1-0d159126856d\") " pod="openshift-monitoring/node-exporter-8p2xd"
Jul 09 00:56:27.008277 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:27.008249    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/643314ab-915e-4dbf-83e1-0d159126856d-node-exporter-tls\") pod \"node-exporter-8p2xd\" (UID: \"643314ab-915e-4dbf-83e1-0d159126856d\") " pod="openshift-monitoring/node-exporter-8p2xd"
Jul 09 00:56:27.234683 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:27.234643    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8p2xd"
Jul 09 00:56:27.248773 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:56:27.248741    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod643314ab_915e_4dbf_83e1_0d159126856d.slice/crio-a488757a787511a109d5f5057abc2341ee9ddadfe3f6fa9cdcb4a7576159cdb3 WatchSource:0}: Error finding container a488757a787511a109d5f5057abc2341ee9ddadfe3f6fa9cdcb4a7576159cdb3: Status 404 returned error can't find the container with id a488757a787511a109d5f5057abc2341ee9ddadfe3f6fa9cdcb4a7576159cdb3
Jul 09 00:56:27.568920 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:27.568881    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8p2xd" event={"ID":"643314ab-915e-4dbf-83e1-0d159126856d","Type":"ContainerStarted","Data":"a488757a787511a109d5f5057abc2341ee9ddadfe3f6fa9cdcb4a7576159cdb3"}
Jul 09 00:56:28.955649 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:28.955569    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6dff8c759c-g4p6l"]
Jul 09 00:56:29.579969 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:29.579928    2557 generic.go:356] "Generic (PLEG): container finished" podID="643314ab-915e-4dbf-83e1-0d159126856d" containerID="c4a61d701354808b6e65bc26138821124b7c093d05c8b851bd87746b9967cdb6" exitCode=0
Jul 09 00:56:29.580169 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:29.580019    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8p2xd" event={"ID":"643314ab-915e-4dbf-83e1-0d159126856d","Type":"ContainerDied","Data":"c4a61d701354808b6e65bc26138821124b7c093d05c8b851bd87746b9967cdb6"}
Jul 09 00:56:30.586414 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:30.586370    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8p2xd" event={"ID":"643314ab-915e-4dbf-83e1-0d159126856d","Type":"ContainerStarted","Data":"a09fd752941e556732847520ed9feeb09bb1c201a4bc713f16b13396fac791cf"}
Jul 09 00:56:30.586802 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:30.586441    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8p2xd" event={"ID":"643314ab-915e-4dbf-83e1-0d159126856d","Type":"ContainerStarted","Data":"e44126918dc73d7099011a0e4e8e0af211bdfb0ab321b35d0bbea9915e1c11da"}
Jul 09 00:56:30.603858 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:30.603810    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8p2xd" podStartSLOduration=3.109222492 podStartE2EDuration="4.603796545s" totalImagesPullingTime="1.430297741s" totalInitContainerRuntime="64.276312ms" isStatefulPod=true podCreationTimestamp="2026-07-09 00:56:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:56:30.602571449 +0000 UTC m=+98.072714189" watchObservedRunningTime="2026-07-09 00:56:30.603796545 +0000 UTC m=+98.073939290"
Jul 09 00:56:32.425802 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:32.425766    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dvvxg"
Jul 09 00:56:53.976963 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:53.976892    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6dff8c759c-g4p6l" podUID="8f822d78-fd3b-44d1-ab1d-310f77a80e56" containerName="registry" containerID="cri-o://986d52e446f4cc030710904d553a8481487c7286257326c363284fa12959fd64" gracePeriod=30
Jul 09 00:56:54.231140 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:54.231080    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dff8c759c-g4p6l"
Jul 09 00:56:54.347771 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:54.347727    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8f822d78-fd3b-44d1-ab1d-310f77a80e56-registry-certificates\") pod \"8f822d78-fd3b-44d1-ab1d-310f77a80e56\" (UID: \"8f822d78-fd3b-44d1-ab1d-310f77a80e56\") "
Jul 09 00:56:54.347979 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:54.347783    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8f822d78-fd3b-44d1-ab1d-310f77a80e56-trusted-ca\") pod \"8f822d78-fd3b-44d1-ab1d-310f77a80e56\" (UID: \"8f822d78-fd3b-44d1-ab1d-310f77a80e56\") "
Jul 09 00:56:54.347979 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:54.347822    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8f822d78-fd3b-44d1-ab1d-310f77a80e56-installation-pull-secrets\") pod \"8f822d78-fd3b-44d1-ab1d-310f77a80e56\" (UID: \"8f822d78-fd3b-44d1-ab1d-310f77a80e56\") "
Jul 09 00:56:54.347979 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:54.347925    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4lmn\" (UniqueName: \"kubernetes.io/projected/8f822d78-fd3b-44d1-ab1d-310f77a80e56-kube-api-access-s4lmn\") pod \"8f822d78-fd3b-44d1-ab1d-310f77a80e56\" (UID: \"8f822d78-fd3b-44d1-ab1d-310f77a80e56\") "
Jul 09 00:56:54.347979 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:54.347971    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f822d78-fd3b-44d1-ab1d-310f77a80e56-bound-sa-token\") pod \"8f822d78-fd3b-44d1-ab1d-310f77a80e56\" (UID: \"8f822d78-fd3b-44d1-ab1d-310f77a80e56\") "
Jul 09 00:56:54.348192 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:54.348006    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8f822d78-fd3b-44d1-ab1d-310f77a80e56-ca-trust-extracted\") pod \"8f822d78-fd3b-44d1-ab1d-310f77a80e56\" (UID: \"8f822d78-fd3b-44d1-ab1d-310f77a80e56\") "
Jul 09 00:56:54.348192 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:54.348042    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f822d78-fd3b-44d1-ab1d-310f77a80e56-registry-tls\") pod \"8f822d78-fd3b-44d1-ab1d-310f77a80e56\" (UID: \"8f822d78-fd3b-44d1-ab1d-310f77a80e56\") "
Jul 09 00:56:54.348192 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:54.348099    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8f822d78-fd3b-44d1-ab1d-310f77a80e56-image-registry-private-configuration\") pod \"8f822d78-fd3b-44d1-ab1d-310f77a80e56\" (UID: \"8f822d78-fd3b-44d1-ab1d-310f77a80e56\") "
Jul 09 00:56:54.348373 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:54.348237    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f822d78-fd3b-44d1-ab1d-310f77a80e56-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "8f822d78-fd3b-44d1-ab1d-310f77a80e56" (UID: "8f822d78-fd3b-44d1-ab1d-310f77a80e56"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 00:56:54.348373 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:54.348283    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f822d78-fd3b-44d1-ab1d-310f77a80e56-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "8f822d78-fd3b-44d1-ab1d-310f77a80e56" (UID: "8f822d78-fd3b-44d1-ab1d-310f77a80e56"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 00:56:54.348596 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:54.348566    2557 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8f822d78-fd3b-44d1-ab1d-310f77a80e56-registry-certificates\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 00:56:54.348596 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:54.348598    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8f822d78-fd3b-44d1-ab1d-310f77a80e56-trusted-ca\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 00:56:54.357092 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:54.356504    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f822d78-fd3b-44d1-ab1d-310f77a80e56-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "8f822d78-fd3b-44d1-ab1d-310f77a80e56" (UID: "8f822d78-fd3b-44d1-ab1d-310f77a80e56"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 00:56:54.357092 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:54.356588    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f822d78-fd3b-44d1-ab1d-310f77a80e56-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "8f822d78-fd3b-44d1-ab1d-310f77a80e56" (UID: "8f822d78-fd3b-44d1-ab1d-310f77a80e56"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 00:56:54.357092 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:54.356589    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f822d78-fd3b-44d1-ab1d-310f77a80e56-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "8f822d78-fd3b-44d1-ab1d-310f77a80e56" (UID: "8f822d78-fd3b-44d1-ab1d-310f77a80e56"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 00:56:54.357512 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:54.357244    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f822d78-fd3b-44d1-ab1d-310f77a80e56-kube-api-access-s4lmn" (OuterVolumeSpecName: "kube-api-access-s4lmn") pod "8f822d78-fd3b-44d1-ab1d-310f77a80e56" (UID: "8f822d78-fd3b-44d1-ab1d-310f77a80e56"). InnerVolumeSpecName "kube-api-access-s4lmn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 00:56:54.357512 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:54.357305    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f822d78-fd3b-44d1-ab1d-310f77a80e56-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8f822d78-fd3b-44d1-ab1d-310f77a80e56" (UID: "8f822d78-fd3b-44d1-ab1d-310f77a80e56"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 00:56:54.358100 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:54.358075    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f822d78-fd3b-44d1-ab1d-310f77a80e56-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "8f822d78-fd3b-44d1-ab1d-310f77a80e56" (UID: "8f822d78-fd3b-44d1-ab1d-310f77a80e56"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 00:56:54.449806 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:54.449762    2557 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8f822d78-fd3b-44d1-ab1d-310f77a80e56-installation-pull-secrets\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 00:56:54.449806 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:54.449799    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4lmn\" (UniqueName: \"kubernetes.io/projected/8f822d78-fd3b-44d1-ab1d-310f77a80e56-kube-api-access-s4lmn\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 00:56:54.450020 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:54.449841    2557 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f822d78-fd3b-44d1-ab1d-310f77a80e56-bound-sa-token\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 00:56:54.450020 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:54.449854    2557 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8f822d78-fd3b-44d1-ab1d-310f77a80e56-ca-trust-extracted\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 00:56:54.450020 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:54.449867    2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f822d78-fd3b-44d1-ab1d-310f77a80e56-registry-tls\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 00:56:54.450020 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:54.449880    2557 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8f822d78-fd3b-44d1-ab1d-310f77a80e56-image-registry-private-configuration\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 00:56:54.675259 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:54.675146    2557 generic.go:356] "Generic (PLEG): container finished" podID="37664234-8f03-4849-b53b-ec22d49b8e31" containerID="c8a8f667948ab8b939be77e8f82c25b5a4ad911df5cb5bac214dcb3d4cc4fb86" exitCode=0
Jul 09 00:56:54.675259 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:54.675227    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jkklf" event={"ID":"37664234-8f03-4849-b53b-ec22d49b8e31","Type":"ContainerDied","Data":"c8a8f667948ab8b939be77e8f82c25b5a4ad911df5cb5bac214dcb3d4cc4fb86"}
Jul 09 00:56:54.675663 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:54.675639    2557 scope.go:117] "RemoveContainer" containerID="c8a8f667948ab8b939be77e8f82c25b5a4ad911df5cb5bac214dcb3d4cc4fb86"
Jul 09 00:56:54.676603 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:54.676575    2557 generic.go:356] "Generic (PLEG): container finished" podID="8f822d78-fd3b-44d1-ab1d-310f77a80e56" containerID="986d52e446f4cc030710904d553a8481487c7286257326c363284fa12959fd64" exitCode=0
Jul 09 00:56:54.676690 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:54.676636    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dff8c759c-g4p6l"
Jul 09 00:56:54.676690 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:54.676648    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6dff8c759c-g4p6l" event={"ID":"8f822d78-fd3b-44d1-ab1d-310f77a80e56","Type":"ContainerDied","Data":"986d52e446f4cc030710904d553a8481487c7286257326c363284fa12959fd64"}
Jul 09 00:56:54.676756 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:54.676705    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6dff8c759c-g4p6l" event={"ID":"8f822d78-fd3b-44d1-ab1d-310f77a80e56","Type":"ContainerDied","Data":"9c13d7f0e28865bd9c795d0e885ddaf8b387a74e19d9c860cb55f66e1460558f"}
Jul 09 00:56:54.676756 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:54.676727    2557 scope.go:117] "RemoveContainer" containerID="986d52e446f4cc030710904d553a8481487c7286257326c363284fa12959fd64"
Jul 09 00:56:54.688069 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:54.688046    2557 scope.go:117] "RemoveContainer" containerID="986d52e446f4cc030710904d553a8481487c7286257326c363284fa12959fd64"
Jul 09 00:56:54.688406 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:56:54.688381    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"986d52e446f4cc030710904d553a8481487c7286257326c363284fa12959fd64\": container with ID starting with 986d52e446f4cc030710904d553a8481487c7286257326c363284fa12959fd64 not found: ID does not exist" containerID="986d52e446f4cc030710904d553a8481487c7286257326c363284fa12959fd64"
Jul 09 00:56:54.688497 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:54.688412    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"986d52e446f4cc030710904d553a8481487c7286257326c363284fa12959fd64"} err="failed to get container status \"986d52e446f4cc030710904d553a8481487c7286257326c363284fa12959fd64\": rpc error: code = NotFound desc = could not find container \"986d52e446f4cc030710904d553a8481487c7286257326c363284fa12959fd64\": container with ID starting with 986d52e446f4cc030710904d553a8481487c7286257326c363284fa12959fd64 not found: ID does not exist"
Jul 09 00:56:54.704314 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:54.704286    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6dff8c759c-g4p6l"]
Jul 09 00:56:54.713365 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:54.713335    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6dff8c759c-g4p6l"]
Jul 09 00:56:55.039598 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:55.039565    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f822d78-fd3b-44d1-ab1d-310f77a80e56" path="/var/lib/kubelet/pods/8f822d78-fd3b-44d1-ab1d-310f77a80e56/volumes"
Jul 09 00:56:55.683161 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:55.683130    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jkklf" event={"ID":"37664234-8f03-4849-b53b-ec22d49b8e31","Type":"ContainerStarted","Data":"71f6f38860dfb06432f292021f5f6893cb225ac342b801c85781ee50751a5199"}
Jul 09 00:56:59.699338 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:59.699302    2557 generic.go:356] "Generic (PLEG): container finished" podID="a5fbbb22-3d60-42aa-bbb0-8426d37e945c" containerID="3a5acccaff90db9f1ec147f5958344ebf656fc5ef21d3893d752af4a2add57f6" exitCode=0
Jul 09 00:56:59.699734 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:59.699376    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rw5s7" event={"ID":"a5fbbb22-3d60-42aa-bbb0-8426d37e945c","Type":"ContainerDied","Data":"3a5acccaff90db9f1ec147f5958344ebf656fc5ef21d3893d752af4a2add57f6"}
Jul 09 00:56:59.699734 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:56:59.699710    2557 scope.go:117] "RemoveContainer" containerID="3a5acccaff90db9f1ec147f5958344ebf656fc5ef21d3893d752af4a2add57f6"
Jul 09 00:57:00.705186 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:57:00.705149    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rw5s7" event={"ID":"a5fbbb22-3d60-42aa-bbb0-8426d37e945c","Type":"ContainerStarted","Data":"894dbc1b7f5c245a0cd42f5a9eae860ddec3a1fb12434cf49d3f1a94b7b65ca2"}
Jul 09 00:57:09.739007 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:57:09.738973    2557 generic.go:356] "Generic (PLEG): container finished" podID="17f6664f-1f4d-4e8d-ad1d-da46c799b51d" containerID="420daaa97d3de6532718549e2f3d62fcb65b3b35f463d9b013ace9ca693c27d9" exitCode=0
Jul 09 00:57:09.739405 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:57:09.739043    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-zbnc6" event={"ID":"17f6664f-1f4d-4e8d-ad1d-da46c799b51d","Type":"ContainerDied","Data":"420daaa97d3de6532718549e2f3d62fcb65b3b35f463d9b013ace9ca693c27d9"}
Jul 09 00:57:09.739451 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:57:09.739415    2557 scope.go:117] "RemoveContainer" containerID="420daaa97d3de6532718549e2f3d62fcb65b3b35f463d9b013ace9ca693c27d9"
Jul 09 00:57:10.327061 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:57:10.327025    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-59b7486ffc-xdjvw_569c1037-0058-4b97-9ebf-3fd77e9f72c3/router/0.log"
Jul 09 00:57:10.332845 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:57:10.332821    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7bwv9_4f1d4fff-34fd-47cf-a632-07d976f8beec/serve-healthcheck-canary/0.log"
Jul 09 00:57:10.744851 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:57:10.744816    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-zbnc6" event={"ID":"17f6664f-1f4d-4e8d-ad1d-da46c799b51d","Type":"ContainerStarted","Data":"9e5fd20ad663dc88e2a51e2dbece2a27be8fcd472dd2439770ae1ace2cfeea77"}
Jul 09 00:59:12.575342 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:12.575302    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85699f56b9-hcz4l"]
Jul 09 00:59:12.575814 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:12.575600    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f822d78-fd3b-44d1-ab1d-310f77a80e56" containerName="registry"
Jul 09 00:59:12.575814 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:12.575611    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f822d78-fd3b-44d1-ab1d-310f77a80e56" containerName="registry"
Jul 09 00:59:12.575814 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:12.575659    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f822d78-fd3b-44d1-ab1d-310f77a80e56" containerName="registry"
Jul 09 00:59:12.578543 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:12.578521    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85699f56b9-hcz4l"
Jul 09 00:59:12.582553 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:12.582527    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 09 00:59:12.584020 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:12.583995    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 09 00:59:12.586146 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:12.586127    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-h7fwd\""
Jul 09 00:59:12.586345 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:12.586331    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 09 00:59:12.586585 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:12.586566    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 09 00:59:12.599301 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:12.599276    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85699f56b9-hcz4l"]
Jul 09 00:59:12.650949 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:12.650908    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a69b915e-86c3-4650-9f13-a1afea3a1d1b-manifests\") pod \"opendatahub-operator-controller-manager-85699f56b9-hcz4l\" (UID: \"a69b915e-86c3-4650-9f13-a1afea3a1d1b\") " pod="opendatahub/opendatahub-operator-controller-manager-85699f56b9-hcz4l"
Jul 09 00:59:12.650949 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:12.650948    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwjp2\" (UniqueName: \"kubernetes.io/projected/a69b915e-86c3-4650-9f13-a1afea3a1d1b-kube-api-access-nwjp2\") pod \"opendatahub-operator-controller-manager-85699f56b9-hcz4l\" (UID: \"a69b915e-86c3-4650-9f13-a1afea3a1d1b\") " pod="opendatahub/opendatahub-operator-controller-manager-85699f56b9-hcz4l"
Jul 09 00:59:12.651172 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:12.650970    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a69b915e-86c3-4650-9f13-a1afea3a1d1b-webhook-cert\") pod \"opendatahub-operator-controller-manager-85699f56b9-hcz4l\" (UID: \"a69b915e-86c3-4650-9f13-a1afea3a1d1b\") " pod="opendatahub/opendatahub-operator-controller-manager-85699f56b9-hcz4l"
Jul 09 00:59:12.651172 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:12.651031    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a69b915e-86c3-4650-9f13-a1afea3a1d1b-tmp\") pod \"opendatahub-operator-controller-manager-85699f56b9-hcz4l\" (UID: \"a69b915e-86c3-4650-9f13-a1afea3a1d1b\") " pod="opendatahub/opendatahub-operator-controller-manager-85699f56b9-hcz4l"
Jul 09 00:59:12.651172 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:12.651049    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a69b915e-86c3-4650-9f13-a1afea3a1d1b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85699f56b9-hcz4l\" (UID: \"a69b915e-86c3-4650-9f13-a1afea3a1d1b\") " pod="opendatahub/opendatahub-operator-controller-manager-85699f56b9-hcz4l"
Jul 09 00:59:12.752204 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:12.752166    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a69b915e-86c3-4650-9f13-a1afea3a1d1b-manifests\") pod \"opendatahub-operator-controller-manager-85699f56b9-hcz4l\" (UID: \"a69b915e-86c3-4650-9f13-a1afea3a1d1b\") " pod="opendatahub/opendatahub-operator-controller-manager-85699f56b9-hcz4l"
Jul 09 00:59:12.752412 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:12.752232    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwjp2\" (UniqueName: \"kubernetes.io/projected/a69b915e-86c3-4650-9f13-a1afea3a1d1b-kube-api-access-nwjp2\") pod \"opendatahub-operator-controller-manager-85699f56b9-hcz4l\" (UID: \"a69b915e-86c3-4650-9f13-a1afea3a1d1b\") " pod="opendatahub/opendatahub-operator-controller-manager-85699f56b9-hcz4l"
Jul 09 00:59:12.752412 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:12.752266    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a69b915e-86c3-4650-9f13-a1afea3a1d1b-webhook-cert\") pod \"opendatahub-operator-controller-manager-85699f56b9-hcz4l\" (UID: \"a69b915e-86c3-4650-9f13-a1afea3a1d1b\") " pod="opendatahub/opendatahub-operator-controller-manager-85699f56b9-hcz4l"
Jul 09 00:59:12.752412 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:12.752354    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a69b915e-86c3-4650-9f13-a1afea3a1d1b-tmp\") pod \"opendatahub-operator-controller-manager-85699f56b9-hcz4l\" (UID: \"a69b915e-86c3-4650-9f13-a1afea3a1d1b\") " pod="opendatahub/opendatahub-operator-controller-manager-85699f56b9-hcz4l"
Jul 09 00:59:12.752412 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:12.752380    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a69b915e-86c3-4650-9f13-a1afea3a1d1b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85699f56b9-hcz4l\" (UID: \"a69b915e-86c3-4650-9f13-a1afea3a1d1b\") " pod="opendatahub/opendatahub-operator-controller-manager-85699f56b9-hcz4l"
Jul 09 00:59:12.752665 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:12.752638    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a69b915e-86c3-4650-9f13-a1afea3a1d1b-manifests\") pod \"opendatahub-operator-controller-manager-85699f56b9-hcz4l\" (UID: \"a69b915e-86c3-4650-9f13-a1afea3a1d1b\") " pod="opendatahub/opendatahub-operator-controller-manager-85699f56b9-hcz4l"
Jul 09 00:59:12.754918 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:12.754880    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a69b915e-86c3-4650-9f13-a1afea3a1d1b-tmp\") pod \"opendatahub-operator-controller-manager-85699f56b9-hcz4l\" (UID: \"a69b915e-86c3-4650-9f13-a1afea3a1d1b\") " pod="opendatahub/opendatahub-operator-controller-manager-85699f56b9-hcz4l"
Jul 09 00:59:12.755047 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:12.754976    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a69b915e-86c3-4650-9f13-a1afea3a1d1b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85699f56b9-hcz4l\" (UID: \"a69b915e-86c3-4650-9f13-a1afea3a1d1b\") " pod="opendatahub/opendatahub-operator-controller-manager-85699f56b9-hcz4l"
Jul 09 00:59:12.755047 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:12.754983    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a69b915e-86c3-4650-9f13-a1afea3a1d1b-webhook-cert\") pod \"opendatahub-operator-controller-manager-85699f56b9-hcz4l\" (UID: \"a69b915e-86c3-4650-9f13-a1afea3a1d1b\") " pod="opendatahub/opendatahub-operator-controller-manager-85699f56b9-hcz4l"
Jul 09 00:59:12.763030 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:12.763005    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwjp2\" (UniqueName: \"kubernetes.io/projected/a69b915e-86c3-4650-9f13-a1afea3a1d1b-kube-api-access-nwjp2\") pod \"opendatahub-operator-controller-manager-85699f56b9-hcz4l\" (UID: \"a69b915e-86c3-4650-9f13-a1afea3a1d1b\") " pod="opendatahub/opendatahub-operator-controller-manager-85699f56b9-hcz4l"
Jul 09 00:59:12.889112 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:12.889026    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85699f56b9-hcz4l"
Jul 09 00:59:13.040862 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:13.040799    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85699f56b9-hcz4l"]
Jul 09 00:59:13.219817 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:13.219783    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85699f56b9-hcz4l" event={"ID":"a69b915e-86c3-4650-9f13-a1afea3a1d1b","Type":"ContainerStarted","Data":"365be4f3d2d2c2bdf7822bcd8c2614f0189c1a6cbff66469a70e1b4f86115901"}
Jul 09 00:59:16.235188 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:16.235101    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85699f56b9-hcz4l" event={"ID":"a69b915e-86c3-4650-9f13-a1afea3a1d1b","Type":"ContainerStarted","Data":"2bf8da2b2fab7c50d9797a5043902e75fc8102f7e878937d69a1f8f2c604c402"}
Jul 09 00:59:17.241154 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:17.241121    2557 generic.go:356] "Generic (PLEG): container finished" podID="a69b915e-86c3-4650-9f13-a1afea3a1d1b" containerID="2bf8da2b2fab7c50d9797a5043902e75fc8102f7e878937d69a1f8f2c604c402" exitCode=0
Jul 09 00:59:17.241551 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:17.241173    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85699f56b9-hcz4l" event={"ID":"a69b915e-86c3-4650-9f13-a1afea3a1d1b","Type":"ContainerDied","Data":"2bf8da2b2fab7c50d9797a5043902e75fc8102f7e878937d69a1f8f2c604c402"}
Jul 09 00:59:18.247353 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:18.247315    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85699f56b9-hcz4l" event={"ID":"a69b915e-86c3-4650-9f13-a1afea3a1d1b","Type":"ContainerStarted","Data":"cd6be647f7f45113dcc74632085f677b3853684ae6d65cc4f837b6f0d26829be"}
Jul 09 00:59:18.247733 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:18.247440    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-85699f56b9-hcz4l"
Jul 09 00:59:18.266734 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:18.266682    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-85699f56b9-hcz4l" podStartSLOduration=1.993839097 podStartE2EDuration="6.266668115s" totalImagesPullingTime="3.234007868s" totalInitContainerRuntime="1.03882115s" isStatefulPod=false podCreationTimestamp="2026-07-09 00:59:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:59:18.265414925 +0000 UTC m=+265.735557846" watchObservedRunningTime="2026-07-09 00:59:18.266668115 +0000 UTC m=+265.736810845"
Jul 09 00:59:29.253925 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:29.253887    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-85699f56b9-hcz4l"
Jul 09 00:59:40.287029 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.286995    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-6bnl4"]
Jul 09 00:59:40.302099 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.302063    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-6bnl4"]
Jul 09 00:59:40.302299 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.302135    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-6bnl4"
Jul 09 00:59:40.304608 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.304585    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 09 00:59:40.304746 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.304640    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-ldjjs\""
Jul 09 00:59:40.386317 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.386164    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-6bnl4\" (UID: \"ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-6bnl4"
Jul 09 00:59:40.386597 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.386576    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-548557588-6bnl4\" (UID: \"ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-6bnl4"
Jul 09 00:59:40.386718 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.386704    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-548557588-6bnl4\" (UID: \"ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-6bnl4"
Jul 09 00:59:40.386894 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.386855    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-istio-data\") pod \"data-science-gateway-data-science-gateway-class-548557588-6bnl4\" (UID: \"ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-6bnl4"
Jul 09 00:59:40.387053 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.387023    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-istio-token\") pod \"data-science-gateway-data-science-gateway-class-548557588-6bnl4\" (UID: \"ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-6bnl4"
Jul 09 00:59:40.387256 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.387239    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-548557588-6bnl4\" (UID: \"ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-6bnl4"
Jul 09 00:59:40.387468 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.387452    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-6bnl4\" (UID: \"ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-6bnl4"
Jul 09 00:59:40.387573 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.387557    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp42r\" (UniqueName: \"kubernetes.io/projected/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-kube-api-access-gp42r\") pod \"data-science-gateway-data-science-gateway-class-548557588-6bnl4\" (UID: \"ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-6bnl4"
Jul 09 00:59:40.387689 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.387676    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-548557588-6bnl4\" (UID: \"ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-6bnl4"
Jul 09 00:59:40.488644 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.488591    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-548557588-6bnl4\" (UID: \"ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-6bnl4"
Jul 09 00:59:40.488839 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.488661    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-6bnl4\" (UID: \"ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-6bnl4"
Jul 09 00:59:40.488839 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.488691    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp42r\" (UniqueName: \"kubernetes.io/projected/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-kube-api-access-gp42r\") pod \"data-science-gateway-data-science-gateway-class-548557588-6bnl4\" (UID: \"ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-6bnl4"
Jul 09 00:59:40.488839 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.488730    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-548557588-6bnl4\" (UID: \"ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-6bnl4"
Jul 09 00:59:40.488839 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.488791    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-6bnl4\" (UID: \"ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-6bnl4"
Jul 09 00:59:40.488839 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.488828    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-548557588-6bnl4\" (UID: \"ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-6bnl4"
Jul 09 00:59:40.489063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.488854    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-548557588-6bnl4\" (UID: \"ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-6bnl4"
Jul 09 00:59:40.489063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.488880    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-istio-data\") pod \"data-science-gateway-data-science-gateway-class-548557588-6bnl4\" (UID: \"ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-6bnl4"
Jul 09 00:59:40.489063 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.488924    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-istio-token\") pod \"data-science-gateway-data-science-gateway-class-548557588-6bnl4\" (UID: \"ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-6bnl4"
Jul 09 00:59:40.489167 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.489142    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-6bnl4\" (UID: \"ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-6bnl4"
Jul 09 00:59:40.489524 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.489499    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-548557588-6bnl4\" (UID: \"ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-6bnl4"
Jul 09 00:59:40.489629 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.489551    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-6bnl4\" (UID: \"ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-6bnl4"
Jul 09 00:59:40.489629 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.489610    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-istio-data\") pod \"data-science-gateway-data-science-gateway-class-548557588-6bnl4\" (UID: \"ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-6bnl4"
Jul 09 00:59:40.489807 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.489790    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-548557588-6bnl4\" (UID: \"ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-6bnl4"
Jul 09 00:59:40.491152 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.491132    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-548557588-6bnl4\" (UID: \"ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-6bnl4"
Jul 09 00:59:40.491307 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.491287    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-548557588-6bnl4\" (UID: \"ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-6bnl4"
Jul 09 00:59:40.498896 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.498874    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp42r\" (UniqueName: \"kubernetes.io/projected/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-kube-api-access-gp42r\") pod \"data-science-gateway-data-science-gateway-class-548557588-6bnl4\" (UID: \"ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-6bnl4"
Jul 09 00:59:40.499633 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.499608    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-istio-token\") pod \"data-science-gateway-data-science-gateway-class-548557588-6bnl4\" (UID: \"ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-6bnl4"
Jul 09 00:59:40.613422 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.613330    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-6bnl4"
Jul 09 00:59:40.683668 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.683606    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fwkbp"]
Jul 09 00:59:40.687595 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.687571    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fwkbp"
Jul 09 00:59:40.708531 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.708455    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fwkbp"]
Jul 09 00:59:40.784096 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.784019    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-6bnl4"]
Jul 09 00:59:40.786769 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:59:40.786740    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecfdeda4_6ed1_4c40_a3e5_ba9aaeb66975.slice/crio-62cf260e23d8cccacc3040992238daa03fb2ac17140f8003265e6847fa20ad3d WatchSource:0}: Error finding container 62cf260e23d8cccacc3040992238daa03fb2ac17140f8003265e6847fa20ad3d: Status 404 returned error can't find the container with id 62cf260e23d8cccacc3040992238daa03fb2ac17140f8003265e6847fa20ad3d
Jul 09 00:59:40.792461 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.792435    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed6bd9ee-f8df-42e5-996a-a3afa712908c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fwkbp\" (UID: \"ed6bd9ee-f8df-42e5-996a-a3afa712908c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fwkbp"
Jul 09 00:59:40.792549 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.792481    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed6bd9ee-f8df-42e5-996a-a3afa712908c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fwkbp\" (UID: \"ed6bd9ee-f8df-42e5-996a-a3afa712908c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fwkbp"
Jul 09 00:59:40.792549 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.792514    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed6bd9ee-f8df-42e5-996a-a3afa712908c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fwkbp\" (UID: \"ed6bd9ee-f8df-42e5-996a-a3afa712908c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fwkbp"
Jul 09 00:59:40.792643 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.792559    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed6bd9ee-f8df-42e5-996a-a3afa712908c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fwkbp\" (UID: \"ed6bd9ee-f8df-42e5-996a-a3afa712908c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fwkbp"
Jul 09 00:59:40.792643 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.792597    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed6bd9ee-f8df-42e5-996a-a3afa712908c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fwkbp\" (UID: \"ed6bd9ee-f8df-42e5-996a-a3afa712908c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fwkbp"
Jul 09 00:59:40.792719 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.792659    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed6bd9ee-f8df-42e5-996a-a3afa712908c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fwkbp\" (UID: \"ed6bd9ee-f8df-42e5-996a-a3afa712908c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fwkbp"
Jul 09 00:59:40.792719 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.792675    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed6bd9ee-f8df-42e5-996a-a3afa712908c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fwkbp\" (UID: \"ed6bd9ee-f8df-42e5-996a-a3afa712908c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fwkbp"
Jul 09 00:59:40.792719 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.792710    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhw86\" (UniqueName: \"kubernetes.io/projected/ed6bd9ee-f8df-42e5-996a-a3afa712908c-kube-api-access-fhw86\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fwkbp\" (UID: \"ed6bd9ee-f8df-42e5-996a-a3afa712908c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fwkbp"
Jul 09 00:59:40.792820 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.792735    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed6bd9ee-f8df-42e5-996a-a3afa712908c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fwkbp\" (UID: \"ed6bd9ee-f8df-42e5-996a-a3afa712908c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fwkbp"
Jul 09 00:59:40.893640 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.893543    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed6bd9ee-f8df-42e5-996a-a3afa712908c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fwkbp\" (UID: \"ed6bd9ee-f8df-42e5-996a-a3afa712908c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fwkbp"
Jul 09 00:59:40.893640 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.893594    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed6bd9ee-f8df-42e5-996a-a3afa712908c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fwkbp\" (UID: \"ed6bd9ee-f8df-42e5-996a-a3afa712908c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fwkbp"
Jul 09 00:59:40.893867 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.893693    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed6bd9ee-f8df-42e5-996a-a3afa712908c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fwkbp\" (UID: \"ed6bd9ee-f8df-42e5-996a-a3afa712908c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fwkbp"
Jul 09 00:59:40.893867 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.893734    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed6bd9ee-f8df-42e5-996a-a3afa712908c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fwkbp\" (UID: \"ed6bd9ee-f8df-42e5-996a-a3afa712908c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fwkbp"
Jul 09 00:59:40.893867 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.893752    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed6bd9ee-f8df-42e5-996a-a3afa712908c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fwkbp\" (UID: \"ed6bd9ee-f8df-42e5-996a-a3afa712908c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fwkbp"
Jul 09 00:59:40.893867 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.893819    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed6bd9ee-f8df-42e5-996a-a3afa712908c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fwkbp\" (UID: \"ed6bd9ee-f8df-42e5-996a-a3afa712908c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fwkbp"
Jul 09 00:59:40.893867 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.893844    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed6bd9ee-f8df-42e5-996a-a3afa712908c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fwkbp\" (UID: \"ed6bd9ee-f8df-42e5-996a-a3afa712908c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fwkbp"
Jul 09 00:59:40.894134 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.893892    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhw86\" (UniqueName: \"kubernetes.io/projected/ed6bd9ee-f8df-42e5-996a-a3afa712908c-kube-api-access-fhw86\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fwkbp\" (UID: \"ed6bd9ee-f8df-42e5-996a-a3afa712908c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fwkbp"
Jul 09 00:59:40.894134 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.893929    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed6bd9ee-f8df-42e5-996a-a3afa712908c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fwkbp\" (UID: \"ed6bd9ee-f8df-42e5-996a-a3afa712908c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fwkbp"
Jul 09 00:59:40.894134 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.894028    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed6bd9ee-f8df-42e5-996a-a3afa712908c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fwkbp\" (UID: \"ed6bd9ee-f8df-42e5-996a-a3afa712908c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fwkbp"
Jul 09 00:59:40.894134 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.894119    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed6bd9ee-f8df-42e5-996a-a3afa712908c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fwkbp\" (UID: \"ed6bd9ee-f8df-42e5-996a-a3afa712908c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fwkbp"
Jul 09 00:59:40.894357 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.894268    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed6bd9ee-f8df-42e5-996a-a3afa712908c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fwkbp\" (UID: \"ed6bd9ee-f8df-42e5-996a-a3afa712908c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fwkbp"
Jul 09 00:59:40.894589 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.894563    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed6bd9ee-f8df-42e5-996a-a3afa712908c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fwkbp\" (UID: \"ed6bd9ee-f8df-42e5-996a-a3afa712908c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fwkbp"
Jul 09 00:59:40.894734 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.894613    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed6bd9ee-f8df-42e5-996a-a3afa712908c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fwkbp\" (UID: \"ed6bd9ee-f8df-42e5-996a-a3afa712908c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fwkbp"
Jul 09 00:59:40.896840 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.896812    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed6bd9ee-f8df-42e5-996a-a3afa712908c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fwkbp\" (UID: \"ed6bd9ee-f8df-42e5-996a-a3afa712908c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fwkbp"
Jul 09 00:59:40.896985 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.896966    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed6bd9ee-f8df-42e5-996a-a3afa712908c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fwkbp\" (UID: \"ed6bd9ee-f8df-42e5-996a-a3afa712908c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fwkbp"
Jul 09 00:59:40.901457 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.901432    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed6bd9ee-f8df-42e5-996a-a3afa712908c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fwkbp\" (UID: \"ed6bd9ee-f8df-42e5-996a-a3afa712908c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fwkbp"
Jul 09 00:59:40.901995 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.901977    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhw86\" (UniqueName: \"kubernetes.io/projected/ed6bd9ee-f8df-42e5-996a-a3afa712908c-kube-api-access-fhw86\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fwkbp\" (UID: \"ed6bd9ee-f8df-42e5-996a-a3afa712908c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fwkbp"
Jul 09 00:59:40.999565 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:40.999520    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fwkbp"
Jul 09 00:59:41.137089 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:41.137047    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fwkbp"]
Jul 09 00:59:41.143411 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:59:41.143328    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded6bd9ee_f8df_42e5_996a_a3afa712908c.slice/crio-8e1d1a3c26c7389e2cbc5e72ed25b7f4d677a94f6c250e296dfc45d6cf3c328f WatchSource:0}: Error finding container 8e1d1a3c26c7389e2cbc5e72ed25b7f4d677a94f6c250e296dfc45d6cf3c328f: Status 404 returned error can't find the container with id 8e1d1a3c26c7389e2cbc5e72ed25b7f4d677a94f6c250e296dfc45d6cf3c328f
Jul 09 00:59:41.343525 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:41.343485    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fwkbp" event={"ID":"ed6bd9ee-f8df-42e5-996a-a3afa712908c","Type":"ContainerStarted","Data":"8e1d1a3c26c7389e2cbc5e72ed25b7f4d677a94f6c250e296dfc45d6cf3c328f"}
Jul 09 00:59:41.344732 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:41.344692    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-6bnl4" event={"ID":"ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975","Type":"ContainerStarted","Data":"62cf260e23d8cccacc3040992238daa03fb2ac17140f8003265e6847fa20ad3d"}
Jul 09 00:59:42.170743 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:42.170703    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-q59pq"]
Jul 09 00:59:42.189366 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:42.189334    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-q59pq"
Jul 09 00:59:42.190130 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:42.190100    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-54976"]
Jul 09 00:59:42.197690 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:42.193317    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-92fsl\""
Jul 09 00:59:42.197690 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:42.193553    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 09 00:59:42.201632 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:42.201607    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-q59pq"]
Jul 09 00:59:42.201828 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:42.201810    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-54976"]
Jul 09 00:59:42.202033 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:42.202016    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-54976"
Jul 09 00:59:42.207043 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:42.207024    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 09 00:59:42.207669 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:42.207484    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-mzzr6\""
Jul 09 00:59:42.310199 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:42.310059    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/076ac464-8772-4d50-b7bd-36ec5a6dae57-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-54976\" (UID: \"076ac464-8772-4d50-b7bd-36ec5a6dae57\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-54976"
Jul 09 00:59:42.310199 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:42.310110    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77vlj\" (UniqueName: \"kubernetes.io/projected/076ac464-8772-4d50-b7bd-36ec5a6dae57-kube-api-access-77vlj\") pod \"llmisvc-controller-manager-777c6bd7d5-54976\" (UID: \"076ac464-8772-4d50-b7bd-36ec5a6dae57\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-54976"
Jul 09 00:59:42.310454 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:42.310281    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ndb7\" (UniqueName: \"kubernetes.io/projected/75807a4c-1321-4666-9f1d-7de6dc9b3e35-kube-api-access-7ndb7\") pod \"kserve-controller-manager-d6f4b65b8-q59pq\" (UID: \"75807a4c-1321-4666-9f1d-7de6dc9b3e35\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-q59pq"
Jul 09 00:59:42.310454 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:42.310346    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75807a4c-1321-4666-9f1d-7de6dc9b3e35-cert\") pod \"kserve-controller-manager-d6f4b65b8-q59pq\" (UID: \"75807a4c-1321-4666-9f1d-7de6dc9b3e35\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-q59pq"
Jul 09 00:59:42.411050 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:42.411001    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/076ac464-8772-4d50-b7bd-36ec5a6dae57-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-54976\" (UID: \"076ac464-8772-4d50-b7bd-36ec5a6dae57\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-54976"
Jul 09 00:59:42.411050 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:42.411052    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77vlj\" (UniqueName: \"kubernetes.io/projected/076ac464-8772-4d50-b7bd-36ec5a6dae57-kube-api-access-77vlj\") pod \"llmisvc-controller-manager-777c6bd7d5-54976\" (UID: \"076ac464-8772-4d50-b7bd-36ec5a6dae57\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-54976"
Jul 09 00:59:42.411590 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:42.411142    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ndb7\" (UniqueName: \"kubernetes.io/projected/75807a4c-1321-4666-9f1d-7de6dc9b3e35-kube-api-access-7ndb7\") pod \"kserve-controller-manager-d6f4b65b8-q59pq\" (UID: \"75807a4c-1321-4666-9f1d-7de6dc9b3e35\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-q59pq"
Jul 09 00:59:42.411590 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:42.411175    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75807a4c-1321-4666-9f1d-7de6dc9b3e35-cert\") pod \"kserve-controller-manager-d6f4b65b8-q59pq\" (UID: \"75807a4c-1321-4666-9f1d-7de6dc9b3e35\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-q59pq"
Jul 09 00:59:42.411590 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:59:42.411352    2557 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 09 00:59:42.411590 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:59:42.411419    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75807a4c-1321-4666-9f1d-7de6dc9b3e35-cert podName:75807a4c-1321-4666-9f1d-7de6dc9b3e35 nodeName:}" failed. No retries permitted until 2026-07-09 00:59:42.911396374 +0000 UTC m=+290.381539084 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/75807a4c-1321-4666-9f1d-7de6dc9b3e35-cert") pod "kserve-controller-manager-d6f4b65b8-q59pq" (UID: "75807a4c-1321-4666-9f1d-7de6dc9b3e35") : secret "kserve-webhook-server-cert" not found
Jul 09 00:59:42.411851 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:59:42.411687    2557 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 09 00:59:42.411851 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:59:42.411744    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/076ac464-8772-4d50-b7bd-36ec5a6dae57-cert podName:076ac464-8772-4d50-b7bd-36ec5a6dae57 nodeName:}" failed. No retries permitted until 2026-07-09 00:59:42.911726786 +0000 UTC m=+290.381869508 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/076ac464-8772-4d50-b7bd-36ec5a6dae57-cert") pod "llmisvc-controller-manager-777c6bd7d5-54976" (UID: "076ac464-8772-4d50-b7bd-36ec5a6dae57") : secret "llmisvc-webhook-server-cert" not found
Jul 09 00:59:42.430992 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:42.430513    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77vlj\" (UniqueName: \"kubernetes.io/projected/076ac464-8772-4d50-b7bd-36ec5a6dae57-kube-api-access-77vlj\") pod \"llmisvc-controller-manager-777c6bd7d5-54976\" (UID: \"076ac464-8772-4d50-b7bd-36ec5a6dae57\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-54976"
Jul 09 00:59:42.434778 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:42.434744    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ndb7\" (UniqueName: \"kubernetes.io/projected/75807a4c-1321-4666-9f1d-7de6dc9b3e35-kube-api-access-7ndb7\") pod \"kserve-controller-manager-d6f4b65b8-q59pq\" (UID: \"75807a4c-1321-4666-9f1d-7de6dc9b3e35\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-q59pq"
Jul 09 00:59:42.588614 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:42.588577    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-75764c764c-ktwd5"]
Jul 09 00:59:42.592247 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:42.592223    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-75764c764c-ktwd5"
Jul 09 00:59:42.596522 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:42.595508    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 09 00:59:42.596522 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:42.595772    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-p2cdx\""
Jul 09 00:59:42.596522 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:42.596159    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 09 00:59:42.596522 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:42.596196    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 09 00:59:42.596822 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:42.596637    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 09 00:59:42.597054 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:42.596913    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 09 00:59:42.603591 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:42.603553    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-75764c764c-ktwd5"]
Jul 09 00:59:42.714660 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:42.714339    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/35951e9e-1cba-45f4-917c-e8283cc5332a-metrics-cert\") pod \"lws-controller-manager-75764c764c-ktwd5\" (UID: \"35951e9e-1cba-45f4-917c-e8283cc5332a\") " pod="openshift-lws-operator/lws-controller-manager-75764c764c-ktwd5"
Jul 09 00:59:42.714660 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:42.714395    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/35951e9e-1cba-45f4-917c-e8283cc5332a-cert\") pod \"lws-controller-manager-75764c764c-ktwd5\" (UID: \"35951e9e-1cba-45f4-917c-e8283cc5332a\") " pod="openshift-lws-operator/lws-controller-manager-75764c764c-ktwd5"
Jul 09 00:59:42.714660 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:42.714504    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/35951e9e-1cba-45f4-917c-e8283cc5332a-manager-config\") pod \"lws-controller-manager-75764c764c-ktwd5\" (UID: \"35951e9e-1cba-45f4-917c-e8283cc5332a\") " pod="openshift-lws-operator/lws-controller-manager-75764c764c-ktwd5"
Jul 09 00:59:42.714660 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:42.714574    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wglv6\" (UniqueName: \"kubernetes.io/projected/35951e9e-1cba-45f4-917c-e8283cc5332a-kube-api-access-wglv6\") pod \"lws-controller-manager-75764c764c-ktwd5\" (UID: \"35951e9e-1cba-45f4-917c-e8283cc5332a\") " pod="openshift-lws-operator/lws-controller-manager-75764c764c-ktwd5"
Jul 09 00:59:42.815762 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:42.815719    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/35951e9e-1cba-45f4-917c-e8283cc5332a-manager-config\") pod \"lws-controller-manager-75764c764c-ktwd5\" (UID: \"35951e9e-1cba-45f4-917c-e8283cc5332a\") " pod="openshift-lws-operator/lws-controller-manager-75764c764c-ktwd5"
Jul 09 00:59:42.816003 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:42.815812    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wglv6\" (UniqueName: \"kubernetes.io/projected/35951e9e-1cba-45f4-917c-e8283cc5332a-kube-api-access-wglv6\") pod \"lws-controller-manager-75764c764c-ktwd5\" (UID: \"35951e9e-1cba-45f4-917c-e8283cc5332a\") " pod="openshift-lws-operator/lws-controller-manager-75764c764c-ktwd5"
Jul 09 00:59:42.816003 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:42.815851    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/35951e9e-1cba-45f4-917c-e8283cc5332a-metrics-cert\") pod \"lws-controller-manager-75764c764c-ktwd5\" (UID: \"35951e9e-1cba-45f4-917c-e8283cc5332a\") " pod="openshift-lws-operator/lws-controller-manager-75764c764c-ktwd5"
Jul 09 00:59:42.816003 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:42.815880    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/35951e9e-1cba-45f4-917c-e8283cc5332a-cert\") pod \"lws-controller-manager-75764c764c-ktwd5\" (UID: \"35951e9e-1cba-45f4-917c-e8283cc5332a\") " pod="openshift-lws-operator/lws-controller-manager-75764c764c-ktwd5"
Jul 09 00:59:42.816633 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:42.816594    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/35951e9e-1cba-45f4-917c-e8283cc5332a-manager-config\") pod \"lws-controller-manager-75764c764c-ktwd5\" (UID: \"35951e9e-1cba-45f4-917c-e8283cc5332a\") " pod="openshift-lws-operator/lws-controller-manager-75764c764c-ktwd5"
Jul 09 00:59:42.819285 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:42.819252    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/35951e9e-1cba-45f4-917c-e8283cc5332a-metrics-cert\") pod \"lws-controller-manager-75764c764c-ktwd5\" (UID: \"35951e9e-1cba-45f4-917c-e8283cc5332a\") " pod="openshift-lws-operator/lws-controller-manager-75764c764c-ktwd5"
Jul 09 00:59:42.819390 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:42.819336    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/35951e9e-1cba-45f4-917c-e8283cc5332a-cert\") pod \"lws-controller-manager-75764c764c-ktwd5\" (UID: \"35951e9e-1cba-45f4-917c-e8283cc5332a\") " pod="openshift-lws-operator/lws-controller-manager-75764c764c-ktwd5"
Jul 09 00:59:42.825694 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:42.825666    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wglv6\" (UniqueName: \"kubernetes.io/projected/35951e9e-1cba-45f4-917c-e8283cc5332a-kube-api-access-wglv6\") pod \"lws-controller-manager-75764c764c-ktwd5\" (UID: \"35951e9e-1cba-45f4-917c-e8283cc5332a\") " pod="openshift-lws-operator/lws-controller-manager-75764c764c-ktwd5"
Jul 09 00:59:42.908178 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:42.908139    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-75764c764c-ktwd5"
Jul 09 00:59:42.917489 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:42.916939    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75807a4c-1321-4666-9f1d-7de6dc9b3e35-cert\") pod \"kserve-controller-manager-d6f4b65b8-q59pq\" (UID: \"75807a4c-1321-4666-9f1d-7de6dc9b3e35\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-q59pq"
Jul 09 00:59:42.917489 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:42.917045    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/076ac464-8772-4d50-b7bd-36ec5a6dae57-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-54976\" (UID: \"076ac464-8772-4d50-b7bd-36ec5a6dae57\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-54976"
Jul 09 00:59:42.921730 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:42.921690    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/076ac464-8772-4d50-b7bd-36ec5a6dae57-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-54976\" (UID: \"076ac464-8772-4d50-b7bd-36ec5a6dae57\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-54976"
Jul 09 00:59:42.923279 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:42.923251    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75807a4c-1321-4666-9f1d-7de6dc9b3e35-cert\") pod \"kserve-controller-manager-d6f4b65b8-q59pq\" (UID: \"75807a4c-1321-4666-9f1d-7de6dc9b3e35\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-q59pq"
Jul 09 00:59:43.085329 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:43.085172    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-75764c764c-ktwd5"]
Jul 09 00:59:43.125907 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:43.125872    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-q59pq"
Jul 09 00:59:43.139349 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:43.139313    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-54976"
Jul 09 00:59:44.112524 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:59:44.112478    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35951e9e_1cba_45f4_917c_e8283cc5332a.slice/crio-bb548a750e24e6a013dd54d144f166dfbf7c8e00426f1fc8fd903d97966c0104 WatchSource:0}: Error finding container bb548a750e24e6a013dd54d144f166dfbf7c8e00426f1fc8fd903d97966c0104: Status 404 returned error can't find the container with id bb548a750e24e6a013dd54d144f166dfbf7c8e00426f1fc8fd903d97966c0104
Jul 09 00:59:44.221286 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:44.221142    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 00:59:44.221441 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:44.221318    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 00:59:44.221441 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:44.221374    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 00:59:44.231229 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:44.230238    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 00:59:44.231229 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:44.230325    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 00:59:44.231229 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:44.230376    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 00:59:44.286811 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:44.286787    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-q59pq"]
Jul 09 00:59:44.289593 ip-10-0-133-31 kubenswrapper[2557]: W0709 00:59:44.289565    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75807a4c_1321_4666_9f1d_7de6dc9b3e35.slice/crio-83bf8e5606db77715daecd91a0f97214e2607c143d78b958ddf7ef48bac03628 WatchSource:0}: Error finding container 83bf8e5606db77715daecd91a0f97214e2607c143d78b958ddf7ef48bac03628: Status 404 returned error can't find the container with id 83bf8e5606db77715daecd91a0f97214e2607c143d78b958ddf7ef48bac03628
Jul 09 00:59:44.293528 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:44.293502    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-54976"]
Jul 09 00:59:44.364719 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:44.364597    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-75764c764c-ktwd5" event={"ID":"35951e9e-1cba-45f4-917c-e8283cc5332a","Type":"ContainerStarted","Data":"bb548a750e24e6a013dd54d144f166dfbf7c8e00426f1fc8fd903d97966c0104"}
Jul 09 00:59:44.368136 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:44.367878    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-6bnl4" event={"ID":"ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975","Type":"ContainerStarted","Data":"d06177e5b3f7dd431526ca69e3e1392c0a27556cd6b506546e750d3c34913260"}
Jul 09 00:59:44.369991 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:44.369934    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-54976" event={"ID":"076ac464-8772-4d50-b7bd-36ec5a6dae57","Type":"ContainerStarted","Data":"a1770d322b9d503618a8e309e021ca3aa016e01e78f5454bfcdb32684ffc5e3e"}
Jul 09 00:59:44.372632 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:44.372595    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fwkbp" event={"ID":"ed6bd9ee-f8df-42e5-996a-a3afa712908c","Type":"ContainerStarted","Data":"2ffb0150d3011e239b663dd6538a0f94464a610c245ba099b4f87fe77adf0de1"}
Jul 09 00:59:44.375920 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:44.375893    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-q59pq" event={"ID":"75807a4c-1321-4666-9f1d-7de6dc9b3e35","Type":"ContainerStarted","Data":"83bf8e5606db77715daecd91a0f97214e2607c143d78b958ddf7ef48bac03628"}
Jul 09 00:59:44.412202 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:44.412115    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-6bnl4" podStartSLOduration=0.980035608 podStartE2EDuration="4.412092817s" totalImagesPullingTime="3.432057209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 00:59:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:59:44.41039004 +0000 UTC m=+291.880532771" watchObservedRunningTime="2026-07-09 00:59:44.412092817 +0000 UTC m=+291.882235551"
Jul 09 00:59:44.445241 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:44.445160    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fwkbp" podStartSLOduration=1.360253872 podStartE2EDuration="4.445139663s" totalImagesPullingTime="3.084885791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 00:59:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:59:44.443468652 +0000 UTC m=+291.913611393" watchObservedRunningTime="2026-07-09 00:59:44.445139663 +0000 UTC m=+291.915282394"
Jul 09 00:59:44.614234 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:44.614184    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-6bnl4"
Jul 09 00:59:45.000690 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:45.000636    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fwkbp"
Jul 09 00:59:45.007456 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:45.007421    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fwkbp"
Jul 09 00:59:45.382874 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:45.382748    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fwkbp"
Jul 09 00:59:45.384632 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:45.384418    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fwkbp"
Jul 09 00:59:45.439253 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:45.439177    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-6bnl4"]
Jul 09 00:59:45.615975 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:45.615936    2557 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-548557588-6bnl4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused" start-of-body=
Jul 09 00:59:45.616147 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:45.616017    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-6bnl4" podUID="ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused"
Jul 09 00:59:46.614519 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:46.614483    2557 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-548557588-6bnl4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused" start-of-body=
Jul 09 00:59:46.615088 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:46.614542    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-6bnl4" podUID="ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused"
Jul 09 00:59:47.398100 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:47.398057    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-6bnl4" podUID="ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975" containerName="istio-proxy" containerID="cri-o://d06177e5b3f7dd431526ca69e3e1392c0a27556cd6b506546e750d3c34913260" gracePeriod=30
Jul 09 00:59:48.403959 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:48.403857    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-q59pq" event={"ID":"75807a4c-1321-4666-9f1d-7de6dc9b3e35","Type":"ContainerStarted","Data":"5e8cc2f993f9a426c517be72d26c808d0d0ae2063e6ce739f93eb5b624ae5410"}
Jul 09 00:59:48.404421 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:48.403957    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-q59pq"
Jul 09 00:59:48.405529 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:48.405507    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-75764c764c-ktwd5" event={"ID":"35951e9e-1cba-45f4-917c-e8283cc5332a","Type":"ContainerStarted","Data":"4a14f3f1bfccef4dc0d6a48bdf9d8a3350384604e484738b03b415f1a4ffbf73"}
Jul 09 00:59:48.405605 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:48.405570    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-75764c764c-ktwd5"
Jul 09 00:59:48.407012 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:48.406989    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-54976" event={"ID":"076ac464-8772-4d50-b7bd-36ec5a6dae57","Type":"ContainerStarted","Data":"9a5abae2fcf708719e740698ab9b284c4e5889b2b5a48ab05af3a5102284b99d"}
Jul 09 00:59:48.407128 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:48.407113    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-54976"
Jul 09 00:59:48.422612 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:48.422555    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-q59pq" podStartSLOduration=2.602384118 podStartE2EDuration="6.422537399s" totalImagesPullingTime="3.820153281s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 00:59:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:59:48.419928128 +0000 UTC m=+295.890070857" watchObservedRunningTime="2026-07-09 00:59:48.422537399 +0000 UTC m=+295.892680129"
Jul 09 00:59:48.438638 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:48.438591    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-75764c764c-ktwd5" podStartSLOduration=2.431273459 podStartE2EDuration="6.438577802s" totalImagesPullingTime="4.007304343s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 00:59:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:59:48.437996461 +0000 UTC m=+295.908139191" watchObservedRunningTime="2026-07-09 00:59:48.438577802 +0000 UTC m=+295.908720528"
Jul 09 00:59:48.452815 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:48.452770    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-54976" podStartSLOduration=2.608105669 podStartE2EDuration="6.452755462s" totalImagesPullingTime="3.844649793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 00:59:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:59:48.452342476 +0000 UTC m=+295.922485217" watchObservedRunningTime="2026-07-09 00:59:48.452755462 +0000 UTC m=+295.922898190"
Jul 09 00:59:52.643365 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:52.643340    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-6bnl4"
Jul 09 00:59:52.818136 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:52.818097    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-istio-podinfo\") pod \"ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975\" (UID: \"ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975\") "
Jul 09 00:59:52.818342 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:52.818151    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-istio-data\") pod \"ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975\" (UID: \"ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975\") "
Jul 09 00:59:52.818342 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:52.818178    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-istio-token\") pod \"ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975\" (UID: \"ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975\") "
Jul 09 00:59:52.818342 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:52.818258    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-credential-socket\") pod \"ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975\" (UID: \"ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975\") "
Jul 09 00:59:52.818342 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:52.818287    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gp42r\" (UniqueName: \"kubernetes.io/projected/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-kube-api-access-gp42r\") pod \"ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975\" (UID: \"ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975\") "
Jul 09 00:59:52.818541 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:52.818357    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-workload-socket\") pod \"ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975\" (UID: \"ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975\") "
Jul 09 00:59:52.818541 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:52.818388    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-workload-certs\") pod \"ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975\" (UID: \"ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975\") "
Jul 09 00:59:52.818541 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:52.818499    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-istio-data" (OuterVolumeSpecName: "istio-data") pod "ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975" (UID: "ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 00:59:52.818694 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:52.818564    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975" (UID: "ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 00:59:52.818694 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:52.818622    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975" (UID: "ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 00:59:52.818694 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:52.818665    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975" (UID: "ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 00:59:52.818694 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:52.818428    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-istio-envoy\") pod \"ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975\" (UID: \"ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975\") "
Jul 09 00:59:52.818865 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:52.818751    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-istiod-ca-cert\") pod \"ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975\" (UID: \"ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975\") "
Jul 09 00:59:52.819087 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:52.819067    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-istio-data\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 00:59:52.819154 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:52.819094    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-credential-socket\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 00:59:52.819154 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:52.819095    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975" (UID: "ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 00:59:52.819154 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:52.819111    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-workload-socket\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 00:59:52.819154 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:52.819127    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-workload-certs\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 00:59:52.820602 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:52.820576    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975" (UID: "ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 00:59:52.820688 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:52.820593    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975" (UID: "ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 00:59:52.820850 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:52.820827    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-kube-api-access-gp42r" (OuterVolumeSpecName: "kube-api-access-gp42r") pod "ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975" (UID: "ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975"). InnerVolumeSpecName "kube-api-access-gp42r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 00:59:52.820909 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:52.820855    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-istio-token" (OuterVolumeSpecName: "istio-token") pod "ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975" (UID: "ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 00:59:52.920165 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:52.920128    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-istio-podinfo\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 00:59:52.920165 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:52.920158    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-istio-token\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 00:59:52.920165 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:52.920167    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gp42r\" (UniqueName: \"kubernetes.io/projected/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-kube-api-access-gp42r\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 00:59:52.920415 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:52.920176    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-istio-envoy\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 00:59:52.920415 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:52.920185    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975-istiod-ca-cert\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 00:59:52.972852 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:52.972806    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z6kj2_7dc12511-b804-4ebc-8646-4d070d93a8cf/console-operator/1.log"
Jul 09 00:59:52.982196 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:52.982164    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z6kj2_7dc12511-b804-4ebc-8646-4d070d93a8cf/console-operator/1.log"
Jul 09 00:59:52.988967 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:52.988940    2557 kubelet.go:1648] "Image garbage collection succeeded"
Jul 09 00:59:53.431375 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:53.431332    2557 generic.go:356] "Generic (PLEG): container finished" podID="ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975" containerID="d06177e5b3f7dd431526ca69e3e1392c0a27556cd6b506546e750d3c34913260" exitCode=0
Jul 09 00:59:53.433720 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:53.431394    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-6bnl4"
Jul 09 00:59:53.433720 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:53.431419    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-6bnl4" event={"ID":"ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975","Type":"ContainerDied","Data":"d06177e5b3f7dd431526ca69e3e1392c0a27556cd6b506546e750d3c34913260"}
Jul 09 00:59:53.433720 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:53.431488    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-6bnl4" event={"ID":"ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975","Type":"ContainerDied","Data":"62cf260e23d8cccacc3040992238daa03fb2ac17140f8003265e6847fa20ad3d"}
Jul 09 00:59:53.433720 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:53.431520    2557 scope.go:117] "RemoveContainer" containerID="d06177e5b3f7dd431526ca69e3e1392c0a27556cd6b506546e750d3c34913260"
Jul 09 00:59:53.440178 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:53.440163    2557 scope.go:117] "RemoveContainer" containerID="d06177e5b3f7dd431526ca69e3e1392c0a27556cd6b506546e750d3c34913260"
Jul 09 00:59:53.440477 ip-10-0-133-31 kubenswrapper[2557]: E0709 00:59:53.440454    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d06177e5b3f7dd431526ca69e3e1392c0a27556cd6b506546e750d3c34913260\": container with ID starting with d06177e5b3f7dd431526ca69e3e1392c0a27556cd6b506546e750d3c34913260 not found: ID does not exist" containerID="d06177e5b3f7dd431526ca69e3e1392c0a27556cd6b506546e750d3c34913260"
Jul 09 00:59:53.440569 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:53.440485    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d06177e5b3f7dd431526ca69e3e1392c0a27556cd6b506546e750d3c34913260"} err="failed to get container status \"d06177e5b3f7dd431526ca69e3e1392c0a27556cd6b506546e750d3c34913260\": rpc error: code = NotFound desc = could not find container \"d06177e5b3f7dd431526ca69e3e1392c0a27556cd6b506546e750d3c34913260\": container with ID starting with d06177e5b3f7dd431526ca69e3e1392c0a27556cd6b506546e750d3c34913260 not found: ID does not exist"
Jul 09 00:59:53.448017 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:53.447993    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-6bnl4"]
Jul 09 00:59:53.451338 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:53.451314    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-6bnl4"]
Jul 09 00:59:55.038891 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:55.038856    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975" path="/var/lib/kubelet/pods/ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975/volumes"
Jul 09 00:59:59.414806 ip-10-0-133-31 kubenswrapper[2557]: I0709 00:59:59.414775    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-75764c764c-ktwd5"
Jul 09 01:00:19.413871 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:00:19.413840    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-54976"
Jul 09 01:00:19.416938 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:00:19.416913    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-q59pq"
Jul 09 01:02:33.078977 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:02:33.078897    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:02:33.079413 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:02:33.079251    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975" containerName="istio-proxy"
Jul 09 01:02:33.079413 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:02:33.079266    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975" containerName="istio-proxy"
Jul 09 01:02:33.079413 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:02:33.079340    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecfdeda4-6ed1-4c40-a3e5-ba9aaeb66975" containerName="istio-proxy"
Jul 09 01:02:33.082405 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:02:33.082384    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"
Jul 09 01:02:33.084645 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:02:33.084621    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 09 01:02:33.085530 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:02:33.085507    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6z7x6\""
Jul 09 01:02:33.085669 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:02:33.085536    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 09 01:02:33.085669 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:02:33.085570    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 09 01:02:33.088668 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:02:33.088649    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:02:33.128499 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:02:33.128464    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:02:33.172533 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:02:33.172494    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/90f670f5-0445-4f0f-9d1b-cd89035c5cf4-config-file\") pod \"limitador-limitador-54d6d988d5-7vvbf\" (UID: \"90f670f5-0445-4f0f-9d1b-cd89035c5cf4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"
Jul 09 01:02:33.172707 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:02:33.172541    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltkqr\" (UniqueName: \"kubernetes.io/projected/90f670f5-0445-4f0f-9d1b-cd89035c5cf4-kube-api-access-ltkqr\") pod \"limitador-limitador-54d6d988d5-7vvbf\" (UID: \"90f670f5-0445-4f0f-9d1b-cd89035c5cf4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"
Jul 09 01:02:33.273610 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:02:33.273573    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/90f670f5-0445-4f0f-9d1b-cd89035c5cf4-config-file\") pod \"limitador-limitador-54d6d988d5-7vvbf\" (UID: \"90f670f5-0445-4f0f-9d1b-cd89035c5cf4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"
Jul 09 01:02:33.273779 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:02:33.273617    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltkqr\" (UniqueName: \"kubernetes.io/projected/90f670f5-0445-4f0f-9d1b-cd89035c5cf4-kube-api-access-ltkqr\") pod \"limitador-limitador-54d6d988d5-7vvbf\" (UID: \"90f670f5-0445-4f0f-9d1b-cd89035c5cf4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"
Jul 09 01:02:33.274254 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:02:33.274198    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/90f670f5-0445-4f0f-9d1b-cd89035c5cf4-config-file\") pod \"limitador-limitador-54d6d988d5-7vvbf\" (UID: \"90f670f5-0445-4f0f-9d1b-cd89035c5cf4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"
Jul 09 01:02:33.281377 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:02:33.281341    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltkqr\" (UniqueName: \"kubernetes.io/projected/90f670f5-0445-4f0f-9d1b-cd89035c5cf4-kube-api-access-ltkqr\") pod \"limitador-limitador-54d6d988d5-7vvbf\" (UID: \"90f670f5-0445-4f0f-9d1b-cd89035c5cf4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"
Jul 09 01:02:33.393084 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:02:33.392991    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"
Jul 09 01:02:33.525908 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:02:33.525885    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:02:33.528386 ip-10-0-133-31 kubenswrapper[2557]: W0709 01:02:33.528347    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90f670f5_0445_4f0f_9d1b_cd89035c5cf4.slice/crio-dfb331b0900b20bde4e428d5ca883f249e17a3a1da7c9f012dbd973eb8160764 WatchSource:0}: Error finding container dfb331b0900b20bde4e428d5ca883f249e17a3a1da7c9f012dbd973eb8160764: Status 404 returned error can't find the container with id dfb331b0900b20bde4e428d5ca883f249e17a3a1da7c9f012dbd973eb8160764
Jul 09 01:02:33.530306 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:02:33.530283    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 01:02:34.132127 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:02:34.132049    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-7vvbf" event={"ID":"90f670f5-0445-4f0f-9d1b-cd89035c5cf4","Type":"ContainerStarted","Data":"dfb331b0900b20bde4e428d5ca883f249e17a3a1da7c9f012dbd973eb8160764"}
Jul 09 01:02:37.147104 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:02:37.147067    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-7vvbf" event={"ID":"90f670f5-0445-4f0f-9d1b-cd89035c5cf4","Type":"ContainerStarted","Data":"7473098890e032e9a740c494f9c02151862afee35d148a9d473fd0aa9c26eef9"}
Jul 09 01:02:37.147530 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:02:37.147319    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"
Jul 09 01:02:37.164129 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:02:37.164077    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-7vvbf" podStartSLOduration=1.599608353 podStartE2EDuration="4.164065176s" totalImagesPullingTime="2.564456823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:02:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:02:37.161605114 +0000 UTC m=+464.631747843" watchObservedRunningTime="2026-07-09 01:02:37.164065176 +0000 UTC m=+464.634207904"
Jul 09 01:02:48.153373 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:02:48.153338    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"
Jul 09 01:03:48.090030 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:03:48.089946    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:04:09.755346 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:09.755309    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:04:16.088467 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:16.088428    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:04:30.229300 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:30.229263    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-2hj68"]
Jul 09 01:04:30.232737 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:30.232718    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2hj68"
Jul 09 01:04:30.235840 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:30.235815    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 09 01:04:30.235973 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:30.235820    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 09 01:04:30.235973 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:30.235821    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-zm9xt\""
Jul 09 01:04:30.235973 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:30.235871    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 09 01:04:30.240781 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:30.240759    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-2hj68"]
Jul 09 01:04:30.384794 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:30.384749    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02ed26e3-e491-4411-bc91-4084c44d2e72-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2hj68\" (UID: \"02ed26e3-e491-4411-bc91-4084c44d2e72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2hj68"
Jul 09 01:04:30.384794 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:30.384799    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02ed26e3-e491-4411-bc91-4084c44d2e72-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2hj68\" (UID: \"02ed26e3-e491-4411-bc91-4084c44d2e72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2hj68"
Jul 09 01:04:30.385039 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:30.384818    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02ed26e3-e491-4411-bc91-4084c44d2e72-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2hj68\" (UID: \"02ed26e3-e491-4411-bc91-4084c44d2e72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2hj68"
Jul 09 01:04:30.385039 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:30.384877    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vvhb\" (UniqueName: \"kubernetes.io/projected/02ed26e3-e491-4411-bc91-4084c44d2e72-kube-api-access-5vvhb\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2hj68\" (UID: \"02ed26e3-e491-4411-bc91-4084c44d2e72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2hj68"
Jul 09 01:04:30.385039 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:30.384907    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02ed26e3-e491-4411-bc91-4084c44d2e72-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2hj68\" (UID: \"02ed26e3-e491-4411-bc91-4084c44d2e72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2hj68"
Jul 09 01:04:30.385039 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:30.384954    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02ed26e3-e491-4411-bc91-4084c44d2e72-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2hj68\" (UID: \"02ed26e3-e491-4411-bc91-4084c44d2e72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2hj68"
Jul 09 01:04:30.486050 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:30.485961    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vvhb\" (UniqueName: \"kubernetes.io/projected/02ed26e3-e491-4411-bc91-4084c44d2e72-kube-api-access-5vvhb\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2hj68\" (UID: \"02ed26e3-e491-4411-bc91-4084c44d2e72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2hj68"
Jul 09 01:04:30.486050 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:30.486010    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02ed26e3-e491-4411-bc91-4084c44d2e72-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2hj68\" (UID: \"02ed26e3-e491-4411-bc91-4084c44d2e72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2hj68"
Jul 09 01:04:30.486050 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:30.486037    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02ed26e3-e491-4411-bc91-4084c44d2e72-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2hj68\" (UID: \"02ed26e3-e491-4411-bc91-4084c44d2e72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2hj68"
Jul 09 01:04:30.486373 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:30.486073    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02ed26e3-e491-4411-bc91-4084c44d2e72-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2hj68\" (UID: \"02ed26e3-e491-4411-bc91-4084c44d2e72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2hj68"
Jul 09 01:04:30.486373 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:30.486092    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02ed26e3-e491-4411-bc91-4084c44d2e72-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2hj68\" (UID: \"02ed26e3-e491-4411-bc91-4084c44d2e72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2hj68"
Jul 09 01:04:30.486373 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:30.486108    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02ed26e3-e491-4411-bc91-4084c44d2e72-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2hj68\" (UID: \"02ed26e3-e491-4411-bc91-4084c44d2e72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2hj68"
Jul 09 01:04:30.486590 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:30.486567    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02ed26e3-e491-4411-bc91-4084c44d2e72-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2hj68\" (UID: \"02ed26e3-e491-4411-bc91-4084c44d2e72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2hj68"
Jul 09 01:04:30.486652 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:30.486602    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02ed26e3-e491-4411-bc91-4084c44d2e72-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2hj68\" (UID: \"02ed26e3-e491-4411-bc91-4084c44d2e72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2hj68"
Jul 09 01:04:30.486652 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:30.486625    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02ed26e3-e491-4411-bc91-4084c44d2e72-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2hj68\" (UID: \"02ed26e3-e491-4411-bc91-4084c44d2e72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2hj68"
Jul 09 01:04:30.488390 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:30.488362    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02ed26e3-e491-4411-bc91-4084c44d2e72-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2hj68\" (UID: \"02ed26e3-e491-4411-bc91-4084c44d2e72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2hj68"
Jul 09 01:04:30.488601 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:30.488583    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02ed26e3-e491-4411-bc91-4084c44d2e72-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2hj68\" (UID: \"02ed26e3-e491-4411-bc91-4084c44d2e72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2hj68"
Jul 09 01:04:30.493275 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:30.493255    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vvhb\" (UniqueName: \"kubernetes.io/projected/02ed26e3-e491-4411-bc91-4084c44d2e72-kube-api-access-5vvhb\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2hj68\" (UID: \"02ed26e3-e491-4411-bc91-4084c44d2e72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2hj68"
Jul 09 01:04:30.543754 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:30.543715    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2hj68"
Jul 09 01:04:30.674349 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:30.674322    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-2hj68"]
Jul 09 01:04:30.676297 ip-10-0-133-31 kubenswrapper[2557]: W0709 01:04:30.676268    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02ed26e3_e491_4411_bc91_4084c44d2e72.slice/crio-2ff3bac5643f34f82ae2e4c993762e6a958fafd447c93e35a6e38de42a487fad WatchSource:0}: Error finding container 2ff3bac5643f34f82ae2e4c993762e6a958fafd447c93e35a6e38de42a487fad: Status 404 returned error can't find the container with id 2ff3bac5643f34f82ae2e4c993762e6a958fafd447c93e35a6e38de42a487fad
Jul 09 01:04:31.592995 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:31.592957    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:04:31.652781 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:31.652738    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2hj68" event={"ID":"02ed26e3-e491-4411-bc91-4084c44d2e72","Type":"ContainerStarted","Data":"2ff3bac5643f34f82ae2e4c993762e6a958fafd447c93e35a6e38de42a487fad"}
Jul 09 01:04:32.659011 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:32.658978    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2hj68" event={"ID":"02ed26e3-e491-4411-bc91-4084c44d2e72","Type":"ContainerStarted","Data":"f444c6432096963389467c6a6fde5cdd2808c063227f5a720b689894325f8a17"}
Jul 09 01:04:32.676360 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:32.676308    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2hj68" podStartSLOduration=1.610652295 podStartE2EDuration="2.67629323s" totalImagesPullingTime="1.065640935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:04:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:04:32.674460592 +0000 UTC m=+580.144603321" watchObservedRunningTime="2026-07-09 01:04:32.67629323 +0000 UTC m=+580.146435958"
Jul 09 01:04:40.544403 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:40.544356    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2hj68"
Jul 09 01:04:40.544845 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:40.544441    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2hj68"
Jul 09 01:04:40.557433 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:40.557399    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2hj68"
Jul 09 01:04:40.706269 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:40.706232    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2hj68"
Jul 09 01:04:42.896594 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:42.896553    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:04:44.729176 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:44.729138    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zfnkx"]
Jul 09 01:04:44.732877 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:44.732855    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zfnkx"
Jul 09 01:04:44.734979 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:44.734960    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 09 01:04:44.741140 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:44.741120    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zfnkx"]
Jul 09 01:04:44.806984 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:44.806949    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90f2096f-0b20-4444-8070-a618e1a431da-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zfnkx\" (UID: \"90f2096f-0b20-4444-8070-a618e1a431da\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zfnkx"
Jul 09 01:04:44.807167 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:44.807000    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90f2096f-0b20-4444-8070-a618e1a431da-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zfnkx\" (UID: \"90f2096f-0b20-4444-8070-a618e1a431da\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zfnkx"
Jul 09 01:04:44.807167 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:44.807077    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90f2096f-0b20-4444-8070-a618e1a431da-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zfnkx\" (UID: \"90f2096f-0b20-4444-8070-a618e1a431da\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zfnkx"
Jul 09 01:04:44.807167 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:44.807122    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90f2096f-0b20-4444-8070-a618e1a431da-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zfnkx\" (UID: \"90f2096f-0b20-4444-8070-a618e1a431da\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zfnkx"
Jul 09 01:04:44.807167 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:44.807149    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t27jn\" (UniqueName: \"kubernetes.io/projected/90f2096f-0b20-4444-8070-a618e1a431da-kube-api-access-t27jn\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zfnkx\" (UID: \"90f2096f-0b20-4444-8070-a618e1a431da\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zfnkx"
Jul 09 01:04:44.807362 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:44.807185    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90f2096f-0b20-4444-8070-a618e1a431da-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zfnkx\" (UID: \"90f2096f-0b20-4444-8070-a618e1a431da\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zfnkx"
Jul 09 01:04:44.908639 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:44.908603    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90f2096f-0b20-4444-8070-a618e1a431da-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zfnkx\" (UID: \"90f2096f-0b20-4444-8070-a618e1a431da\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zfnkx"
Jul 09 01:04:44.908837 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:44.908653    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90f2096f-0b20-4444-8070-a618e1a431da-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zfnkx\" (UID: \"90f2096f-0b20-4444-8070-a618e1a431da\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zfnkx"
Jul 09 01:04:44.908837 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:44.908693    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90f2096f-0b20-4444-8070-a618e1a431da-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zfnkx\" (UID: \"90f2096f-0b20-4444-8070-a618e1a431da\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zfnkx"
Jul 09 01:04:44.908837 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:44.908726    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90f2096f-0b20-4444-8070-a618e1a431da-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zfnkx\" (UID: \"90f2096f-0b20-4444-8070-a618e1a431da\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zfnkx"
Jul 09 01:04:44.909006 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:44.908865    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t27jn\" (UniqueName: \"kubernetes.io/projected/90f2096f-0b20-4444-8070-a618e1a431da-kube-api-access-t27jn\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zfnkx\" (UID: \"90f2096f-0b20-4444-8070-a618e1a431da\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zfnkx"
Jul 09 01:04:44.909006 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:44.908909    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90f2096f-0b20-4444-8070-a618e1a431da-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zfnkx\" (UID: \"90f2096f-0b20-4444-8070-a618e1a431da\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zfnkx"
Jul 09 01:04:44.909115 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:44.909054    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90f2096f-0b20-4444-8070-a618e1a431da-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zfnkx\" (UID: \"90f2096f-0b20-4444-8070-a618e1a431da\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zfnkx"
Jul 09 01:04:44.909170 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:44.909127    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90f2096f-0b20-4444-8070-a618e1a431da-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zfnkx\" (UID: \"90f2096f-0b20-4444-8070-a618e1a431da\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zfnkx"
Jul 09 01:04:44.909170 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:44.909160    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90f2096f-0b20-4444-8070-a618e1a431da-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zfnkx\" (UID: \"90f2096f-0b20-4444-8070-a618e1a431da\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zfnkx"
Jul 09 01:04:44.911099 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:44.911066    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90f2096f-0b20-4444-8070-a618e1a431da-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zfnkx\" (UID: \"90f2096f-0b20-4444-8070-a618e1a431da\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zfnkx"
Jul 09 01:04:44.911204 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:44.911101    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90f2096f-0b20-4444-8070-a618e1a431da-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zfnkx\" (UID: \"90f2096f-0b20-4444-8070-a618e1a431da\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zfnkx"
Jul 09 01:04:44.915936 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:44.915914    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t27jn\" (UniqueName: \"kubernetes.io/projected/90f2096f-0b20-4444-8070-a618e1a431da-kube-api-access-t27jn\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zfnkx\" (UID: \"90f2096f-0b20-4444-8070-a618e1a431da\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zfnkx"
Jul 09 01:04:45.043656 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:45.043576    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zfnkx"
Jul 09 01:04:45.176534 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:45.176402    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zfnkx"]
Jul 09 01:04:45.181432 ip-10-0-133-31 kubenswrapper[2557]: W0709 01:04:45.179357    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90f2096f_0b20_4444_8070_a618e1a431da.slice/crio-e89436caac0fc9a187285709e0d2b5e601e86a18bfcb4f7467ec60c87705ec09 WatchSource:0}: Error finding container e89436caac0fc9a187285709e0d2b5e601e86a18bfcb4f7467ec60c87705ec09: Status 404 returned error can't find the container with id e89436caac0fc9a187285709e0d2b5e601e86a18bfcb4f7467ec60c87705ec09
Jul 09 01:04:45.718680 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:45.718639    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zfnkx" event={"ID":"90f2096f-0b20-4444-8070-a618e1a431da","Type":"ContainerStarted","Data":"82a8881a19a4da2c5d37d3f784bd243d2b0b96b425df37bfc77c3588a6c80eb4"}
Jul 09 01:04:45.718860 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:45.718702    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zfnkx" event={"ID":"90f2096f-0b20-4444-8070-a618e1a431da","Type":"ContainerStarted","Data":"e89436caac0fc9a187285709e0d2b5e601e86a18bfcb4f7467ec60c87705ec09"}
Jul 09 01:04:45.735299 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:45.735247    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zfnkx" podStartSLOduration=1.5304996960000001 podStartE2EDuration="1.735228574s" totalImagesPullingTime="204.728878ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:04:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:04:45.733944735 +0000 UTC m=+593.204087474" watchObservedRunningTime="2026-07-09 01:04:45.735228574 +0000 UTC m=+593.205371300"
Jul 09 01:04:51.388256 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:51.388220    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:04:53.006843 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:53.006812    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z6kj2_7dc12511-b804-4ebc-8646-4d070d93a8cf/console-operator/1.log"
Jul 09 01:04:53.011051 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:53.011029    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z6kj2_7dc12511-b804-4ebc-8646-4d070d93a8cf/console-operator/1.log"
Jul 09 01:04:55.044421 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:55.044388    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zfnkx"
Jul 09 01:04:55.046651 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:55.044439    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zfnkx"
Jul 09 01:04:55.056773 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:55.056742    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zfnkx"
Jul 09 01:04:55.771526 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:55.771491    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zfnkx"
Jul 09 01:04:57.492184 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:04:57.492146    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:06:40.307266 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:06:40.307225    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:06:50.389626 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:06:50.389540    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:07:01.491148 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:07:01.491111    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:07:09.990005 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:07:09.989964    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:07:21.193585 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:07:21.193549    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:07:49.293367 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:07:49.293332    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:08:01.687486 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:08:01.687447    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:08:36.895657 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:08:36.895623    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:08:46.394187 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:08:46.394152    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:08:56.891792 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:08:56.891756    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:09:06.593008 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:09:06.592974    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:09:16.389847 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:09:16.389805    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:09:28.588418 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:09:28.588381    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:09:39.189847 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:09:39.189805    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:09:49.900865 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:09:49.900828    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:09:53.035167 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:09:53.035125    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z6kj2_7dc12511-b804-4ebc-8646-4d070d93a8cf/console-operator/1.log"
Jul 09 01:09:53.036179 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:09:53.036154    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z6kj2_7dc12511-b804-4ebc-8646-4d070d93a8cf/console-operator/1.log"
Jul 09 01:10:10.992547 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:10:10.992502    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:10:22.991470 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:10:22.991433    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:10:46.398080 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:10:46.398034    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:10:57.695180 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:10:57.695145    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:11:12.097941 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:11:12.097903    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:11:21.796129 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:11:21.796046    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:11:33.495856 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:11:33.495819    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:11:45.588018 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:11:45.587978    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:13:40.098863 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:13:40.098824    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:13:49.389008 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:13:49.388968    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:14:01.900502 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:14:01.900458    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:14:13.699301 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:14:13.699263    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:14:25.793435 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:14:25.793354    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:14:35.902354 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:14:35.902317    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:14:44.192870 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:14:44.192820    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:14:53.063890 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:14:53.063855    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z6kj2_7dc12511-b804-4ebc-8646-4d070d93a8cf/console-operator/1.log"
Jul 09 01:14:53.066369 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:14:53.066347    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z6kj2_7dc12511-b804-4ebc-8646-4d070d93a8cf/console-operator/1.log"
Jul 09 01:14:55.683905 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:14:55.683870    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:15:06.790202 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:15:06.790159    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:15:15.286966 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:15:15.286928    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:15:29.589562 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:15:29.589528    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:15:50.388804 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:15:50.388597    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:15:57.793441 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:15:57.793403    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:16:08.495605 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:16:08.495571    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:16:21.185986 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:16:21.185954    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:16:37.090076 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:16:37.090039    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:16:46.988144 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:16:46.988105    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:16:56.489819 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:16:56.489782    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:17:05.898773 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:17:05.898729    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:17:17.101655 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:17:17.101570    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:17:27.795183 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:17:27.795145    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:17:40.094787 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:17:40.094733    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:17:55.901851 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:17:55.901814    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:18:10.689265 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:18:10.689199    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:18:23.192462 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:18:23.192429    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:18:39.491838 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:18:39.491798    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:18:51.090786 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:18:51.090693    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:19:02.789189 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:02.789149    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:19:12.295374 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:12.295336    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:19:22.294630 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:22.294589    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:19:34.299604 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:34.299566    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:19:39.694064 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:39.694029    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq"]
Jul 09 01:19:39.698232 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:39.698189    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq"
Jul 09 01:19:39.700562 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:39.700537    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-a486953c-openshift-default-dockercfg-49m2m\""
Jul 09 01:19:39.716977 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:39.716951    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq"]
Jul 09 01:19:39.851580 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:39.851544    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-workload-socket\") pod \"e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq\" (UID: \"03a8e53b-f0fb-4864-b0dd-34a28b99bef1\") " pod="openshift-ingress/e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq"
Jul 09 01:19:39.851580 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:39.851584    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-istio-envoy\") pod \"e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq\" (UID: \"03a8e53b-f0fb-4864-b0dd-34a28b99bef1\") " pod="openshift-ingress/e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq"
Jul 09 01:19:39.851797 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:39.851608    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-istio-token\") pod \"e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq\" (UID: \"03a8e53b-f0fb-4864-b0dd-34a28b99bef1\") " pod="openshift-ingress/e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq"
Jul 09 01:19:39.851797 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:39.851703    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-credential-socket\") pod \"e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq\" (UID: \"03a8e53b-f0fb-4864-b0dd-34a28b99bef1\") " pod="openshift-ingress/e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq"
Jul 09 01:19:39.851797 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:39.851733    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-istio-data\") pod \"e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq\" (UID: \"03a8e53b-f0fb-4864-b0dd-34a28b99bef1\") " pod="openshift-ingress/e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq"
Jul 09 01:19:39.851797 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:39.851755    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-istiod-ca-cert\") pod \"e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq\" (UID: \"03a8e53b-f0fb-4864-b0dd-34a28b99bef1\") " pod="openshift-ingress/e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq"
Jul 09 01:19:39.851797 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:39.851773    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69r65\" (UniqueName: \"kubernetes.io/projected/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-kube-api-access-69r65\") pod \"e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq\" (UID: \"03a8e53b-f0fb-4864-b0dd-34a28b99bef1\") " pod="openshift-ingress/e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq"
Jul 09 01:19:39.851953 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:39.851803    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-workload-certs\") pod \"e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq\" (UID: \"03a8e53b-f0fb-4864-b0dd-34a28b99bef1\") " pod="openshift-ingress/e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq"
Jul 09 01:19:39.851953 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:39.851831    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-istio-podinfo\") pod \"e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq\" (UID: \"03a8e53b-f0fb-4864-b0dd-34a28b99bef1\") " pod="openshift-ingress/e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq"
Jul 09 01:19:39.952956 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:39.952871    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-istiod-ca-cert\") pod \"e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq\" (UID: \"03a8e53b-f0fb-4864-b0dd-34a28b99bef1\") " pod="openshift-ingress/e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq"
Jul 09 01:19:39.952956 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:39.952911    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69r65\" (UniqueName: \"kubernetes.io/projected/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-kube-api-access-69r65\") pod \"e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq\" (UID: \"03a8e53b-f0fb-4864-b0dd-34a28b99bef1\") " pod="openshift-ingress/e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq"
Jul 09 01:19:39.952956 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:39.952932    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-workload-certs\") pod \"e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq\" (UID: \"03a8e53b-f0fb-4864-b0dd-34a28b99bef1\") " pod="openshift-ingress/e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq"
Jul 09 01:19:39.953257 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:39.953003    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-istio-podinfo\") pod \"e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq\" (UID: \"03a8e53b-f0fb-4864-b0dd-34a28b99bef1\") " pod="openshift-ingress/e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq"
Jul 09 01:19:39.953257 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:39.953096    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-workload-socket\") pod \"e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq\" (UID: \"03a8e53b-f0fb-4864-b0dd-34a28b99bef1\") " pod="openshift-ingress/e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq"
Jul 09 01:19:39.953379 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:39.953253    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-istio-envoy\") pod \"e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq\" (UID: \"03a8e53b-f0fb-4864-b0dd-34a28b99bef1\") " pod="openshift-ingress/e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq"
Jul 09 01:19:39.953379 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:39.953293    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-istio-token\") pod \"e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq\" (UID: \"03a8e53b-f0fb-4864-b0dd-34a28b99bef1\") " pod="openshift-ingress/e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq"
Jul 09 01:19:39.953379 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:39.953361    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-workload-certs\") pod \"e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq\" (UID: \"03a8e53b-f0fb-4864-b0dd-34a28b99bef1\") " pod="openshift-ingress/e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq"
Jul 09 01:19:39.953522 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:39.953386    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-credential-socket\") pod \"e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq\" (UID: \"03a8e53b-f0fb-4864-b0dd-34a28b99bef1\") " pod="openshift-ingress/e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq"
Jul 09 01:19:39.953522 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:39.953429    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-istio-data\") pod \"e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq\" (UID: \"03a8e53b-f0fb-4864-b0dd-34a28b99bef1\") " pod="openshift-ingress/e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq"
Jul 09 01:19:39.953522 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:39.953431    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-workload-socket\") pod \"e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq\" (UID: \"03a8e53b-f0fb-4864-b0dd-34a28b99bef1\") " pod="openshift-ingress/e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq"
Jul 09 01:19:39.953674 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:39.953620    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-credential-socket\") pod \"e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq\" (UID: \"03a8e53b-f0fb-4864-b0dd-34a28b99bef1\") " pod="openshift-ingress/e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq"
Jul 09 01:19:39.953775 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:39.953756    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-istiod-ca-cert\") pod \"e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq\" (UID: \"03a8e53b-f0fb-4864-b0dd-34a28b99bef1\") " pod="openshift-ingress/e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq"
Jul 09 01:19:39.953842 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:39.953803    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-istio-data\") pod \"e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq\" (UID: \"03a8e53b-f0fb-4864-b0dd-34a28b99bef1\") " pod="openshift-ingress/e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq"
Jul 09 01:19:39.955292 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:39.955274    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-istio-envoy\") pod \"e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq\" (UID: \"03a8e53b-f0fb-4864-b0dd-34a28b99bef1\") " pod="openshift-ingress/e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq"
Jul 09 01:19:39.955512 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:39.955495    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-istio-podinfo\") pod \"e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq\" (UID: \"03a8e53b-f0fb-4864-b0dd-34a28b99bef1\") " pod="openshift-ingress/e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq"
Jul 09 01:19:39.960672 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:39.960652    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-istio-token\") pod \"e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq\" (UID: \"03a8e53b-f0fb-4864-b0dd-34a28b99bef1\") " pod="openshift-ingress/e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq"
Jul 09 01:19:39.960890 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:39.960871    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69r65\" (UniqueName: \"kubernetes.io/projected/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-kube-api-access-69r65\") pod \"e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq\" (UID: \"03a8e53b-f0fb-4864-b0dd-34a28b99bef1\") " pod="openshift-ingress/e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq"
Jul 09 01:19:40.011438 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:40.011407    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq"
Jul 09 01:19:40.154187 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:40.154114    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq"]
Jul 09 01:19:40.156539 ip-10-0-133-31 kubenswrapper[2557]: W0709 01:19:40.156514    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03a8e53b_f0fb_4864_b0dd_34a28b99bef1.slice/crio-0c5d0148bd12f2474a2a7c516d847cee24ec941fc11bbdd486fcbf85908e76e3 WatchSource:0}: Error finding container 0c5d0148bd12f2474a2a7c516d847cee24ec941fc11bbdd486fcbf85908e76e3: Status 404 returned error can't find the container with id 0c5d0148bd12f2474a2a7c516d847cee24ec941fc11bbdd486fcbf85908e76e3
Jul 09 01:19:40.158577 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:40.158544    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:19:40.161263 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:40.159016    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:19:40.161263 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:40.159145    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:19:40.721425 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:40.721387    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq" event={"ID":"03a8e53b-f0fb-4864-b0dd-34a28b99bef1","Type":"ContainerStarted","Data":"e2ff3d6f100dfb7e8b4113963552cfdca529d52e9bf416a170a31a701eb300b6"}
Jul 09 01:19:40.721924 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:40.721482    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq" event={"ID":"03a8e53b-f0fb-4864-b0dd-34a28b99bef1","Type":"ContainerStarted","Data":"0c5d0148bd12f2474a2a7c516d847cee24ec941fc11bbdd486fcbf85908e76e3"}
Jul 09 01:19:40.741265 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:40.741203    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq" podStartSLOduration=1.741189974 podStartE2EDuration="1.741189974s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:19:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:19:40.739154547 +0000 UTC m=+1488.209297276" watchObservedRunningTime="2026-07-09 01:19:40.741189974 +0000 UTC m=+1488.211332703"
Jul 09 01:19:41.012329 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:41.012234    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq"
Jul 09 01:19:41.017349 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:41.017322    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq"
Jul 09 01:19:41.726059 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:41.726027    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq"
Jul 09 01:19:41.727083 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:41.727060    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq"
Jul 09 01:19:44.384858 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:44.384822    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:19:46.114771 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:46.114725    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq"]
Jul 09 01:19:46.115242 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:46.114961    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq" podUID="03a8e53b-f0fb-4864-b0dd-34a28b99bef1" containerName="istio-proxy" containerID="cri-o://e2ff3d6f100dfb7e8b4113963552cfdca529d52e9bf416a170a31a701eb300b6" gracePeriod=30
Jul 09 01:19:52.079560 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.079521    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj"]
Jul 09 01:19:52.085899 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.085871    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj"
Jul 09 01:19:52.088183 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.088159    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-e6bc8ba4-openshift-default-dockercfg-5ttt8\""
Jul 09 01:19:52.099705 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.099044    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj"]
Jul 09 01:19:52.269402 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.269368    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2b1296d-81fd-4bd0-842e-083d6d54b253-workload-certs\") pod \"e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj\" (UID: \"c2b1296d-81fd-4bd0-842e-083d6d54b253\") " pod="openshift-ingress/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj"
Jul 09 01:19:52.269574 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.269459    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2b1296d-81fd-4bd0-842e-083d6d54b253-istio-envoy\") pod \"e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj\" (UID: \"c2b1296d-81fd-4bd0-842e-083d6d54b253\") " pod="openshift-ingress/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj"
Jul 09 01:19:52.269574 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.269500    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2b1296d-81fd-4bd0-842e-083d6d54b253-istio-data\") pod \"e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj\" (UID: \"c2b1296d-81fd-4bd0-842e-083d6d54b253\") " pod="openshift-ingress/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj"
Jul 09 01:19:52.269574 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.269524    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2b1296d-81fd-4bd0-842e-083d6d54b253-workload-socket\") pod \"e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj\" (UID: \"c2b1296d-81fd-4bd0-842e-083d6d54b253\") " pod="openshift-ingress/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj"
Jul 09 01:19:52.269674 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.269591    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2b1296d-81fd-4bd0-842e-083d6d54b253-istiod-ca-cert\") pod \"e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj\" (UID: \"c2b1296d-81fd-4bd0-842e-083d6d54b253\") " pod="openshift-ingress/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj"
Jul 09 01:19:52.269674 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.269625    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2b1296d-81fd-4bd0-842e-083d6d54b253-credential-socket\") pod \"e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj\" (UID: \"c2b1296d-81fd-4bd0-842e-083d6d54b253\") " pod="openshift-ingress/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj"
Jul 09 01:19:52.269674 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.269647    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2b1296d-81fd-4bd0-842e-083d6d54b253-istio-token\") pod \"e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj\" (UID: \"c2b1296d-81fd-4bd0-842e-083d6d54b253\") " pod="openshift-ingress/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj"
Jul 09 01:19:52.269768 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.269676    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6j58\" (UniqueName: \"kubernetes.io/projected/c2b1296d-81fd-4bd0-842e-083d6d54b253-kube-api-access-l6j58\") pod \"e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj\" (UID: \"c2b1296d-81fd-4bd0-842e-083d6d54b253\") " pod="openshift-ingress/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj"
Jul 09 01:19:52.269768 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.269698    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2b1296d-81fd-4bd0-842e-083d6d54b253-istio-podinfo\") pod \"e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj\" (UID: \"c2b1296d-81fd-4bd0-842e-083d6d54b253\") " pod="openshift-ingress/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj"
Jul 09 01:19:52.370507 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.370417    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2b1296d-81fd-4bd0-842e-083d6d54b253-istio-token\") pod \"e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj\" (UID: \"c2b1296d-81fd-4bd0-842e-083d6d54b253\") " pod="openshift-ingress/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj"
Jul 09 01:19:52.370507 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.370465    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6j58\" (UniqueName: \"kubernetes.io/projected/c2b1296d-81fd-4bd0-842e-083d6d54b253-kube-api-access-l6j58\") pod \"e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj\" (UID: \"c2b1296d-81fd-4bd0-842e-083d6d54b253\") " pod="openshift-ingress/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj"
Jul 09 01:19:52.370507 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.370492    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2b1296d-81fd-4bd0-842e-083d6d54b253-istio-podinfo\") pod \"e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj\" (UID: \"c2b1296d-81fd-4bd0-842e-083d6d54b253\") " pod="openshift-ingress/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj"
Jul 09 01:19:52.370778 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.370530    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2b1296d-81fd-4bd0-842e-083d6d54b253-workload-certs\") pod \"e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj\" (UID: \"c2b1296d-81fd-4bd0-842e-083d6d54b253\") " pod="openshift-ingress/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj"
Jul 09 01:19:52.370778 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.370715    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2b1296d-81fd-4bd0-842e-083d6d54b253-istio-envoy\") pod \"e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj\" (UID: \"c2b1296d-81fd-4bd0-842e-083d6d54b253\") " pod="openshift-ingress/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj"
Jul 09 01:19:52.370894 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.370805    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2b1296d-81fd-4bd0-842e-083d6d54b253-istio-data\") pod \"e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj\" (UID: \"c2b1296d-81fd-4bd0-842e-083d6d54b253\") " pod="openshift-ingress/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj"
Jul 09 01:19:52.370894 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.370840    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2b1296d-81fd-4bd0-842e-083d6d54b253-workload-socket\") pod \"e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj\" (UID: \"c2b1296d-81fd-4bd0-842e-083d6d54b253\") " pod="openshift-ingress/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj"
Jul 09 01:19:52.371001 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.370939    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2b1296d-81fd-4bd0-842e-083d6d54b253-istiod-ca-cert\") pod \"e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj\" (UID: \"c2b1296d-81fd-4bd0-842e-083d6d54b253\") " pod="openshift-ingress/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj"
Jul 09 01:19:52.371001 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.370950    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2b1296d-81fd-4bd0-842e-083d6d54b253-workload-certs\") pod \"e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj\" (UID: \"c2b1296d-81fd-4bd0-842e-083d6d54b253\") " pod="openshift-ingress/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj"
Jul 09 01:19:52.371001 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.370978    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2b1296d-81fd-4bd0-842e-083d6d54b253-credential-socket\") pod \"e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj\" (UID: \"c2b1296d-81fd-4bd0-842e-083d6d54b253\") " pod="openshift-ingress/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj"
Jul 09 01:19:52.371163 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.371127    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2b1296d-81fd-4bd0-842e-083d6d54b253-workload-socket\") pod \"e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj\" (UID: \"c2b1296d-81fd-4bd0-842e-083d6d54b253\") " pod="openshift-ingress/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj"
Jul 09 01:19:52.371232 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.371184    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2b1296d-81fd-4bd0-842e-083d6d54b253-istio-data\") pod \"e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj\" (UID: \"c2b1296d-81fd-4bd0-842e-083d6d54b253\") " pod="openshift-ingress/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj"
Jul 09 01:19:52.371347 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.371325    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2b1296d-81fd-4bd0-842e-083d6d54b253-credential-socket\") pod \"e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj\" (UID: \"c2b1296d-81fd-4bd0-842e-083d6d54b253\") " pod="openshift-ingress/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj"
Jul 09 01:19:52.371655 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.371630    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2b1296d-81fd-4bd0-842e-083d6d54b253-istiod-ca-cert\") pod \"e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj\" (UID: \"c2b1296d-81fd-4bd0-842e-083d6d54b253\") " pod="openshift-ingress/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj"
Jul 09 01:19:52.372981 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.372958    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2b1296d-81fd-4bd0-842e-083d6d54b253-istio-envoy\") pod \"e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj\" (UID: \"c2b1296d-81fd-4bd0-842e-083d6d54b253\") " pod="openshift-ingress/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj"
Jul 09 01:19:52.373229 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.373187    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2b1296d-81fd-4bd0-842e-083d6d54b253-istio-podinfo\") pod \"e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj\" (UID: \"c2b1296d-81fd-4bd0-842e-083d6d54b253\") " pod="openshift-ingress/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj"
Jul 09 01:19:52.378725 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.378696    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2b1296d-81fd-4bd0-842e-083d6d54b253-istio-token\") pod \"e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj\" (UID: \"c2b1296d-81fd-4bd0-842e-083d6d54b253\") " pod="openshift-ingress/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj"
Jul 09 01:19:52.378832 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.378810    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6j58\" (UniqueName: \"kubernetes.io/projected/c2b1296d-81fd-4bd0-842e-083d6d54b253-kube-api-access-l6j58\") pod \"e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj\" (UID: \"c2b1296d-81fd-4bd0-842e-083d6d54b253\") " pod="openshift-ingress/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj"
Jul 09 01:19:52.404638 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.404556    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj"
Jul 09 01:19:52.455667 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.455638    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq"
Jul 09 01:19:52.547028 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.546997    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj"]
Jul 09 01:19:52.548580 ip-10-0-133-31 kubenswrapper[2557]: W0709 01:19:52.548554    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2b1296d_81fd_4bd0_842e_083d6d54b253.slice/crio-9166c4c85d1d56d115cd6d3870706ad5a1050defec84155af42756ce8fa87949 WatchSource:0}: Error finding container 9166c4c85d1d56d115cd6d3870706ad5a1050defec84155af42756ce8fa87949: Status 404 returned error can't find the container with id 9166c4c85d1d56d115cd6d3870706ad5a1050defec84155af42756ce8fa87949
Jul 09 01:19:52.550656 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.550624    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:19:52.550768 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.550700    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:19:52.550768 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.550759    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:19:52.573834 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.573811    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-workload-socket\") pod \"03a8e53b-f0fb-4864-b0dd-34a28b99bef1\" (UID: \"03a8e53b-f0fb-4864-b0dd-34a28b99bef1\") "
Jul 09 01:19:52.573936 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.573846    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-istio-data\") pod \"03a8e53b-f0fb-4864-b0dd-34a28b99bef1\" (UID: \"03a8e53b-f0fb-4864-b0dd-34a28b99bef1\") "
Jul 09 01:19:52.573936 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.573878    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-istio-token\") pod \"03a8e53b-f0fb-4864-b0dd-34a28b99bef1\" (UID: \"03a8e53b-f0fb-4864-b0dd-34a28b99bef1\") "
Jul 09 01:19:52.573936 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.573894    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-credential-socket\") pod \"03a8e53b-f0fb-4864-b0dd-34a28b99bef1\" (UID: \"03a8e53b-f0fb-4864-b0dd-34a28b99bef1\") "
Jul 09 01:19:52.573936 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.573914    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69r65\" (UniqueName: \"kubernetes.io/projected/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-kube-api-access-69r65\") pod \"03a8e53b-f0fb-4864-b0dd-34a28b99bef1\" (UID: \"03a8e53b-f0fb-4864-b0dd-34a28b99bef1\") "
Jul 09 01:19:52.574125 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.573958    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-istio-podinfo\") pod \"03a8e53b-f0fb-4864-b0dd-34a28b99bef1\" (UID: \"03a8e53b-f0fb-4864-b0dd-34a28b99bef1\") "
Jul 09 01:19:52.574125 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.574024    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-istio-envoy\") pod \"03a8e53b-f0fb-4864-b0dd-34a28b99bef1\" (UID: \"03a8e53b-f0fb-4864-b0dd-34a28b99bef1\") "
Jul 09 01:19:52.574125 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.574054    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-workload-certs\") pod \"03a8e53b-f0fb-4864-b0dd-34a28b99bef1\" (UID: \"03a8e53b-f0fb-4864-b0dd-34a28b99bef1\") "
Jul 09 01:19:52.574125 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.574091    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-istiod-ca-cert\") pod \"03a8e53b-f0fb-4864-b0dd-34a28b99bef1\" (UID: \"03a8e53b-f0fb-4864-b0dd-34a28b99bef1\") "
Jul 09 01:19:52.574475 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.574086    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "03a8e53b-f0fb-4864-b0dd-34a28b99bef1" (UID: "03a8e53b-f0fb-4864-b0dd-34a28b99bef1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:19:52.574475 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.574251    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "03a8e53b-f0fb-4864-b0dd-34a28b99bef1" (UID: "03a8e53b-f0fb-4864-b0dd-34a28b99bef1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:19:52.574475 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.574464    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "03a8e53b-f0fb-4864-b0dd-34a28b99bef1" (UID: "03a8e53b-f0fb-4864-b0dd-34a28b99bef1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:19:52.574718 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.574693    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "03a8e53b-f0fb-4864-b0dd-34a28b99bef1" (UID: "03a8e53b-f0fb-4864-b0dd-34a28b99bef1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 01:19:52.574785 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.574696    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-istio-data" (OuterVolumeSpecName: "istio-data") pod "03a8e53b-f0fb-4864-b0dd-34a28b99bef1" (UID: "03a8e53b-f0fb-4864-b0dd-34a28b99bef1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:19:52.576121 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.576094    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-istio-token" (OuterVolumeSpecName: "istio-token") pod "03a8e53b-f0fb-4864-b0dd-34a28b99bef1" (UID: "03a8e53b-f0fb-4864-b0dd-34a28b99bef1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:19:52.576282 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.576134    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "03a8e53b-f0fb-4864-b0dd-34a28b99bef1" (UID: "03a8e53b-f0fb-4864-b0dd-34a28b99bef1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:19:52.576567 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.576547    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-kube-api-access-69r65" (OuterVolumeSpecName: "kube-api-access-69r65") pod "03a8e53b-f0fb-4864-b0dd-34a28b99bef1" (UID: "03a8e53b-f0fb-4864-b0dd-34a28b99bef1"). InnerVolumeSpecName "kube-api-access-69r65". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:19:52.576612 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.576547    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "03a8e53b-f0fb-4864-b0dd-34a28b99bef1" (UID: "03a8e53b-f0fb-4864-b0dd-34a28b99bef1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 01:19:52.675878 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.675787    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-istio-envoy\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:19:52.675878 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.675819    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-workload-certs\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:19:52.675878 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.675828    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-istiod-ca-cert\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:19:52.675878 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.675837    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-workload-socket\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:19:52.675878 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.675845    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-istio-data\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:19:52.675878 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.675853    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-istio-token\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:19:52.675878 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.675862    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-credential-socket\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:19:52.675878 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.675872    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69r65\" (UniqueName: \"kubernetes.io/projected/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-kube-api-access-69r65\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:19:52.675878 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.675881    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03a8e53b-f0fb-4864-b0dd-34a28b99bef1-istio-podinfo\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:19:52.784792 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.784756    2557 generic.go:356] "Generic (PLEG): container finished" podID="03a8e53b-f0fb-4864-b0dd-34a28b99bef1" containerID="e2ff3d6f100dfb7e8b4113963552cfdca529d52e9bf416a170a31a701eb300b6" exitCode=0
Jul 09 01:19:52.784984 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.784800    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq"
Jul 09 01:19:52.784984 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.784838    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq" event={"ID":"03a8e53b-f0fb-4864-b0dd-34a28b99bef1","Type":"ContainerDied","Data":"e2ff3d6f100dfb7e8b4113963552cfdca529d52e9bf416a170a31a701eb300b6"}
Jul 09 01:19:52.784984 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.784903    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq" event={"ID":"03a8e53b-f0fb-4864-b0dd-34a28b99bef1","Type":"ContainerDied","Data":"0c5d0148bd12f2474a2a7c516d847cee24ec941fc11bbdd486fcbf85908e76e3"}
Jul 09 01:19:52.784984 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.784937    2557 scope.go:117] "RemoveContainer" containerID="e2ff3d6f100dfb7e8b4113963552cfdca529d52e9bf416a170a31a701eb300b6"
Jul 09 01:19:52.786846 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.786817    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj" event={"ID":"c2b1296d-81fd-4bd0-842e-083d6d54b253","Type":"ContainerStarted","Data":"4cbc909b9f336453c669d5322ded6aefb56a01c05cd1e1c0937e54c96334b15f"}
Jul 09 01:19:52.786984 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.786864    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj" event={"ID":"c2b1296d-81fd-4bd0-842e-083d6d54b253","Type":"ContainerStarted","Data":"9166c4c85d1d56d115cd6d3870706ad5a1050defec84155af42756ce8fa87949"}
Jul 09 01:19:52.795895 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.795872    2557 scope.go:117] "RemoveContainer" containerID="e2ff3d6f100dfb7e8b4113963552cfdca529d52e9bf416a170a31a701eb300b6"
Jul 09 01:19:52.796165 ip-10-0-133-31 kubenswrapper[2557]: E0709 01:19:52.796145    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2ff3d6f100dfb7e8b4113963552cfdca529d52e9bf416a170a31a701eb300b6\": container with ID starting with e2ff3d6f100dfb7e8b4113963552cfdca529d52e9bf416a170a31a701eb300b6 not found: ID does not exist" containerID="e2ff3d6f100dfb7e8b4113963552cfdca529d52e9bf416a170a31a701eb300b6"
Jul 09 01:19:52.796238 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.796176    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2ff3d6f100dfb7e8b4113963552cfdca529d52e9bf416a170a31a701eb300b6"} err="failed to get container status \"e2ff3d6f100dfb7e8b4113963552cfdca529d52e9bf416a170a31a701eb300b6\": rpc error: code = NotFound desc = could not find container \"e2ff3d6f100dfb7e8b4113963552cfdca529d52e9bf416a170a31a701eb300b6\": container with ID starting with e2ff3d6f100dfb7e8b4113963552cfdca529d52e9bf416a170a31a701eb300b6 not found: ID does not exist"
Jul 09 01:19:52.807247 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.807190    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj" podStartSLOduration=0.807177312 podStartE2EDuration="807.177312ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:19:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:19:52.804905326 +0000 UTC m=+1500.275048055" watchObservedRunningTime="2026-07-09 01:19:52.807177312 +0000 UTC m=+1500.277320040"
Jul 09 01:19:52.817086 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.817064    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq"]
Jul 09 01:19:52.821480 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:52.821452    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq"]
Jul 09 01:19:53.040366 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:53.040334    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03a8e53b-f0fb-4864-b0dd-34a28b99bef1" path="/var/lib/kubelet/pods/03a8e53b-f0fb-4864-b0dd-34a28b99bef1/volumes"
Jul 09 01:19:53.091770 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:53.091739    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z6kj2_7dc12511-b804-4ebc-8646-4d070d93a8cf/console-operator/1.log"
Jul 09 01:19:53.094280 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:53.094256    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z6kj2_7dc12511-b804-4ebc-8646-4d070d93a8cf/console-operator/1.log"
Jul 09 01:19:53.405309 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:53.405228    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj"
Jul 09 01:19:53.411054 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:53.411026    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj"
Jul 09 01:19:53.792762 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:53.792735    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj"
Jul 09 01:19:53.793918 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:53.793889    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj"
Jul 09 01:19:54.987003 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:19:54.986967    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:20:04.382272 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:04.382233    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj"]
Jul 09 01:20:04.382750 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:04.382452    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj" podUID="c2b1296d-81fd-4bd0-842e-083d6d54b253" containerName="istio-proxy" containerID="cri-o://4cbc909b9f336453c669d5322ded6aefb56a01c05cd1e1c0937e54c96334b15f" gracePeriod=30
Jul 09 01:20:08.795459 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:08.795414    2557 patch_prober.go:28] interesting pod/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 09 01:20:08.795846 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:08.795483    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj" podUID="c2b1296d-81fd-4bd0-842e-083d6d54b253" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 09 01:20:09.635978 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:09.635953    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj"
Jul 09 01:20:09.726279 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:09.726253    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2b1296d-81fd-4bd0-842e-083d6d54b253-istiod-ca-cert\") pod \"c2b1296d-81fd-4bd0-842e-083d6d54b253\" (UID: \"c2b1296d-81fd-4bd0-842e-083d6d54b253\") "
Jul 09 01:20:09.726458 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:09.726288    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2b1296d-81fd-4bd0-842e-083d6d54b253-istio-podinfo\") pod \"c2b1296d-81fd-4bd0-842e-083d6d54b253\" (UID: \"c2b1296d-81fd-4bd0-842e-083d6d54b253\") "
Jul 09 01:20:09.726458 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:09.726367    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2b1296d-81fd-4bd0-842e-083d6d54b253-istio-token\") pod \"c2b1296d-81fd-4bd0-842e-083d6d54b253\" (UID: \"c2b1296d-81fd-4bd0-842e-083d6d54b253\") "
Jul 09 01:20:09.726458 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:09.726385    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l6j58\" (UniqueName: \"kubernetes.io/projected/c2b1296d-81fd-4bd0-842e-083d6d54b253-kube-api-access-l6j58\") pod \"c2b1296d-81fd-4bd0-842e-083d6d54b253\" (UID: \"c2b1296d-81fd-4bd0-842e-083d6d54b253\") "
Jul 09 01:20:09.726458 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:09.726405    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2b1296d-81fd-4bd0-842e-083d6d54b253-workload-socket\") pod \"c2b1296d-81fd-4bd0-842e-083d6d54b253\" (UID: \"c2b1296d-81fd-4bd0-842e-083d6d54b253\") "
Jul 09 01:20:09.726458 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:09.726422    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2b1296d-81fd-4bd0-842e-083d6d54b253-istio-data\") pod \"c2b1296d-81fd-4bd0-842e-083d6d54b253\" (UID: \"c2b1296d-81fd-4bd0-842e-083d6d54b253\") "
Jul 09 01:20:09.726458 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:09.726446    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2b1296d-81fd-4bd0-842e-083d6d54b253-istio-envoy\") pod \"c2b1296d-81fd-4bd0-842e-083d6d54b253\" (UID: \"c2b1296d-81fd-4bd0-842e-083d6d54b253\") "
Jul 09 01:20:09.726757 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:09.726498    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2b1296d-81fd-4bd0-842e-083d6d54b253-workload-certs\") pod \"c2b1296d-81fd-4bd0-842e-083d6d54b253\" (UID: \"c2b1296d-81fd-4bd0-842e-083d6d54b253\") "
Jul 09 01:20:09.726824 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:09.726766    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2b1296d-81fd-4bd0-842e-083d6d54b253-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c2b1296d-81fd-4bd0-842e-083d6d54b253" (UID: "c2b1296d-81fd-4bd0-842e-083d6d54b253"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:20:09.726824 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:09.726783    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2b1296d-81fd-4bd0-842e-083d6d54b253-istio-data" (OuterVolumeSpecName: "istio-data") pod "c2b1296d-81fd-4bd0-842e-083d6d54b253" (UID: "c2b1296d-81fd-4bd0-842e-083d6d54b253"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:20:09.726824 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:09.726791    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2b1296d-81fd-4bd0-842e-083d6d54b253-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c2b1296d-81fd-4bd0-842e-083d6d54b253" (UID: "c2b1296d-81fd-4bd0-842e-083d6d54b253"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 01:20:09.726956 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:09.726868    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2b1296d-81fd-4bd0-842e-083d6d54b253-credential-socket\") pod \"c2b1296d-81fd-4bd0-842e-083d6d54b253\" (UID: \"c2b1296d-81fd-4bd0-842e-083d6d54b253\") "
Jul 09 01:20:09.726999 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:09.726981    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2b1296d-81fd-4bd0-842e-083d6d54b253-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c2b1296d-81fd-4bd0-842e-083d6d54b253" (UID: "c2b1296d-81fd-4bd0-842e-083d6d54b253"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:20:09.727106 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:09.727084    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2b1296d-81fd-4bd0-842e-083d6d54b253-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c2b1296d-81fd-4bd0-842e-083d6d54b253" (UID: "c2b1296d-81fd-4bd0-842e-083d6d54b253"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:20:09.727199 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:09.727182    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2b1296d-81fd-4bd0-842e-083d6d54b253-workload-socket\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:20:09.727282 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:09.727225    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2b1296d-81fd-4bd0-842e-083d6d54b253-istio-data\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:20:09.727282 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:09.727241    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2b1296d-81fd-4bd0-842e-083d6d54b253-workload-certs\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:20:09.727282 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:09.727255    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2b1296d-81fd-4bd0-842e-083d6d54b253-credential-socket\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:20:09.727282 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:09.727270    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2b1296d-81fd-4bd0-842e-083d6d54b253-istiod-ca-cert\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:20:09.728796 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:09.728773    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2b1296d-81fd-4bd0-842e-083d6d54b253-istio-token" (OuterVolumeSpecName: "istio-token") pod "c2b1296d-81fd-4bd0-842e-083d6d54b253" (UID: "c2b1296d-81fd-4bd0-842e-083d6d54b253"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:20:09.728896 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:09.728873    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2b1296d-81fd-4bd0-842e-083d6d54b253-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c2b1296d-81fd-4bd0-842e-083d6d54b253" (UID: "c2b1296d-81fd-4bd0-842e-083d6d54b253"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:20:09.729067 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:09.729047    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2b1296d-81fd-4bd0-842e-083d6d54b253-kube-api-access-l6j58" (OuterVolumeSpecName: "kube-api-access-l6j58") pod "c2b1296d-81fd-4bd0-842e-083d6d54b253" (UID: "c2b1296d-81fd-4bd0-842e-083d6d54b253"). InnerVolumeSpecName "kube-api-access-l6j58". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:20:09.729124 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:09.729047    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c2b1296d-81fd-4bd0-842e-083d6d54b253-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c2b1296d-81fd-4bd0-842e-083d6d54b253" (UID: "c2b1296d-81fd-4bd0-842e-083d6d54b253"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 01:20:09.827942 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:09.827906    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2b1296d-81fd-4bd0-842e-083d6d54b253-istio-token\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:20:09.827942 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:09.827935    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l6j58\" (UniqueName: \"kubernetes.io/projected/c2b1296d-81fd-4bd0-842e-083d6d54b253-kube-api-access-l6j58\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:20:09.827942 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:09.827946    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2b1296d-81fd-4bd0-842e-083d6d54b253-istio-envoy\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:20:09.827942 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:09.827954    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2b1296d-81fd-4bd0-842e-083d6d54b253-istio-podinfo\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:20:09.867780 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:09.867746    2557 generic.go:356] "Generic (PLEG): container finished" podID="c2b1296d-81fd-4bd0-842e-083d6d54b253" containerID="4cbc909b9f336453c669d5322ded6aefb56a01c05cd1e1c0937e54c96334b15f" exitCode=0
Jul 09 01:20:09.867933 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:09.867792    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj"
Jul 09 01:20:09.867933 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:09.867842    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj" event={"ID":"c2b1296d-81fd-4bd0-842e-083d6d54b253","Type":"ContainerDied","Data":"4cbc909b9f336453c669d5322ded6aefb56a01c05cd1e1c0937e54c96334b15f"}
Jul 09 01:20:09.867933 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:09.867898    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj" event={"ID":"c2b1296d-81fd-4bd0-842e-083d6d54b253","Type":"ContainerDied","Data":"9166c4c85d1d56d115cd6d3870706ad5a1050defec84155af42756ce8fa87949"}
Jul 09 01:20:09.867933 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:09.867921    2557 scope.go:117] "RemoveContainer" containerID="4cbc909b9f336453c669d5322ded6aefb56a01c05cd1e1c0937e54c96334b15f"
Jul 09 01:20:09.877602 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:09.877584    2557 scope.go:117] "RemoveContainer" containerID="4cbc909b9f336453c669d5322ded6aefb56a01c05cd1e1c0937e54c96334b15f"
Jul 09 01:20:09.877864 ip-10-0-133-31 kubenswrapper[2557]: E0709 01:20:09.877838    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cbc909b9f336453c669d5322ded6aefb56a01c05cd1e1c0937e54c96334b15f\": container with ID starting with 4cbc909b9f336453c669d5322ded6aefb56a01c05cd1e1c0937e54c96334b15f not found: ID does not exist" containerID="4cbc909b9f336453c669d5322ded6aefb56a01c05cd1e1c0937e54c96334b15f"
Jul 09 01:20:09.877937 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:09.877878    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cbc909b9f336453c669d5322ded6aefb56a01c05cd1e1c0937e54c96334b15f"} err="failed to get container status \"4cbc909b9f336453c669d5322ded6aefb56a01c05cd1e1c0937e54c96334b15f\": rpc error: code = NotFound desc = could not find container \"4cbc909b9f336453c669d5322ded6aefb56a01c05cd1e1c0937e54c96334b15f\": container with ID starting with 4cbc909b9f336453c669d5322ded6aefb56a01c05cd1e1c0937e54c96334b15f not found: ID does not exist"
Jul 09 01:20:09.892669 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:09.892599    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj"]
Jul 09 01:20:09.894611 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:09.894580    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj"]
Jul 09 01:20:10.595073 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:10.595042    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh"]
Jul 09 01:20:10.595604 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:10.595458    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03a8e53b-f0fb-4864-b0dd-34a28b99bef1" containerName="istio-proxy"
Jul 09 01:20:10.595604 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:10.595479    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="03a8e53b-f0fb-4864-b0dd-34a28b99bef1" containerName="istio-proxy"
Jul 09 01:20:10.595604 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:10.595494    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2b1296d-81fd-4bd0-842e-083d6d54b253" containerName="istio-proxy"
Jul 09 01:20:10.595604 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:10.595501    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2b1296d-81fd-4bd0-842e-083d6d54b253" containerName="istio-proxy"
Jul 09 01:20:10.595604 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:10.595593    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="03a8e53b-f0fb-4864-b0dd-34a28b99bef1" containerName="istio-proxy"
Jul 09 01:20:10.595604 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:10.595609    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2b1296d-81fd-4bd0-842e-083d6d54b253" containerName="istio-proxy"
Jul 09 01:20:10.599821 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:10.599802    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh"
Jul 09 01:20:10.602203 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:10.602181    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-488986e9-openshift-default-dockercfg-4sx5n\""
Jul 09 01:20:10.610732 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:10.610710    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh"]
Jul 09 01:20:10.635873 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:10.635849    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9dd3cbba-06fc-4053-9f1c-728378bc417b-istio-envoy\") pod \"e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh\" (UID: \"9dd3cbba-06fc-4053-9f1c-728378bc417b\") " pod="openshift-ingress/e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh"
Jul 09 01:20:10.636007 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:10.635887    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dd3cbba-06fc-4053-9f1c-728378bc417b-credential-socket\") pod \"e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh\" (UID: \"9dd3cbba-06fc-4053-9f1c-728378bc417b\") " pod="openshift-ingress/e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh"
Jul 09 01:20:10.636007 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:10.635913    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9dd3cbba-06fc-4053-9f1c-728378bc417b-istio-token\") pod \"e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh\" (UID: \"9dd3cbba-06fc-4053-9f1c-728378bc417b\") " pod="openshift-ingress/e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh"
Jul 09 01:20:10.636007 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:10.635986    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9dd3cbba-06fc-4053-9f1c-728378bc417b-istiod-ca-cert\") pod \"e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh\" (UID: \"9dd3cbba-06fc-4053-9f1c-728378bc417b\") " pod="openshift-ingress/e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh"
Jul 09 01:20:10.636108 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:10.636015    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dd3cbba-06fc-4053-9f1c-728378bc417b-workload-socket\") pod \"e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh\" (UID: \"9dd3cbba-06fc-4053-9f1c-728378bc417b\") " pod="openshift-ingress/e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh"
Jul 09 01:20:10.636108 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:10.636033    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9q2h\" (UniqueName: \"kubernetes.io/projected/9dd3cbba-06fc-4053-9f1c-728378bc417b-kube-api-access-s9q2h\") pod \"e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh\" (UID: \"9dd3cbba-06fc-4053-9f1c-728378bc417b\") " pod="openshift-ingress/e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh"
Jul 09 01:20:10.636108 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:10.636093    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9dd3cbba-06fc-4053-9f1c-728378bc417b-workload-certs\") pod \"e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh\" (UID: \"9dd3cbba-06fc-4053-9f1c-728378bc417b\") " pod="openshift-ingress/e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh"
Jul 09 01:20:10.636198 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:10.636114    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9dd3cbba-06fc-4053-9f1c-728378bc417b-istio-data\") pod \"e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh\" (UID: \"9dd3cbba-06fc-4053-9f1c-728378bc417b\") " pod="openshift-ingress/e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh"
Jul 09 01:20:10.636198 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:10.636135    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9dd3cbba-06fc-4053-9f1c-728378bc417b-istio-podinfo\") pod \"e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh\" (UID: \"9dd3cbba-06fc-4053-9f1c-728378bc417b\") " pod="openshift-ingress/e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh"
Jul 09 01:20:10.737573 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:10.737534    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9dd3cbba-06fc-4053-9f1c-728378bc417b-istio-envoy\") pod \"e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh\" (UID: \"9dd3cbba-06fc-4053-9f1c-728378bc417b\") " pod="openshift-ingress/e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh"
Jul 09 01:20:10.737573 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:10.737580    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dd3cbba-06fc-4053-9f1c-728378bc417b-credential-socket\") pod \"e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh\" (UID: \"9dd3cbba-06fc-4053-9f1c-728378bc417b\") " pod="openshift-ingress/e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh"
Jul 09 01:20:10.737846 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:10.737602    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9dd3cbba-06fc-4053-9f1c-728378bc417b-istio-token\") pod \"e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh\" (UID: \"9dd3cbba-06fc-4053-9f1c-728378bc417b\") " pod="openshift-ingress/e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh"
Jul 09 01:20:10.737846 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:10.737736    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9dd3cbba-06fc-4053-9f1c-728378bc417b-istiod-ca-cert\") pod \"e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh\" (UID: \"9dd3cbba-06fc-4053-9f1c-728378bc417b\") " pod="openshift-ingress/e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh"
Jul 09 01:20:10.737846 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:10.737782    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dd3cbba-06fc-4053-9f1c-728378bc417b-workload-socket\") pod \"e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh\" (UID: \"9dd3cbba-06fc-4053-9f1c-728378bc417b\") " pod="openshift-ingress/e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh"
Jul 09 01:20:10.737846 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:10.737805    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9q2h\" (UniqueName: \"kubernetes.io/projected/9dd3cbba-06fc-4053-9f1c-728378bc417b-kube-api-access-s9q2h\") pod \"e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh\" (UID: \"9dd3cbba-06fc-4053-9f1c-728378bc417b\") " pod="openshift-ingress/e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh"
Jul 09 01:20:10.738062 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:10.737888    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9dd3cbba-06fc-4053-9f1c-728378bc417b-workload-certs\") pod \"e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh\" (UID: \"9dd3cbba-06fc-4053-9f1c-728378bc417b\") " pod="openshift-ingress/e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh"
Jul 09 01:20:10.738062 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:10.737915    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9dd3cbba-06fc-4053-9f1c-728378bc417b-istio-data\") pod \"e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh\" (UID: \"9dd3cbba-06fc-4053-9f1c-728378bc417b\") " pod="openshift-ingress/e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh"
Jul 09 01:20:10.738062 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:10.737949    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9dd3cbba-06fc-4053-9f1c-728378bc417b-istio-podinfo\") pod \"e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh\" (UID: \"9dd3cbba-06fc-4053-9f1c-728378bc417b\") " pod="openshift-ingress/e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh"
Jul 09 01:20:10.738062 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:10.738045    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dd3cbba-06fc-4053-9f1c-728378bc417b-credential-socket\") pod \"e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh\" (UID: \"9dd3cbba-06fc-4053-9f1c-728378bc417b\") " pod="openshift-ingress/e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh"
Jul 09 01:20:10.738298 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:10.738104    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dd3cbba-06fc-4053-9f1c-728378bc417b-workload-socket\") pod \"e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh\" (UID: \"9dd3cbba-06fc-4053-9f1c-728378bc417b\") " pod="openshift-ingress/e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh"
Jul 09 01:20:10.738358 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:10.738310    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9dd3cbba-06fc-4053-9f1c-728378bc417b-workload-certs\") pod \"e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh\" (UID: \"9dd3cbba-06fc-4053-9f1c-728378bc417b\") " pod="openshift-ingress/e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh"
Jul 09 01:20:10.738411 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:10.738370    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9dd3cbba-06fc-4053-9f1c-728378bc417b-istio-data\") pod \"e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh\" (UID: \"9dd3cbba-06fc-4053-9f1c-728378bc417b\") " pod="openshift-ingress/e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh"
Jul 09 01:20:10.738608 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:10.738587    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9dd3cbba-06fc-4053-9f1c-728378bc417b-istiod-ca-cert\") pod \"e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh\" (UID: \"9dd3cbba-06fc-4053-9f1c-728378bc417b\") " pod="openshift-ingress/e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh"
Jul 09 01:20:10.739942 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:10.739920    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9dd3cbba-06fc-4053-9f1c-728378bc417b-istio-envoy\") pod \"e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh\" (UID: \"9dd3cbba-06fc-4053-9f1c-728378bc417b\") " pod="openshift-ingress/e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh"
Jul 09 01:20:10.740296 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:10.740277    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9dd3cbba-06fc-4053-9f1c-728378bc417b-istio-podinfo\") pod \"e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh\" (UID: \"9dd3cbba-06fc-4053-9f1c-728378bc417b\") " pod="openshift-ingress/e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh"
Jul 09 01:20:10.744962 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:10.744932    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9dd3cbba-06fc-4053-9f1c-728378bc417b-istio-token\") pod \"e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh\" (UID: \"9dd3cbba-06fc-4053-9f1c-728378bc417b\") " pod="openshift-ingress/e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh"
Jul 09 01:20:10.745183 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:10.745166    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9q2h\" (UniqueName: \"kubernetes.io/projected/9dd3cbba-06fc-4053-9f1c-728378bc417b-kube-api-access-s9q2h\") pod \"e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh\" (UID: \"9dd3cbba-06fc-4053-9f1c-728378bc417b\") " pod="openshift-ingress/e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh"
Jul 09 01:20:10.913007 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:10.912926    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh"
Jul 09 01:20:11.040779 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:11.040747    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2b1296d-81fd-4bd0-842e-083d6d54b253" path="/var/lib/kubelet/pods/c2b1296d-81fd-4bd0-842e-083d6d54b253/volumes"
Jul 09 01:20:11.071686 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:11.071669    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh"]
Jul 09 01:20:11.073872 ip-10-0-133-31 kubenswrapper[2557]: W0709 01:20:11.073845    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dd3cbba_06fc_4053_9f1c_728378bc417b.slice/crio-a6210919948a30c761337c28060e4d62b29370b411a42c988649c0e342215aaa WatchSource:0}: Error finding container a6210919948a30c761337c28060e4d62b29370b411a42c988649c0e342215aaa: Status 404 returned error can't find the container with id a6210919948a30c761337c28060e4d62b29370b411a42c988649c0e342215aaa
Jul 09 01:20:11.076346 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:11.076309    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:20:11.076469 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:11.076390    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:20:11.076469 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:11.076430    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:20:11.880014 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:11.879975    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh" event={"ID":"9dd3cbba-06fc-4053-9f1c-728378bc417b","Type":"ContainerStarted","Data":"83b4764d47af4f5c9b820042264a857d60538a30d181ff9648de687fcb96cf86"}
Jul 09 01:20:11.880242 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:11.880059    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh" event={"ID":"9dd3cbba-06fc-4053-9f1c-728378bc417b","Type":"ContainerStarted","Data":"a6210919948a30c761337c28060e4d62b29370b411a42c988649c0e342215aaa"}
Jul 09 01:20:11.907581 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:11.907527    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh" podStartSLOduration=1.907510606 podStartE2EDuration="1.907510606s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:20:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:20:11.90593243 +0000 UTC m=+1519.376075157" watchObservedRunningTime="2026-07-09 01:20:11.907510606 +0000 UTC m=+1519.377653335"
Jul 09 01:20:11.913733 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:11.913711    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh"
Jul 09 01:20:12.918447 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:12.918417    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh"
Jul 09 01:20:13.890541 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:13.890502    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh"
Jul 09 01:20:13.891395 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:13.891372    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh"
Jul 09 01:20:14.987409 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:14.987378    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:20:16.370946 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:16.370906    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh"]
Jul 09 01:20:16.908754 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:16.908713    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh" podUID="9dd3cbba-06fc-4053-9f1c-728378bc417b" containerName="istio-proxy" containerID="cri-o://83b4764d47af4f5c9b820042264a857d60538a30d181ff9648de687fcb96cf86" gracePeriod=30
Jul 09 01:20:22.667770 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:22.667744    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh"
Jul 09 01:20:22.751780 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:22.751741    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9dd3cbba-06fc-4053-9f1c-728378bc417b-istio-token\") pod \"9dd3cbba-06fc-4053-9f1c-728378bc417b\" (UID: \"9dd3cbba-06fc-4053-9f1c-728378bc417b\") "
Jul 09 01:20:22.751780 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:22.751785    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9dd3cbba-06fc-4053-9f1c-728378bc417b-istio-data\") pod \"9dd3cbba-06fc-4053-9f1c-728378bc417b\" (UID: \"9dd3cbba-06fc-4053-9f1c-728378bc417b\") "
Jul 09 01:20:22.752042 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:22.751824    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9dd3cbba-06fc-4053-9f1c-728378bc417b-istio-podinfo\") pod \"9dd3cbba-06fc-4053-9f1c-728378bc417b\" (UID: \"9dd3cbba-06fc-4053-9f1c-728378bc417b\") "
Jul 09 01:20:22.752042 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:22.751967    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dd3cbba-06fc-4053-9f1c-728378bc417b-credential-socket\") pod \"9dd3cbba-06fc-4053-9f1c-728378bc417b\" (UID: \"9dd3cbba-06fc-4053-9f1c-728378bc417b\") "
Jul 09 01:20:22.752042 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:22.752021    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9dd3cbba-06fc-4053-9f1c-728378bc417b-workload-certs\") pod \"9dd3cbba-06fc-4053-9f1c-728378bc417b\" (UID: \"9dd3cbba-06fc-4053-9f1c-728378bc417b\") "
Jul 09 01:20:22.752230 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:22.752059    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9dd3cbba-06fc-4053-9f1c-728378bc417b-istio-envoy\") pod \"9dd3cbba-06fc-4053-9f1c-728378bc417b\" (UID: \"9dd3cbba-06fc-4053-9f1c-728378bc417b\") "
Jul 09 01:20:22.752230 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:22.752094    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9q2h\" (UniqueName: \"kubernetes.io/projected/9dd3cbba-06fc-4053-9f1c-728378bc417b-kube-api-access-s9q2h\") pod \"9dd3cbba-06fc-4053-9f1c-728378bc417b\" (UID: \"9dd3cbba-06fc-4053-9f1c-728378bc417b\") "
Jul 09 01:20:22.752230 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:22.752127    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dd3cbba-06fc-4053-9f1c-728378bc417b-workload-socket\") pod \"9dd3cbba-06fc-4053-9f1c-728378bc417b\" (UID: \"9dd3cbba-06fc-4053-9f1c-728378bc417b\") "
Jul 09 01:20:22.752230 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:22.752186    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9dd3cbba-06fc-4053-9f1c-728378bc417b-istiod-ca-cert\") pod \"9dd3cbba-06fc-4053-9f1c-728378bc417b\" (UID: \"9dd3cbba-06fc-4053-9f1c-728378bc417b\") "
Jul 09 01:20:22.752443 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:22.752257    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dd3cbba-06fc-4053-9f1c-728378bc417b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9dd3cbba-06fc-4053-9f1c-728378bc417b" (UID: "9dd3cbba-06fc-4053-9f1c-728378bc417b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:20:22.752502 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:22.752477    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dd3cbba-06fc-4053-9f1c-728378bc417b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9dd3cbba-06fc-4053-9f1c-728378bc417b" (UID: "9dd3cbba-06fc-4053-9f1c-728378bc417b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:20:22.752556 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:22.752536    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dd3cbba-06fc-4053-9f1c-728378bc417b-credential-socket\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:20:22.752609 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:22.752546    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dd3cbba-06fc-4053-9f1c-728378bc417b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9dd3cbba-06fc-4053-9f1c-728378bc417b" (UID: "9dd3cbba-06fc-4053-9f1c-728378bc417b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:20:22.752794 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:22.752763    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dd3cbba-06fc-4053-9f1c-728378bc417b-istio-data" (OuterVolumeSpecName: "istio-data") pod "9dd3cbba-06fc-4053-9f1c-728378bc417b" (UID: "9dd3cbba-06fc-4053-9f1c-728378bc417b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:20:22.752929 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:22.752862    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9dd3cbba-06fc-4053-9f1c-728378bc417b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9dd3cbba-06fc-4053-9f1c-728378bc417b" (UID: "9dd3cbba-06fc-4053-9f1c-728378bc417b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 01:20:22.754170 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:22.754143    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dd3cbba-06fc-4053-9f1c-728378bc417b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9dd3cbba-06fc-4053-9f1c-728378bc417b" (UID: "9dd3cbba-06fc-4053-9f1c-728378bc417b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:20:22.754281 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:22.754143    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dd3cbba-06fc-4053-9f1c-728378bc417b-istio-token" (OuterVolumeSpecName: "istio-token") pod "9dd3cbba-06fc-4053-9f1c-728378bc417b" (UID: "9dd3cbba-06fc-4053-9f1c-728378bc417b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:20:22.754281 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:22.754147    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9dd3cbba-06fc-4053-9f1c-728378bc417b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9dd3cbba-06fc-4053-9f1c-728378bc417b" (UID: "9dd3cbba-06fc-4053-9f1c-728378bc417b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 01:20:22.754357 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:22.754303    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dd3cbba-06fc-4053-9f1c-728378bc417b-kube-api-access-s9q2h" (OuterVolumeSpecName: "kube-api-access-s9q2h") pod "9dd3cbba-06fc-4053-9f1c-728378bc417b" (UID: "9dd3cbba-06fc-4053-9f1c-728378bc417b"). InnerVolumeSpecName "kube-api-access-s9q2h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:20:22.853571 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:22.853522    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9dd3cbba-06fc-4053-9f1c-728378bc417b-workload-certs\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:20:22.853571 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:22.853563    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9dd3cbba-06fc-4053-9f1c-728378bc417b-istio-envoy\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:20:22.853571 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:22.853573    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9q2h\" (UniqueName: \"kubernetes.io/projected/9dd3cbba-06fc-4053-9f1c-728378bc417b-kube-api-access-s9q2h\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:20:22.853571 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:22.853583    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dd3cbba-06fc-4053-9f1c-728378bc417b-workload-socket\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:20:22.853571 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:22.853592    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9dd3cbba-06fc-4053-9f1c-728378bc417b-istiod-ca-cert\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:20:22.853870 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:22.853601    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9dd3cbba-06fc-4053-9f1c-728378bc417b-istio-token\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:20:22.853870 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:22.853609    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9dd3cbba-06fc-4053-9f1c-728378bc417b-istio-data\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:20:22.853870 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:22.853617    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9dd3cbba-06fc-4053-9f1c-728378bc417b-istio-podinfo\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:20:22.938466 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:22.938429    2557 generic.go:356] "Generic (PLEG): container finished" podID="9dd3cbba-06fc-4053-9f1c-728378bc417b" containerID="83b4764d47af4f5c9b820042264a857d60538a30d181ff9648de687fcb96cf86" exitCode=0
Jul 09 01:20:22.938603 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:22.938477    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh"
Jul 09 01:20:22.938603 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:22.938500    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh" event={"ID":"9dd3cbba-06fc-4053-9f1c-728378bc417b","Type":"ContainerDied","Data":"83b4764d47af4f5c9b820042264a857d60538a30d181ff9648de687fcb96cf86"}
Jul 09 01:20:22.938603 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:22.938567    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh" event={"ID":"9dd3cbba-06fc-4053-9f1c-728378bc417b","Type":"ContainerDied","Data":"a6210919948a30c761337c28060e4d62b29370b411a42c988649c0e342215aaa"}
Jul 09 01:20:22.938603 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:22.938588    2557 scope.go:117] "RemoveContainer" containerID="83b4764d47af4f5c9b820042264a857d60538a30d181ff9648de687fcb96cf86"
Jul 09 01:20:22.948374 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:22.948344    2557 scope.go:117] "RemoveContainer" containerID="83b4764d47af4f5c9b820042264a857d60538a30d181ff9648de687fcb96cf86"
Jul 09 01:20:22.948694 ip-10-0-133-31 kubenswrapper[2557]: E0709 01:20:22.948671    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83b4764d47af4f5c9b820042264a857d60538a30d181ff9648de687fcb96cf86\": container with ID starting with 83b4764d47af4f5c9b820042264a857d60538a30d181ff9648de687fcb96cf86 not found: ID does not exist" containerID="83b4764d47af4f5c9b820042264a857d60538a30d181ff9648de687fcb96cf86"
Jul 09 01:20:22.948768 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:22.948702    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83b4764d47af4f5c9b820042264a857d60538a30d181ff9648de687fcb96cf86"} err="failed to get container status \"83b4764d47af4f5c9b820042264a857d60538a30d181ff9648de687fcb96cf86\": rpc error: code = NotFound desc = could not find container \"83b4764d47af4f5c9b820042264a857d60538a30d181ff9648de687fcb96cf86\": container with ID starting with 83b4764d47af4f5c9b820042264a857d60538a30d181ff9648de687fcb96cf86 not found: ID does not exist"
Jul 09 01:20:22.961694 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:22.961666    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh"]
Jul 09 01:20:22.966858 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:22.966834    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh"]
Jul 09 01:20:23.039280 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:23.039182    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9dd3cbba-06fc-4053-9f1c-728378bc417b" path="/var/lib/kubelet/pods/9dd3cbba-06fc-4053-9f1c-728378bc417b/volumes"
Jul 09 01:20:25.992266 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:20:25.992231    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:21:44.493037 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:21:44.493003    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:21:53.593352 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:21:53.593269    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:21:56.648485 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:21:56.648446    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb"]
Jul 09 01:21:56.648852 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:21:56.648822    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dd3cbba-06fc-4053-9f1c-728378bc417b" containerName="istio-proxy"
Jul 09 01:21:56.648852 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:21:56.648834    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dd3cbba-06fc-4053-9f1c-728378bc417b" containerName="istio-proxy"
Jul 09 01:21:56.648922 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:21:56.648901    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="9dd3cbba-06fc-4053-9f1c-728378bc417b" containerName="istio-proxy"
Jul 09 01:21:56.651982 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:21:56.651960    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb"
Jul 09 01:21:56.654630 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:21:56.654610    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-6b5edbb9-openshift-default-dockercfg-ptvkh\""
Jul 09 01:21:56.679366 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:21:56.679337    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb"]
Jul 09 01:21:56.790474 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:21:56.790438    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5d0e464-2250-46d1-9aeb-b580131ef435-workload-socket\") pod \"e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb\" (UID: \"c5d0e464-2250-46d1-9aeb-b580131ef435\") " pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb"
Jul 09 01:21:56.790474 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:21:56.790480    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5d0e464-2250-46d1-9aeb-b580131ef435-istio-data\") pod \"e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb\" (UID: \"c5d0e464-2250-46d1-9aeb-b580131ef435\") " pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb"
Jul 09 01:21:56.790741 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:21:56.790511    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5d0e464-2250-46d1-9aeb-b580131ef435-workload-certs\") pod \"e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb\" (UID: \"c5d0e464-2250-46d1-9aeb-b580131ef435\") " pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb"
Jul 09 01:21:56.790741 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:21:56.790560    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5d0e464-2250-46d1-9aeb-b580131ef435-istio-envoy\") pod \"e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb\" (UID: \"c5d0e464-2250-46d1-9aeb-b580131ef435\") " pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb"
Jul 09 01:21:56.790741 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:21:56.790611    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5d0e464-2250-46d1-9aeb-b580131ef435-istio-podinfo\") pod \"e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb\" (UID: \"c5d0e464-2250-46d1-9aeb-b580131ef435\") " pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb"
Jul 09 01:21:56.790741 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:21:56.790684    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpz4d\" (UniqueName: \"kubernetes.io/projected/c5d0e464-2250-46d1-9aeb-b580131ef435-kube-api-access-rpz4d\") pod \"e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb\" (UID: \"c5d0e464-2250-46d1-9aeb-b580131ef435\") " pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb"
Jul 09 01:21:56.790741 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:21:56.790712    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5d0e464-2250-46d1-9aeb-b580131ef435-istio-token\") pod \"e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb\" (UID: \"c5d0e464-2250-46d1-9aeb-b580131ef435\") " pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb"
Jul 09 01:21:56.790741 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:21:56.790737    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5d0e464-2250-46d1-9aeb-b580131ef435-istiod-ca-cert\") pod \"e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb\" (UID: \"c5d0e464-2250-46d1-9aeb-b580131ef435\") " pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb"
Jul 09 01:21:56.790983 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:21:56.790781    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5d0e464-2250-46d1-9aeb-b580131ef435-credential-socket\") pod \"e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb\" (UID: \"c5d0e464-2250-46d1-9aeb-b580131ef435\") " pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb"
Jul 09 01:21:56.892224 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:21:56.892186    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5d0e464-2250-46d1-9aeb-b580131ef435-workload-certs\") pod \"e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb\" (UID: \"c5d0e464-2250-46d1-9aeb-b580131ef435\") " pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb"
Jul 09 01:21:56.892413 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:21:56.892259    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5d0e464-2250-46d1-9aeb-b580131ef435-istio-envoy\") pod \"e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb\" (UID: \"c5d0e464-2250-46d1-9aeb-b580131ef435\") " pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb"
Jul 09 01:21:56.892413 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:21:56.892288    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5d0e464-2250-46d1-9aeb-b580131ef435-istio-podinfo\") pod \"e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb\" (UID: \"c5d0e464-2250-46d1-9aeb-b580131ef435\") " pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb"
Jul 09 01:21:56.892413 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:21:56.892360    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpz4d\" (UniqueName: \"kubernetes.io/projected/c5d0e464-2250-46d1-9aeb-b580131ef435-kube-api-access-rpz4d\") pod \"e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb\" (UID: \"c5d0e464-2250-46d1-9aeb-b580131ef435\") " pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb"
Jul 09 01:21:56.892413 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:21:56.892386    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5d0e464-2250-46d1-9aeb-b580131ef435-istio-token\") pod \"e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb\" (UID: \"c5d0e464-2250-46d1-9aeb-b580131ef435\") " pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb"
Jul 09 01:21:56.892413 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:21:56.892408    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5d0e464-2250-46d1-9aeb-b580131ef435-istiod-ca-cert\") pod \"e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb\" (UID: \"c5d0e464-2250-46d1-9aeb-b580131ef435\") " pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb"
Jul 09 01:21:56.892685 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:21:56.892603    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5d0e464-2250-46d1-9aeb-b580131ef435-workload-certs\") pod \"e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb\" (UID: \"c5d0e464-2250-46d1-9aeb-b580131ef435\") " pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb"
Jul 09 01:21:56.892685 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:21:56.892647    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5d0e464-2250-46d1-9aeb-b580131ef435-credential-socket\") pod \"e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb\" (UID: \"c5d0e464-2250-46d1-9aeb-b580131ef435\") " pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb"
Jul 09 01:21:56.892796 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:21:56.892749    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5d0e464-2250-46d1-9aeb-b580131ef435-workload-socket\") pod \"e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb\" (UID: \"c5d0e464-2250-46d1-9aeb-b580131ef435\") " pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb"
Jul 09 01:21:56.892796 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:21:56.892782    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5d0e464-2250-46d1-9aeb-b580131ef435-istio-data\") pod \"e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb\" (UID: \"c5d0e464-2250-46d1-9aeb-b580131ef435\") " pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb"
Jul 09 01:21:56.892986 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:21:56.892952    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5d0e464-2250-46d1-9aeb-b580131ef435-credential-socket\") pod \"e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb\" (UID: \"c5d0e464-2250-46d1-9aeb-b580131ef435\") " pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb"
Jul 09 01:21:56.893139 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:21:56.893040    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5d0e464-2250-46d1-9aeb-b580131ef435-workload-socket\") pod \"e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb\" (UID: \"c5d0e464-2250-46d1-9aeb-b580131ef435\") " pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb"
Jul 09 01:21:56.893139 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:21:56.893126    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5d0e464-2250-46d1-9aeb-b580131ef435-istiod-ca-cert\") pod \"e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb\" (UID: \"c5d0e464-2250-46d1-9aeb-b580131ef435\") " pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb"
Jul 09 01:21:56.893325 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:21:56.893141    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5d0e464-2250-46d1-9aeb-b580131ef435-istio-data\") pod \"e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb\" (UID: \"c5d0e464-2250-46d1-9aeb-b580131ef435\") " pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb"
Jul 09 01:21:56.894602 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:21:56.894570    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5d0e464-2250-46d1-9aeb-b580131ef435-istio-envoy\") pod \"e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb\" (UID: \"c5d0e464-2250-46d1-9aeb-b580131ef435\") " pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb"
Jul 09 01:21:56.894960 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:21:56.894936    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5d0e464-2250-46d1-9aeb-b580131ef435-istio-podinfo\") pod \"e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb\" (UID: \"c5d0e464-2250-46d1-9aeb-b580131ef435\") " pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb"
Jul 09 01:21:56.900417 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:21:56.900360    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5d0e464-2250-46d1-9aeb-b580131ef435-istio-token\") pod \"e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb\" (UID: \"c5d0e464-2250-46d1-9aeb-b580131ef435\") " pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb"
Jul 09 01:21:56.900627 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:21:56.900605    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpz4d\" (UniqueName: \"kubernetes.io/projected/c5d0e464-2250-46d1-9aeb-b580131ef435-kube-api-access-rpz4d\") pod \"e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb\" (UID: \"c5d0e464-2250-46d1-9aeb-b580131ef435\") " pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb"
Jul 09 01:21:56.962288 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:21:56.962253    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb"
Jul 09 01:21:57.099087 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:21:57.099052    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb"]
Jul 09 01:21:57.102413 ip-10-0-133-31 kubenswrapper[2557]: W0709 01:21:57.102361    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5d0e464_2250_46d1_9aeb_b580131ef435.slice/crio-11b36c670f9f6c035aa82b4a1b111c3c342aeb885978a33e797d6e074ce0ec95 WatchSource:0}: Error finding container 11b36c670f9f6c035aa82b4a1b111c3c342aeb885978a33e797d6e074ce0ec95: Status 404 returned error can't find the container with id 11b36c670f9f6c035aa82b4a1b111c3c342aeb885978a33e797d6e074ce0ec95
Jul 09 01:21:57.105028 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:21:57.104979    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:21:57.105125 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:21:57.105063    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:21:57.105170 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:21:57.105139    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:21:57.364609 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:21:57.364574    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb" event={"ID":"c5d0e464-2250-46d1-9aeb-b580131ef435","Type":"ContainerStarted","Data":"730a80bd607057d059fc38c82897f02afc2a0381fe29ac7ffc61c912fa3de960"}
Jul 09 01:21:57.364797 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:21:57.364626    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb" event={"ID":"c5d0e464-2250-46d1-9aeb-b580131ef435","Type":"ContainerStarted","Data":"11b36c670f9f6c035aa82b4a1b111c3c342aeb885978a33e797d6e074ce0ec95"}
Jul 09 01:21:57.383199 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:21:57.383149    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb" podStartSLOduration=1.383133146 podStartE2EDuration="1.383133146s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:21:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:21:57.381070514 +0000 UTC m=+1624.851213243" watchObservedRunningTime="2026-07-09 01:21:57.383133146 +0000 UTC m=+1624.853275875"
Jul 09 01:21:57.962608 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:21:57.962569    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb"
Jul 09 01:21:58.968613 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:21:58.968579    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb"
Jul 09 01:21:59.374814 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:21:59.374724    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb"
Jul 09 01:21:59.375590 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:21:59.375570    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb"
Jul 09 01:22:01.998304 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:01.998269    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:22:10.432368 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:10.432330    2557 generic.go:356] "Generic (PLEG): container finished" podID="c5d0e464-2250-46d1-9aeb-b580131ef435" containerID="730a80bd607057d059fc38c82897f02afc2a0381fe29ac7ffc61c912fa3de960" exitCode=0
Jul 09 01:22:10.432833 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:10.432403    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb" event={"ID":"c5d0e464-2250-46d1-9aeb-b580131ef435","Type":"ContainerDied","Data":"730a80bd607057d059fc38c82897f02afc2a0381fe29ac7ffc61c912fa3de960"}
Jul 09 01:22:10.432833 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:10.432789    2557 scope.go:117] "RemoveContainer" containerID="730a80bd607057d059fc38c82897f02afc2a0381fe29ac7ffc61c912fa3de960"
Jul 09 01:22:10.433753 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:10.433727    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:22:10.433806 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:10.433794    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:22:10.433849 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:10.433835    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:22:11.439329 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:11.439293    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb" event={"ID":"c5d0e464-2250-46d1-9aeb-b580131ef435","Type":"ContainerStarted","Data":"d5fb3cbf299d86bd959f6d6a53d909b9dca27e1fa9e94e9fc4cbd5b49629b761"}
Jul 09 01:22:11.963188 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:11.963144    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb"
Jul 09 01:22:11.964499 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:11.964474    2557 patch_prober.go:28] interesting pod/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Jul 09 01:22:11.964599 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:11.964522    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb" podUID="c5d0e464-2250-46d1-9aeb-b580131ef435" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Jul 09 01:22:12.963078 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:12.963039    2557 patch_prober.go:28] interesting pod/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Jul 09 01:22:12.963514 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:12.963095    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb" podUID="c5d0e464-2250-46d1-9aeb-b580131ef435" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Jul 09 01:22:13.963159 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:13.963117    2557 patch_prober.go:28] interesting pod/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Jul 09 01:22:13.963578 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:13.963179    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb" podUID="c5d0e464-2250-46d1-9aeb-b580131ef435" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Jul 09 01:22:14.375256 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:14.375178    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb"
Jul 09 01:22:14.963310 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:14.963272    2557 patch_prober.go:28] interesting pod/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Jul 09 01:22:14.963732 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:14.963329    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb" podUID="c5d0e464-2250-46d1-9aeb-b580131ef435" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Jul 09 01:22:15.491767 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:15.491733    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:22:15.972005 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:15.971976    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb"
Jul 09 01:22:15.973027 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:15.973003    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb"
Jul 09 01:22:17.404706 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:17.404671    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb"]
Jul 09 01:22:17.468273 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:17.468227    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb" podUID="c5d0e464-2250-46d1-9aeb-b580131ef435" containerName="istio-proxy" containerID="cri-o://d5fb3cbf299d86bd959f6d6a53d909b9dca27e1fa9e94e9fc4cbd5b49629b761" gracePeriod=30
Jul 09 01:22:22.714034 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:22.714001    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb"
Jul 09 01:22:22.824994 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:22.824899    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5d0e464-2250-46d1-9aeb-b580131ef435-istio-data\") pod \"c5d0e464-2250-46d1-9aeb-b580131ef435\" (UID: \"c5d0e464-2250-46d1-9aeb-b580131ef435\") "
Jul 09 01:22:22.824994 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:22.824951    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rpz4d\" (UniqueName: \"kubernetes.io/projected/c5d0e464-2250-46d1-9aeb-b580131ef435-kube-api-access-rpz4d\") pod \"c5d0e464-2250-46d1-9aeb-b580131ef435\" (UID: \"c5d0e464-2250-46d1-9aeb-b580131ef435\") "
Jul 09 01:22:22.824994 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:22.824978    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5d0e464-2250-46d1-9aeb-b580131ef435-istio-token\") pod \"c5d0e464-2250-46d1-9aeb-b580131ef435\" (UID: \"c5d0e464-2250-46d1-9aeb-b580131ef435\") "
Jul 09 01:22:22.825277 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:22.825000    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5d0e464-2250-46d1-9aeb-b580131ef435-istiod-ca-cert\") pod \"c5d0e464-2250-46d1-9aeb-b580131ef435\" (UID: \"c5d0e464-2250-46d1-9aeb-b580131ef435\") "
Jul 09 01:22:22.825277 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:22.825031    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5d0e464-2250-46d1-9aeb-b580131ef435-workload-socket\") pod \"c5d0e464-2250-46d1-9aeb-b580131ef435\" (UID: \"c5d0e464-2250-46d1-9aeb-b580131ef435\") "
Jul 09 01:22:22.825277 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:22.825079    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5d0e464-2250-46d1-9aeb-b580131ef435-workload-certs\") pod \"c5d0e464-2250-46d1-9aeb-b580131ef435\" (UID: \"c5d0e464-2250-46d1-9aeb-b580131ef435\") "
Jul 09 01:22:22.825277 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:22.825099    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5d0e464-2250-46d1-9aeb-b580131ef435-istio-envoy\") pod \"c5d0e464-2250-46d1-9aeb-b580131ef435\" (UID: \"c5d0e464-2250-46d1-9aeb-b580131ef435\") "
Jul 09 01:22:22.825277 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:22.825136    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5d0e464-2250-46d1-9aeb-b580131ef435-credential-socket\") pod \"c5d0e464-2250-46d1-9aeb-b580131ef435\" (UID: \"c5d0e464-2250-46d1-9aeb-b580131ef435\") "
Jul 09 01:22:22.825277 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:22.825201    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5d0e464-2250-46d1-9aeb-b580131ef435-istio-podinfo\") pod \"c5d0e464-2250-46d1-9aeb-b580131ef435\" (UID: \"c5d0e464-2250-46d1-9aeb-b580131ef435\") "
Jul 09 01:22:22.825725 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:22.825703    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5d0e464-2250-46d1-9aeb-b580131ef435-istio-data" (OuterVolumeSpecName: "istio-data") pod "c5d0e464-2250-46d1-9aeb-b580131ef435" (UID: "c5d0e464-2250-46d1-9aeb-b580131ef435"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:22:22.826440 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:22.826412    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5d0e464-2250-46d1-9aeb-b580131ef435-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c5d0e464-2250-46d1-9aeb-b580131ef435" (UID: "c5d0e464-2250-46d1-9aeb-b580131ef435"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:22:22.826656 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:22.826613    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5d0e464-2250-46d1-9aeb-b580131ef435-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c5d0e464-2250-46d1-9aeb-b580131ef435" (UID: "c5d0e464-2250-46d1-9aeb-b580131ef435"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:22:22.826819 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:22.826660    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5d0e464-2250-46d1-9aeb-b580131ef435-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c5d0e464-2250-46d1-9aeb-b580131ef435" (UID: "c5d0e464-2250-46d1-9aeb-b580131ef435"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 01:22:22.826819 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:22.826739    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5d0e464-2250-46d1-9aeb-b580131ef435-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c5d0e464-2250-46d1-9aeb-b580131ef435" (UID: "c5d0e464-2250-46d1-9aeb-b580131ef435"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:22:22.828604 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:22.828578    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5d0e464-2250-46d1-9aeb-b580131ef435-istio-token" (OuterVolumeSpecName: "istio-token") pod "c5d0e464-2250-46d1-9aeb-b580131ef435" (UID: "c5d0e464-2250-46d1-9aeb-b580131ef435"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:22:22.828695 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:22.828633    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c5d0e464-2250-46d1-9aeb-b580131ef435-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c5d0e464-2250-46d1-9aeb-b580131ef435" (UID: "c5d0e464-2250-46d1-9aeb-b580131ef435"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 01:22:22.828695 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:22.828666    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5d0e464-2250-46d1-9aeb-b580131ef435-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c5d0e464-2250-46d1-9aeb-b580131ef435" (UID: "c5d0e464-2250-46d1-9aeb-b580131ef435"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:22:22.828773 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:22.828717    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5d0e464-2250-46d1-9aeb-b580131ef435-kube-api-access-rpz4d" (OuterVolumeSpecName: "kube-api-access-rpz4d") pod "c5d0e464-2250-46d1-9aeb-b580131ef435" (UID: "c5d0e464-2250-46d1-9aeb-b580131ef435"). InnerVolumeSpecName "kube-api-access-rpz4d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:22:22.926476 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:22.926436    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5d0e464-2250-46d1-9aeb-b580131ef435-credential-socket\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:22:22.926476 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:22.926468    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5d0e464-2250-46d1-9aeb-b580131ef435-istio-podinfo\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:22:22.926476 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:22.926479    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5d0e464-2250-46d1-9aeb-b580131ef435-istio-data\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:22:22.926717 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:22.926488    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rpz4d\" (UniqueName: \"kubernetes.io/projected/c5d0e464-2250-46d1-9aeb-b580131ef435-kube-api-access-rpz4d\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:22:22.926717 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:22.926497    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5d0e464-2250-46d1-9aeb-b580131ef435-istio-token\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:22:22.926717 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:22.926506    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5d0e464-2250-46d1-9aeb-b580131ef435-istiod-ca-cert\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:22:22.926717 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:22.926513    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5d0e464-2250-46d1-9aeb-b580131ef435-workload-socket\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:22:22.926717 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:22.926521    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5d0e464-2250-46d1-9aeb-b580131ef435-workload-certs\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:22:22.926717 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:22.926528    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5d0e464-2250-46d1-9aeb-b580131ef435-istio-envoy\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:22:23.497945 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:23.497908    2557 generic.go:356] "Generic (PLEG): container finished" podID="c5d0e464-2250-46d1-9aeb-b580131ef435" containerID="d5fb3cbf299d86bd959f6d6a53d909b9dca27e1fa9e94e9fc4cbd5b49629b761" exitCode=0
Jul 09 01:22:23.498126 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:23.497957    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb"
Jul 09 01:22:23.498126 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:23.497989    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb" event={"ID":"c5d0e464-2250-46d1-9aeb-b580131ef435","Type":"ContainerDied","Data":"d5fb3cbf299d86bd959f6d6a53d909b9dca27e1fa9e94e9fc4cbd5b49629b761"}
Jul 09 01:22:23.498126 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:23.498042    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb" event={"ID":"c5d0e464-2250-46d1-9aeb-b580131ef435","Type":"ContainerDied","Data":"11b36c670f9f6c035aa82b4a1b111c3c342aeb885978a33e797d6e074ce0ec95"}
Jul 09 01:22:23.498126 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:23.498068    2557 scope.go:117] "RemoveContainer" containerID="d5fb3cbf299d86bd959f6d6a53d909b9dca27e1fa9e94e9fc4cbd5b49629b761"
Jul 09 01:22:23.506506 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:23.506483    2557 scope.go:117] "RemoveContainer" containerID="730a80bd607057d059fc38c82897f02afc2a0381fe29ac7ffc61c912fa3de960"
Jul 09 01:22:23.514218 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:23.514182    2557 scope.go:117] "RemoveContainer" containerID="d5fb3cbf299d86bd959f6d6a53d909b9dca27e1fa9e94e9fc4cbd5b49629b761"
Jul 09 01:22:23.514682 ip-10-0-133-31 kubenswrapper[2557]: E0709 01:22:23.514573    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5fb3cbf299d86bd959f6d6a53d909b9dca27e1fa9e94e9fc4cbd5b49629b761\": container with ID starting with d5fb3cbf299d86bd959f6d6a53d909b9dca27e1fa9e94e9fc4cbd5b49629b761 not found: ID does not exist" containerID="d5fb3cbf299d86bd959f6d6a53d909b9dca27e1fa9e94e9fc4cbd5b49629b761"
Jul 09 01:22:23.514682 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:23.514609    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5fb3cbf299d86bd959f6d6a53d909b9dca27e1fa9e94e9fc4cbd5b49629b761"} err="failed to get container status \"d5fb3cbf299d86bd959f6d6a53d909b9dca27e1fa9e94e9fc4cbd5b49629b761\": rpc error: code = NotFound desc = could not find container \"d5fb3cbf299d86bd959f6d6a53d909b9dca27e1fa9e94e9fc4cbd5b49629b761\": container with ID starting with d5fb3cbf299d86bd959f6d6a53d909b9dca27e1fa9e94e9fc4cbd5b49629b761 not found: ID does not exist"
Jul 09 01:22:23.514682 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:23.514631    2557 scope.go:117] "RemoveContainer" containerID="730a80bd607057d059fc38c82897f02afc2a0381fe29ac7ffc61c912fa3de960"
Jul 09 01:22:23.514900 ip-10-0-133-31 kubenswrapper[2557]: E0709 01:22:23.514882    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"730a80bd607057d059fc38c82897f02afc2a0381fe29ac7ffc61c912fa3de960\": container with ID starting with 730a80bd607057d059fc38c82897f02afc2a0381fe29ac7ffc61c912fa3de960 not found: ID does not exist" containerID="730a80bd607057d059fc38c82897f02afc2a0381fe29ac7ffc61c912fa3de960"
Jul 09 01:22:23.514939 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:23.514906    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"730a80bd607057d059fc38c82897f02afc2a0381fe29ac7ffc61c912fa3de960"} err="failed to get container status \"730a80bd607057d059fc38c82897f02afc2a0381fe29ac7ffc61c912fa3de960\": rpc error: code = NotFound desc = could not find container \"730a80bd607057d059fc38c82897f02afc2a0381fe29ac7ffc61c912fa3de960\": container with ID starting with 730a80bd607057d059fc38c82897f02afc2a0381fe29ac7ffc61c912fa3de960 not found: ID does not exist"
Jul 09 01:22:23.515998 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:23.515981    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb"]
Jul 09 01:22:23.519796 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:23.519776    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb"]
Jul 09 01:22:25.039278 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:25.039237    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5d0e464-2250-46d1-9aeb-b580131ef435" path="/var/lib/kubelet/pods/c5d0e464-2250-46d1-9aeb-b580131ef435/volumes"
Jul 09 01:22:36.586923 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:36.586887    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6"]
Jul 09 01:22:36.587394 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:36.587261    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5d0e464-2250-46d1-9aeb-b580131ef435" containerName="istio-proxy"
Jul 09 01:22:36.587394 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:36.587273    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5d0e464-2250-46d1-9aeb-b580131ef435" containerName="istio-proxy"
Jul 09 01:22:36.587394 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:36.587348    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5d0e464-2250-46d1-9aeb-b580131ef435" containerName="istio-proxy"
Jul 09 01:22:36.587394 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:36.587357    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5d0e464-2250-46d1-9aeb-b580131ef435" containerName="istio-proxy"
Jul 09 01:22:36.590559 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:36.590542    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6"
Jul 09 01:22:36.592688 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:36.592664    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-e0f06239-openshift-default-dockercfg-x99wh\""
Jul 09 01:22:36.601264 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:36.601239    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6"]
Jul 09 01:22:36.645418 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:36.645382    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fea88b86-9bb1-453c-83b9-ceb85c3fd785-istio-podinfo\") pod \"e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6\" (UID: \"fea88b86-9bb1-453c-83b9-ceb85c3fd785\") " pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6"
Jul 09 01:22:36.645593 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:36.645427    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lnx2\" (UniqueName: \"kubernetes.io/projected/fea88b86-9bb1-453c-83b9-ceb85c3fd785-kube-api-access-5lnx2\") pod \"e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6\" (UID: \"fea88b86-9bb1-453c-83b9-ceb85c3fd785\") " pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6"
Jul 09 01:22:36.645593 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:36.645462    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fea88b86-9bb1-453c-83b9-ceb85c3fd785-istio-token\") pod \"e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6\" (UID: \"fea88b86-9bb1-453c-83b9-ceb85c3fd785\") " pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6"
Jul 09 01:22:36.645593 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:36.645493    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fea88b86-9bb1-453c-83b9-ceb85c3fd785-workload-socket\") pod \"e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6\" (UID: \"fea88b86-9bb1-453c-83b9-ceb85c3fd785\") " pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6"
Jul 09 01:22:36.645593 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:36.645560    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fea88b86-9bb1-453c-83b9-ceb85c3fd785-credential-socket\") pod \"e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6\" (UID: \"fea88b86-9bb1-453c-83b9-ceb85c3fd785\") " pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6"
Jul 09 01:22:36.645798 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:36.645597    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fea88b86-9bb1-453c-83b9-ceb85c3fd785-istio-envoy\") pod \"e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6\" (UID: \"fea88b86-9bb1-453c-83b9-ceb85c3fd785\") " pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6"
Jul 09 01:22:36.645798 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:36.645631    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fea88b86-9bb1-453c-83b9-ceb85c3fd785-istio-data\") pod \"e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6\" (UID: \"fea88b86-9bb1-453c-83b9-ceb85c3fd785\") " pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6"
Jul 09 01:22:36.645798 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:36.645662    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fea88b86-9bb1-453c-83b9-ceb85c3fd785-istiod-ca-cert\") pod \"e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6\" (UID: \"fea88b86-9bb1-453c-83b9-ceb85c3fd785\") " pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6"
Jul 09 01:22:36.645798 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:36.645704    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fea88b86-9bb1-453c-83b9-ceb85c3fd785-workload-certs\") pod \"e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6\" (UID: \"fea88b86-9bb1-453c-83b9-ceb85c3fd785\") " pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6"
Jul 09 01:22:36.747124 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:36.747080    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lnx2\" (UniqueName: \"kubernetes.io/projected/fea88b86-9bb1-453c-83b9-ceb85c3fd785-kube-api-access-5lnx2\") pod \"e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6\" (UID: \"fea88b86-9bb1-453c-83b9-ceb85c3fd785\") " pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6"
Jul 09 01:22:36.747333 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:36.747135    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fea88b86-9bb1-453c-83b9-ceb85c3fd785-istio-token\") pod \"e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6\" (UID: \"fea88b86-9bb1-453c-83b9-ceb85c3fd785\") " pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6"
Jul 09 01:22:36.747333 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:36.747165    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fea88b86-9bb1-453c-83b9-ceb85c3fd785-workload-socket\") pod \"e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6\" (UID: \"fea88b86-9bb1-453c-83b9-ceb85c3fd785\") " pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6"
Jul 09 01:22:36.747333 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:36.747244    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fea88b86-9bb1-453c-83b9-ceb85c3fd785-credential-socket\") pod \"e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6\" (UID: \"fea88b86-9bb1-453c-83b9-ceb85c3fd785\") " pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6"
Jul 09 01:22:36.747333 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:36.747276    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fea88b86-9bb1-453c-83b9-ceb85c3fd785-istio-envoy\") pod \"e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6\" (UID: \"fea88b86-9bb1-453c-83b9-ceb85c3fd785\") " pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6"
Jul 09 01:22:36.747638 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:36.747381    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fea88b86-9bb1-453c-83b9-ceb85c3fd785-istio-data\") pod \"e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6\" (UID: \"fea88b86-9bb1-453c-83b9-ceb85c3fd785\") " pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6"
Jul 09 01:22:36.747638 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:36.747447    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fea88b86-9bb1-453c-83b9-ceb85c3fd785-istiod-ca-cert\") pod \"e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6\" (UID: \"fea88b86-9bb1-453c-83b9-ceb85c3fd785\") " pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6"
Jul 09 01:22:36.747638 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:36.747503    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fea88b86-9bb1-453c-83b9-ceb85c3fd785-workload-certs\") pod \"e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6\" (UID: \"fea88b86-9bb1-453c-83b9-ceb85c3fd785\") " pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6"
Jul 09 01:22:36.747638 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:36.747566    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fea88b86-9bb1-453c-83b9-ceb85c3fd785-istio-podinfo\") pod \"e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6\" (UID: \"fea88b86-9bb1-453c-83b9-ceb85c3fd785\") " pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6"
Jul 09 01:22:36.747855 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:36.747744    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fea88b86-9bb1-453c-83b9-ceb85c3fd785-credential-socket\") pod \"e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6\" (UID: \"fea88b86-9bb1-453c-83b9-ceb85c3fd785\") " pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6"
Jul 09 01:22:36.747855 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:36.747762    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fea88b86-9bb1-453c-83b9-ceb85c3fd785-istio-data\") pod \"e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6\" (UID: \"fea88b86-9bb1-453c-83b9-ceb85c3fd785\") " pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6"
Jul 09 01:22:36.747855 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:36.747843    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fea88b86-9bb1-453c-83b9-ceb85c3fd785-workload-socket\") pod \"e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6\" (UID: \"fea88b86-9bb1-453c-83b9-ceb85c3fd785\") " pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6"
Jul 09 01:22:36.748007 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:36.747953    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fea88b86-9bb1-453c-83b9-ceb85c3fd785-workload-certs\") pod \"e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6\" (UID: \"fea88b86-9bb1-453c-83b9-ceb85c3fd785\") " pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6"
Jul 09 01:22:36.748339 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:36.748317    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fea88b86-9bb1-453c-83b9-ceb85c3fd785-istiod-ca-cert\") pod \"e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6\" (UID: \"fea88b86-9bb1-453c-83b9-ceb85c3fd785\") " pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6"
Jul 09 01:22:36.749891 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:36.749864    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fea88b86-9bb1-453c-83b9-ceb85c3fd785-istio-envoy\") pod \"e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6\" (UID: \"fea88b86-9bb1-453c-83b9-ceb85c3fd785\") " pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6"
Jul 09 01:22:36.749991 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:36.749964    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fea88b86-9bb1-453c-83b9-ceb85c3fd785-istio-podinfo\") pod \"e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6\" (UID: \"fea88b86-9bb1-453c-83b9-ceb85c3fd785\") " pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6"
Jul 09 01:22:36.755376 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:36.755351    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fea88b86-9bb1-453c-83b9-ceb85c3fd785-istio-token\") pod \"e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6\" (UID: \"fea88b86-9bb1-453c-83b9-ceb85c3fd785\") " pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6"
Jul 09 01:22:36.755460 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:36.755445    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lnx2\" (UniqueName: \"kubernetes.io/projected/fea88b86-9bb1-453c-83b9-ceb85c3fd785-kube-api-access-5lnx2\") pod \"e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6\" (UID: \"fea88b86-9bb1-453c-83b9-ceb85c3fd785\") " pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6"
Jul 09 01:22:36.902481 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:36.902390    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6"
Jul 09 01:22:37.044946 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:37.044921    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6"]
Jul 09 01:22:37.047573 ip-10-0-133-31 kubenswrapper[2557]: W0709 01:22:37.047549    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfea88b86_9bb1_453c_83b9_ceb85c3fd785.slice/crio-33e58c9d32f35e98a3d6733867878d13508a7d9dee7a65a0c955e1fa42608041 WatchSource:0}: Error finding container 33e58c9d32f35e98a3d6733867878d13508a7d9dee7a65a0c955e1fa42608041: Status 404 returned error can't find the container with id 33e58c9d32f35e98a3d6733867878d13508a7d9dee7a65a0c955e1fa42608041
Jul 09 01:22:37.053037 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:37.052998    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:22:37.053150 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:37.053081    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:22:37.053150 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:37.053124    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:22:37.561281 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:37.561241    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6" event={"ID":"fea88b86-9bb1-453c-83b9-ceb85c3fd785","Type":"ContainerStarted","Data":"61acf181d53c968556f3c41b3fb9a9699a8365d2b147cd567ef638c63c4e7e68"}
Jul 09 01:22:37.561485 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:37.561302    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6" event={"ID":"fea88b86-9bb1-453c-83b9-ceb85c3fd785","Type":"ContainerStarted","Data":"33e58c9d32f35e98a3d6733867878d13508a7d9dee7a65a0c955e1fa42608041"}
Jul 09 01:22:37.585422 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:37.585369    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6" podStartSLOduration=1.585353265 podStartE2EDuration="1.585353265s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:22:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:22:37.582982467 +0000 UTC m=+1665.053125200" watchObservedRunningTime="2026-07-09 01:22:37.585353265 +0000 UTC m=+1665.055495994"
Jul 09 01:22:37.903381 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:37.903293    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6"
Jul 09 01:22:38.907832 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:38.907802    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6"
Jul 09 01:22:39.571995 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:39.571962    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6"
Jul 09 01:22:39.572929 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:39.572903    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6"
Jul 09 01:22:42.287742 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:42.287702    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:22:50.634981 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:50.634942    2557 generic.go:356] "Generic (PLEG): container finished" podID="fea88b86-9bb1-453c-83b9-ceb85c3fd785" containerID="61acf181d53c968556f3c41b3fb9a9699a8365d2b147cd567ef638c63c4e7e68" exitCode=0
Jul 09 01:22:50.635476 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:50.635019    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6" event={"ID":"fea88b86-9bb1-453c-83b9-ceb85c3fd785","Type":"ContainerDied","Data":"61acf181d53c968556f3c41b3fb9a9699a8365d2b147cd567ef638c63c4e7e68"}
Jul 09 01:22:50.635476 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:50.635434    2557 scope.go:117] "RemoveContainer" containerID="61acf181d53c968556f3c41b3fb9a9699a8365d2b147cd567ef638c63c4e7e68"
Jul 09 01:22:50.636537 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:50.636510    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:22:50.636633 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:50.636579    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:22:50.636633 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:50.636620    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:22:51.641661 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:51.641620    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6" event={"ID":"fea88b86-9bb1-453c-83b9-ceb85c3fd785","Type":"ContainerStarted","Data":"1f362c8b84dc1cc51c1241430f96388e2b7c82c76304e4a7ac59d469fa11deaa"}
Jul 09 01:22:51.903116 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:51.903007    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6"
Jul 09 01:22:51.904653 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:51.904625    2557 patch_prober.go:28] interesting pod/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 09 01:22:51.904729 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:51.904704    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6" podUID="fea88b86-9bb1-453c-83b9-ceb85c3fd785" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 09 01:22:52.903800 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:52.903760    2557 patch_prober.go:28] interesting pod/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 09 01:22:52.904311 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:52.903833    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6" podUID="fea88b86-9bb1-453c-83b9-ceb85c3fd785" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 09 01:22:53.903046 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:53.903009    2557 patch_prober.go:28] interesting pod/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 09 01:22:53.903249 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:53.903070    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6" podUID="fea88b86-9bb1-453c-83b9-ceb85c3fd785" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 09 01:22:54.572854 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:54.572810    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6"
Jul 09 01:22:54.903804 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:54.903706    2557 patch_prober.go:28] interesting pod/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 09 01:22:54.903804 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:54.903788    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6" podUID="fea88b86-9bb1-453c-83b9-ceb85c3fd785" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 09 01:22:55.906742 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:55.906707    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6"
Jul 09 01:22:55.907608 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:22:55.907587    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6"
Jul 09 01:23:17.794802 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:23:17.794706    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:23:30.791890 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:23:30.791850    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:23:42.101985 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:23:42.101949    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:23:51.596432 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:23:51.596394    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:24:27.696307 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:24:27.696268    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:24:30.581632 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:24:30.581598    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6"]
Jul 09 01:24:30.582127 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:24:30.581815    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6" podUID="fea88b86-9bb1-453c-83b9-ceb85c3fd785" containerName="istio-proxy" containerID="cri-o://1f362c8b84dc1cc51c1241430f96388e2b7c82c76304e4a7ac59d469fa11deaa" gracePeriod=30
Jul 09 01:24:35.835887 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:24:35.835857    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6"
Jul 09 01:24:36.004923 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:24:36.004873    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fea88b86-9bb1-453c-83b9-ceb85c3fd785-istio-envoy\") pod \"fea88b86-9bb1-453c-83b9-ceb85c3fd785\" (UID: \"fea88b86-9bb1-453c-83b9-ceb85c3fd785\") "
Jul 09 01:24:36.004923 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:24:36.004932    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fea88b86-9bb1-453c-83b9-ceb85c3fd785-istio-data\") pod \"fea88b86-9bb1-453c-83b9-ceb85c3fd785\" (UID: \"fea88b86-9bb1-453c-83b9-ceb85c3fd785\") "
Jul 09 01:24:36.005197 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:24:36.004963    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fea88b86-9bb1-453c-83b9-ceb85c3fd785-workload-certs\") pod \"fea88b86-9bb1-453c-83b9-ceb85c3fd785\" (UID: \"fea88b86-9bb1-453c-83b9-ceb85c3fd785\") "
Jul 09 01:24:36.005197 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:24:36.004984    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fea88b86-9bb1-453c-83b9-ceb85c3fd785-istio-podinfo\") pod \"fea88b86-9bb1-453c-83b9-ceb85c3fd785\" (UID: \"fea88b86-9bb1-453c-83b9-ceb85c3fd785\") "
Jul 09 01:24:36.005197 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:24:36.005007    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5lnx2\" (UniqueName: \"kubernetes.io/projected/fea88b86-9bb1-453c-83b9-ceb85c3fd785-kube-api-access-5lnx2\") pod \"fea88b86-9bb1-453c-83b9-ceb85c3fd785\" (UID: \"fea88b86-9bb1-453c-83b9-ceb85c3fd785\") "
Jul 09 01:24:36.005197 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:24:36.005032    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fea88b86-9bb1-453c-83b9-ceb85c3fd785-workload-socket\") pod \"fea88b86-9bb1-453c-83b9-ceb85c3fd785\" (UID: \"fea88b86-9bb1-453c-83b9-ceb85c3fd785\") "
Jul 09 01:24:36.005197 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:24:36.005084    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fea88b86-9bb1-453c-83b9-ceb85c3fd785-credential-socket\") pod \"fea88b86-9bb1-453c-83b9-ceb85c3fd785\" (UID: \"fea88b86-9bb1-453c-83b9-ceb85c3fd785\") "
Jul 09 01:24:36.005197 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:24:36.005111    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fea88b86-9bb1-453c-83b9-ceb85c3fd785-istiod-ca-cert\") pod \"fea88b86-9bb1-453c-83b9-ceb85c3fd785\" (UID: \"fea88b86-9bb1-453c-83b9-ceb85c3fd785\") "
Jul 09 01:24:36.005197 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:24:36.005195    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fea88b86-9bb1-453c-83b9-ceb85c3fd785-istio-token\") pod \"fea88b86-9bb1-453c-83b9-ceb85c3fd785\" (UID: \"fea88b86-9bb1-453c-83b9-ceb85c3fd785\") "
Jul 09 01:24:36.005602 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:24:36.005329    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fea88b86-9bb1-453c-83b9-ceb85c3fd785-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fea88b86-9bb1-453c-83b9-ceb85c3fd785" (UID: "fea88b86-9bb1-453c-83b9-ceb85c3fd785"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:24:36.005602 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:24:36.005406    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fea88b86-9bb1-453c-83b9-ceb85c3fd785-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fea88b86-9bb1-453c-83b9-ceb85c3fd785" (UID: "fea88b86-9bb1-453c-83b9-ceb85c3fd785"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:24:36.005709 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:24:36.005490    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fea88b86-9bb1-453c-83b9-ceb85c3fd785-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fea88b86-9bb1-453c-83b9-ceb85c3fd785" (UID: "fea88b86-9bb1-453c-83b9-ceb85c3fd785"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:24:36.005709 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:24:36.005589    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fea88b86-9bb1-453c-83b9-ceb85c3fd785-workload-certs\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:24:36.005816 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:24:36.005755    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fea88b86-9bb1-453c-83b9-ceb85c3fd785-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fea88b86-9bb1-453c-83b9-ceb85c3fd785" (UID: "fea88b86-9bb1-453c-83b9-ceb85c3fd785"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 01:24:36.005936 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:24:36.005915    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fea88b86-9bb1-453c-83b9-ceb85c3fd785-istio-data" (OuterVolumeSpecName: "istio-data") pod "fea88b86-9bb1-453c-83b9-ceb85c3fd785" (UID: "fea88b86-9bb1-453c-83b9-ceb85c3fd785"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:24:36.007459 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:24:36.007424    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fea88b86-9bb1-453c-83b9-ceb85c3fd785-istio-token" (OuterVolumeSpecName: "istio-token") pod "fea88b86-9bb1-453c-83b9-ceb85c3fd785" (UID: "fea88b86-9bb1-453c-83b9-ceb85c3fd785"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:24:36.007459 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:24:36.007422    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fea88b86-9bb1-453c-83b9-ceb85c3fd785-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fea88b86-9bb1-453c-83b9-ceb85c3fd785" (UID: "fea88b86-9bb1-453c-83b9-ceb85c3fd785"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 01:24:36.007725 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:24:36.007701    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fea88b86-9bb1-453c-83b9-ceb85c3fd785-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fea88b86-9bb1-453c-83b9-ceb85c3fd785" (UID: "fea88b86-9bb1-453c-83b9-ceb85c3fd785"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:24:36.007807 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:24:36.007710    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fea88b86-9bb1-453c-83b9-ceb85c3fd785-kube-api-access-5lnx2" (OuterVolumeSpecName: "kube-api-access-5lnx2") pod "fea88b86-9bb1-453c-83b9-ceb85c3fd785" (UID: "fea88b86-9bb1-453c-83b9-ceb85c3fd785"). InnerVolumeSpecName "kube-api-access-5lnx2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:24:36.106476 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:24:36.106427    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fea88b86-9bb1-453c-83b9-ceb85c3fd785-istio-envoy\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:24:36.106476 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:24:36.106471    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fea88b86-9bb1-453c-83b9-ceb85c3fd785-istio-data\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:24:36.106476 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:24:36.106481    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fea88b86-9bb1-453c-83b9-ceb85c3fd785-istio-podinfo\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:24:36.106476 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:24:36.106490    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5lnx2\" (UniqueName: \"kubernetes.io/projected/fea88b86-9bb1-453c-83b9-ceb85c3fd785-kube-api-access-5lnx2\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:24:36.106906 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:24:36.106500    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fea88b86-9bb1-453c-83b9-ceb85c3fd785-workload-socket\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:24:36.106906 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:24:36.106508    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fea88b86-9bb1-453c-83b9-ceb85c3fd785-credential-socket\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:24:36.106906 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:24:36.106516    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fea88b86-9bb1-453c-83b9-ceb85c3fd785-istiod-ca-cert\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:24:36.106906 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:24:36.106524    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fea88b86-9bb1-453c-83b9-ceb85c3fd785-istio-token\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:24:36.114518 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:24:36.114482    2557 generic.go:356] "Generic (PLEG): container finished" podID="fea88b86-9bb1-453c-83b9-ceb85c3fd785" containerID="1f362c8b84dc1cc51c1241430f96388e2b7c82c76304e4a7ac59d469fa11deaa" exitCode=0
Jul 09 01:24:36.114676 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:24:36.114537    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6"
Jul 09 01:24:36.114676 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:24:36.114544    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6" event={"ID":"fea88b86-9bb1-453c-83b9-ceb85c3fd785","Type":"ContainerDied","Data":"1f362c8b84dc1cc51c1241430f96388e2b7c82c76304e4a7ac59d469fa11deaa"}
Jul 09 01:24:36.114676 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:24:36.114585    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6" event={"ID":"fea88b86-9bb1-453c-83b9-ceb85c3fd785","Type":"ContainerDied","Data":"33e58c9d32f35e98a3d6733867878d13508a7d9dee7a65a0c955e1fa42608041"}
Jul 09 01:24:36.114676 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:24:36.114606    2557 scope.go:117] "RemoveContainer" containerID="1f362c8b84dc1cc51c1241430f96388e2b7c82c76304e4a7ac59d469fa11deaa"
Jul 09 01:24:36.124111 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:24:36.124093    2557 scope.go:117] "RemoveContainer" containerID="61acf181d53c968556f3c41b3fb9a9699a8365d2b147cd567ef638c63c4e7e68"
Jul 09 01:24:36.132133 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:24:36.132113    2557 scope.go:117] "RemoveContainer" containerID="1f362c8b84dc1cc51c1241430f96388e2b7c82c76304e4a7ac59d469fa11deaa"
Jul 09 01:24:36.132415 ip-10-0-133-31 kubenswrapper[2557]: E0709 01:24:36.132394    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f362c8b84dc1cc51c1241430f96388e2b7c82c76304e4a7ac59d469fa11deaa\": container with ID starting with 1f362c8b84dc1cc51c1241430f96388e2b7c82c76304e4a7ac59d469fa11deaa not found: ID does not exist" containerID="1f362c8b84dc1cc51c1241430f96388e2b7c82c76304e4a7ac59d469fa11deaa"
Jul 09 01:24:36.132484 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:24:36.132424    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f362c8b84dc1cc51c1241430f96388e2b7c82c76304e4a7ac59d469fa11deaa"} err="failed to get container status \"1f362c8b84dc1cc51c1241430f96388e2b7c82c76304e4a7ac59d469fa11deaa\": rpc error: code = NotFound desc = could not find container \"1f362c8b84dc1cc51c1241430f96388e2b7c82c76304e4a7ac59d469fa11deaa\": container with ID starting with 1f362c8b84dc1cc51c1241430f96388e2b7c82c76304e4a7ac59d469fa11deaa not found: ID does not exist"
Jul 09 01:24:36.132484 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:24:36.132444    2557 scope.go:117] "RemoveContainer" containerID="61acf181d53c968556f3c41b3fb9a9699a8365d2b147cd567ef638c63c4e7e68"
Jul 09 01:24:36.132686 ip-10-0-133-31 kubenswrapper[2557]: E0709 01:24:36.132667    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61acf181d53c968556f3c41b3fb9a9699a8365d2b147cd567ef638c63c4e7e68\": container with ID starting with 61acf181d53c968556f3c41b3fb9a9699a8365d2b147cd567ef638c63c4e7e68 not found: ID does not exist" containerID="61acf181d53c968556f3c41b3fb9a9699a8365d2b147cd567ef638c63c4e7e68"
Jul 09 01:24:36.132741 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:24:36.132697    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61acf181d53c968556f3c41b3fb9a9699a8365d2b147cd567ef638c63c4e7e68"} err="failed to get container status \"61acf181d53c968556f3c41b3fb9a9699a8365d2b147cd567ef638c63c4e7e68\": rpc error: code = NotFound desc = could not find container \"61acf181d53c968556f3c41b3fb9a9699a8365d2b147cd567ef638c63c4e7e68\": container with ID starting with 61acf181d53c968556f3c41b3fb9a9699a8365d2b147cd567ef638c63c4e7e68 not found: ID does not exist"
Jul 09 01:24:36.135744 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:24:36.135718    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6"]
Jul 09 01:24:36.139827 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:24:36.139806    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6"]
Jul 09 01:24:37.040002 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:24:37.039964    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fea88b86-9bb1-453c-83b9-ceb85c3fd785" path="/var/lib/kubelet/pods/fea88b86-9bb1-453c-83b9-ceb85c3fd785/volumes"
Jul 09 01:24:40.391291 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:24:40.391250    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:24:49.789372 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:24:49.789284    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:24:53.117941 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:24:53.117910    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z6kj2_7dc12511-b804-4ebc-8646-4d070d93a8cf/console-operator/1.log"
Jul 09 01:24:53.122075 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:24:53.122051    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z6kj2_7dc12511-b804-4ebc-8646-4d070d93a8cf/console-operator/1.log"
Jul 09 01:25:24.848680 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:24.848647    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc"]
Jul 09 01:25:24.849111 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:24.848976    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fea88b86-9bb1-453c-83b9-ceb85c3fd785" containerName="istio-proxy"
Jul 09 01:25:24.849111 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:24.848988    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="fea88b86-9bb1-453c-83b9-ceb85c3fd785" containerName="istio-proxy"
Jul 09 01:25:24.849111 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:24.849004    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fea88b86-9bb1-453c-83b9-ceb85c3fd785" containerName="istio-proxy"
Jul 09 01:25:24.849111 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:24.849010    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="fea88b86-9bb1-453c-83b9-ceb85c3fd785" containerName="istio-proxy"
Jul 09 01:25:24.849111 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:24.849026    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5d0e464-2250-46d1-9aeb-b580131ef435" containerName="istio-proxy"
Jul 09 01:25:24.849111 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:24.849032    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5d0e464-2250-46d1-9aeb-b580131ef435" containerName="istio-proxy"
Jul 09 01:25:24.849111 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:24.849091    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="fea88b86-9bb1-453c-83b9-ceb85c3fd785" containerName="istio-proxy"
Jul 09 01:25:24.849111 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:24.849098    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="fea88b86-9bb1-453c-83b9-ceb85c3fd785" containerName="istio-proxy"
Jul 09 01:25:24.852063 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:24.852045    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc"
Jul 09 01:25:24.854711 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:24.854688    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-3460b5-openshift-default-dockercfg-bt9nm\""
Jul 09 01:25:24.863586 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:24.863560    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc"]
Jul 09 01:25:24.930983 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:24.930949    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d74ee095-aab6-4803-b958-269012ec08f6-istio-podinfo\") pod \"e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc\" (UID: \"d74ee095-aab6-4803-b958-269012ec08f6\") " pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc"
Jul 09 01:25:24.931230 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:24.930997    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d74ee095-aab6-4803-b958-269012ec08f6-workload-socket\") pod \"e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc\" (UID: \"d74ee095-aab6-4803-b958-269012ec08f6\") " pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc"
Jul 09 01:25:24.931230 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:24.931060    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d74ee095-aab6-4803-b958-269012ec08f6-istio-data\") pod \"e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc\" (UID: \"d74ee095-aab6-4803-b958-269012ec08f6\") " pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc"
Jul 09 01:25:24.931230 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:24.931108    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d74ee095-aab6-4803-b958-269012ec08f6-istiod-ca-cert\") pod \"e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc\" (UID: \"d74ee095-aab6-4803-b958-269012ec08f6\") " pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc"
Jul 09 01:25:24.931230 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:24.931197    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d74ee095-aab6-4803-b958-269012ec08f6-istio-token\") pod \"e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc\" (UID: \"d74ee095-aab6-4803-b958-269012ec08f6\") " pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc"
Jul 09 01:25:24.931538 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:24.931278    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d74ee095-aab6-4803-b958-269012ec08f6-istio-envoy\") pod \"e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc\" (UID: \"d74ee095-aab6-4803-b958-269012ec08f6\") " pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc"
Jul 09 01:25:24.931538 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:24.931374    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d74ee095-aab6-4803-b958-269012ec08f6-credential-socket\") pod \"e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc\" (UID: \"d74ee095-aab6-4803-b958-269012ec08f6\") " pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc"
Jul 09 01:25:24.931538 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:24.931405    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wg2jl\" (UniqueName: \"kubernetes.io/projected/d74ee095-aab6-4803-b958-269012ec08f6-kube-api-access-wg2jl\") pod \"e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc\" (UID: \"d74ee095-aab6-4803-b958-269012ec08f6\") " pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc"
Jul 09 01:25:24.931538 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:24.931480    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d74ee095-aab6-4803-b958-269012ec08f6-workload-certs\") pod \"e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc\" (UID: \"d74ee095-aab6-4803-b958-269012ec08f6\") " pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc"
Jul 09 01:25:25.032576 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:25.032539    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d74ee095-aab6-4803-b958-269012ec08f6-istio-podinfo\") pod \"e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc\" (UID: \"d74ee095-aab6-4803-b958-269012ec08f6\") " pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc"
Jul 09 01:25:25.032761 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:25.032590    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d74ee095-aab6-4803-b958-269012ec08f6-workload-socket\") pod \"e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc\" (UID: \"d74ee095-aab6-4803-b958-269012ec08f6\") " pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc"
Jul 09 01:25:25.032761 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:25.032625    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d74ee095-aab6-4803-b958-269012ec08f6-istio-data\") pod \"e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc\" (UID: \"d74ee095-aab6-4803-b958-269012ec08f6\") " pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc"
Jul 09 01:25:25.032761 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:25.032647    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d74ee095-aab6-4803-b958-269012ec08f6-istiod-ca-cert\") pod \"e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc\" (UID: \"d74ee095-aab6-4803-b958-269012ec08f6\") " pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc"
Jul 09 01:25:25.032761 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:25.032682    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d74ee095-aab6-4803-b958-269012ec08f6-istio-token\") pod \"e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc\" (UID: \"d74ee095-aab6-4803-b958-269012ec08f6\") " pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc"
Jul 09 01:25:25.032761 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:25.032712    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d74ee095-aab6-4803-b958-269012ec08f6-istio-envoy\") pod \"e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc\" (UID: \"d74ee095-aab6-4803-b958-269012ec08f6\") " pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc"
Jul 09 01:25:25.032998 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:25.032765    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d74ee095-aab6-4803-b958-269012ec08f6-credential-socket\") pod \"e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc\" (UID: \"d74ee095-aab6-4803-b958-269012ec08f6\") " pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc"
Jul 09 01:25:25.032998 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:25.032787    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wg2jl\" (UniqueName: \"kubernetes.io/projected/d74ee095-aab6-4803-b958-269012ec08f6-kube-api-access-wg2jl\") pod \"e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc\" (UID: \"d74ee095-aab6-4803-b958-269012ec08f6\") " pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc"
Jul 09 01:25:25.033143 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:25.033104    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d74ee095-aab6-4803-b958-269012ec08f6-istio-data\") pod \"e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc\" (UID: \"d74ee095-aab6-4803-b958-269012ec08f6\") " pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc"
Jul 09 01:25:25.033143 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:25.033112    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d74ee095-aab6-4803-b958-269012ec08f6-workload-certs\") pod \"e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc\" (UID: \"d74ee095-aab6-4803-b958-269012ec08f6\") " pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc"
Jul 09 01:25:25.033303 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:25.033177    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d74ee095-aab6-4803-b958-269012ec08f6-workload-socket\") pod \"e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc\" (UID: \"d74ee095-aab6-4803-b958-269012ec08f6\") " pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc"
Jul 09 01:25:25.033534 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:25.033499    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d74ee095-aab6-4803-b958-269012ec08f6-credential-socket\") pod \"e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc\" (UID: \"d74ee095-aab6-4803-b958-269012ec08f6\") " pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc"
Jul 09 01:25:25.033534 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:25.033523    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d74ee095-aab6-4803-b958-269012ec08f6-workload-certs\") pod \"e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc\" (UID: \"d74ee095-aab6-4803-b958-269012ec08f6\") " pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc"
Jul 09 01:25:25.033687 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:25.033575    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d74ee095-aab6-4803-b958-269012ec08f6-istiod-ca-cert\") pod \"e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc\" (UID: \"d74ee095-aab6-4803-b958-269012ec08f6\") " pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc"
Jul 09 01:25:25.035284 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:25.035262    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d74ee095-aab6-4803-b958-269012ec08f6-istio-podinfo\") pod \"e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc\" (UID: \"d74ee095-aab6-4803-b958-269012ec08f6\") " pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc"
Jul 09 01:25:25.035383 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:25.035364    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d74ee095-aab6-4803-b958-269012ec08f6-istio-envoy\") pod \"e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc\" (UID: \"d74ee095-aab6-4803-b958-269012ec08f6\") " pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc"
Jul 09 01:25:25.043715 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:25.043689    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d74ee095-aab6-4803-b958-269012ec08f6-istio-token\") pod \"e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc\" (UID: \"d74ee095-aab6-4803-b958-269012ec08f6\") " pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc"
Jul 09 01:25:25.043948 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:25.043808    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wg2jl\" (UniqueName: \"kubernetes.io/projected/d74ee095-aab6-4803-b958-269012ec08f6-kube-api-access-wg2jl\") pod \"e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc\" (UID: \"d74ee095-aab6-4803-b958-269012ec08f6\") " pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc"
Jul 09 01:25:25.163867 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:25.163772    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc"
Jul 09 01:25:25.303261 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:25.303237    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc"]
Jul 09 01:25:25.305071 ip-10-0-133-31 kubenswrapper[2557]: W0709 01:25:25.305034    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd74ee095_aab6_4803_b958_269012ec08f6.slice/crio-35c102d9562a5e0840168db43108a6c73345188f45af325a0fb1f65ac5da1807 WatchSource:0}: Error finding container 35c102d9562a5e0840168db43108a6c73345188f45af325a0fb1f65ac5da1807: Status 404 returned error can't find the container with id 35c102d9562a5e0840168db43108a6c73345188f45af325a0fb1f65ac5da1807
Jul 09 01:25:25.307203 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:25.307162    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:25:25.307315 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:25.307250    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:25:25.307315 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:25.307283    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:25:25.327737 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:25.327710    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc" event={"ID":"d74ee095-aab6-4803-b958-269012ec08f6","Type":"ContainerStarted","Data":"35c102d9562a5e0840168db43108a6c73345188f45af325a0fb1f65ac5da1807"}
Jul 09 01:25:26.333808 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:26.333769    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc" event={"ID":"d74ee095-aab6-4803-b958-269012ec08f6","Type":"ContainerStarted","Data":"ff93239cd20ba0d0ac1863f8f1af6516be45246cee3169e120fbfd7d215d7bd5"}
Jul 09 01:25:26.353406 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:26.353346    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc" podStartSLOduration=2.353326733 podStartE2EDuration="2.353326733s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:25:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:25:26.35233077 +0000 UTC m=+1833.822473497" watchObservedRunningTime="2026-07-09 01:25:26.353326733 +0000 UTC m=+1833.823469465"
Jul 09 01:25:27.164972 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:27.164935    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc"
Jul 09 01:25:27.170049 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:27.170023    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc"
Jul 09 01:25:27.339024 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:27.338993    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc"
Jul 09 01:25:27.340143 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:27.340124    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc"
Jul 09 01:25:33.410639 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:33.410598    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz"]
Jul 09 01:25:33.414828 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:33.414794    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz"
Jul 09 01:25:33.417549 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:33.417528    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-adaf0e-openshift-default-dockercfg-sr6gt\""
Jul 09 01:25:33.423706 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:33.423682    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz"]
Jul 09 01:25:33.512639 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:33.512592    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-credential-socket\") pod \"e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz\" (UID: \"70a7ae4d-299d-4894-b20e-790ccdc0ddc5\") " pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz"
Jul 09 01:25:33.512639 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:33.512638    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-istio-token\") pod \"e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz\" (UID: \"70a7ae4d-299d-4894-b20e-790ccdc0ddc5\") " pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz"
Jul 09 01:25:33.512860 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:33.512708    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-workload-certs\") pod \"e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz\" (UID: \"70a7ae4d-299d-4894-b20e-790ccdc0ddc5\") " pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz"
Jul 09 01:25:33.512860 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:33.512753    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-istiod-ca-cert\") pod \"e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz\" (UID: \"70a7ae4d-299d-4894-b20e-790ccdc0ddc5\") " pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz"
Jul 09 01:25:33.512860 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:33.512780    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjlxs\" (UniqueName: \"kubernetes.io/projected/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-kube-api-access-xjlxs\") pod \"e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz\" (UID: \"70a7ae4d-299d-4894-b20e-790ccdc0ddc5\") " pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz"
Jul 09 01:25:33.512860 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:33.512832    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-workload-socket\") pod \"e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz\" (UID: \"70a7ae4d-299d-4894-b20e-790ccdc0ddc5\") " pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz"
Jul 09 01:25:33.513033 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:33.512866    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-istio-podinfo\") pod \"e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz\" (UID: \"70a7ae4d-299d-4894-b20e-790ccdc0ddc5\") " pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz"
Jul 09 01:25:33.513033 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:33.512896    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-istio-envoy\") pod \"e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz\" (UID: \"70a7ae4d-299d-4894-b20e-790ccdc0ddc5\") " pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz"
Jul 09 01:25:33.513033 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:33.512914    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-istio-data\") pod \"e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz\" (UID: \"70a7ae4d-299d-4894-b20e-790ccdc0ddc5\") " pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz"
Jul 09 01:25:33.614499 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:33.614459    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-credential-socket\") pod \"e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz\" (UID: \"70a7ae4d-299d-4894-b20e-790ccdc0ddc5\") " pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz"
Jul 09 01:25:33.614699 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:33.614507    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-istio-token\") pod \"e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz\" (UID: \"70a7ae4d-299d-4894-b20e-790ccdc0ddc5\") " pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz"
Jul 09 01:25:33.614699 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:33.614647    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-workload-certs\") pod \"e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz\" (UID: \"70a7ae4d-299d-4894-b20e-790ccdc0ddc5\") " pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz"
Jul 09 01:25:33.614699 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:33.614688    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-istiod-ca-cert\") pod \"e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz\" (UID: \"70a7ae4d-299d-4894-b20e-790ccdc0ddc5\") " pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz"
Jul 09 01:25:33.614912 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:33.614721    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjlxs\" (UniqueName: \"kubernetes.io/projected/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-kube-api-access-xjlxs\") pod \"e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz\" (UID: \"70a7ae4d-299d-4894-b20e-790ccdc0ddc5\") " pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz"
Jul 09 01:25:33.614912 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:33.614793    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-workload-socket\") pod \"e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz\" (UID: \"70a7ae4d-299d-4894-b20e-790ccdc0ddc5\") " pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz"
Jul 09 01:25:33.614912 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:33.614834    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-istio-podinfo\") pod \"e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz\" (UID: \"70a7ae4d-299d-4894-b20e-790ccdc0ddc5\") " pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz"
Jul 09 01:25:33.614912 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:33.614863    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-istio-envoy\") pod \"e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz\" (UID: \"70a7ae4d-299d-4894-b20e-790ccdc0ddc5\") " pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz"
Jul 09 01:25:33.614912 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:33.614889    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-istio-data\") pod \"e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz\" (UID: \"70a7ae4d-299d-4894-b20e-790ccdc0ddc5\") " pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz"
Jul 09 01:25:33.615202 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:33.614921    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-credential-socket\") pod \"e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz\" (UID: \"70a7ae4d-299d-4894-b20e-790ccdc0ddc5\") " pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz"
Jul 09 01:25:33.615202 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:33.614952    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-workload-certs\") pod \"e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz\" (UID: \"70a7ae4d-299d-4894-b20e-790ccdc0ddc5\") " pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz"
Jul 09 01:25:33.615366 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:33.615257    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-istio-data\") pod \"e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz\" (UID: \"70a7ae4d-299d-4894-b20e-790ccdc0ddc5\") " pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz"
Jul 09 01:25:33.615366 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:33.615306    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-workload-socket\") pod \"e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz\" (UID: \"70a7ae4d-299d-4894-b20e-790ccdc0ddc5\") " pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz"
Jul 09 01:25:33.615560 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:33.615514    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-istiod-ca-cert\") pod \"e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz\" (UID: \"70a7ae4d-299d-4894-b20e-790ccdc0ddc5\") " pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz"
Jul 09 01:25:33.617859 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:33.617834    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-istio-envoy\") pod \"e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz\" (UID: \"70a7ae4d-299d-4894-b20e-790ccdc0ddc5\") " pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz"
Jul 09 01:25:33.618613 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:33.618587    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-istio-podinfo\") pod \"e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz\" (UID: \"70a7ae4d-299d-4894-b20e-790ccdc0ddc5\") " pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz"
Jul 09 01:25:33.621729 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:33.621706    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-istio-token\") pod \"e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz\" (UID: \"70a7ae4d-299d-4894-b20e-790ccdc0ddc5\") " pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz"
Jul 09 01:25:33.621925 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:33.621896    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjlxs\" (UniqueName: \"kubernetes.io/projected/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-kube-api-access-xjlxs\") pod \"e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz\" (UID: \"70a7ae4d-299d-4894-b20e-790ccdc0ddc5\") " pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz"
Jul 09 01:25:33.727572 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:33.727540    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz"
Jul 09 01:25:33.866697 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:33.866676    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz"]
Jul 09 01:25:33.869522 ip-10-0-133-31 kubenswrapper[2557]: W0709 01:25:33.869493    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70a7ae4d_299d_4894_b20e_790ccdc0ddc5.slice/crio-3ef96d36aefa32290ccd20d415decf0d1be44b0575b16c6646c1f60a87b40bbf WatchSource:0}: Error finding container 3ef96d36aefa32290ccd20d415decf0d1be44b0575b16c6646c1f60a87b40bbf: Status 404 returned error can't find the container with id 3ef96d36aefa32290ccd20d415decf0d1be44b0575b16c6646c1f60a87b40bbf
Jul 09 01:25:33.871554 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:33.871522    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:25:33.871642 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:33.871592    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:25:33.871642 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:33.871624    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:25:34.372409 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:34.372371    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz" event={"ID":"70a7ae4d-299d-4894-b20e-790ccdc0ddc5","Type":"ContainerStarted","Data":"5176a288003c5b8464cfd864a4d49b5669a30d5d2b83c8c1eada371b4cdfcd4e"}
Jul 09 01:25:34.372634 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:34.372434    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz" event={"ID":"70a7ae4d-299d-4894-b20e-790ccdc0ddc5","Type":"ContainerStarted","Data":"3ef96d36aefa32290ccd20d415decf0d1be44b0575b16c6646c1f60a87b40bbf"}
Jul 09 01:25:34.393464 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:34.393407    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz" podStartSLOduration=1.393393303 podStartE2EDuration="1.393393303s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:25:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:25:34.392073858 +0000 UTC m=+1841.862216587" watchObservedRunningTime="2026-07-09 01:25:34.393393303 +0000 UTC m=+1841.863536031"
Jul 09 01:25:34.728391 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:34.728357    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz"
Jul 09 01:25:34.733172 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:34.733143    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz"
Jul 09 01:25:35.377507 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:35.377475    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz"
Jul 09 01:25:35.378598 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:35.378577    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz"
Jul 09 01:25:35.591358 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:35.591322    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:25:43.380491 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:43.380435    2557 patch_prober.go:28] interesting pod/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 09 01:25:43.381559 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:43.381131    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc" podUID="d74ee095-aab6-4803-b958-269012ec08f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 09 01:25:44.428542 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:44.428507    2557 generic.go:356] "Generic (PLEG): container finished" podID="d74ee095-aab6-4803-b958-269012ec08f6" containerID="ff93239cd20ba0d0ac1863f8f1af6516be45246cee3169e120fbfd7d215d7bd5" exitCode=0
Jul 09 01:25:44.428542 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:44.428546    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc" event={"ID":"d74ee095-aab6-4803-b958-269012ec08f6","Type":"ContainerDied","Data":"ff93239cd20ba0d0ac1863f8f1af6516be45246cee3169e120fbfd7d215d7bd5"}
Jul 09 01:25:44.429035 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:44.428904    2557 scope.go:117] "RemoveContainer" containerID="ff93239cd20ba0d0ac1863f8f1af6516be45246cee3169e120fbfd7d215d7bd5"
Jul 09 01:25:44.430032 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:44.429998    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:25:44.430162 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:44.430084    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:25:44.430162 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:44.430139    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:25:45.436169 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:45.436132    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc" event={"ID":"d74ee095-aab6-4803-b958-269012ec08f6","Type":"ContainerStarted","Data":"4e32148d8c383650ca4b68306d5c2d609b465bb6d5792bf42a3f60d9faa8c22b"}
Jul 09 01:25:46.164714 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:46.164674    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc"
Jul 09 01:25:46.164927 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:46.164797    2557 patch_prober.go:28] interesting pod/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 09 01:25:46.164927 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:46.164839    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc" podUID="d74ee095-aab6-4803-b958-269012ec08f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 09 01:25:46.488850 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:46.488811    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:25:47.164350 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:47.164303    2557 patch_prober.go:28] interesting pod/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 09 01:25:47.164519 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:47.164392    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc" podUID="d74ee095-aab6-4803-b958-269012ec08f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 09 01:25:48.164713 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:48.164677    2557 patch_prober.go:28] interesting pod/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 09 01:25:48.165233 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:48.164743    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc" podUID="d74ee095-aab6-4803-b958-269012ec08f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 09 01:25:49.164783 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:49.164747    2557 patch_prober.go:28] interesting pod/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 09 01:25:49.165167 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:49.164803    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc" podUID="d74ee095-aab6-4803-b958-269012ec08f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 09 01:25:50.167772 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:50.167741    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc"
Jul 09 01:25:50.169015 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:50.168079    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc"
Jul 09 01:25:50.169015 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:50.168712    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc"
Jul 09 01:25:50.378586 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:50.378553    2557 patch_prober.go:28] interesting pod/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 09 01:25:50.378756 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:50.378637    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz" podUID="70a7ae4d-299d-4894-b20e-790ccdc0ddc5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 09 01:25:50.462194 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:50.462096    2557 generic.go:356] "Generic (PLEG): container finished" podID="70a7ae4d-299d-4894-b20e-790ccdc0ddc5" containerID="5176a288003c5b8464cfd864a4d49b5669a30d5d2b83c8c1eada371b4cdfcd4e" exitCode=0
Jul 09 01:25:50.462194 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:50.462156    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz" event={"ID":"70a7ae4d-299d-4894-b20e-790ccdc0ddc5","Type":"ContainerDied","Data":"5176a288003c5b8464cfd864a4d49b5669a30d5d2b83c8c1eada371b4cdfcd4e"}
Jul 09 01:25:50.462764 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:50.462735    2557 scope.go:117] "RemoveContainer" containerID="5176a288003c5b8464cfd864a4d49b5669a30d5d2b83c8c1eada371b4cdfcd4e"
Jul 09 01:25:50.463719 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:50.463693    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:25:50.463781 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:50.463765    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:25:50.463827 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:50.463798    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:25:51.468809 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:51.468771    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz" event={"ID":"70a7ae4d-299d-4894-b20e-790ccdc0ddc5","Type":"ContainerStarted","Data":"b282f14e6a0ec8f762e8f5e66da231d2b6fbe58a9098b67ce82a60c80b2782c7"}
Jul 09 01:25:51.728307 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:51.728189    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz"
Jul 09 01:25:51.728500 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:51.728468    2557 patch_prober.go:28] interesting pod/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 09 01:25:51.728618 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:51.728521    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz" podUID="70a7ae4d-299d-4894-b20e-790ccdc0ddc5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 09 01:25:52.728229 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:52.728171    2557 patch_prober.go:28] interesting pod/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 09 01:25:52.728636 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:52.728243    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz" podUID="70a7ae4d-299d-4894-b20e-790ccdc0ddc5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 09 01:25:53.728522 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:53.728486    2557 patch_prober.go:28] interesting pod/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 09 01:25:53.728951 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:53.728554    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz" podUID="70a7ae4d-299d-4894-b20e-790ccdc0ddc5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 09 01:25:54.728724 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:54.728692    2557 patch_prober.go:28] interesting pod/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 09 01:25:54.729095 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:54.728757    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz" podUID="70a7ae4d-299d-4894-b20e-790ccdc0ddc5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 09 01:25:55.728586 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:55.728543    2557 patch_prober.go:28] interesting pod/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 09 01:25:55.728805 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:55.728629    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz" podUID="70a7ae4d-299d-4894-b20e-790ccdc0ddc5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 09 01:25:56.732148 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:56.732118    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz"
Jul 09 01:25:56.732544 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:56.732399    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz"
Jul 09 01:25:56.733068 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:56.733053    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz"
Jul 09 01:25:59.196805 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:25:59.196759    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:26:23.688093 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:26:23.688052    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:26:37.192202 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:26:37.192167    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:26:50.187846 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:26:50.187809    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:27:28.080956 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:28.080911    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc"]
Jul 09 01:27:28.081517 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:28.081181    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc" podUID="d74ee095-aab6-4803-b958-269012ec08f6" containerName="istio-proxy" containerID="cri-o://4e32148d8c383650ca4b68306d5c2d609b465bb6d5792bf42a3f60d9faa8c22b" gracePeriod=30
Jul 09 01:27:32.195976 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:32.195936    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:27:33.340725 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:33.340658    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc"
Jul 09 01:27:33.401504 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:33.401477    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d74ee095-aab6-4803-b958-269012ec08f6-workload-certs\") pod \"d74ee095-aab6-4803-b958-269012ec08f6\" (UID: \"d74ee095-aab6-4803-b958-269012ec08f6\") "
Jul 09 01:27:33.401679 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:33.401527    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d74ee095-aab6-4803-b958-269012ec08f6-credential-socket\") pod \"d74ee095-aab6-4803-b958-269012ec08f6\" (UID: \"d74ee095-aab6-4803-b958-269012ec08f6\") "
Jul 09 01:27:33.401679 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:33.401545    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d74ee095-aab6-4803-b958-269012ec08f6-istiod-ca-cert\") pod \"d74ee095-aab6-4803-b958-269012ec08f6\" (UID: \"d74ee095-aab6-4803-b958-269012ec08f6\") "
Jul 09 01:27:33.401679 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:33.401577    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d74ee095-aab6-4803-b958-269012ec08f6-workload-socket\") pod \"d74ee095-aab6-4803-b958-269012ec08f6\" (UID: \"d74ee095-aab6-4803-b958-269012ec08f6\") "
Jul 09 01:27:33.401679 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:33.401605    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d74ee095-aab6-4803-b958-269012ec08f6-istio-data\") pod \"d74ee095-aab6-4803-b958-269012ec08f6\" (UID: \"d74ee095-aab6-4803-b958-269012ec08f6\") "
Jul 09 01:27:33.401679 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:33.401634    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d74ee095-aab6-4803-b958-269012ec08f6-istio-envoy\") pod \"d74ee095-aab6-4803-b958-269012ec08f6\" (UID: \"d74ee095-aab6-4803-b958-269012ec08f6\") "
Jul 09 01:27:33.401945 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:33.401678    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d74ee095-aab6-4803-b958-269012ec08f6-istio-podinfo\") pod \"d74ee095-aab6-4803-b958-269012ec08f6\" (UID: \"d74ee095-aab6-4803-b958-269012ec08f6\") "
Jul 09 01:27:33.401945 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:33.401710    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wg2jl\" (UniqueName: \"kubernetes.io/projected/d74ee095-aab6-4803-b958-269012ec08f6-kube-api-access-wg2jl\") pod \"d74ee095-aab6-4803-b958-269012ec08f6\" (UID: \"d74ee095-aab6-4803-b958-269012ec08f6\") "
Jul 09 01:27:33.401945 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:33.401738    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d74ee095-aab6-4803-b958-269012ec08f6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d74ee095-aab6-4803-b958-269012ec08f6" (UID: "d74ee095-aab6-4803-b958-269012ec08f6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:27:33.401945 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:33.401748    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d74ee095-aab6-4803-b958-269012ec08f6-istio-token\") pod \"d74ee095-aab6-4803-b958-269012ec08f6\" (UID: \"d74ee095-aab6-4803-b958-269012ec08f6\") "
Jul 09 01:27:33.402154 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:33.401761    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d74ee095-aab6-4803-b958-269012ec08f6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d74ee095-aab6-4803-b958-269012ec08f6" (UID: "d74ee095-aab6-4803-b958-269012ec08f6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:27:33.402154 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:33.401874    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d74ee095-aab6-4803-b958-269012ec08f6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d74ee095-aab6-4803-b958-269012ec08f6" (UID: "d74ee095-aab6-4803-b958-269012ec08f6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:27:33.402154 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:33.401972    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d74ee095-aab6-4803-b958-269012ec08f6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d74ee095-aab6-4803-b958-269012ec08f6" (UID: "d74ee095-aab6-4803-b958-269012ec08f6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 01:27:33.402348 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:33.402157    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d74ee095-aab6-4803-b958-269012ec08f6-workload-certs\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:27:33.402348 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:33.402171    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d74ee095-aab6-4803-b958-269012ec08f6-credential-socket\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:27:33.402348 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:33.402180    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d74ee095-aab6-4803-b958-269012ec08f6-istiod-ca-cert\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:27:33.402348 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:33.402189    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d74ee095-aab6-4803-b958-269012ec08f6-workload-socket\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:27:33.402518 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:33.402496    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d74ee095-aab6-4803-b958-269012ec08f6-istio-data" (OuterVolumeSpecName: "istio-data") pod "d74ee095-aab6-4803-b958-269012ec08f6" (UID: "d74ee095-aab6-4803-b958-269012ec08f6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:27:33.403995 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:33.403972    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d74ee095-aab6-4803-b958-269012ec08f6-istio-token" (OuterVolumeSpecName: "istio-token") pod "d74ee095-aab6-4803-b958-269012ec08f6" (UID: "d74ee095-aab6-4803-b958-269012ec08f6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:27:33.404087 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:33.404023    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d74ee095-aab6-4803-b958-269012ec08f6-kube-api-access-wg2jl" (OuterVolumeSpecName: "kube-api-access-wg2jl") pod "d74ee095-aab6-4803-b958-269012ec08f6" (UID: "d74ee095-aab6-4803-b958-269012ec08f6"). InnerVolumeSpecName "kube-api-access-wg2jl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:27:33.404309 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:33.404279    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d74ee095-aab6-4803-b958-269012ec08f6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d74ee095-aab6-4803-b958-269012ec08f6" (UID: "d74ee095-aab6-4803-b958-269012ec08f6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:27:33.404362 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:33.404329    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d74ee095-aab6-4803-b958-269012ec08f6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d74ee095-aab6-4803-b958-269012ec08f6" (UID: "d74ee095-aab6-4803-b958-269012ec08f6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 01:27:33.502869 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:33.502832    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d74ee095-aab6-4803-b958-269012ec08f6-istio-envoy\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:27:33.502869 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:33.502864    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d74ee095-aab6-4803-b958-269012ec08f6-istio-podinfo\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:27:33.502869 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:33.502873    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wg2jl\" (UniqueName: \"kubernetes.io/projected/d74ee095-aab6-4803-b958-269012ec08f6-kube-api-access-wg2jl\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:27:33.503114 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:33.502882    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d74ee095-aab6-4803-b958-269012ec08f6-istio-token\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:27:33.503114 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:33.502891    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d74ee095-aab6-4803-b958-269012ec08f6-istio-data\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:27:33.952620 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:33.952586    2557 generic.go:356] "Generic (PLEG): container finished" podID="d74ee095-aab6-4803-b958-269012ec08f6" containerID="4e32148d8c383650ca4b68306d5c2d609b465bb6d5792bf42a3f60d9faa8c22b" exitCode=0
Jul 09 01:27:33.952791 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:33.952640    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc"
Jul 09 01:27:33.952791 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:33.952634    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc" event={"ID":"d74ee095-aab6-4803-b958-269012ec08f6","Type":"ContainerDied","Data":"4e32148d8c383650ca4b68306d5c2d609b465bb6d5792bf42a3f60d9faa8c22b"}
Jul 09 01:27:33.952791 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:33.952770    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc" event={"ID":"d74ee095-aab6-4803-b958-269012ec08f6","Type":"ContainerDied","Data":"35c102d9562a5e0840168db43108a6c73345188f45af325a0fb1f65ac5da1807"}
Jul 09 01:27:33.952911 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:33.952800    2557 scope.go:117] "RemoveContainer" containerID="4e32148d8c383650ca4b68306d5c2d609b465bb6d5792bf42a3f60d9faa8c22b"
Jul 09 01:27:33.962426 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:33.962407    2557 scope.go:117] "RemoveContainer" containerID="ff93239cd20ba0d0ac1863f8f1af6516be45246cee3169e120fbfd7d215d7bd5"
Jul 09 01:27:33.970644 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:33.970623    2557 scope.go:117] "RemoveContainer" containerID="4e32148d8c383650ca4b68306d5c2d609b465bb6d5792bf42a3f60d9faa8c22b"
Jul 09 01:27:33.970913 ip-10-0-133-31 kubenswrapper[2557]: E0709 01:27:33.970893    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e32148d8c383650ca4b68306d5c2d609b465bb6d5792bf42a3f60d9faa8c22b\": container with ID starting with 4e32148d8c383650ca4b68306d5c2d609b465bb6d5792bf42a3f60d9faa8c22b not found: ID does not exist" containerID="4e32148d8c383650ca4b68306d5c2d609b465bb6d5792bf42a3f60d9faa8c22b"
Jul 09 01:27:33.970964 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:33.970922    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e32148d8c383650ca4b68306d5c2d609b465bb6d5792bf42a3f60d9faa8c22b"} err="failed to get container status \"4e32148d8c383650ca4b68306d5c2d609b465bb6d5792bf42a3f60d9faa8c22b\": rpc error: code = NotFound desc = could not find container \"4e32148d8c383650ca4b68306d5c2d609b465bb6d5792bf42a3f60d9faa8c22b\": container with ID starting with 4e32148d8c383650ca4b68306d5c2d609b465bb6d5792bf42a3f60d9faa8c22b not found: ID does not exist"
Jul 09 01:27:33.970964 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:33.970940    2557 scope.go:117] "RemoveContainer" containerID="ff93239cd20ba0d0ac1863f8f1af6516be45246cee3169e120fbfd7d215d7bd5"
Jul 09 01:27:33.971188 ip-10-0-133-31 kubenswrapper[2557]: E0709 01:27:33.971174    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff93239cd20ba0d0ac1863f8f1af6516be45246cee3169e120fbfd7d215d7bd5\": container with ID starting with ff93239cd20ba0d0ac1863f8f1af6516be45246cee3169e120fbfd7d215d7bd5 not found: ID does not exist" containerID="ff93239cd20ba0d0ac1863f8f1af6516be45246cee3169e120fbfd7d215d7bd5"
Jul 09 01:27:33.971239 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:33.971192    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff93239cd20ba0d0ac1863f8f1af6516be45246cee3169e120fbfd7d215d7bd5"} err="failed to get container status \"ff93239cd20ba0d0ac1863f8f1af6516be45246cee3169e120fbfd7d215d7bd5\": rpc error: code = NotFound desc = could not find container \"ff93239cd20ba0d0ac1863f8f1af6516be45246cee3169e120fbfd7d215d7bd5\": container with ID starting with ff93239cd20ba0d0ac1863f8f1af6516be45246cee3169e120fbfd7d215d7bd5 not found: ID does not exist"
Jul 09 01:27:33.973768 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:33.973742    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc"]
Jul 09 01:27:33.977623 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:33.977603    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc"]
Jul 09 01:27:34.975974 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:34.975944    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz"]
Jul 09 01:27:34.976481 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:34.976236    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz" podUID="70a7ae4d-299d-4894-b20e-790ccdc0ddc5" containerName="istio-proxy" containerID="cri-o://b282f14e6a0ec8f762e8f5e66da231d2b6fbe58a9098b67ce82a60c80b2782c7" gracePeriod=30
Jul 09 01:27:35.045132 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:35.042389    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d74ee095-aab6-4803-b958-269012ec08f6" path="/var/lib/kubelet/pods/d74ee095-aab6-4803-b958-269012ec08f6/volumes"
Jul 09 01:27:35.868589 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:35.868557    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd"]
Jul 09 01:27:35.868927 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:35.868913    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d74ee095-aab6-4803-b958-269012ec08f6" containerName="istio-proxy"
Jul 09 01:27:35.868927 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:35.868928    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d74ee095-aab6-4803-b958-269012ec08f6" containerName="istio-proxy"
Jul 09 01:27:35.869035 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:35.868948    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d74ee095-aab6-4803-b958-269012ec08f6" containerName="istio-proxy"
Jul 09 01:27:35.869035 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:35.868954    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d74ee095-aab6-4803-b958-269012ec08f6" containerName="istio-proxy"
Jul 09 01:27:35.869035 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:35.869012    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d74ee095-aab6-4803-b958-269012ec08f6" containerName="istio-proxy"
Jul 09 01:27:35.873499 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:35.873479    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd"
Jul 09 01:27:35.876091 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:35.876069    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-45d60b-openshift-default-dockercfg-zx5qt\""
Jul 09 01:27:35.886878 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:35.886850    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd"]
Jul 09 01:27:35.921719 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:35.921683    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-credential-socket\") pod \"e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd\" (UID: \"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2\") " pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd"
Jul 09 01:27:35.921719 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:35.921721    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-istio-token\") pod \"e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd\" (UID: \"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2\") " pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd"
Jul 09 01:27:35.921931 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:35.921748    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-workload-certs\") pod \"e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd\" (UID: \"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2\") " pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd"
Jul 09 01:27:35.921931 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:35.921819    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-workload-socket\") pod \"e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd\" (UID: \"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2\") " pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd"
Jul 09 01:27:35.921931 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:35.921841    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-istio-envoy\") pod \"e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd\" (UID: \"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2\") " pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd"
Jul 09 01:27:35.921931 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:35.921860    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-istiod-ca-cert\") pod \"e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd\" (UID: \"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2\") " pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd"
Jul 09 01:27:35.921931 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:35.921882    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv57d\" (UniqueName: \"kubernetes.io/projected/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-kube-api-access-lv57d\") pod \"e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd\" (UID: \"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2\") " pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd"
Jul 09 01:27:35.921931 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:35.921922    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-istio-data\") pod \"e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd\" (UID: \"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2\") " pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd"
Jul 09 01:27:35.922123 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:35.921951    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-istio-podinfo\") pod \"e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd\" (UID: \"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2\") " pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd"
Jul 09 01:27:36.022545 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:36.022501    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-credential-socket\") pod \"e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd\" (UID: \"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2\") " pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd"
Jul 09 01:27:36.022545 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:36.022544    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-istio-token\") pod \"e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd\" (UID: \"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2\") " pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd"
Jul 09 01:27:36.023097 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:36.022567    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-workload-certs\") pod \"e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd\" (UID: \"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2\") " pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd"
Jul 09 01:27:36.023097 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:36.022596    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-workload-socket\") pod \"e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd\" (UID: \"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2\") " pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd"
Jul 09 01:27:36.023097 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:36.022616    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-istio-envoy\") pod \"e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd\" (UID: \"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2\") " pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd"
Jul 09 01:27:36.023097 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:36.022636    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-istiod-ca-cert\") pod \"e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd\" (UID: \"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2\") " pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd"
Jul 09 01:27:36.023097 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:36.022656    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv57d\" (UniqueName: \"kubernetes.io/projected/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-kube-api-access-lv57d\") pod \"e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd\" (UID: \"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2\") " pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd"
Jul 09 01:27:36.023097 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:36.022680    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-istio-data\") pod \"e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd\" (UID: \"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2\") " pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd"
Jul 09 01:27:36.023097 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:36.022921    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-istio-podinfo\") pod \"e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd\" (UID: \"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2\") " pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd"
Jul 09 01:27:36.023097 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:36.023021    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-credential-socket\") pod \"e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd\" (UID: \"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2\") " pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd"
Jul 09 01:27:36.023520 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:36.023253    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-workload-socket\") pod \"e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd\" (UID: \"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2\") " pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd"
Jul 09 01:27:36.023520 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:36.023291    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-istio-data\") pod \"e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd\" (UID: \"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2\") " pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd"
Jul 09 01:27:36.023520 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:36.023366    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-workload-certs\") pod \"e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd\" (UID: \"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2\") " pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd"
Jul 09 01:27:36.023520 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:36.023474    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-istiod-ca-cert\") pod \"e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd\" (UID: \"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2\") " pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd"
Jul 09 01:27:36.025048 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:36.025027    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-istio-envoy\") pod \"e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd\" (UID: \"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2\") " pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd"
Jul 09 01:27:36.025395 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:36.025375    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-istio-podinfo\") pod \"e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd\" (UID: \"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2\") " pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd"
Jul 09 01:27:36.030240 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:36.030195    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-istio-token\") pod \"e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd\" (UID: \"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2\") " pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd"
Jul 09 01:27:36.030517 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:36.030493    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv57d\" (UniqueName: \"kubernetes.io/projected/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-kube-api-access-lv57d\") pod \"e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd\" (UID: \"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2\") " pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd"
Jul 09 01:27:36.185878 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:36.185794    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd"
Jul 09 01:27:36.323819 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:36.323796    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd"]
Jul 09 01:27:36.326046 ip-10-0-133-31 kubenswrapper[2557]: W0709 01:27:36.326021    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c78c0d9_7215_42c8_b1b7_2dcfe082e4f2.slice/crio-656c00a3032b7b9224ae4b537dd78a665bdc9e56b69a5b2680b0d291008d4702 WatchSource:0}: Error finding container 656c00a3032b7b9224ae4b537dd78a665bdc9e56b69a5b2680b0d291008d4702: Status 404 returned error can't find the container with id 656c00a3032b7b9224ae4b537dd78a665bdc9e56b69a5b2680b0d291008d4702
Jul 09 01:27:36.328128 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:36.328095    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:27:36.328241 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:36.328173    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:27:36.328312 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:36.328236    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:27:36.970535 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:36.970496    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd" event={"ID":"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2","Type":"ContainerStarted","Data":"cfe5e9ff2a5b1eda44190abd3bcd0a1b7984869c2ee7c197b4632a56c144716e"}
Jul 09 01:27:36.970723 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:36.970561    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd" event={"ID":"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2","Type":"ContainerStarted","Data":"656c00a3032b7b9224ae4b537dd78a665bdc9e56b69a5b2680b0d291008d4702"}
Jul 09 01:27:36.989081 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:36.989028    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd" podStartSLOduration=1.9890091220000001 podStartE2EDuration="1.989009122s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:27:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:27:36.986855111 +0000 UTC m=+1964.456997842" watchObservedRunningTime="2026-07-09 01:27:36.989009122 +0000 UTC m=+1964.459151909"
Jul 09 01:27:37.186244 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:37.186191    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd"
Jul 09 01:27:37.191292 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:37.191266    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd"
Jul 09 01:27:37.975958 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:37.975920    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd"
Jul 09 01:27:37.976870 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:37.976844    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd"
Jul 09 01:27:40.232603 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:40.232577    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz"
Jul 09 01:27:40.360732 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:40.360646    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-istio-podinfo\") pod \"70a7ae4d-299d-4894-b20e-790ccdc0ddc5\" (UID: \"70a7ae4d-299d-4894-b20e-790ccdc0ddc5\") "
Jul 09 01:27:40.360732 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:40.360682    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-istio-token\") pod \"70a7ae4d-299d-4894-b20e-790ccdc0ddc5\" (UID: \"70a7ae4d-299d-4894-b20e-790ccdc0ddc5\") "
Jul 09 01:27:40.360732 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:40.360729    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-workload-certs\") pod \"70a7ae4d-299d-4894-b20e-790ccdc0ddc5\" (UID: \"70a7ae4d-299d-4894-b20e-790ccdc0ddc5\") "
Jul 09 01:27:40.361015 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:40.360754    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-istiod-ca-cert\") pod \"70a7ae4d-299d-4894-b20e-790ccdc0ddc5\" (UID: \"70a7ae4d-299d-4894-b20e-790ccdc0ddc5\") "
Jul 09 01:27:40.361015 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:40.360807    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-istio-data\") pod \"70a7ae4d-299d-4894-b20e-790ccdc0ddc5\" (UID: \"70a7ae4d-299d-4894-b20e-790ccdc0ddc5\") "
Jul 09 01:27:40.361015 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:40.360851    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-istio-envoy\") pod \"70a7ae4d-299d-4894-b20e-790ccdc0ddc5\" (UID: \"70a7ae4d-299d-4894-b20e-790ccdc0ddc5\") "
Jul 09 01:27:40.361015 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:40.360879    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-credential-socket\") pod \"70a7ae4d-299d-4894-b20e-790ccdc0ddc5\" (UID: \"70a7ae4d-299d-4894-b20e-790ccdc0ddc5\") "
Jul 09 01:27:40.361015 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:40.360905    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xjlxs\" (UniqueName: \"kubernetes.io/projected/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-kube-api-access-xjlxs\") pod \"70a7ae4d-299d-4894-b20e-790ccdc0ddc5\" (UID: \"70a7ae4d-299d-4894-b20e-790ccdc0ddc5\") "
Jul 09 01:27:40.361015 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:40.360928    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-workload-socket\") pod \"70a7ae4d-299d-4894-b20e-790ccdc0ddc5\" (UID: \"70a7ae4d-299d-4894-b20e-790ccdc0ddc5\") "
Jul 09 01:27:40.368270 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:40.361451    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "70a7ae4d-299d-4894-b20e-790ccdc0ddc5" (UID: "70a7ae4d-299d-4894-b20e-790ccdc0ddc5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:27:40.368270 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:40.361665    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "70a7ae4d-299d-4894-b20e-790ccdc0ddc5" (UID: "70a7ae4d-299d-4894-b20e-790ccdc0ddc5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:27:40.368270 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:40.361697    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "70a7ae4d-299d-4894-b20e-790ccdc0ddc5" (UID: "70a7ae4d-299d-4894-b20e-790ccdc0ddc5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 01:27:40.368270 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:40.361854    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "70a7ae4d-299d-4894-b20e-790ccdc0ddc5" (UID: "70a7ae4d-299d-4894-b20e-790ccdc0ddc5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:27:40.368270 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:40.362020    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-workload-certs\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:27:40.368270 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:40.362037    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-istio-data" (OuterVolumeSpecName: "istio-data") pod "70a7ae4d-299d-4894-b20e-790ccdc0ddc5" (UID: "70a7ae4d-299d-4894-b20e-790ccdc0ddc5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:27:40.369980 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:40.369948    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-istio-token" (OuterVolumeSpecName: "istio-token") pod "70a7ae4d-299d-4894-b20e-790ccdc0ddc5" (UID: "70a7ae4d-299d-4894-b20e-790ccdc0ddc5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:27:40.369980 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:40.369948    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-kube-api-access-xjlxs" (OuterVolumeSpecName: "kube-api-access-xjlxs") pod "70a7ae4d-299d-4894-b20e-790ccdc0ddc5" (UID: "70a7ae4d-299d-4894-b20e-790ccdc0ddc5"). InnerVolumeSpecName "kube-api-access-xjlxs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:27:40.370136 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:40.369980    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "70a7ae4d-299d-4894-b20e-790ccdc0ddc5" (UID: "70a7ae4d-299d-4894-b20e-790ccdc0ddc5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:27:40.370136 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:40.369976    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "70a7ae4d-299d-4894-b20e-790ccdc0ddc5" (UID: "70a7ae4d-299d-4894-b20e-790ccdc0ddc5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 01:27:40.463073 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:40.463034    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-istio-data\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:27:40.463073 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:40.463067    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-istio-envoy\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:27:40.463073 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:40.463077    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-credential-socket\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:27:40.463329 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:40.463087    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjlxs\" (UniqueName: \"kubernetes.io/projected/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-kube-api-access-xjlxs\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:27:40.463329 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:40.463097    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-workload-socket\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:27:40.463329 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:40.463105    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-istio-podinfo\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:27:40.463329 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:40.463118    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-istio-token\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:27:40.463329 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:40.463127    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70a7ae4d-299d-4894-b20e-790ccdc0ddc5-istiod-ca-cert\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:27:40.991859 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:40.991827    2557 generic.go:356] "Generic (PLEG): container finished" podID="70a7ae4d-299d-4894-b20e-790ccdc0ddc5" containerID="b282f14e6a0ec8f762e8f5e66da231d2b6fbe58a9098b67ce82a60c80b2782c7" exitCode=0
Jul 09 01:27:40.992047 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:40.991887    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz"
Jul 09 01:27:40.992047 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:40.991920    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz" event={"ID":"70a7ae4d-299d-4894-b20e-790ccdc0ddc5","Type":"ContainerDied","Data":"b282f14e6a0ec8f762e8f5e66da231d2b6fbe58a9098b67ce82a60c80b2782c7"}
Jul 09 01:27:40.992047 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:40.992000    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz" event={"ID":"70a7ae4d-299d-4894-b20e-790ccdc0ddc5","Type":"ContainerDied","Data":"3ef96d36aefa32290ccd20d415decf0d1be44b0575b16c6646c1f60a87b40bbf"}
Jul 09 01:27:40.992047 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:40.992026    2557 scope.go:117] "RemoveContainer" containerID="b282f14e6a0ec8f762e8f5e66da231d2b6fbe58a9098b67ce82a60c80b2782c7"
Jul 09 01:27:41.002428 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:41.002408    2557 scope.go:117] "RemoveContainer" containerID="5176a288003c5b8464cfd864a4d49b5669a30d5d2b83c8c1eada371b4cdfcd4e"
Jul 09 01:27:41.010197 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:41.010178    2557 scope.go:117] "RemoveContainer" containerID="b282f14e6a0ec8f762e8f5e66da231d2b6fbe58a9098b67ce82a60c80b2782c7"
Jul 09 01:27:41.010484 ip-10-0-133-31 kubenswrapper[2557]: E0709 01:27:41.010466    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b282f14e6a0ec8f762e8f5e66da231d2b6fbe58a9098b67ce82a60c80b2782c7\": container with ID starting with b282f14e6a0ec8f762e8f5e66da231d2b6fbe58a9098b67ce82a60c80b2782c7 not found: ID does not exist" containerID="b282f14e6a0ec8f762e8f5e66da231d2b6fbe58a9098b67ce82a60c80b2782c7"
Jul 09 01:27:41.010535 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:41.010493    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b282f14e6a0ec8f762e8f5e66da231d2b6fbe58a9098b67ce82a60c80b2782c7"} err="failed to get container status \"b282f14e6a0ec8f762e8f5e66da231d2b6fbe58a9098b67ce82a60c80b2782c7\": rpc error: code = NotFound desc = could not find container \"b282f14e6a0ec8f762e8f5e66da231d2b6fbe58a9098b67ce82a60c80b2782c7\": container with ID starting with b282f14e6a0ec8f762e8f5e66da231d2b6fbe58a9098b67ce82a60c80b2782c7 not found: ID does not exist"
Jul 09 01:27:41.010535 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:41.010510    2557 scope.go:117] "RemoveContainer" containerID="5176a288003c5b8464cfd864a4d49b5669a30d5d2b83c8c1eada371b4cdfcd4e"
Jul 09 01:27:41.010736 ip-10-0-133-31 kubenswrapper[2557]: E0709 01:27:41.010721    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5176a288003c5b8464cfd864a4d49b5669a30d5d2b83c8c1eada371b4cdfcd4e\": container with ID starting with 5176a288003c5b8464cfd864a4d49b5669a30d5d2b83c8c1eada371b4cdfcd4e not found: ID does not exist" containerID="5176a288003c5b8464cfd864a4d49b5669a30d5d2b83c8c1eada371b4cdfcd4e"
Jul 09 01:27:41.010790 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:41.010749    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5176a288003c5b8464cfd864a4d49b5669a30d5d2b83c8c1eada371b4cdfcd4e"} err="failed to get container status \"5176a288003c5b8464cfd864a4d49b5669a30d5d2b83c8c1eada371b4cdfcd4e\": rpc error: code = NotFound desc = could not find container \"5176a288003c5b8464cfd864a4d49b5669a30d5d2b83c8c1eada371b4cdfcd4e\": container with ID starting with 5176a288003c5b8464cfd864a4d49b5669a30d5d2b83c8c1eada371b4cdfcd4e not found: ID does not exist"
Jul 09 01:27:41.013718 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:41.013695    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz"]
Jul 09 01:27:41.017304 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:41.017283    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz"]
Jul 09 01:27:41.039351 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:41.039327    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70a7ae4d-299d-4894-b20e-790ccdc0ddc5" path="/var/lib/kubelet/pods/70a7ae4d-299d-4894-b20e-790ccdc0ddc5/volumes"
Jul 09 01:27:42.284068 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:42.284031    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:27:44.169770 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:44.169732    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh"]
Jul 09 01:27:44.170316 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:44.170291    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70a7ae4d-299d-4894-b20e-790ccdc0ddc5" containerName="istio-proxy"
Jul 09 01:27:44.170316 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:44.170315    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="70a7ae4d-299d-4894-b20e-790ccdc0ddc5" containerName="istio-proxy"
Jul 09 01:27:44.170491 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:44.170331    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70a7ae4d-299d-4894-b20e-790ccdc0ddc5" containerName="istio-proxy"
Jul 09 01:27:44.170491 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:44.170339    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="70a7ae4d-299d-4894-b20e-790ccdc0ddc5" containerName="istio-proxy"
Jul 09 01:27:44.170491 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:44.170442    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d74ee095-aab6-4803-b958-269012ec08f6" containerName="istio-proxy"
Jul 09 01:27:44.170491 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:44.170456    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="70a7ae4d-299d-4894-b20e-790ccdc0ddc5" containerName="istio-proxy"
Jul 09 01:27:44.170491 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:44.170469    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="70a7ae4d-299d-4894-b20e-790ccdc0ddc5" containerName="istio-proxy"
Jul 09 01:27:44.205232 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:44.204507    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh"]
Jul 09 01:27:44.205232 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:44.204677    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh"
Jul 09 01:27:44.207535 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:44.207508    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-fbc435-openshift-default-dockercfg-5lmxp\""
Jul 09 01:27:44.303234 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:44.301729    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-istio-data\") pod \"e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh\" (UID: \"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9\") " pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh"
Jul 09 01:27:44.303234 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:44.301785    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-istio-podinfo\") pod \"e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh\" (UID: \"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9\") " pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh"
Jul 09 01:27:44.303234 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:44.301818    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f66vd\" (UniqueName: \"kubernetes.io/projected/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-kube-api-access-f66vd\") pod \"e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh\" (UID: \"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9\") " pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh"
Jul 09 01:27:44.303234 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:44.301913    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-istio-token\") pod \"e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh\" (UID: \"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9\") " pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh"
Jul 09 01:27:44.303234 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:44.301963    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-workload-certs\") pod \"e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh\" (UID: \"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9\") " pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh"
Jul 09 01:27:44.303234 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:44.301996    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-istio-envoy\") pod \"e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh\" (UID: \"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9\") " pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh"
Jul 09 01:27:44.303234 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:44.302051    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-workload-socket\") pod \"e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh\" (UID: \"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9\") " pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh"
Jul 09 01:27:44.303234 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:44.302078    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-istiod-ca-cert\") pod \"e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh\" (UID: \"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9\") " pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh"
Jul 09 01:27:44.303234 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:44.302107    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-credential-socket\") pod \"e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh\" (UID: \"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9\") " pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh"
Jul 09 01:27:44.404320 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:44.403011    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-workload-certs\") pod \"e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh\" (UID: \"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9\") " pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh"
Jul 09 01:27:44.404320 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:44.403066    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-istio-envoy\") pod \"e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh\" (UID: \"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9\") " pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh"
Jul 09 01:27:44.404320 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:44.403115    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-workload-socket\") pod \"e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh\" (UID: \"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9\") " pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh"
Jul 09 01:27:44.404320 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:44.403142    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-istiod-ca-cert\") pod \"e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh\" (UID: \"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9\") " pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh"
Jul 09 01:27:44.404320 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:44.403173    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-credential-socket\") pod \"e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh\" (UID: \"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9\") " pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh"
Jul 09 01:27:44.404320 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:44.403200    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-istio-data\") pod \"e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh\" (UID: \"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9\") " pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh"
Jul 09 01:27:44.404320 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:44.403250    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-istio-podinfo\") pod \"e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh\" (UID: \"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9\") " pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh"
Jul 09 01:27:44.404320 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:44.403273    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f66vd\" (UniqueName: \"kubernetes.io/projected/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-kube-api-access-f66vd\") pod \"e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh\" (UID: \"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9\") " pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh"
Jul 09 01:27:44.404320 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:44.403363    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-istio-token\") pod \"e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh\" (UID: \"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9\") " pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh"
Jul 09 01:27:44.404320 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:44.404104    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-credential-socket\") pod \"e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh\" (UID: \"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9\") " pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh"
Jul 09 01:27:44.405653 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:44.405046    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-workload-certs\") pod \"e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh\" (UID: \"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9\") " pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh"
Jul 09 01:27:44.405653 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:44.405166    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-istio-data\") pod \"e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh\" (UID: \"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9\") " pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh"
Jul 09 01:27:44.405653 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:44.405589    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-istiod-ca-cert\") pod \"e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh\" (UID: \"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9\") " pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh"
Jul 09 01:27:44.405653 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:44.405616    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-workload-socket\") pod \"e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh\" (UID: \"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9\") " pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh"
Jul 09 01:27:44.407460 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:44.407435    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-istio-envoy\") pod \"e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh\" (UID: \"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9\") " pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh"
Jul 09 01:27:44.408418 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:44.408389    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-istio-podinfo\") pod \"e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh\" (UID: \"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9\") " pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh"
Jul 09 01:27:44.412484 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:44.412459    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-istio-token\") pod \"e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh\" (UID: \"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9\") " pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh"
Jul 09 01:27:44.412811 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:44.412790    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f66vd\" (UniqueName: \"kubernetes.io/projected/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-kube-api-access-f66vd\") pod \"e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh\" (UID: \"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9\") " pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh"
Jul 09 01:27:44.523396 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:44.523344    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh"
Jul 09 01:27:44.720090 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:44.720065    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh"]
Jul 09 01:27:44.722461 ip-10-0-133-31 kubenswrapper[2557]: W0709 01:27:44.722431    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc1d5fb3_2b92_44eb_8e35_4d5111d850b9.slice/crio-633bef2e5a8e76afd981e12f3abc8cc7324251d03c4ee7938f54c9b01e086c7b WatchSource:0}: Error finding container 633bef2e5a8e76afd981e12f3abc8cc7324251d03c4ee7938f54c9b01e086c7b: Status 404 returned error can't find the container with id 633bef2e5a8e76afd981e12f3abc8cc7324251d03c4ee7938f54c9b01e086c7b
Jul 09 01:27:44.724704 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:44.724670    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:27:44.724783 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:44.724755    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:27:44.724823 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:44.724793    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:27:45.014499 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:45.014400    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh" event={"ID":"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9","Type":"ContainerStarted","Data":"57a02d9b3b94fa1bd77b481d01197b5ec7b66124de59524d03e5e287e5c947fe"}
Jul 09 01:27:45.014499 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:45.014462    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh" event={"ID":"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9","Type":"ContainerStarted","Data":"633bef2e5a8e76afd981e12f3abc8cc7324251d03c4ee7938f54c9b01e086c7b"}
Jul 09 01:27:45.034860 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:45.034799    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh" podStartSLOduration=1.034780533 podStartE2EDuration="1.034780533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:27:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:27:45.032268884 +0000 UTC m=+1972.502411613" watchObservedRunningTime="2026-07-09 01:27:45.034780533 +0000 UTC m=+1972.504923262"
Jul 09 01:27:45.524006 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:45.523969    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh"
Jul 09 01:27:45.529086 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:45.529056    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh"
Jul 09 01:27:46.019880 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:46.019845    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh"
Jul 09 01:27:46.021003 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:46.020983    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh"
Jul 09 01:27:51.047368 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:51.047338    2557 generic.go:356] "Generic (PLEG): container finished" podID="2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2" containerID="cfe5e9ff2a5b1eda44190abd3bcd0a1b7984869c2ee7c197b4632a56c144716e" exitCode=0
Jul 09 01:27:51.047798 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:51.047398    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd" event={"ID":"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2","Type":"ContainerDied","Data":"cfe5e9ff2a5b1eda44190abd3bcd0a1b7984869c2ee7c197b4632a56c144716e"}
Jul 09 01:27:51.047798 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:51.047770    2557 scope.go:117] "RemoveContainer" containerID="cfe5e9ff2a5b1eda44190abd3bcd0a1b7984869c2ee7c197b4632a56c144716e"
Jul 09 01:27:51.048730 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:51.048701    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:27:51.048801 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:51.048769    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:27:51.048839 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:51.048804    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:27:52.054043 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:52.054005    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd" event={"ID":"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2","Type":"ContainerStarted","Data":"cd6aa3715b1116f1a987df5ff9c496190536a0b1a561d8c41ddf51e3d5d5063d"}
Jul 09 01:27:52.189851 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:52.189815    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd"
Jul 09 01:27:52.191184 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:52.191153    2557 patch_prober.go:28] interesting pod/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 09 01:27:52.191446 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:52.191419    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd" podUID="2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 09 01:27:52.587750 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:52.587701    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:27:52.976466 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:52.976421    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd"
Jul 09 01:27:53.186477 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:53.186430    2557 patch_prober.go:28] interesting pod/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 09 01:27:53.187006 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:53.186523    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd" podUID="2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 09 01:27:54.186774 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:54.186717    2557 patch_prober.go:28] interesting pod/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 09 01:27:54.187416 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:54.186816    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd" podUID="2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 09 01:27:55.193235 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:55.189664    2557 patch_prober.go:28] interesting pod/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 09 01:27:55.193235 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:55.189766    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd" podUID="2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 09 01:27:56.199414 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:56.199360    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd"
Jul 09 01:27:56.202007 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:27:56.201977    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd"
Jul 09 01:28:01.021096 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:01.021058    2557 patch_prober.go:28] interesting pod/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 09 01:28:01.021571 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:01.021113    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh" podUID="cc1d5fb3-2b92-44eb-8e35-4d5111d850b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 09 01:28:01.098378 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:01.098346    2557 generic.go:356] "Generic (PLEG): container finished" podID="cc1d5fb3-2b92-44eb-8e35-4d5111d850b9" containerID="57a02d9b3b94fa1bd77b481d01197b5ec7b66124de59524d03e5e287e5c947fe" exitCode=0
Jul 09 01:28:01.098553 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:01.098423    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh" event={"ID":"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9","Type":"ContainerDied","Data":"57a02d9b3b94fa1bd77b481d01197b5ec7b66124de59524d03e5e287e5c947fe"}
Jul 09 01:28:01.098887 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:01.098873    2557 scope.go:117] "RemoveContainer" containerID="57a02d9b3b94fa1bd77b481d01197b5ec7b66124de59524d03e5e287e5c947fe"
Jul 09 01:28:01.099976 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:01.099949    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:28:01.100048 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:01.100018    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:28:01.100090 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:01.100048    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:28:02.110650 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:02.110617    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh" event={"ID":"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9","Type":"ContainerStarted","Data":"affae8c453b6253c36f31689e5f453a17096e763d7b8253b953981d07dbe4f58"}
Jul 09 01:28:02.523932 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:02.523895    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh"
Jul 09 01:28:02.524123 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:02.524099    2557 patch_prober.go:28] interesting pod/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 09 01:28:02.524176 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:02.524150    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh" podUID="cc1d5fb3-2b92-44eb-8e35-4d5111d850b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 09 01:28:03.299066 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:03.299017    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:28:03.524250 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:03.524187    2557 patch_prober.go:28] interesting pod/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 09 01:28:03.524458 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:03.524272    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh" podUID="cc1d5fb3-2b92-44eb-8e35-4d5111d850b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 09 01:28:04.523991 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:04.523958    2557 patch_prober.go:28] interesting pod/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 09 01:28:04.524417 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:04.524013    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh" podUID="cc1d5fb3-2b92-44eb-8e35-4d5111d850b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 09 01:28:05.524312 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:05.524274    2557 patch_prober.go:28] interesting pod/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 09 01:28:05.524716 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:05.524333    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh" podUID="cc1d5fb3-2b92-44eb-8e35-4d5111d850b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 09 01:28:06.270061 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:06.270023    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd"]
Jul 09 01:28:06.270295 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:06.270252    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd" podUID="2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2" containerName="istio-proxy" containerID="cri-o://cd6aa3715b1116f1a987df5ff9c496190536a0b1a561d8c41ddf51e3d5d5063d" gracePeriod=30
Jul 09 01:28:06.528533 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:06.528446    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh"
Jul 09 01:28:06.528969 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:06.528856    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh"
Jul 09 01:28:06.529527 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:06.529505    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh"
Jul 09 01:28:11.202635 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:11.202586    2557 patch_prober.go:28] interesting pod/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 09 01:28:11.203103 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:11.202656    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd" podUID="2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 09 01:28:11.525358 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:11.525329    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd"
Jul 09 01:28:11.575369 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:11.575337    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-istio-data\") pod \"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2\" (UID: \"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2\") "
Jul 09 01:28:11.575545 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:11.575387    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-credential-socket\") pod \"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2\" (UID: \"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2\") "
Jul 09 01:28:11.575545 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:11.575439    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-workload-socket\") pod \"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2\" (UID: \"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2\") "
Jul 09 01:28:11.575545 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:11.575488    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lv57d\" (UniqueName: \"kubernetes.io/projected/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-kube-api-access-lv57d\") pod \"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2\" (UID: \"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2\") "
Jul 09 01:28:11.575719 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:11.575551    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-istio-token\") pod \"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2\" (UID: \"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2\") "
Jul 09 01:28:11.575719 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:11.575584    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-workload-certs\") pod \"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2\" (UID: \"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2\") "
Jul 09 01:28:11.575719 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:11.575610    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-istiod-ca-cert\") pod \"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2\" (UID: \"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2\") "
Jul 09 01:28:11.575719 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:11.575639    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-istio-envoy\") pod \"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2\" (UID: \"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2\") "
Jul 09 01:28:11.575719 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:11.575675    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-istio-podinfo\") pod \"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2\" (UID: \"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2\") "
Jul 09 01:28:11.575968 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:11.575713    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2" (UID: "2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:28:11.576164 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:11.576074    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2" (UID: "2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:28:11.576284 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:11.576264    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-credential-socket\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:28:11.576350 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:11.576290    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-workload-certs\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:28:11.576350 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:11.576315    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-istio-data" (OuterVolumeSpecName: "istio-data") pod "2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2" (UID: "2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:28:11.576460 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:11.576393    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2" (UID: "2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:28:11.576591 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:11.576564    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2" (UID: "2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 01:28:11.578388 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:11.578358    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2" (UID: "2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 01:28:11.578503 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:11.578481    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-istio-token" (OuterVolumeSpecName: "istio-token") pod "2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2" (UID: "2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:28:11.578576 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:11.578535    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2" (UID: "2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:28:11.578680 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:11.578601    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-kube-api-access-lv57d" (OuterVolumeSpecName: "kube-api-access-lv57d") pod "2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2" (UID: "2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2"). InnerVolumeSpecName "kube-api-access-lv57d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:28:11.677180 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:11.677145    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-istio-podinfo\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:28:11.677180 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:11.677173    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-istio-data\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:28:11.677180 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:11.677184    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-workload-socket\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:28:11.677439 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:11.677193    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lv57d\" (UniqueName: \"kubernetes.io/projected/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-kube-api-access-lv57d\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:28:11.677439 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:11.677202    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-istio-token\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:28:11.677439 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:11.677222    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-istiod-ca-cert\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:28:11.677439 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:11.677230    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2-istio-envoy\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:28:12.159644 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:12.159610    2557 generic.go:356] "Generic (PLEG): container finished" podID="2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2" containerID="cd6aa3715b1116f1a987df5ff9c496190536a0b1a561d8c41ddf51e3d5d5063d" exitCode=0
Jul 09 01:28:12.159825 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:12.159664    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd"
Jul 09 01:28:12.159825 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:12.159669    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd" event={"ID":"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2","Type":"ContainerDied","Data":"cd6aa3715b1116f1a987df5ff9c496190536a0b1a561d8c41ddf51e3d5d5063d"}
Jul 09 01:28:12.159825 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:12.159723    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd" event={"ID":"2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2","Type":"ContainerDied","Data":"656c00a3032b7b9224ae4b537dd78a665bdc9e56b69a5b2680b0d291008d4702"}
Jul 09 01:28:12.159825 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:12.159753    2557 scope.go:117] "RemoveContainer" containerID="cd6aa3715b1116f1a987df5ff9c496190536a0b1a561d8c41ddf51e3d5d5063d"
Jul 09 01:28:12.169383 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:12.169366    2557 scope.go:117] "RemoveContainer" containerID="cfe5e9ff2a5b1eda44190abd3bcd0a1b7984869c2ee7c197b4632a56c144716e"
Jul 09 01:28:12.177545 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:12.177524    2557 scope.go:117] "RemoveContainer" containerID="cd6aa3715b1116f1a987df5ff9c496190536a0b1a561d8c41ddf51e3d5d5063d"
Jul 09 01:28:12.177816 ip-10-0-133-31 kubenswrapper[2557]: E0709 01:28:12.177796    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd6aa3715b1116f1a987df5ff9c496190536a0b1a561d8c41ddf51e3d5d5063d\": container with ID starting with cd6aa3715b1116f1a987df5ff9c496190536a0b1a561d8c41ddf51e3d5d5063d not found: ID does not exist" containerID="cd6aa3715b1116f1a987df5ff9c496190536a0b1a561d8c41ddf51e3d5d5063d"
Jul 09 01:28:12.177861 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:12.177825    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd6aa3715b1116f1a987df5ff9c496190536a0b1a561d8c41ddf51e3d5d5063d"} err="failed to get container status \"cd6aa3715b1116f1a987df5ff9c496190536a0b1a561d8c41ddf51e3d5d5063d\": rpc error: code = NotFound desc = could not find container \"cd6aa3715b1116f1a987df5ff9c496190536a0b1a561d8c41ddf51e3d5d5063d\": container with ID starting with cd6aa3715b1116f1a987df5ff9c496190536a0b1a561d8c41ddf51e3d5d5063d not found: ID does not exist"
Jul 09 01:28:12.177861 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:12.177850    2557 scope.go:117] "RemoveContainer" containerID="cfe5e9ff2a5b1eda44190abd3bcd0a1b7984869c2ee7c197b4632a56c144716e"
Jul 09 01:28:12.178058 ip-10-0-133-31 kubenswrapper[2557]: E0709 01:28:12.178042    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfe5e9ff2a5b1eda44190abd3bcd0a1b7984869c2ee7c197b4632a56c144716e\": container with ID starting with cfe5e9ff2a5b1eda44190abd3bcd0a1b7984869c2ee7c197b4632a56c144716e not found: ID does not exist" containerID="cfe5e9ff2a5b1eda44190abd3bcd0a1b7984869c2ee7c197b4632a56c144716e"
Jul 09 01:28:12.178096 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:12.178065    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfe5e9ff2a5b1eda44190abd3bcd0a1b7984869c2ee7c197b4632a56c144716e"} err="failed to get container status \"cfe5e9ff2a5b1eda44190abd3bcd0a1b7984869c2ee7c197b4632a56c144716e\": rpc error: code = NotFound desc = could not find container \"cfe5e9ff2a5b1eda44190abd3bcd0a1b7984869c2ee7c197b4632a56c144716e\": container with ID starting with cfe5e9ff2a5b1eda44190abd3bcd0a1b7984869c2ee7c197b4632a56c144716e not found: ID does not exist"
Jul 09 01:28:12.180979 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:12.180955    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd"]
Jul 09 01:28:12.184666 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:12.184646    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd"]
Jul 09 01:28:13.051011 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:13.050968    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2" path="/var/lib/kubelet/pods/2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2/volumes"
Jul 09 01:28:13.070376 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:13.070343    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh"]
Jul 09 01:28:13.070564 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:13.070539    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh" podUID="cc1d5fb3-2b92-44eb-8e35-4d5111d850b9" containerName="istio-proxy" containerID="cri-o://affae8c453b6253c36f31689e5f453a17096e763d7b8253b953981d07dbe4f58" gracePeriod=30
Jul 09 01:28:16.091387 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:16.091352    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:28:18.191897 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:18.191872    2557 generic.go:356] "Generic (PLEG): container finished" podID="cc1d5fb3-2b92-44eb-8e35-4d5111d850b9" containerID="affae8c453b6253c36f31689e5f453a17096e763d7b8253b953981d07dbe4f58" exitCode=0
Jul 09 01:28:18.192246 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:18.191948    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh" event={"ID":"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9","Type":"ContainerDied","Data":"affae8c453b6253c36f31689e5f453a17096e763d7b8253b953981d07dbe4f58"}
Jul 09 01:28:18.192246 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:18.192022    2557 scope.go:117] "RemoveContainer" containerID="57a02d9b3b94fa1bd77b481d01197b5ec7b66124de59524d03e5e287e5c947fe"
Jul 09 01:28:18.328462 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:18.328436    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh"
Jul 09 01:28:18.434587 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:18.434494    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-istio-envoy\") pod \"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9\" (UID: \"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9\") "
Jul 09 01:28:18.434587 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:18.434564    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-istio-podinfo\") pod \"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9\" (UID: \"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9\") "
Jul 09 01:28:18.434587 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:18.434586    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-workload-certs\") pod \"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9\" (UID: \"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9\") "
Jul 09 01:28:18.434890 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:18.434607    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-istio-data\") pod \"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9\" (UID: \"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9\") "
Jul 09 01:28:18.434890 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:18.434656    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-istio-token\") pod \"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9\" (UID: \"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9\") "
Jul 09 01:28:18.434890 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:18.434690    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-workload-socket\") pod \"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9\" (UID: \"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9\") "
Jul 09 01:28:18.434890 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:18.434734    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f66vd\" (UniqueName: \"kubernetes.io/projected/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-kube-api-access-f66vd\") pod \"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9\" (UID: \"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9\") "
Jul 09 01:28:18.434890 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:18.434758    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-istiod-ca-cert\") pod \"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9\" (UID: \"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9\") "
Jul 09 01:28:18.434890 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:18.434836    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-credential-socket\") pod \"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9\" (UID: \"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9\") "
Jul 09 01:28:18.435170 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:18.434887    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cc1d5fb3-2b92-44eb-8e35-4d5111d850b9" (UID: "cc1d5fb3-2b92-44eb-8e35-4d5111d850b9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:28:18.435170 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:18.435113    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-workload-certs\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:28:18.435313 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:18.435251    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cc1d5fb3-2b92-44eb-8e35-4d5111d850b9" (UID: "cc1d5fb3-2b92-44eb-8e35-4d5111d850b9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:28:18.435372 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:18.435321    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cc1d5fb3-2b92-44eb-8e35-4d5111d850b9" (UID: "cc1d5fb3-2b92-44eb-8e35-4d5111d850b9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 01:28:18.435372 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:18.435356    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cc1d5fb3-2b92-44eb-8e35-4d5111d850b9" (UID: "cc1d5fb3-2b92-44eb-8e35-4d5111d850b9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:28:18.435626 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:18.435603    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-istio-data" (OuterVolumeSpecName: "istio-data") pod "cc1d5fb3-2b92-44eb-8e35-4d5111d850b9" (UID: "cc1d5fb3-2b92-44eb-8e35-4d5111d850b9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:28:18.436903 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:18.436876    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cc1d5fb3-2b92-44eb-8e35-4d5111d850b9" (UID: "cc1d5fb3-2b92-44eb-8e35-4d5111d850b9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 01:28:18.437001 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:18.436953    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-istio-token" (OuterVolumeSpecName: "istio-token") pod "cc1d5fb3-2b92-44eb-8e35-4d5111d850b9" (UID: "cc1d5fb3-2b92-44eb-8e35-4d5111d850b9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:28:18.437169 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:18.437151    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cc1d5fb3-2b92-44eb-8e35-4d5111d850b9" (UID: "cc1d5fb3-2b92-44eb-8e35-4d5111d850b9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:28:18.437334 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:18.437311    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-kube-api-access-f66vd" (OuterVolumeSpecName: "kube-api-access-f66vd") pod "cc1d5fb3-2b92-44eb-8e35-4d5111d850b9" (UID: "cc1d5fb3-2b92-44eb-8e35-4d5111d850b9"). InnerVolumeSpecName "kube-api-access-f66vd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:28:18.536514 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:18.536483    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-istio-podinfo\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:28:18.536514 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:18.536509    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-istio-data\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:28:18.536514 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:18.536521    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-istio-token\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:28:18.536734 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:18.536532    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-workload-socket\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:28:18.536734 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:18.536543    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f66vd\" (UniqueName: \"kubernetes.io/projected/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-kube-api-access-f66vd\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:28:18.536734 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:18.536555    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-istiod-ca-cert\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:28:18.536734 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:18.536567    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-credential-socket\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:28:18.536734 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:18.536578    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9-istio-envoy\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:28:19.197309 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:19.197271    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh" event={"ID":"cc1d5fb3-2b92-44eb-8e35-4d5111d850b9","Type":"ContainerDied","Data":"633bef2e5a8e76afd981e12f3abc8cc7324251d03c4ee7938f54c9b01e086c7b"}
Jul 09 01:28:19.197738 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:19.197355    2557 scope.go:117] "RemoveContainer" containerID="affae8c453b6253c36f31689e5f453a17096e763d7b8253b953981d07dbe4f58"
Jul 09 01:28:19.197738 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:19.197353    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh"
Jul 09 01:28:19.215061 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:19.215038    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh"]
Jul 09 01:28:19.218706 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:19.218686    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh"]
Jul 09 01:28:21.039563 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:21.039522    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc1d5fb3-2b92-44eb-8e35-4d5111d850b9" path="/var/lib/kubelet/pods/cc1d5fb3-2b92-44eb-8e35-4d5111d850b9/volumes"
Jul 09 01:28:26.267492 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:26.267459    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j"]
Jul 09 01:28:26.268042 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:26.267949    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2" containerName="istio-proxy"
Jul 09 01:28:26.268042 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:26.267969    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2" containerName="istio-proxy"
Jul 09 01:28:26.268042 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:26.268011    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc1d5fb3-2b92-44eb-8e35-4d5111d850b9" containerName="istio-proxy"
Jul 09 01:28:26.268042 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:26.268020    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc1d5fb3-2b92-44eb-8e35-4d5111d850b9" containerName="istio-proxy"
Jul 09 01:28:26.268042 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:26.268035    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc1d5fb3-2b92-44eb-8e35-4d5111d850b9" containerName="istio-proxy"
Jul 09 01:28:26.268042 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:26.268042    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc1d5fb3-2b92-44eb-8e35-4d5111d850b9" containerName="istio-proxy"
Jul 09 01:28:26.268444 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:26.268131    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc1d5fb3-2b92-44eb-8e35-4d5111d850b9" containerName="istio-proxy"
Jul 09 01:28:26.268444 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:26.268142    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2" containerName="istio-proxy"
Jul 09 01:28:26.268444 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:26.268151    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc1d5fb3-2b92-44eb-8e35-4d5111d850b9" containerName="istio-proxy"
Jul 09 01:28:26.268444 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:26.268161    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2" containerName="istio-proxy"
Jul 09 01:28:26.272883 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:26.272863    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j"
Jul 09 01:28:26.275393 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:26.275372    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-52d242-openshift-default-dockercfg-xrw5m\""
Jul 09 01:28:26.282636 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:26.282612    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j"]
Jul 09 01:28:26.405758 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:26.405714    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbac52fb-19b0-4131-9758-052e15bdf746-istio-podinfo\") pod \"e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j\" (UID: \"dbac52fb-19b0-4131-9758-052e15bdf746\") " pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j"
Jul 09 01:28:26.405758 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:26.405759    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbac52fb-19b0-4131-9758-052e15bdf746-istio-envoy\") pod \"e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j\" (UID: \"dbac52fb-19b0-4131-9758-052e15bdf746\") " pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j"
Jul 09 01:28:26.405977 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:26.405776    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbac52fb-19b0-4131-9758-052e15bdf746-istio-data\") pod \"e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j\" (UID: \"dbac52fb-19b0-4131-9758-052e15bdf746\") " pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j"
Jul 09 01:28:26.405977 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:26.405876    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbac52fb-19b0-4131-9758-052e15bdf746-workload-certs\") pod \"e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j\" (UID: \"dbac52fb-19b0-4131-9758-052e15bdf746\") " pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j"
Jul 09 01:28:26.405977 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:26.405942    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbac52fb-19b0-4131-9758-052e15bdf746-credential-socket\") pod \"e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j\" (UID: \"dbac52fb-19b0-4131-9758-052e15bdf746\") " pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j"
Jul 09 01:28:26.406079 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:26.405975    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbac52fb-19b0-4131-9758-052e15bdf746-istio-token\") pod \"e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j\" (UID: \"dbac52fb-19b0-4131-9758-052e15bdf746\") " pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j"
Jul 09 01:28:26.406079 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:26.406041    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbac52fb-19b0-4131-9758-052e15bdf746-workload-socket\") pod \"e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j\" (UID: \"dbac52fb-19b0-4131-9758-052e15bdf746\") " pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j"
Jul 09 01:28:26.406143 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:26.406083    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxvsz\" (UniqueName: \"kubernetes.io/projected/dbac52fb-19b0-4131-9758-052e15bdf746-kube-api-access-rxvsz\") pod \"e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j\" (UID: \"dbac52fb-19b0-4131-9758-052e15bdf746\") " pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j"
Jul 09 01:28:26.406143 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:26.406109    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbac52fb-19b0-4131-9758-052e15bdf746-istiod-ca-cert\") pod \"e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j\" (UID: \"dbac52fb-19b0-4131-9758-052e15bdf746\") " pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j"
Jul 09 01:28:26.507222 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:26.507171    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbac52fb-19b0-4131-9758-052e15bdf746-workload-socket\") pod \"e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j\" (UID: \"dbac52fb-19b0-4131-9758-052e15bdf746\") " pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j"
Jul 09 01:28:26.507403 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:26.507240    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxvsz\" (UniqueName: \"kubernetes.io/projected/dbac52fb-19b0-4131-9758-052e15bdf746-kube-api-access-rxvsz\") pod \"e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j\" (UID: \"dbac52fb-19b0-4131-9758-052e15bdf746\") " pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j"
Jul 09 01:28:26.507403 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:26.507270    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbac52fb-19b0-4131-9758-052e15bdf746-istiod-ca-cert\") pod \"e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j\" (UID: \"dbac52fb-19b0-4131-9758-052e15bdf746\") " pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j"
Jul 09 01:28:26.507403 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:26.507324    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbac52fb-19b0-4131-9758-052e15bdf746-istio-podinfo\") pod \"e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j\" (UID: \"dbac52fb-19b0-4131-9758-052e15bdf746\") " pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j"
Jul 09 01:28:26.507403 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:26.507349    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbac52fb-19b0-4131-9758-052e15bdf746-istio-envoy\") pod \"e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j\" (UID: \"dbac52fb-19b0-4131-9758-052e15bdf746\") " pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j"
Jul 09 01:28:26.507633 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:26.507475    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbac52fb-19b0-4131-9758-052e15bdf746-istio-data\") pod \"e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j\" (UID: \"dbac52fb-19b0-4131-9758-052e15bdf746\") " pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j"
Jul 09 01:28:26.507633 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:26.507557    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbac52fb-19b0-4131-9758-052e15bdf746-workload-certs\") pod \"e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j\" (UID: \"dbac52fb-19b0-4131-9758-052e15bdf746\") " pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j"
Jul 09 01:28:26.507633 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:26.507613    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbac52fb-19b0-4131-9758-052e15bdf746-credential-socket\") pod \"e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j\" (UID: \"dbac52fb-19b0-4131-9758-052e15bdf746\") " pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j"
Jul 09 01:28:26.507792 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:26.507624    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbac52fb-19b0-4131-9758-052e15bdf746-workload-socket\") pod \"e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j\" (UID: \"dbac52fb-19b0-4131-9758-052e15bdf746\") " pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j"
Jul 09 01:28:26.507792 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:26.507646    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbac52fb-19b0-4131-9758-052e15bdf746-istio-token\") pod \"e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j\" (UID: \"dbac52fb-19b0-4131-9758-052e15bdf746\") " pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j"
Jul 09 01:28:26.507904 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:26.507823    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbac52fb-19b0-4131-9758-052e15bdf746-istio-data\") pod \"e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j\" (UID: \"dbac52fb-19b0-4131-9758-052e15bdf746\") " pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j"
Jul 09 01:28:26.507962 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:26.507897    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbac52fb-19b0-4131-9758-052e15bdf746-credential-socket\") pod \"e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j\" (UID: \"dbac52fb-19b0-4131-9758-052e15bdf746\") " pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j"
Jul 09 01:28:26.508111 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:26.508083    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbac52fb-19b0-4131-9758-052e15bdf746-workload-certs\") pod \"e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j\" (UID: \"dbac52fb-19b0-4131-9758-052e15bdf746\") " pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j"
Jul 09 01:28:26.508283 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:26.508117    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbac52fb-19b0-4131-9758-052e15bdf746-istiod-ca-cert\") pod \"e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j\" (UID: \"dbac52fb-19b0-4131-9758-052e15bdf746\") " pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j"
Jul 09 01:28:26.510071 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:26.510049    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbac52fb-19b0-4131-9758-052e15bdf746-istio-envoy\") pod \"e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j\" (UID: \"dbac52fb-19b0-4131-9758-052e15bdf746\") " pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j"
Jul 09 01:28:26.510180 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:26.510142    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbac52fb-19b0-4131-9758-052e15bdf746-istio-podinfo\") pod \"e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j\" (UID: \"dbac52fb-19b0-4131-9758-052e15bdf746\") " pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j"
Jul 09 01:28:26.514899 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:26.514873    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxvsz\" (UniqueName: \"kubernetes.io/projected/dbac52fb-19b0-4131-9758-052e15bdf746-kube-api-access-rxvsz\") pod \"e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j\" (UID: \"dbac52fb-19b0-4131-9758-052e15bdf746\") " pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j"
Jul 09 01:28:26.514899 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:26.514890    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbac52fb-19b0-4131-9758-052e15bdf746-istio-token\") pod \"e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j\" (UID: \"dbac52fb-19b0-4131-9758-052e15bdf746\") " pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j"
Jul 09 01:28:26.584996 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:26.584917    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j"
Jul 09 01:28:26.725052 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:26.725025    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j"]
Jul 09 01:28:26.726719 ip-10-0-133-31 kubenswrapper[2557]: W0709 01:28:26.726691    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbac52fb_19b0_4131_9758_052e15bdf746.slice/crio-c1972fbc9dace917e8ddceb1d24af45de1e328a10b00dfba871d39d954f98dbf WatchSource:0}: Error finding container c1972fbc9dace917e8ddceb1d24af45de1e328a10b00dfba871d39d954f98dbf: Status 404 returned error can't find the container with id c1972fbc9dace917e8ddceb1d24af45de1e328a10b00dfba871d39d954f98dbf
Jul 09 01:28:26.728863 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:26.728831    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:28:26.728970 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:26.728909    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:28:26.728970 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:26.728953    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:28:27.233814 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:27.233778    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j" event={"ID":"dbac52fb-19b0-4131-9758-052e15bdf746","Type":"ContainerStarted","Data":"8080f07f4760a85d080df877f4518f54e4d73d9ea675825e566168efa2cc5ba8"}
Jul 09 01:28:27.234015 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:27.233826    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j" event={"ID":"dbac52fb-19b0-4131-9758-052e15bdf746","Type":"ContainerStarted","Data":"c1972fbc9dace917e8ddceb1d24af45de1e328a10b00dfba871d39d954f98dbf"}
Jul 09 01:28:27.254841 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:27.254789    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j" podStartSLOduration=1.25477245 podStartE2EDuration="1.25477245s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:28:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:28:27.252065617 +0000 UTC m=+2014.722208359" watchObservedRunningTime="2026-07-09 01:28:27.25477245 +0000 UTC m=+2014.724915162"
Jul 09 01:28:27.585199 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:27.585106    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j"
Jul 09 01:28:27.589730 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:27.589702    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j"
Jul 09 01:28:28.238531 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:28.238498    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j"
Jul 09 01:28:28.239575 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:28.239554    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j"
Jul 09 01:28:29.212447 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:29.212411    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:28:41.292327 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:41.292280    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:28:44.281426 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:44.281376    2557 patch_prober.go:28] interesting pod/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 09 01:28:44.281905 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:44.281471    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j" podUID="dbac52fb-19b0-4131-9758-052e15bdf746" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 09 01:28:45.326409 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:45.326373    2557 generic.go:356] "Generic (PLEG): container finished" podID="dbac52fb-19b0-4131-9758-052e15bdf746" containerID="8080f07f4760a85d080df877f4518f54e4d73d9ea675825e566168efa2cc5ba8" exitCode=0
Jul 09 01:28:45.326962 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:45.326451    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j" event={"ID":"dbac52fb-19b0-4131-9758-052e15bdf746","Type":"ContainerDied","Data":"8080f07f4760a85d080df877f4518f54e4d73d9ea675825e566168efa2cc5ba8"}
Jul 09 01:28:45.326962 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:45.326932    2557 scope.go:117] "RemoveContainer" containerID="8080f07f4760a85d080df877f4518f54e4d73d9ea675825e566168efa2cc5ba8"
Jul 09 01:28:45.327986 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:45.327957    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:28:45.328098 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:45.328026    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:28:45.328098 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:45.328066    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 01:28:46.333434 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:46.333399    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j" event={"ID":"dbac52fb-19b0-4131-9758-052e15bdf746","Type":"ContainerStarted","Data":"d05e5a692d7024849da36d106e72215ef13f9aa96bd71addfe7c0c45ab448893"}
Jul 09 01:28:46.585359 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:46.585250    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j"
Jul 09 01:28:46.585574 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:46.585543    2557 patch_prober.go:28] interesting pod/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 09 01:28:46.585645 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:46.585612    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j" podUID="dbac52fb-19b0-4131-9758-052e15bdf746" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 09 01:28:47.586033 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:47.585993    2557 patch_prober.go:28] interesting pod/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 09 01:28:47.586674 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:47.586640    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j" podUID="dbac52fb-19b0-4131-9758-052e15bdf746" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 09 01:28:48.585838 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:48.585801    2557 patch_prober.go:28] interesting pod/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 09 01:28:48.586129 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:48.586098    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j" podUID="dbac52fb-19b0-4131-9758-052e15bdf746" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 09 01:28:49.585867 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:49.585815    2557 patch_prober.go:28] interesting pod/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 09 01:28:49.586087 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:49.585928    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j" podUID="dbac52fb-19b0-4131-9758-052e15bdf746" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 09 01:28:50.589420 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:50.589378    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j"
Jul 09 01:28:50.589824 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:50.589703    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j"
Jul 09 01:28:50.590478 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:50.590461    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j"
Jul 09 01:28:59.591783 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:28:59.591745    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:29:27.096366 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:29:27.096335    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:29:53.146382 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:29:53.146348    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z6kj2_7dc12511-b804-4ebc-8646-4d070d93a8cf/console-operator/1.log"
Jul 09 01:29:53.161112 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:29:53.161088    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z6kj2_7dc12511-b804-4ebc-8646-4d070d93a8cf/console-operator/1.log"
Jul 09 01:29:53.691478 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:29:53.691445    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:30:00.133230 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:30:00.133166    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-88a238-29726010-qhdvt"]
Jul 09 01:30:00.134781 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:30:00.134744    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2" containerName="istio-proxy"
Jul 09 01:30:00.134781 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:30:00.134781    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c78c0d9-7215-42c8-b1b7-2dcfe082e4f2" containerName="istio-proxy"
Jul 09 01:30:00.139396 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:30:00.139369    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726010-ffwbt"]
Jul 09 01:30:00.140290 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:30:00.140263    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-88a238-29726010-qhdvt"
Jul 09 01:30:00.142868 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:30:00.142810    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 01:30:00.143011 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:30:00.142932    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-5rxv2\""
Jul 09 01:30:00.143170 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:30:00.143153    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 01:30:00.144077 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:30:00.144055    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726010-ffwbt"
Jul 09 01:30:00.144429 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:30:00.144404    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726010-ffwbt"]
Jul 09 01:30:00.147036 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:30:00.147013    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-88a238-29726010-qhdvt"]
Jul 09 01:30:00.230087 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:30:00.230050    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4ppp\" (UniqueName: \"kubernetes.io/projected/3aee70d7-40ef-4a95-861b-d9dbe2228dea-kube-api-access-j4ppp\") pod \"maas-api-key-cleanup-29726010-ffwbt\" (UID: \"3aee70d7-40ef-4a95-861b-d9dbe2228dea\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726010-ffwbt"
Jul 09 01:30:00.230278 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:30:00.230130    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7h4b\" (UniqueName: \"kubernetes.io/projected/47222eb7-9319-4272-ac9a-b55429400058-kube-api-access-g7h4b\") pod \"maas-api-key-cleanup-e2e-shared-a-88a238-29726010-qhdvt\" (UID: \"47222eb7-9319-4272-ac9a-b55429400058\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-88a238-29726010-qhdvt"
Jul 09 01:30:00.331396 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:30:00.331358    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4ppp\" (UniqueName: \"kubernetes.io/projected/3aee70d7-40ef-4a95-861b-d9dbe2228dea-kube-api-access-j4ppp\") pod \"maas-api-key-cleanup-29726010-ffwbt\" (UID: \"3aee70d7-40ef-4a95-861b-d9dbe2228dea\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726010-ffwbt"
Jul 09 01:30:00.331611 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:30:00.331412    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7h4b\" (UniqueName: \"kubernetes.io/projected/47222eb7-9319-4272-ac9a-b55429400058-kube-api-access-g7h4b\") pod \"maas-api-key-cleanup-e2e-shared-a-88a238-29726010-qhdvt\" (UID: \"47222eb7-9319-4272-ac9a-b55429400058\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-88a238-29726010-qhdvt"
Jul 09 01:30:00.339164 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:30:00.339129    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7h4b\" (UniqueName: \"kubernetes.io/projected/47222eb7-9319-4272-ac9a-b55429400058-kube-api-access-g7h4b\") pod \"maas-api-key-cleanup-e2e-shared-a-88a238-29726010-qhdvt\" (UID: \"47222eb7-9319-4272-ac9a-b55429400058\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-88a238-29726010-qhdvt"
Jul 09 01:30:00.339300 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:30:00.339169    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4ppp\" (UniqueName: \"kubernetes.io/projected/3aee70d7-40ef-4a95-861b-d9dbe2228dea-kube-api-access-j4ppp\") pod \"maas-api-key-cleanup-29726010-ffwbt\" (UID: \"3aee70d7-40ef-4a95-861b-d9dbe2228dea\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726010-ffwbt"
Jul 09 01:30:00.457561 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:30:00.457472    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-88a238-29726010-qhdvt"
Jul 09 01:30:00.462505 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:30:00.462485    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726010-ffwbt"
Jul 09 01:30:00.603905 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:30:00.603878    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-88a238-29726010-qhdvt"]
Jul 09 01:30:00.606616 ip-10-0-133-31 kubenswrapper[2557]: W0709 01:30:00.606578    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47222eb7_9319_4272_ac9a_b55429400058.slice/crio-b36004f5ae4695ea9e2b999558b1b836d8641718ad8e04705aa76cbb74bbd85e WatchSource:0}: Error finding container b36004f5ae4695ea9e2b999558b1b836d8641718ad8e04705aa76cbb74bbd85e: Status 404 returned error can't find the container with id b36004f5ae4695ea9e2b999558b1b836d8641718ad8e04705aa76cbb74bbd85e
Jul 09 01:30:00.609181 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:30:00.609159    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 01:30:00.629747 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:30:00.629725    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726010-ffwbt"]
Jul 09 01:30:00.631698 ip-10-0-133-31 kubenswrapper[2557]: W0709 01:30:00.631659    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3aee70d7_40ef_4a95_861b_d9dbe2228dea.slice/crio-507366950f6c3e02bb564d53465dca382e172940e68fa84097e395fb12506927 WatchSource:0}: Error finding container 507366950f6c3e02bb564d53465dca382e172940e68fa84097e395fb12506927: Status 404 returned error can't find the container with id 507366950f6c3e02bb564d53465dca382e172940e68fa84097e395fb12506927
Jul 09 01:30:00.678893 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:30:00.678852    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726010-ffwbt" event={"ID":"3aee70d7-40ef-4a95-861b-d9dbe2228dea","Type":"ContainerStarted","Data":"507366950f6c3e02bb564d53465dca382e172940e68fa84097e395fb12506927"}
Jul 09 01:30:00.680170 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:30:00.680131    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-88a238-29726010-qhdvt" event={"ID":"47222eb7-9319-4272-ac9a-b55429400058","Type":"ContainerStarted","Data":"b36004f5ae4695ea9e2b999558b1b836d8641718ad8e04705aa76cbb74bbd85e"}
Jul 09 01:30:04.700567 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:30:04.700472    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726010-ffwbt" event={"ID":"3aee70d7-40ef-4a95-861b-d9dbe2228dea","Type":"ContainerStarted","Data":"11767d61faccf9c949bd7df755b8e7b92167267104b4b07d07e09a5e0fa2bae4"}
Jul 09 01:30:04.715321 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:30:04.715270    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726010-ffwbt" podStartSLOduration=1.2717774880000001 podStartE2EDuration="4.715253876s" totalImagesPullingTime="3.443476388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:30:04.713614499 +0000 UTC m=+2112.183757228" watchObservedRunningTime="2026-07-09 01:30:04.715253876 +0000 UTC m=+2112.185396604"
Jul 09 01:30:06.712439 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:30:06.712396    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-88a238-29726010-qhdvt" event={"ID":"47222eb7-9319-4272-ac9a-b55429400058","Type":"ContainerStarted","Data":"3f52c6e46808cfee82694e48e9b882de4c56695dce42dee0c281d09483df49c8"}
Jul 09 01:30:06.727863 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:30:06.727809    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-88a238-29726010-qhdvt" podStartSLOduration=1.531401259 podStartE2EDuration="6.72779528s" totalImagesPullingTime="5.196394021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:30:06.726016465 +0000 UTC m=+2114.196159194" watchObservedRunningTime="2026-07-09 01:30:06.72779528 +0000 UTC m=+2114.197938011"
Jul 09 01:30:14.239852 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:30:14.239814    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:30:30.796914 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:30:30.796879    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:30:49.793908 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:30:49.793819    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:31:00.013186 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:00.013149    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726010-ffwbt"]
Jul 09 01:31:00.013774 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:00.013400    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726010-ffwbt" podUID="3aee70d7-40ef-4a95-861b-d9dbe2228dea" containerName="cleanup" containerID="cri-o://11767d61faccf9c949bd7df755b8e7b92167267104b4b07d07e09a5e0fa2bae4" gracePeriod=30
Jul 09 01:31:00.015178 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:00.015152    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-88a238-29726010-qhdvt"]
Jul 09 01:31:00.015391 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:00.015353    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-88a238-29726010-qhdvt" podUID="47222eb7-9319-4272-ac9a-b55429400058" containerName="cleanup" containerID="cri-o://3f52c6e46808cfee82694e48e9b882de4c56695dce42dee0c281d09483df49c8" gracePeriod=30
Jul 09 01:31:08.499020 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:08.498985    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:31:27.494523 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:27.494486    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:31:30.108409 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:30.108367    2557 generic.go:356] "Generic (PLEG): container finished" podID="47222eb7-9319-4272-ac9a-b55429400058" containerID="3f52c6e46808cfee82694e48e9b882de4c56695dce42dee0c281d09483df49c8" exitCode=137
Jul 09 01:31:30.108998 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:30.108409    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-88a238-29726010-qhdvt" event={"ID":"47222eb7-9319-4272-ac9a-b55429400058","Type":"ContainerDied","Data":"3f52c6e46808cfee82694e48e9b882de4c56695dce42dee0c281d09483df49c8"}
Jul 09 01:31:30.110368 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:30.110340    2557 generic.go:356] "Generic (PLEG): container finished" podID="3aee70d7-40ef-4a95-861b-d9dbe2228dea" containerID="11767d61faccf9c949bd7df755b8e7b92167267104b4b07d07e09a5e0fa2bae4" exitCode=137
Jul 09 01:31:30.110472 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:30.110382    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726010-ffwbt" event={"ID":"3aee70d7-40ef-4a95-861b-d9dbe2228dea","Type":"ContainerDied","Data":"11767d61faccf9c949bd7df755b8e7b92167267104b4b07d07e09a5e0fa2bae4"}
Jul 09 01:31:30.208182 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:30.208154    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726010-ffwbt"
Jul 09 01:31:30.236706 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:30.236677    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-88a238-29726010-qhdvt"
Jul 09 01:31:30.360385 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:30.360292    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7h4b\" (UniqueName: \"kubernetes.io/projected/47222eb7-9319-4272-ac9a-b55429400058-kube-api-access-g7h4b\") pod \"47222eb7-9319-4272-ac9a-b55429400058\" (UID: \"47222eb7-9319-4272-ac9a-b55429400058\") "
Jul 09 01:31:30.360385 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:30.360366    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j4ppp\" (UniqueName: \"kubernetes.io/projected/3aee70d7-40ef-4a95-861b-d9dbe2228dea-kube-api-access-j4ppp\") pod \"3aee70d7-40ef-4a95-861b-d9dbe2228dea\" (UID: \"3aee70d7-40ef-4a95-861b-d9dbe2228dea\") "
Jul 09 01:31:30.362570 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:30.362538    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3aee70d7-40ef-4a95-861b-d9dbe2228dea-kube-api-access-j4ppp" (OuterVolumeSpecName: "kube-api-access-j4ppp") pod "3aee70d7-40ef-4a95-861b-d9dbe2228dea" (UID: "3aee70d7-40ef-4a95-861b-d9dbe2228dea"). InnerVolumeSpecName "kube-api-access-j4ppp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:31:30.362703 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:30.362573    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47222eb7-9319-4272-ac9a-b55429400058-kube-api-access-g7h4b" (OuterVolumeSpecName: "kube-api-access-g7h4b") pod "47222eb7-9319-4272-ac9a-b55429400058" (UID: "47222eb7-9319-4272-ac9a-b55429400058"). InnerVolumeSpecName "kube-api-access-g7h4b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:31:30.461646 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:30.461605    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7h4b\" (UniqueName: \"kubernetes.io/projected/47222eb7-9319-4272-ac9a-b55429400058-kube-api-access-g7h4b\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:31:30.461646 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:30.461639    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4ppp\" (UniqueName: \"kubernetes.io/projected/3aee70d7-40ef-4a95-861b-d9dbe2228dea-kube-api-access-j4ppp\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:31:31.116507 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:31.116476    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726010-ffwbt"
Jul 09 01:31:31.116948 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:31.116475    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726010-ffwbt" event={"ID":"3aee70d7-40ef-4a95-861b-d9dbe2228dea","Type":"ContainerDied","Data":"507366950f6c3e02bb564d53465dca382e172940e68fa84097e395fb12506927"}
Jul 09 01:31:31.116948 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:31.116637    2557 scope.go:117] "RemoveContainer" containerID="11767d61faccf9c949bd7df755b8e7b92167267104b4b07d07e09a5e0fa2bae4"
Jul 09 01:31:31.117998 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:31.117822    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-88a238-29726010-qhdvt"
Jul 09 01:31:31.117998 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:31.117871    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-88a238-29726010-qhdvt" event={"ID":"47222eb7-9319-4272-ac9a-b55429400058","Type":"ContainerDied","Data":"b36004f5ae4695ea9e2b999558b1b836d8641718ad8e04705aa76cbb74bbd85e"}
Jul 09 01:31:31.125612 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:31.125597    2557 scope.go:117] "RemoveContainer" containerID="3f52c6e46808cfee82694e48e9b882de4c56695dce42dee0c281d09483df49c8"
Jul 09 01:31:31.134817 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:31.134786    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726010-ffwbt"]
Jul 09 01:31:31.140177 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:31.140157    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726010-ffwbt"]
Jul 09 01:31:31.149040 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:31.149022    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-88a238-29726010-qhdvt"]
Jul 09 01:31:31.150974 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:31.150957    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-88a238-29726010-qhdvt"]
Jul 09 01:31:33.041433 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:33.041397    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3aee70d7-40ef-4a95-861b-d9dbe2228dea" path="/var/lib/kubelet/pods/3aee70d7-40ef-4a95-861b-d9dbe2228dea/volumes"
Jul 09 01:31:33.041850 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:33.041797    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47222eb7-9319-4272-ac9a-b55429400058" path="/var/lib/kubelet/pods/47222eb7-9319-4272-ac9a-b55429400058/volumes"
Jul 09 01:31:45.994096 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:45.994063    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:31:48.034961 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:48.034929    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-88a238/sub-test-model-88a238-kserve-745fd6d85f-kn2t5"]
Jul 09 01:31:48.035357 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:48.035341    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47222eb7-9319-4272-ac9a-b55429400058" containerName="cleanup"
Jul 09 01:31:48.035403 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:48.035358    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="47222eb7-9319-4272-ac9a-b55429400058" containerName="cleanup"
Jul 09 01:31:48.035403 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:48.035369    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3aee70d7-40ef-4a95-861b-d9dbe2228dea" containerName="cleanup"
Jul 09 01:31:48.035403 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:48.035374    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="3aee70d7-40ef-4a95-861b-d9dbe2228dea" containerName="cleanup"
Jul 09 01:31:48.035495 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:48.035442    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="47222eb7-9319-4272-ac9a-b55429400058" containerName="cleanup"
Jul 09 01:31:48.035495 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:48.035450    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="3aee70d7-40ef-4a95-861b-d9dbe2228dea" containerName="cleanup"
Jul 09 01:31:48.048494 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:48.048464    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-88a238/sub-test-model-88a238-kserve-745fd6d85f-kn2t5"]
Jul 09 01:31:48.048649 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:48.048558    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-88a238/sub-test-model-88a238-kserve-745fd6d85f-kn2t5"
Jul 09 01:31:48.050928 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:48.050904    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-88a238\"/\"kube-root-ca.crt\""
Jul 09 01:31:48.051996 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:48.051969    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-88a238\"/\"default-dockercfg-zf6pf\""
Jul 09 01:31:48.051996 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:48.051983    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-88a238\"/\"sub-test-model-88a238-kserve-self-signed-certs\""
Jul 09 01:31:48.052193 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:48.052044    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-88a238\"/\"openshift-service-ca.crt\""
Jul 09 01:31:48.118769 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:48.118731    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/186296ae-4f52-4b7d-96bf-503fa7c83557-dshm\") pod \"sub-test-model-88a238-kserve-745fd6d85f-kn2t5\" (UID: \"186296ae-4f52-4b7d-96bf-503fa7c83557\") " pod="ai-tenant-e2e-shared-a-88a238/sub-test-model-88a238-kserve-745fd6d85f-kn2t5"
Jul 09 01:31:48.118962 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:48.118815    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzw7w\" (UniqueName: \"kubernetes.io/projected/186296ae-4f52-4b7d-96bf-503fa7c83557-kube-api-access-gzw7w\") pod \"sub-test-model-88a238-kserve-745fd6d85f-kn2t5\" (UID: \"186296ae-4f52-4b7d-96bf-503fa7c83557\") " pod="ai-tenant-e2e-shared-a-88a238/sub-test-model-88a238-kserve-745fd6d85f-kn2t5"
Jul 09 01:31:48.118962 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:48.118848    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/186296ae-4f52-4b7d-96bf-503fa7c83557-tmp-dir\") pod \"sub-test-model-88a238-kserve-745fd6d85f-kn2t5\" (UID: \"186296ae-4f52-4b7d-96bf-503fa7c83557\") " pod="ai-tenant-e2e-shared-a-88a238/sub-test-model-88a238-kserve-745fd6d85f-kn2t5"
Jul 09 01:31:48.118962 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:48.118868    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/186296ae-4f52-4b7d-96bf-503fa7c83557-home\") pod \"sub-test-model-88a238-kserve-745fd6d85f-kn2t5\" (UID: \"186296ae-4f52-4b7d-96bf-503fa7c83557\") " pod="ai-tenant-e2e-shared-a-88a238/sub-test-model-88a238-kserve-745fd6d85f-kn2t5"
Jul 09 01:31:48.118962 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:48.118891    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/186296ae-4f52-4b7d-96bf-503fa7c83557-tls-certs\") pod \"sub-test-model-88a238-kserve-745fd6d85f-kn2t5\" (UID: \"186296ae-4f52-4b7d-96bf-503fa7c83557\") " pod="ai-tenant-e2e-shared-a-88a238/sub-test-model-88a238-kserve-745fd6d85f-kn2t5"
Jul 09 01:31:48.118962 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:48.118922    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/186296ae-4f52-4b7d-96bf-503fa7c83557-model-cache\") pod \"sub-test-model-88a238-kserve-745fd6d85f-kn2t5\" (UID: \"186296ae-4f52-4b7d-96bf-503fa7c83557\") " pod="ai-tenant-e2e-shared-a-88a238/sub-test-model-88a238-kserve-745fd6d85f-kn2t5"
Jul 09 01:31:48.219418 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:48.219383    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzw7w\" (UniqueName: \"kubernetes.io/projected/186296ae-4f52-4b7d-96bf-503fa7c83557-kube-api-access-gzw7w\") pod \"sub-test-model-88a238-kserve-745fd6d85f-kn2t5\" (UID: \"186296ae-4f52-4b7d-96bf-503fa7c83557\") " pod="ai-tenant-e2e-shared-a-88a238/sub-test-model-88a238-kserve-745fd6d85f-kn2t5"
Jul 09 01:31:48.219597 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:48.219439    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/186296ae-4f52-4b7d-96bf-503fa7c83557-tmp-dir\") pod \"sub-test-model-88a238-kserve-745fd6d85f-kn2t5\" (UID: \"186296ae-4f52-4b7d-96bf-503fa7c83557\") " pod="ai-tenant-e2e-shared-a-88a238/sub-test-model-88a238-kserve-745fd6d85f-kn2t5"
Jul 09 01:31:48.219597 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:48.219471    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/186296ae-4f52-4b7d-96bf-503fa7c83557-home\") pod \"sub-test-model-88a238-kserve-745fd6d85f-kn2t5\" (UID: \"186296ae-4f52-4b7d-96bf-503fa7c83557\") " pod="ai-tenant-e2e-shared-a-88a238/sub-test-model-88a238-kserve-745fd6d85f-kn2t5"
Jul 09 01:31:48.219597 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:48.219492    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/186296ae-4f52-4b7d-96bf-503fa7c83557-tls-certs\") pod \"sub-test-model-88a238-kserve-745fd6d85f-kn2t5\" (UID: \"186296ae-4f52-4b7d-96bf-503fa7c83557\") " pod="ai-tenant-e2e-shared-a-88a238/sub-test-model-88a238-kserve-745fd6d85f-kn2t5"
Jul 09 01:31:48.219597 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:48.219516    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/186296ae-4f52-4b7d-96bf-503fa7c83557-model-cache\") pod \"sub-test-model-88a238-kserve-745fd6d85f-kn2t5\" (UID: \"186296ae-4f52-4b7d-96bf-503fa7c83557\") " pod="ai-tenant-e2e-shared-a-88a238/sub-test-model-88a238-kserve-745fd6d85f-kn2t5"
Jul 09 01:31:48.219597 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:48.219578    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/186296ae-4f52-4b7d-96bf-503fa7c83557-dshm\") pod \"sub-test-model-88a238-kserve-745fd6d85f-kn2t5\" (UID: \"186296ae-4f52-4b7d-96bf-503fa7c83557\") " pod="ai-tenant-e2e-shared-a-88a238/sub-test-model-88a238-kserve-745fd6d85f-kn2t5"
Jul 09 01:31:48.219872 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:48.219847    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/186296ae-4f52-4b7d-96bf-503fa7c83557-tmp-dir\") pod \"sub-test-model-88a238-kserve-745fd6d85f-kn2t5\" (UID: \"186296ae-4f52-4b7d-96bf-503fa7c83557\") " pod="ai-tenant-e2e-shared-a-88a238/sub-test-model-88a238-kserve-745fd6d85f-kn2t5"
Jul 09 01:31:48.219920 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:48.219875    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/186296ae-4f52-4b7d-96bf-503fa7c83557-home\") pod \"sub-test-model-88a238-kserve-745fd6d85f-kn2t5\" (UID: \"186296ae-4f52-4b7d-96bf-503fa7c83557\") " pod="ai-tenant-e2e-shared-a-88a238/sub-test-model-88a238-kserve-745fd6d85f-kn2t5"
Jul 09 01:31:48.219955 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:48.219931    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/186296ae-4f52-4b7d-96bf-503fa7c83557-model-cache\") pod \"sub-test-model-88a238-kserve-745fd6d85f-kn2t5\" (UID: \"186296ae-4f52-4b7d-96bf-503fa7c83557\") " pod="ai-tenant-e2e-shared-a-88a238/sub-test-model-88a238-kserve-745fd6d85f-kn2t5"
Jul 09 01:31:48.221816 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:48.221795    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/186296ae-4f52-4b7d-96bf-503fa7c83557-dshm\") pod \"sub-test-model-88a238-kserve-745fd6d85f-kn2t5\" (UID: \"186296ae-4f52-4b7d-96bf-503fa7c83557\") " pod="ai-tenant-e2e-shared-a-88a238/sub-test-model-88a238-kserve-745fd6d85f-kn2t5"
Jul 09 01:31:48.221989 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:48.221969    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/186296ae-4f52-4b7d-96bf-503fa7c83557-tls-certs\") pod \"sub-test-model-88a238-kserve-745fd6d85f-kn2t5\" (UID: \"186296ae-4f52-4b7d-96bf-503fa7c83557\") " pod="ai-tenant-e2e-shared-a-88a238/sub-test-model-88a238-kserve-745fd6d85f-kn2t5"
Jul 09 01:31:48.226625 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:48.226602    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzw7w\" (UniqueName: \"kubernetes.io/projected/186296ae-4f52-4b7d-96bf-503fa7c83557-kube-api-access-gzw7w\") pod \"sub-test-model-88a238-kserve-745fd6d85f-kn2t5\" (UID: \"186296ae-4f52-4b7d-96bf-503fa7c83557\") " pod="ai-tenant-e2e-shared-a-88a238/sub-test-model-88a238-kserve-745fd6d85f-kn2t5"
Jul 09 01:31:48.360721 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:48.360632    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-88a238/sub-test-model-88a238-kserve-745fd6d85f-kn2t5"
Jul 09 01:31:48.494427 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:48.494396    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-88a238/sub-test-model-88a238-kserve-745fd6d85f-kn2t5"]
Jul 09 01:31:48.497772 ip-10-0-133-31 kubenswrapper[2557]: W0709 01:31:48.497740    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod186296ae_4f52_4b7d_96bf_503fa7c83557.slice/crio-21575f946b88e698e4e779fc7a6fc9341995a33da6a7eca96808021c2d6bcb33 WatchSource:0}: Error finding container 21575f946b88e698e4e779fc7a6fc9341995a33da6a7eca96808021c2d6bcb33: Status 404 returned error can't find the container with id 21575f946b88e698e4e779fc7a6fc9341995a33da6a7eca96808021c2d6bcb33
Jul 09 01:31:49.208556 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:49.208506    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-88a238/sub-test-model-88a238-kserve-745fd6d85f-kn2t5" event={"ID":"186296ae-4f52-4b7d-96bf-503fa7c83557","Type":"ContainerStarted","Data":"4749ac70fcea457e061bd24937a6d2b8cc6fc2210f0aa14946ae453456d54046"}
Jul 09 01:31:49.208556 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:49.208558    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-88a238/sub-test-model-88a238-kserve-745fd6d85f-kn2t5" event={"ID":"186296ae-4f52-4b7d-96bf-503fa7c83557","Type":"ContainerStarted","Data":"21575f946b88e698e4e779fc7a6fc9341995a33da6a7eca96808021c2d6bcb33"}
Jul 09 01:31:49.226035 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:49.225987    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-88a238/sub-test-model-88a238-kserve-745fd6d85f-kn2t5" podStartSLOduration=1.225972619 podStartE2EDuration="1.225972619s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:31:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:31:49.223935329 +0000 UTC m=+2216.694078058" watchObservedRunningTime="2026-07-09 01:31:49.225972619 +0000 UTC m=+2216.696115348"
Jul 09 01:31:58.361078 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:58.361029    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-88a238/sub-test-model-88a238-kserve-745fd6d85f-kn2t5"
Jul 09 01:31:58.361078 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:58.361088    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-88a238/sub-test-model-88a238-kserve-745fd6d85f-kn2t5"
Jul 09 01:31:58.373923 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:58.373899    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-88a238/sub-test-model-88a238-kserve-745fd6d85f-kn2t5"
Jul 09 01:31:59.267447 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:31:59.267417    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-88a238/sub-test-model-88a238-kserve-745fd6d85f-kn2t5"
Jul 09 01:32:02.497654 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:32:02.497621    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:32:23.292878 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:32:23.292839    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:32:38.401279 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:32:38.401247    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:32:59.288977 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:32:59.288942    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:33:05.013854 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:05.013817    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-88a238/sub-test-model-88a238-kserve-745fd6d85f-kn2t5"]
Jul 09 01:33:17.295436 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:17.295403    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:33:20.034362 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:20.034299    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-88a238/sub-test-model-88a238-kserve-745fd6d85f-kn2t5" podUID="186296ae-4f52-4b7d-96bf-503fa7c83557" containerName="main" containerID="cri-o://4749ac70fcea457e061bd24937a6d2b8cc6fc2210f0aa14946ae453456d54046" gracePeriod=45
Jul 09 01:33:20.289369 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:20.289304    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-88a238/sub-test-model-88a238-kserve-745fd6d85f-kn2t5"
Jul 09 01:33:20.358230 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:20.358160    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/186296ae-4f52-4b7d-96bf-503fa7c83557-home\") pod \"186296ae-4f52-4b7d-96bf-503fa7c83557\" (UID: \"186296ae-4f52-4b7d-96bf-503fa7c83557\") "
Jul 09 01:33:20.358230 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:20.358241    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/186296ae-4f52-4b7d-96bf-503fa7c83557-dshm\") pod \"186296ae-4f52-4b7d-96bf-503fa7c83557\" (UID: \"186296ae-4f52-4b7d-96bf-503fa7c83557\") "
Jul 09 01:33:20.358483 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:20.358262    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/186296ae-4f52-4b7d-96bf-503fa7c83557-tmp-dir\") pod \"186296ae-4f52-4b7d-96bf-503fa7c83557\" (UID: \"186296ae-4f52-4b7d-96bf-503fa7c83557\") "
Jul 09 01:33:20.358483 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:20.358286    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/186296ae-4f52-4b7d-96bf-503fa7c83557-tls-certs\") pod \"186296ae-4f52-4b7d-96bf-503fa7c83557\" (UID: \"186296ae-4f52-4b7d-96bf-503fa7c83557\") "
Jul 09 01:33:20.358483 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:20.358307    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gzw7w\" (UniqueName: \"kubernetes.io/projected/186296ae-4f52-4b7d-96bf-503fa7c83557-kube-api-access-gzw7w\") pod \"186296ae-4f52-4b7d-96bf-503fa7c83557\" (UID: \"186296ae-4f52-4b7d-96bf-503fa7c83557\") "
Jul 09 01:33:20.358483 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:20.358374    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/186296ae-4f52-4b7d-96bf-503fa7c83557-model-cache\") pod \"186296ae-4f52-4b7d-96bf-503fa7c83557\" (UID: \"186296ae-4f52-4b7d-96bf-503fa7c83557\") "
Jul 09 01:33:20.358483 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:20.358467    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/186296ae-4f52-4b7d-96bf-503fa7c83557-home" (OuterVolumeSpecName: "home") pod "186296ae-4f52-4b7d-96bf-503fa7c83557" (UID: "186296ae-4f52-4b7d-96bf-503fa7c83557"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:33:20.358728 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:20.358522    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/186296ae-4f52-4b7d-96bf-503fa7c83557-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "186296ae-4f52-4b7d-96bf-503fa7c83557" (UID: "186296ae-4f52-4b7d-96bf-503fa7c83557"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:33:20.358728 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:20.358631    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/186296ae-4f52-4b7d-96bf-503fa7c83557-model-cache" (OuterVolumeSpecName: "model-cache") pod "186296ae-4f52-4b7d-96bf-503fa7c83557" (UID: "186296ae-4f52-4b7d-96bf-503fa7c83557"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:33:20.358728 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:20.358717    2557 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/186296ae-4f52-4b7d-96bf-503fa7c83557-model-cache\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:33:20.358956 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:20.358732    2557 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/186296ae-4f52-4b7d-96bf-503fa7c83557-home\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:33:20.358956 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:20.358741    2557 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/186296ae-4f52-4b7d-96bf-503fa7c83557-tmp-dir\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:33:20.360564 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:20.360534    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/186296ae-4f52-4b7d-96bf-503fa7c83557-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "186296ae-4f52-4b7d-96bf-503fa7c83557" (UID: "186296ae-4f52-4b7d-96bf-503fa7c83557"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 01:33:20.360660 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:20.360541    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/186296ae-4f52-4b7d-96bf-503fa7c83557-dshm" (OuterVolumeSpecName: "dshm") pod "186296ae-4f52-4b7d-96bf-503fa7c83557" (UID: "186296ae-4f52-4b7d-96bf-503fa7c83557"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:33:20.360660 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:20.360572    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/186296ae-4f52-4b7d-96bf-503fa7c83557-kube-api-access-gzw7w" (OuterVolumeSpecName: "kube-api-access-gzw7w") pod "186296ae-4f52-4b7d-96bf-503fa7c83557" (UID: "186296ae-4f52-4b7d-96bf-503fa7c83557"). InnerVolumeSpecName "kube-api-access-gzw7w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:33:20.459420 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:20.459383    2557 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/186296ae-4f52-4b7d-96bf-503fa7c83557-dshm\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:33:20.459420 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:20.459414    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/186296ae-4f52-4b7d-96bf-503fa7c83557-tls-certs\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:33:20.459420 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:20.459425    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzw7w\" (UniqueName: \"kubernetes.io/projected/186296ae-4f52-4b7d-96bf-503fa7c83557-kube-api-access-gzw7w\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:33:20.631319 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:20.631195    2557 generic.go:356] "Generic (PLEG): container finished" podID="186296ae-4f52-4b7d-96bf-503fa7c83557" containerID="4749ac70fcea457e061bd24937a6d2b8cc6fc2210f0aa14946ae453456d54046" exitCode=0
Jul 09 01:33:20.631319 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:20.631259    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-88a238/sub-test-model-88a238-kserve-745fd6d85f-kn2t5"
Jul 09 01:33:20.631319 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:20.631287    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-88a238/sub-test-model-88a238-kserve-745fd6d85f-kn2t5" event={"ID":"186296ae-4f52-4b7d-96bf-503fa7c83557","Type":"ContainerDied","Data":"4749ac70fcea457e061bd24937a6d2b8cc6fc2210f0aa14946ae453456d54046"}
Jul 09 01:33:20.631614 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:20.631337    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-88a238/sub-test-model-88a238-kserve-745fd6d85f-kn2t5" event={"ID":"186296ae-4f52-4b7d-96bf-503fa7c83557","Type":"ContainerDied","Data":"21575f946b88e698e4e779fc7a6fc9341995a33da6a7eca96808021c2d6bcb33"}
Jul 09 01:33:20.631614 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:20.631360    2557 scope.go:117] "RemoveContainer" containerID="4749ac70fcea457e061bd24937a6d2b8cc6fc2210f0aa14946ae453456d54046"
Jul 09 01:33:20.640413 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:20.640393    2557 scope.go:117] "RemoveContainer" containerID="4749ac70fcea457e061bd24937a6d2b8cc6fc2210f0aa14946ae453456d54046"
Jul 09 01:33:20.640689 ip-10-0-133-31 kubenswrapper[2557]: E0709 01:33:20.640667    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4749ac70fcea457e061bd24937a6d2b8cc6fc2210f0aa14946ae453456d54046\": container with ID starting with 4749ac70fcea457e061bd24937a6d2b8cc6fc2210f0aa14946ae453456d54046 not found: ID does not exist" containerID="4749ac70fcea457e061bd24937a6d2b8cc6fc2210f0aa14946ae453456d54046"
Jul 09 01:33:20.640740 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:20.640699    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4749ac70fcea457e061bd24937a6d2b8cc6fc2210f0aa14946ae453456d54046"} err="failed to get container status \"4749ac70fcea457e061bd24937a6d2b8cc6fc2210f0aa14946ae453456d54046\": rpc error: code = NotFound desc = could not find container \"4749ac70fcea457e061bd24937a6d2b8cc6fc2210f0aa14946ae453456d54046\": container with ID starting with 4749ac70fcea457e061bd24937a6d2b8cc6fc2210f0aa14946ae453456d54046 not found: ID does not exist"
Jul 09 01:33:20.651514 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:20.651490    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-88a238/sub-test-model-88a238-kserve-745fd6d85f-kn2t5"]
Jul 09 01:33:20.654941 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:20.654918    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-88a238/sub-test-model-88a238-kserve-745fd6d85f-kn2t5"]
Jul 09 01:33:21.039417 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:21.039383    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="186296ae-4f52-4b7d-96bf-503fa7c83557" path="/var/lib/kubelet/pods/186296ae-4f52-4b7d-96bf-503fa7c83557/volumes"
Jul 09 01:33:28.996219 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:28.996168    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:33:37.040503 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:37.040466    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-52d242/rate-test-model-52d242-kserve-7b5bffbff9-6jnpv"]
Jul 09 01:33:37.040905 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:37.040784    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="186296ae-4f52-4b7d-96bf-503fa7c83557" containerName="main"
Jul 09 01:33:37.040905 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:37.040794    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="186296ae-4f52-4b7d-96bf-503fa7c83557" containerName="main"
Jul 09 01:33:37.040905 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:37.040869    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="186296ae-4f52-4b7d-96bf-503fa7c83557" containerName="main"
Jul 09 01:33:37.043534 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:37.043517    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-52d242/rate-test-model-52d242-kserve-7b5bffbff9-6jnpv"
Jul 09 01:33:37.046631 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:37.046601    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-52d242\"/\"rate-test-model-52d242-kserve-self-signed-certs\""
Jul 09 01:33:37.046631 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:37.046613    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-52d242\"/\"openshift-service-ca.crt\""
Jul 09 01:33:37.046631 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:37.046634    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-52d242\"/\"kube-root-ca.crt\""
Jul 09 01:33:37.046857 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:37.046667    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-52d242\"/\"default-dockercfg-kh25v\""
Jul 09 01:33:37.051335 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:37.051313    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-52d242/rate-test-model-52d242-kserve-7b5bffbff9-6jnpv"]
Jul 09 01:33:37.114777 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:37.114733    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/348d5f38-0cc6-4fe2-ac22-d5f8305c3302-tls-certs\") pod \"rate-test-model-52d242-kserve-7b5bffbff9-6jnpv\" (UID: \"348d5f38-0cc6-4fe2-ac22-d5f8305c3302\") " pod="ai-tenant-e2e-shared-b-52d242/rate-test-model-52d242-kserve-7b5bffbff9-6jnpv"
Jul 09 01:33:37.114982 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:37.114802    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/348d5f38-0cc6-4fe2-ac22-d5f8305c3302-tmp-dir\") pod \"rate-test-model-52d242-kserve-7b5bffbff9-6jnpv\" (UID: \"348d5f38-0cc6-4fe2-ac22-d5f8305c3302\") " pod="ai-tenant-e2e-shared-b-52d242/rate-test-model-52d242-kserve-7b5bffbff9-6jnpv"
Jul 09 01:33:37.114982 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:37.114894    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/348d5f38-0cc6-4fe2-ac22-d5f8305c3302-home\") pod \"rate-test-model-52d242-kserve-7b5bffbff9-6jnpv\" (UID: \"348d5f38-0cc6-4fe2-ac22-d5f8305c3302\") " pod="ai-tenant-e2e-shared-b-52d242/rate-test-model-52d242-kserve-7b5bffbff9-6jnpv"
Jul 09 01:33:37.114982 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:37.114933    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/348d5f38-0cc6-4fe2-ac22-d5f8305c3302-dshm\") pod \"rate-test-model-52d242-kserve-7b5bffbff9-6jnpv\" (UID: \"348d5f38-0cc6-4fe2-ac22-d5f8305c3302\") " pod="ai-tenant-e2e-shared-b-52d242/rate-test-model-52d242-kserve-7b5bffbff9-6jnpv"
Jul 09 01:33:37.114982 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:37.114957    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/348d5f38-0cc6-4fe2-ac22-d5f8305c3302-model-cache\") pod \"rate-test-model-52d242-kserve-7b5bffbff9-6jnpv\" (UID: \"348d5f38-0cc6-4fe2-ac22-d5f8305c3302\") " pod="ai-tenant-e2e-shared-b-52d242/rate-test-model-52d242-kserve-7b5bffbff9-6jnpv"
Jul 09 01:33:37.115298 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:37.114990    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8zzj\" (UniqueName: \"kubernetes.io/projected/348d5f38-0cc6-4fe2-ac22-d5f8305c3302-kube-api-access-b8zzj\") pod \"rate-test-model-52d242-kserve-7b5bffbff9-6jnpv\" (UID: \"348d5f38-0cc6-4fe2-ac22-d5f8305c3302\") " pod="ai-tenant-e2e-shared-b-52d242/rate-test-model-52d242-kserve-7b5bffbff9-6jnpv"
Jul 09 01:33:37.215636 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:37.215605    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/348d5f38-0cc6-4fe2-ac22-d5f8305c3302-tls-certs\") pod \"rate-test-model-52d242-kserve-7b5bffbff9-6jnpv\" (UID: \"348d5f38-0cc6-4fe2-ac22-d5f8305c3302\") " pod="ai-tenant-e2e-shared-b-52d242/rate-test-model-52d242-kserve-7b5bffbff9-6jnpv"
Jul 09 01:33:37.215839 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:37.215648    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/348d5f38-0cc6-4fe2-ac22-d5f8305c3302-tmp-dir\") pod \"rate-test-model-52d242-kserve-7b5bffbff9-6jnpv\" (UID: \"348d5f38-0cc6-4fe2-ac22-d5f8305c3302\") " pod="ai-tenant-e2e-shared-b-52d242/rate-test-model-52d242-kserve-7b5bffbff9-6jnpv"
Jul 09 01:33:37.215839 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:37.215679    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/348d5f38-0cc6-4fe2-ac22-d5f8305c3302-home\") pod \"rate-test-model-52d242-kserve-7b5bffbff9-6jnpv\" (UID: \"348d5f38-0cc6-4fe2-ac22-d5f8305c3302\") " pod="ai-tenant-e2e-shared-b-52d242/rate-test-model-52d242-kserve-7b5bffbff9-6jnpv"
Jul 09 01:33:37.215839 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:37.215700    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/348d5f38-0cc6-4fe2-ac22-d5f8305c3302-dshm\") pod \"rate-test-model-52d242-kserve-7b5bffbff9-6jnpv\" (UID: \"348d5f38-0cc6-4fe2-ac22-d5f8305c3302\") " pod="ai-tenant-e2e-shared-b-52d242/rate-test-model-52d242-kserve-7b5bffbff9-6jnpv"
Jul 09 01:33:37.215839 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:37.215714    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/348d5f38-0cc6-4fe2-ac22-d5f8305c3302-model-cache\") pod \"rate-test-model-52d242-kserve-7b5bffbff9-6jnpv\" (UID: \"348d5f38-0cc6-4fe2-ac22-d5f8305c3302\") " pod="ai-tenant-e2e-shared-b-52d242/rate-test-model-52d242-kserve-7b5bffbff9-6jnpv"
Jul 09 01:33:37.215839 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:37.215737    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8zzj\" (UniqueName: \"kubernetes.io/projected/348d5f38-0cc6-4fe2-ac22-d5f8305c3302-kube-api-access-b8zzj\") pod \"rate-test-model-52d242-kserve-7b5bffbff9-6jnpv\" (UID: \"348d5f38-0cc6-4fe2-ac22-d5f8305c3302\") " pod="ai-tenant-e2e-shared-b-52d242/rate-test-model-52d242-kserve-7b5bffbff9-6jnpv"
Jul 09 01:33:37.216515 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:37.216484    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/348d5f38-0cc6-4fe2-ac22-d5f8305c3302-model-cache\") pod \"rate-test-model-52d242-kserve-7b5bffbff9-6jnpv\" (UID: \"348d5f38-0cc6-4fe2-ac22-d5f8305c3302\") " pod="ai-tenant-e2e-shared-b-52d242/rate-test-model-52d242-kserve-7b5bffbff9-6jnpv"
Jul 09 01:33:37.216706 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:37.216537    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/348d5f38-0cc6-4fe2-ac22-d5f8305c3302-tmp-dir\") pod \"rate-test-model-52d242-kserve-7b5bffbff9-6jnpv\" (UID: \"348d5f38-0cc6-4fe2-ac22-d5f8305c3302\") " pod="ai-tenant-e2e-shared-b-52d242/rate-test-model-52d242-kserve-7b5bffbff9-6jnpv"
Jul 09 01:33:37.216826 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:37.216802    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/348d5f38-0cc6-4fe2-ac22-d5f8305c3302-home\") pod \"rate-test-model-52d242-kserve-7b5bffbff9-6jnpv\" (UID: \"348d5f38-0cc6-4fe2-ac22-d5f8305c3302\") " pod="ai-tenant-e2e-shared-b-52d242/rate-test-model-52d242-kserve-7b5bffbff9-6jnpv"
Jul 09 01:33:37.218999 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:37.218972    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/348d5f38-0cc6-4fe2-ac22-d5f8305c3302-dshm\") pod \"rate-test-model-52d242-kserve-7b5bffbff9-6jnpv\" (UID: \"348d5f38-0cc6-4fe2-ac22-d5f8305c3302\") " pod="ai-tenant-e2e-shared-b-52d242/rate-test-model-52d242-kserve-7b5bffbff9-6jnpv"
Jul 09 01:33:37.224870 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:37.224843    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/348d5f38-0cc6-4fe2-ac22-d5f8305c3302-tls-certs\") pod \"rate-test-model-52d242-kserve-7b5bffbff9-6jnpv\" (UID: \"348d5f38-0cc6-4fe2-ac22-d5f8305c3302\") " pod="ai-tenant-e2e-shared-b-52d242/rate-test-model-52d242-kserve-7b5bffbff9-6jnpv"
Jul 09 01:33:37.224987 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:37.224928    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8zzj\" (UniqueName: \"kubernetes.io/projected/348d5f38-0cc6-4fe2-ac22-d5f8305c3302-kube-api-access-b8zzj\") pod \"rate-test-model-52d242-kserve-7b5bffbff9-6jnpv\" (UID: \"348d5f38-0cc6-4fe2-ac22-d5f8305c3302\") " pod="ai-tenant-e2e-shared-b-52d242/rate-test-model-52d242-kserve-7b5bffbff9-6jnpv"
Jul 09 01:33:37.353365 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:37.353260    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-52d242/rate-test-model-52d242-kserve-7b5bffbff9-6jnpv"
Jul 09 01:33:37.484505 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:37.484480    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-52d242/rate-test-model-52d242-kserve-7b5bffbff9-6jnpv"]
Jul 09 01:33:37.486288 ip-10-0-133-31 kubenswrapper[2557]: W0709 01:33:37.486259    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod348d5f38_0cc6_4fe2_ac22_d5f8305c3302.slice/crio-dc3b4119020c0487a86d90ab5f68170f287a6385bddbe616109001f829cfc482 WatchSource:0}: Error finding container dc3b4119020c0487a86d90ab5f68170f287a6385bddbe616109001f829cfc482: Status 404 returned error can't find the container with id dc3b4119020c0487a86d90ab5f68170f287a6385bddbe616109001f829cfc482
Jul 09 01:33:37.712072 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:37.711975    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-52d242/rate-test-model-52d242-kserve-7b5bffbff9-6jnpv" event={"ID":"348d5f38-0cc6-4fe2-ac22-d5f8305c3302","Type":"ContainerStarted","Data":"3c9539ef9ff51445cad753f3a95fc2174319cf23e3619775a71054f37c8f8ae6"}
Jul 09 01:33:37.712072 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:37.712028    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-52d242/rate-test-model-52d242-kserve-7b5bffbff9-6jnpv" event={"ID":"348d5f38-0cc6-4fe2-ac22-d5f8305c3302","Type":"ContainerStarted","Data":"dc3b4119020c0487a86d90ab5f68170f287a6385bddbe616109001f829cfc482"}
Jul 09 01:33:37.728823 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:37.728778    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-52d242/rate-test-model-52d242-kserve-7b5bffbff9-6jnpv" podStartSLOduration=0.728762688 podStartE2EDuration="728.762688ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:33:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:33:37.728521711 +0000 UTC m=+2325.198664440" watchObservedRunningTime="2026-07-09 01:33:37.728762688 +0000 UTC m=+2325.198905394"
Jul 09 01:33:41.094008 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:41.093974    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:33:47.354118 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:47.353999    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-52d242/rate-test-model-52d242-kserve-7b5bffbff9-6jnpv"
Jul 09 01:33:47.354118 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:47.354083    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-52d242/rate-test-model-52d242-kserve-7b5bffbff9-6jnpv"
Jul 09 01:33:47.366947 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:47.366926    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-52d242/rate-test-model-52d242-kserve-7b5bffbff9-6jnpv"
Jul 09 01:33:47.767940 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:47.767910    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-52d242/rate-test-model-52d242-kserve-7b5bffbff9-6jnpv"
Jul 09 01:33:59.794704 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:33:59.794665    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:34:20.097194 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:34:20.097159    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:34:28.945678 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:34:28.945641    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-52d242/rate-test-model-52d242-kserve-7b5bffbff9-6jnpv"]
Jul 09 01:34:35.294844 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:34:35.294795    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:34:43.967876 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:34:43.967833    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-52d242/rate-test-model-52d242-kserve-7b5bffbff9-6jnpv" podUID="348d5f38-0cc6-4fe2-ac22-d5f8305c3302" containerName="main" containerID="cri-o://3c9539ef9ff51445cad753f3a95fc2174319cf23e3619775a71054f37c8f8ae6" gracePeriod=45
Jul 09 01:34:44.230193 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:34:44.230129    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-52d242/rate-test-model-52d242-kserve-7b5bffbff9-6jnpv"
Jul 09 01:34:44.415668 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:34:44.415632    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/348d5f38-0cc6-4fe2-ac22-d5f8305c3302-model-cache\") pod \"348d5f38-0cc6-4fe2-ac22-d5f8305c3302\" (UID: \"348d5f38-0cc6-4fe2-ac22-d5f8305c3302\") "
Jul 09 01:34:44.415846 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:34:44.415705    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8zzj\" (UniqueName: \"kubernetes.io/projected/348d5f38-0cc6-4fe2-ac22-d5f8305c3302-kube-api-access-b8zzj\") pod \"348d5f38-0cc6-4fe2-ac22-d5f8305c3302\" (UID: \"348d5f38-0cc6-4fe2-ac22-d5f8305c3302\") "
Jul 09 01:34:44.415846 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:34:44.415747    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/348d5f38-0cc6-4fe2-ac22-d5f8305c3302-tls-certs\") pod \"348d5f38-0cc6-4fe2-ac22-d5f8305c3302\" (UID: \"348d5f38-0cc6-4fe2-ac22-d5f8305c3302\") "
Jul 09 01:34:44.415981 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:34:44.415844    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/348d5f38-0cc6-4fe2-ac22-d5f8305c3302-tmp-dir\") pod \"348d5f38-0cc6-4fe2-ac22-d5f8305c3302\" (UID: \"348d5f38-0cc6-4fe2-ac22-d5f8305c3302\") "
Jul 09 01:34:44.415981 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:34:44.415873    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/348d5f38-0cc6-4fe2-ac22-d5f8305c3302-home\") pod \"348d5f38-0cc6-4fe2-ac22-d5f8305c3302\" (UID: \"348d5f38-0cc6-4fe2-ac22-d5f8305c3302\") "
Jul 09 01:34:44.415981 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:34:44.415882    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/348d5f38-0cc6-4fe2-ac22-d5f8305c3302-model-cache" (OuterVolumeSpecName: "model-cache") pod "348d5f38-0cc6-4fe2-ac22-d5f8305c3302" (UID: "348d5f38-0cc6-4fe2-ac22-d5f8305c3302"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:34:44.415981 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:34:44.415896    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/348d5f38-0cc6-4fe2-ac22-d5f8305c3302-dshm\") pod \"348d5f38-0cc6-4fe2-ac22-d5f8305c3302\" (UID: \"348d5f38-0cc6-4fe2-ac22-d5f8305c3302\") "
Jul 09 01:34:44.416201 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:34:44.416126    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/348d5f38-0cc6-4fe2-ac22-d5f8305c3302-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "348d5f38-0cc6-4fe2-ac22-d5f8305c3302" (UID: "348d5f38-0cc6-4fe2-ac22-d5f8305c3302"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:34:44.416201 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:34:44.416159    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/348d5f38-0cc6-4fe2-ac22-d5f8305c3302-home" (OuterVolumeSpecName: "home") pod "348d5f38-0cc6-4fe2-ac22-d5f8305c3302" (UID: "348d5f38-0cc6-4fe2-ac22-d5f8305c3302"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:34:44.416325 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:34:44.416280    2557 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/348d5f38-0cc6-4fe2-ac22-d5f8305c3302-tmp-dir\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:34:44.416325 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:34:44.416298    2557 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/348d5f38-0cc6-4fe2-ac22-d5f8305c3302-home\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:34:44.416325 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:34:44.416312    2557 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/348d5f38-0cc6-4fe2-ac22-d5f8305c3302-model-cache\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:34:44.418049 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:34:44.418019    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/348d5f38-0cc6-4fe2-ac22-d5f8305c3302-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "348d5f38-0cc6-4fe2-ac22-d5f8305c3302" (UID: "348d5f38-0cc6-4fe2-ac22-d5f8305c3302"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 01:34:44.418166 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:34:44.418061    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/348d5f38-0cc6-4fe2-ac22-d5f8305c3302-dshm" (OuterVolumeSpecName: "dshm") pod "348d5f38-0cc6-4fe2-ac22-d5f8305c3302" (UID: "348d5f38-0cc6-4fe2-ac22-d5f8305c3302"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:34:44.418166 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:34:44.418069    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/348d5f38-0cc6-4fe2-ac22-d5f8305c3302-kube-api-access-b8zzj" (OuterVolumeSpecName: "kube-api-access-b8zzj") pod "348d5f38-0cc6-4fe2-ac22-d5f8305c3302" (UID: "348d5f38-0cc6-4fe2-ac22-d5f8305c3302"). InnerVolumeSpecName "kube-api-access-b8zzj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:34:44.517619 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:34:44.517537    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8zzj\" (UniqueName: \"kubernetes.io/projected/348d5f38-0cc6-4fe2-ac22-d5f8305c3302-kube-api-access-b8zzj\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:34:44.517619 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:34:44.517567    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/348d5f38-0cc6-4fe2-ac22-d5f8305c3302-tls-certs\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:34:44.517619 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:34:44.517577    2557 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/348d5f38-0cc6-4fe2-ac22-d5f8305c3302-dshm\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:34:45.031042 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:34:45.031008    2557 generic.go:356] "Generic (PLEG): container finished" podID="348d5f38-0cc6-4fe2-ac22-d5f8305c3302" containerID="3c9539ef9ff51445cad753f3a95fc2174319cf23e3619775a71054f37c8f8ae6" exitCode=0
Jul 09 01:34:45.031502 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:34:45.031056    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-52d242/rate-test-model-52d242-kserve-7b5bffbff9-6jnpv"
Jul 09 01:34:45.031502 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:34:45.031100    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-52d242/rate-test-model-52d242-kserve-7b5bffbff9-6jnpv" event={"ID":"348d5f38-0cc6-4fe2-ac22-d5f8305c3302","Type":"ContainerDied","Data":"3c9539ef9ff51445cad753f3a95fc2174319cf23e3619775a71054f37c8f8ae6"}
Jul 09 01:34:45.031502 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:34:45.031144    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-52d242/rate-test-model-52d242-kserve-7b5bffbff9-6jnpv" event={"ID":"348d5f38-0cc6-4fe2-ac22-d5f8305c3302","Type":"ContainerDied","Data":"dc3b4119020c0487a86d90ab5f68170f287a6385bddbe616109001f829cfc482"}
Jul 09 01:34:45.031502 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:34:45.031164    2557 scope.go:117] "RemoveContainer" containerID="3c9539ef9ff51445cad753f3a95fc2174319cf23e3619775a71054f37c8f8ae6"
Jul 09 01:34:45.041188 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:34:45.041170    2557 scope.go:117] "RemoveContainer" containerID="3c9539ef9ff51445cad753f3a95fc2174319cf23e3619775a71054f37c8f8ae6"
Jul 09 01:34:45.041473 ip-10-0-133-31 kubenswrapper[2557]: E0709 01:34:45.041449    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c9539ef9ff51445cad753f3a95fc2174319cf23e3619775a71054f37c8f8ae6\": container with ID starting with 3c9539ef9ff51445cad753f3a95fc2174319cf23e3619775a71054f37c8f8ae6 not found: ID does not exist" containerID="3c9539ef9ff51445cad753f3a95fc2174319cf23e3619775a71054f37c8f8ae6"
Jul 09 01:34:45.041530 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:34:45.041486    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c9539ef9ff51445cad753f3a95fc2174319cf23e3619775a71054f37c8f8ae6"} err="failed to get container status \"3c9539ef9ff51445cad753f3a95fc2174319cf23e3619775a71054f37c8f8ae6\": rpc error: code = NotFound desc = could not find container \"3c9539ef9ff51445cad753f3a95fc2174319cf23e3619775a71054f37c8f8ae6\": container with ID starting with 3c9539ef9ff51445cad753f3a95fc2174319cf23e3619775a71054f37c8f8ae6 not found: ID does not exist"
Jul 09 01:34:45.052400 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:34:45.052374    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-52d242/rate-test-model-52d242-kserve-7b5bffbff9-6jnpv"]
Jul 09 01:34:45.057852 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:34:45.057827    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-52d242/rate-test-model-52d242-kserve-7b5bffbff9-6jnpv"]
Jul 09 01:34:47.040890 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:34:47.040853    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="348d5f38-0cc6-4fe2-ac22-d5f8305c3302" path="/var/lib/kubelet/pods/348d5f38-0cc6-4fe2-ac22-d5f8305c3302/volumes"
Jul 09 01:34:50.993109 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:34:50.993075    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:34:53.177155 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:34:53.177126    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z6kj2_7dc12511-b804-4ebc-8646-4d070d93a8cf/console-operator/1.log"
Jul 09 01:34:53.196937 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:34:53.196912    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z6kj2_7dc12511-b804-4ebc-8646-4d070d93a8cf/console-operator/1.log"
Jul 09 01:35:01.553126 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:01.553088    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j"]
Jul 09 01:35:01.553675 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:01.553359    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j" podUID="dbac52fb-19b0-4131-9758-052e15bdf746" containerName="istio-proxy" containerID="cri-o://d05e5a692d7024849da36d106e72215ef13f9aa96bd71addfe7c0c45ab448893" gracePeriod=30
Jul 09 01:35:03.892381 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:03.892340    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7vvbf"]
Jul 09 01:35:05.591792 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:05.591749    2557 patch_prober.go:28] interesting pod/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 09 01:35:05.592184 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:05.591831    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j" podUID="dbac52fb-19b0-4131-9758-052e15bdf746" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 09 01:35:06.807820 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:06.807795    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j"
Jul 09 01:35:06.913528 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:06.913447    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxvsz\" (UniqueName: \"kubernetes.io/projected/dbac52fb-19b0-4131-9758-052e15bdf746-kube-api-access-rxvsz\") pod \"dbac52fb-19b0-4131-9758-052e15bdf746\" (UID: \"dbac52fb-19b0-4131-9758-052e15bdf746\") "
Jul 09 01:35:06.913528 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:06.913499    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbac52fb-19b0-4131-9758-052e15bdf746-istio-envoy\") pod \"dbac52fb-19b0-4131-9758-052e15bdf746\" (UID: \"dbac52fb-19b0-4131-9758-052e15bdf746\") "
Jul 09 01:35:06.913528 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:06.913525    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbac52fb-19b0-4131-9758-052e15bdf746-istio-data\") pod \"dbac52fb-19b0-4131-9758-052e15bdf746\" (UID: \"dbac52fb-19b0-4131-9758-052e15bdf746\") "
Jul 09 01:35:06.913815 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:06.913541    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbac52fb-19b0-4131-9758-052e15bdf746-workload-certs\") pod \"dbac52fb-19b0-4131-9758-052e15bdf746\" (UID: \"dbac52fb-19b0-4131-9758-052e15bdf746\") "
Jul 09 01:35:06.913815 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:06.913558    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbac52fb-19b0-4131-9758-052e15bdf746-credential-socket\") pod \"dbac52fb-19b0-4131-9758-052e15bdf746\" (UID: \"dbac52fb-19b0-4131-9758-052e15bdf746\") "
Jul 09 01:35:06.913815 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:06.913576    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbac52fb-19b0-4131-9758-052e15bdf746-istio-token\") pod \"dbac52fb-19b0-4131-9758-052e15bdf746\" (UID: \"dbac52fb-19b0-4131-9758-052e15bdf746\") "
Jul 09 01:35:06.913815 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:06.913594    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbac52fb-19b0-4131-9758-052e15bdf746-workload-socket\") pod \"dbac52fb-19b0-4131-9758-052e15bdf746\" (UID: \"dbac52fb-19b0-4131-9758-052e15bdf746\") "
Jul 09 01:35:06.913815 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:06.913629    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbac52fb-19b0-4131-9758-052e15bdf746-istio-podinfo\") pod \"dbac52fb-19b0-4131-9758-052e15bdf746\" (UID: \"dbac52fb-19b0-4131-9758-052e15bdf746\") "
Jul 09 01:35:06.913815 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:06.913652    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbac52fb-19b0-4131-9758-052e15bdf746-istiod-ca-cert\") pod \"dbac52fb-19b0-4131-9758-052e15bdf746\" (UID: \"dbac52fb-19b0-4131-9758-052e15bdf746\") "
Jul 09 01:35:06.914130 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:06.913883    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbac52fb-19b0-4131-9758-052e15bdf746-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dbac52fb-19b0-4131-9758-052e15bdf746" (UID: "dbac52fb-19b0-4131-9758-052e15bdf746"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:35:06.914130 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:06.913955    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbac52fb-19b0-4131-9758-052e15bdf746-credential-socket\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:35:06.914353 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:06.914299    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbac52fb-19b0-4131-9758-052e15bdf746-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dbac52fb-19b0-4131-9758-052e15bdf746" (UID: "dbac52fb-19b0-4131-9758-052e15bdf746"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:35:06.914353 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:06.914324    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbac52fb-19b0-4131-9758-052e15bdf746-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dbac52fb-19b0-4131-9758-052e15bdf746" (UID: "dbac52fb-19b0-4131-9758-052e15bdf746"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:35:06.914353 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:06.914305    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbac52fb-19b0-4131-9758-052e15bdf746-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dbac52fb-19b0-4131-9758-052e15bdf746" (UID: "dbac52fb-19b0-4131-9758-052e15bdf746"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 01:35:06.914622 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:06.914598    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbac52fb-19b0-4131-9758-052e15bdf746-istio-data" (OuterVolumeSpecName: "istio-data") pod "dbac52fb-19b0-4131-9758-052e15bdf746" (UID: "dbac52fb-19b0-4131-9758-052e15bdf746"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:35:06.915967 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:06.915943    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dbac52fb-19b0-4131-9758-052e15bdf746-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dbac52fb-19b0-4131-9758-052e15bdf746" (UID: "dbac52fb-19b0-4131-9758-052e15bdf746"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 01:35:06.916089 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:06.915974    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbac52fb-19b0-4131-9758-052e15bdf746-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dbac52fb-19b0-4131-9758-052e15bdf746" (UID: "dbac52fb-19b0-4131-9758-052e15bdf746"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:35:06.916089 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:06.916030    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbac52fb-19b0-4131-9758-052e15bdf746-istio-token" (OuterVolumeSpecName: "istio-token") pod "dbac52fb-19b0-4131-9758-052e15bdf746" (UID: "dbac52fb-19b0-4131-9758-052e15bdf746"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:35:06.916089 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:06.916046    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbac52fb-19b0-4131-9758-052e15bdf746-kube-api-access-rxvsz" (OuterVolumeSpecName: "kube-api-access-rxvsz") pod "dbac52fb-19b0-4131-9758-052e15bdf746" (UID: "dbac52fb-19b0-4131-9758-052e15bdf746"). InnerVolumeSpecName "kube-api-access-rxvsz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:35:07.014395 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:07.014356    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxvsz\" (UniqueName: \"kubernetes.io/projected/dbac52fb-19b0-4131-9758-052e15bdf746-kube-api-access-rxvsz\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:35:07.014395 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:07.014388    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbac52fb-19b0-4131-9758-052e15bdf746-istio-envoy\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:35:07.014395 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:07.014397    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbac52fb-19b0-4131-9758-052e15bdf746-istio-data\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:35:07.014395 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:07.014405    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbac52fb-19b0-4131-9758-052e15bdf746-workload-certs\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:35:07.014667 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:07.014413    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbac52fb-19b0-4131-9758-052e15bdf746-istio-token\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:35:07.014667 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:07.014421    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbac52fb-19b0-4131-9758-052e15bdf746-workload-socket\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:35:07.014667 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:07.014428    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbac52fb-19b0-4131-9758-052e15bdf746-istio-podinfo\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:35:07.014667 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:07.014436    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbac52fb-19b0-4131-9758-052e15bdf746-istiod-ca-cert\") on node \"ip-10-0-133-31.ec2.internal\" DevicePath \"\""
Jul 09 01:35:07.031194 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:07.031167    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-q59pq_75807a4c-1321-4666-9f1d-7de6dc9b3e35/manager/0.log"
Jul 09 01:35:07.140764 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:07.140731    2557 generic.go:356] "Generic (PLEG): container finished" podID="dbac52fb-19b0-4131-9758-052e15bdf746" containerID="d05e5a692d7024849da36d106e72215ef13f9aa96bd71addfe7c0c45ab448893" exitCode=0
Jul 09 01:35:07.140969 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:07.140782    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j"
Jul 09 01:35:07.140969 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:07.140819    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j" event={"ID":"dbac52fb-19b0-4131-9758-052e15bdf746","Type":"ContainerDied","Data":"d05e5a692d7024849da36d106e72215ef13f9aa96bd71addfe7c0c45ab448893"}
Jul 09 01:35:07.140969 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:07.140886    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j" event={"ID":"dbac52fb-19b0-4131-9758-052e15bdf746","Type":"ContainerDied","Data":"c1972fbc9dace917e8ddceb1d24af45de1e328a10b00dfba871d39d954f98dbf"}
Jul 09 01:35:07.140969 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:07.140920    2557 scope.go:117] "RemoveContainer" containerID="d05e5a692d7024849da36d106e72215ef13f9aa96bd71addfe7c0c45ab448893"
Jul 09 01:35:07.150570 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:07.150545    2557 scope.go:117] "RemoveContainer" containerID="8080f07f4760a85d080df877f4518f54e4d73d9ea675825e566168efa2cc5ba8"
Jul 09 01:35:07.158951 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:07.158925    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j"]
Jul 09 01:35:07.161556 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:07.161531    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j"]
Jul 09 01:35:07.161755 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:07.161685    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-54976_076ac464-8772-4d50-b7bd-36ec5a6dae57/manager/0.log"
Jul 09 01:35:07.161859 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:07.161842    2557 scope.go:117] "RemoveContainer" containerID="d05e5a692d7024849da36d106e72215ef13f9aa96bd71addfe7c0c45ab448893"
Jul 09 01:35:07.162174 ip-10-0-133-31 kubenswrapper[2557]: E0709 01:35:07.162154    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d05e5a692d7024849da36d106e72215ef13f9aa96bd71addfe7c0c45ab448893\": container with ID starting with d05e5a692d7024849da36d106e72215ef13f9aa96bd71addfe7c0c45ab448893 not found: ID does not exist" containerID="d05e5a692d7024849da36d106e72215ef13f9aa96bd71addfe7c0c45ab448893"
Jul 09 01:35:07.162245 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:07.162183    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d05e5a692d7024849da36d106e72215ef13f9aa96bd71addfe7c0c45ab448893"} err="failed to get container status \"d05e5a692d7024849da36d106e72215ef13f9aa96bd71addfe7c0c45ab448893\": rpc error: code = NotFound desc = could not find container \"d05e5a692d7024849da36d106e72215ef13f9aa96bd71addfe7c0c45ab448893\": container with ID starting with d05e5a692d7024849da36d106e72215ef13f9aa96bd71addfe7c0c45ab448893 not found: ID does not exist"
Jul 09 01:35:07.162245 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:07.162202    2557 scope.go:117] "RemoveContainer" containerID="8080f07f4760a85d080df877f4518f54e4d73d9ea675825e566168efa2cc5ba8"
Jul 09 01:35:07.162445 ip-10-0-133-31 kubenswrapper[2557]: E0709 01:35:07.162429    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8080f07f4760a85d080df877f4518f54e4d73d9ea675825e566168efa2cc5ba8\": container with ID starting with 8080f07f4760a85d080df877f4518f54e4d73d9ea675825e566168efa2cc5ba8 not found: ID does not exist" containerID="8080f07f4760a85d080df877f4518f54e4d73d9ea675825e566168efa2cc5ba8"
Jul 09 01:35:07.162485 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:07.162448    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8080f07f4760a85d080df877f4518f54e4d73d9ea675825e566168efa2cc5ba8"} err="failed to get container status \"8080f07f4760a85d080df877f4518f54e4d73d9ea675825e566168efa2cc5ba8\": rpc error: code = NotFound desc = could not find container \"8080f07f4760a85d080df877f4518f54e4d73d9ea675825e566168efa2cc5ba8\": container with ID starting with 8080f07f4760a85d080df877f4518f54e4d73d9ea675825e566168efa2cc5ba8 not found: ID does not exist"
Jul 09 01:35:07.747337 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:07.747310    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85699f56b9-hcz4l_a69b915e-86c3-4650-9f13-a1afea3a1d1b/copy-manifests/0.log"
Jul 09 01:35:07.766466 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:07.766433    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85699f56b9-hcz4l_a69b915e-86c3-4650-9f13-a1afea3a1d1b/manager/0.log"
Jul 09 01:35:09.039303 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:09.039269    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbac52fb-19b0-4131-9758-052e15bdf746" path="/var/lib/kubelet/pods/dbac52fb-19b0-4131-9758-052e15bdf746/volumes"
Jul 09 01:35:10.343273 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:10.343243    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-7vvbf_90f670f5-0445-4f0f-9d1b-cd89035c5cf4/limitador/0.log"
Jul 09 01:35:10.804979 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:10.804941    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678fwkbp_ed6bd9ee-f8df-42e5-996a-a3afa712908c/istio-proxy/0.log"
Jul 09 01:35:11.628734 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:11.628699    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-59b7486ffc-xdjvw_569c1037-0058-4b97-9ebf-3fd77e9f72c3/router/0.log"
Jul 09 01:35:12.196942 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:12.196910    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-2hj68_02ed26e3-e491-4411-bc91-4084c44d2e72/main/0.log"
Jul 09 01:35:12.419951 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:12.419914    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-zfnkx_90f2096f-0b20-4444-8070-a618e1a431da/main/0.log"
Jul 09 01:35:16.402820 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:16.402738    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6bs7j/must-gather-6lfvh"]
Jul 09 01:35:16.403172 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:16.403131    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbac52fb-19b0-4131-9758-052e15bdf746" containerName="istio-proxy"
Jul 09 01:35:16.403172 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:16.403146    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbac52fb-19b0-4131-9758-052e15bdf746" containerName="istio-proxy"
Jul 09 01:35:16.403172 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:16.403169    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbac52fb-19b0-4131-9758-052e15bdf746" containerName="istio-proxy"
Jul 09 01:35:16.403320 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:16.403175    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbac52fb-19b0-4131-9758-052e15bdf746" containerName="istio-proxy"
Jul 09 01:35:16.403320 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:16.403183    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="348d5f38-0cc6-4fe2-ac22-d5f8305c3302" containerName="main"
Jul 09 01:35:16.403320 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:16.403188    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="348d5f38-0cc6-4fe2-ac22-d5f8305c3302" containerName="main"
Jul 09 01:35:16.403320 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:16.403261    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbac52fb-19b0-4131-9758-052e15bdf746" containerName="istio-proxy"
Jul 09 01:35:16.403320 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:16.403269    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="348d5f38-0cc6-4fe2-ac22-d5f8305c3302" containerName="main"
Jul 09 01:35:16.403467 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:16.403377    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbac52fb-19b0-4131-9758-052e15bdf746" containerName="istio-proxy"
Jul 09 01:35:16.407620 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:16.407598    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6bs7j/must-gather-6lfvh"
Jul 09 01:35:16.410074 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:16.410056    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6bs7j\"/\"kube-root-ca.crt\""
Jul 09 01:35:16.410203 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:16.410071    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6bs7j\"/\"openshift-service-ca.crt\""
Jul 09 01:35:16.410203 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:16.410081    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6bs7j\"/\"default-dockercfg-r8h45\""
Jul 09 01:35:16.416088 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:16.416070    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6bs7j/must-gather-6lfvh"]
Jul 09 01:35:16.495222 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:16.495179    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4frmb\" (UniqueName: \"kubernetes.io/projected/7ab8ff7c-8eaa-4c16-90b1-46c8e88276a0-kube-api-access-4frmb\") pod \"must-gather-6lfvh\" (UID: \"7ab8ff7c-8eaa-4c16-90b1-46c8e88276a0\") " pod="openshift-must-gather-6bs7j/must-gather-6lfvh"
Jul 09 01:35:16.495410 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:16.495286    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7ab8ff7c-8eaa-4c16-90b1-46c8e88276a0-must-gather-output\") pod \"must-gather-6lfvh\" (UID: \"7ab8ff7c-8eaa-4c16-90b1-46c8e88276a0\") " pod="openshift-must-gather-6bs7j/must-gather-6lfvh"
Jul 09 01:35:16.596259 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:16.596225    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7ab8ff7c-8eaa-4c16-90b1-46c8e88276a0-must-gather-output\") pod \"must-gather-6lfvh\" (UID: \"7ab8ff7c-8eaa-4c16-90b1-46c8e88276a0\") " pod="openshift-must-gather-6bs7j/must-gather-6lfvh"
Jul 09 01:35:16.596415 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:16.596322    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4frmb\" (UniqueName: \"kubernetes.io/projected/7ab8ff7c-8eaa-4c16-90b1-46c8e88276a0-kube-api-access-4frmb\") pod \"must-gather-6lfvh\" (UID: \"7ab8ff7c-8eaa-4c16-90b1-46c8e88276a0\") " pod="openshift-must-gather-6bs7j/must-gather-6lfvh"
Jul 09 01:35:16.596608 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:16.596585    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7ab8ff7c-8eaa-4c16-90b1-46c8e88276a0-must-gather-output\") pod \"must-gather-6lfvh\" (UID: \"7ab8ff7c-8eaa-4c16-90b1-46c8e88276a0\") " pod="openshift-must-gather-6bs7j/must-gather-6lfvh"
Jul 09 01:35:16.604088 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:16.604066    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4frmb\" (UniqueName: \"kubernetes.io/projected/7ab8ff7c-8eaa-4c16-90b1-46c8e88276a0-kube-api-access-4frmb\") pod \"must-gather-6lfvh\" (UID: \"7ab8ff7c-8eaa-4c16-90b1-46c8e88276a0\") " pod="openshift-must-gather-6bs7j/must-gather-6lfvh"
Jul 09 01:35:16.717505 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:16.717412    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6bs7j/must-gather-6lfvh"
Jul 09 01:35:16.847769 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:16.847711    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6bs7j/must-gather-6lfvh"]
Jul 09 01:35:16.849974 ip-10-0-133-31 kubenswrapper[2557]: W0709 01:35:16.849945    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7ab8ff7c_8eaa_4c16_90b1_46c8e88276a0.slice/crio-4d0a6a4f800d9f871caefa865fe3fcafec5db8bd199741eb212ebb348bbde90c WatchSource:0}: Error finding container 4d0a6a4f800d9f871caefa865fe3fcafec5db8bd199741eb212ebb348bbde90c: Status 404 returned error can't find the container with id 4d0a6a4f800d9f871caefa865fe3fcafec5db8bd199741eb212ebb348bbde90c
Jul 09 01:35:16.851794 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:16.851778    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 01:35:17.188013 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:17.187924    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6bs7j/must-gather-6lfvh" event={"ID":"7ab8ff7c-8eaa-4c16-90b1-46c8e88276a0","Type":"ContainerStarted","Data":"4d0a6a4f800d9f871caefa865fe3fcafec5db8bd199741eb212ebb348bbde90c"}
Jul 09 01:35:18.202732 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:18.202630    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6bs7j/must-gather-6lfvh" event={"ID":"7ab8ff7c-8eaa-4c16-90b1-46c8e88276a0","Type":"ContainerStarted","Data":"8d5429d507a65d30774b23cf040d530b00fef9160316f93bdf5561e56cf4d42f"}
Jul 09 01:35:18.202732 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:18.202690    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6bs7j/must-gather-6lfvh" event={"ID":"7ab8ff7c-8eaa-4c16-90b1-46c8e88276a0","Type":"ContainerStarted","Data":"2db45e95194b825eb3873b21c6f85b9b8e178d9ccf6faa7e91314f6bb6850abf"}
Jul 09 01:35:18.219086 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:18.219028    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6bs7j/must-gather-6lfvh" podStartSLOduration=1.3385331329999999 podStartE2EDuration="2.218995191s" totalImagesPullingTime="880.462058ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:35:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:35:18.21832046 +0000 UTC m=+2425.688463190" watchObservedRunningTime="2026-07-09 01:35:18.218995191 +0000 UTC m=+2425.689137921"
Jul 09 01:35:19.194459 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:19.194420    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8p4px_65de29a1-ee8f-4539-8e6d-997a7889fc85/global-pull-secret-syncer/0.log"
Jul 09 01:35:19.398778 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:19.398735    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pg99d_f00d32fa-a646-4c75-8c89-3b282d512750/konnectivity-agent/0.log"
Jul 09 01:35:19.421191 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:19.421160    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-31.ec2.internal_d799c3ef85e5886492cae7cd2485596a/haproxy/0.log"
Jul 09 01:35:24.939519 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:24.939480    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-7vvbf_90f670f5-0445-4f0f-9d1b-cd89035c5cf4/limitador/0.log"
Jul 09 01:35:26.856367 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:26.856274    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-qrrdm_7e907cd7-ed51-4737-a088-df3d9597489d/cluster-monitoring-operator/0.log"
Jul 09 01:35:27.090977 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:27.090941    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8p2xd_643314ab-915e-4dbf-83e1-0d159126856d/node-exporter/0.log"
Jul 09 01:35:27.112598 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:27.112513    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8p2xd_643314ab-915e-4dbf-83e1-0d159126856d/kube-rbac-proxy/0.log"
Jul 09 01:35:27.132359 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:27.132328    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8p2xd_643314ab-915e-4dbf-83e1-0d159126856d/init-textfile/0.log"
Jul 09 01:35:28.880572 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:28.880531    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-m9dnr_24f30d79-7850-4f7f-8208-86aa1ee58a82/networking-console-plugin/0.log"
Jul 09 01:35:29.450286 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:29.450238    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6bs7j/perf-node-gather-daemonset-wvdx9"]
Jul 09 01:35:29.458570 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:29.458537    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6bs7j/perf-node-gather-daemonset-wvdx9"
Jul 09 01:35:29.472115 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:29.472081    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6bs7j/perf-node-gather-daemonset-wvdx9"]
Jul 09 01:35:29.525254 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:29.525102    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z6kj2_7dc12511-b804-4ebc-8646-4d070d93a8cf/console-operator/1.log"
Jul 09 01:35:29.529136 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:29.529104    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5454b580-e145-424f-a937-ac95e6e5feae-podres\") pod \"perf-node-gather-daemonset-wvdx9\" (UID: \"5454b580-e145-424f-a937-ac95e6e5feae\") " pod="openshift-must-gather-6bs7j/perf-node-gather-daemonset-wvdx9"
Jul 09 01:35:29.529422 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:29.529320    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5454b580-e145-424f-a937-ac95e6e5feae-sys\") pod \"perf-node-gather-daemonset-wvdx9\" (UID: \"5454b580-e145-424f-a937-ac95e6e5feae\") " pod="openshift-must-gather-6bs7j/perf-node-gather-daemonset-wvdx9"
Jul 09 01:35:29.529422 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:29.529356    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5454b580-e145-424f-a937-ac95e6e5feae-proc\") pod \"perf-node-gather-daemonset-wvdx9\" (UID: \"5454b580-e145-424f-a937-ac95e6e5feae\") " pod="openshift-must-gather-6bs7j/perf-node-gather-daemonset-wvdx9"
Jul 09 01:35:29.529556 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:29.529486    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5454b580-e145-424f-a937-ac95e6e5feae-lib-modules\") pod \"perf-node-gather-daemonset-wvdx9\" (UID: \"5454b580-e145-424f-a937-ac95e6e5feae\") " pod="openshift-must-gather-6bs7j/perf-node-gather-daemonset-wvdx9"
Jul 09 01:35:29.529556 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:29.529546    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hppp\" (UniqueName: \"kubernetes.io/projected/5454b580-e145-424f-a937-ac95e6e5feae-kube-api-access-4hppp\") pod \"perf-node-gather-daemonset-wvdx9\" (UID: \"5454b580-e145-424f-a937-ac95e6e5feae\") " pod="openshift-must-gather-6bs7j/perf-node-gather-daemonset-wvdx9"
Jul 09 01:35:29.538367 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:29.538338    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z6kj2_7dc12511-b804-4ebc-8646-4d070d93a8cf/console-operator/2.log"
Jul 09 01:35:29.630699 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:29.630652    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5454b580-e145-424f-a937-ac95e6e5feae-lib-modules\") pod \"perf-node-gather-daemonset-wvdx9\" (UID: \"5454b580-e145-424f-a937-ac95e6e5feae\") " pod="openshift-must-gather-6bs7j/perf-node-gather-daemonset-wvdx9"
Jul 09 01:35:29.630918 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:29.630725    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hppp\" (UniqueName: \"kubernetes.io/projected/5454b580-e145-424f-a937-ac95e6e5feae-kube-api-access-4hppp\") pod \"perf-node-gather-daemonset-wvdx9\" (UID: \"5454b580-e145-424f-a937-ac95e6e5feae\") " pod="openshift-must-gather-6bs7j/perf-node-gather-daemonset-wvdx9"
Jul 09 01:35:29.630918 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:29.630788    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5454b580-e145-424f-a937-ac95e6e5feae-podres\") pod \"perf-node-gather-daemonset-wvdx9\" (UID: \"5454b580-e145-424f-a937-ac95e6e5feae\") " pod="openshift-must-gather-6bs7j/perf-node-gather-daemonset-wvdx9"
Jul 09 01:35:29.630918 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:29.630814    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5454b580-e145-424f-a937-ac95e6e5feae-sys\") pod \"perf-node-gather-daemonset-wvdx9\" (UID: \"5454b580-e145-424f-a937-ac95e6e5feae\") " pod="openshift-must-gather-6bs7j/perf-node-gather-daemonset-wvdx9"
Jul 09 01:35:29.630918 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:29.630853    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5454b580-e145-424f-a937-ac95e6e5feae-proc\") pod \"perf-node-gather-daemonset-wvdx9\" (UID: \"5454b580-e145-424f-a937-ac95e6e5feae\") " pod="openshift-must-gather-6bs7j/perf-node-gather-daemonset-wvdx9"
Jul 09 01:35:29.630918 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:29.630870    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5454b580-e145-424f-a937-ac95e6e5feae-lib-modules\") pod \"perf-node-gather-daemonset-wvdx9\" (UID: \"5454b580-e145-424f-a937-ac95e6e5feae\") " pod="openshift-must-gather-6bs7j/perf-node-gather-daemonset-wvdx9"
Jul 09 01:35:29.631233 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:29.630963    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5454b580-e145-424f-a937-ac95e6e5feae-proc\") pod \"perf-node-gather-daemonset-wvdx9\" (UID: \"5454b580-e145-424f-a937-ac95e6e5feae\") " pod="openshift-must-gather-6bs7j/perf-node-gather-daemonset-wvdx9"
Jul 09 01:35:29.631233 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:29.630980    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5454b580-e145-424f-a937-ac95e6e5feae-sys\") pod \"perf-node-gather-daemonset-wvdx9\" (UID: \"5454b580-e145-424f-a937-ac95e6e5feae\") " pod="openshift-must-gather-6bs7j/perf-node-gather-daemonset-wvdx9"
Jul 09 01:35:29.631233 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:29.631058    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5454b580-e145-424f-a937-ac95e6e5feae-podres\") pod \"perf-node-gather-daemonset-wvdx9\" (UID: \"5454b580-e145-424f-a937-ac95e6e5feae\") " pod="openshift-must-gather-6bs7j/perf-node-gather-daemonset-wvdx9"
Jul 09 01:35:29.639515 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:29.639487    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hppp\" (UniqueName: \"kubernetes.io/projected/5454b580-e145-424f-a937-ac95e6e5feae-kube-api-access-4hppp\") pod \"perf-node-gather-daemonset-wvdx9\" (UID: \"5454b580-e145-424f-a937-ac95e6e5feae\") " pod="openshift-must-gather-6bs7j/perf-node-gather-daemonset-wvdx9"
Jul 09 01:35:29.781141 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:29.781103    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6bs7j/perf-node-gather-daemonset-wvdx9"
Jul 09 01:35:29.957344 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:29.957320    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6bs7j/perf-node-gather-daemonset-wvdx9"]
Jul 09 01:35:29.960520 ip-10-0-133-31 kubenswrapper[2557]: W0709 01:35:29.960486    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5454b580_e145_424f_a937_ac95e6e5feae.slice/crio-45e566678f93f572d655cf4e8c249c69a29ba87191aafe1832a0a8a2cb2df8d0 WatchSource:0}: Error finding container 45e566678f93f572d655cf4e8c249c69a29ba87191aafe1832a0a8a2cb2df8d0: Status 404 returned error can't find the container with id 45e566678f93f572d655cf4e8c249c69a29ba87191aafe1832a0a8a2cb2df8d0
Jul 09 01:35:30.277912 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:30.277875    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6bs7j/perf-node-gather-daemonset-wvdx9" event={"ID":"5454b580-e145-424f-a937-ac95e6e5feae","Type":"ContainerStarted","Data":"cf29ac250528945626528f37c6508b8df25b854f279708a805bbf5b462032ec4"}
Jul 09 01:35:30.278116 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:30.277939    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6bs7j/perf-node-gather-daemonset-wvdx9" event={"ID":"5454b580-e145-424f-a937-ac95e6e5feae","Type":"ContainerStarted","Data":"45e566678f93f572d655cf4e8c249c69a29ba87191aafe1832a0a8a2cb2df8d0"}
Jul 09 01:35:30.278116 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:30.277987    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6bs7j/perf-node-gather-daemonset-wvdx9"
Jul 09 01:35:30.293770 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:30.293716    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6bs7j/perf-node-gather-daemonset-wvdx9" podStartSLOduration=1.2936991820000001 podStartE2EDuration="1.293699182s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 01:35:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:35:30.291706023 +0000 UTC m=+2437.761848759" watchObservedRunningTime="2026-07-09 01:35:30.293699182 +0000 UTC m=+2437.763841912"
Jul 09 01:35:30.689448 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:30.689422    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-g9tpr_b0927f8c-f098-4c8e-b680-1caccc77226d/volume-data-source-validator/0.log"
Jul 09 01:35:31.674366 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:31.674334    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-22rnw_d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0/dns/0.log"
Jul 09 01:35:31.694180 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:31.694154    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-22rnw_d8416ea4-9f33-4c30-aa0d-3cb9efd1a0d0/kube-rbac-proxy/0.log"
Jul 09 01:35:31.849239 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:31.849121    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tkg22_868053ea-aa08-4c9f-a2f6-05351b70b539/dns-node-resolver/0.log"
Jul 09 01:35:32.425946 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:32.425915    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xnxng_fc7293e1-bc7a-4d70-9cd2-2dd0b1b5c231/node-ca/0.log"
Jul 09 01:35:33.312419 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:33.312385    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678fwkbp_ed6bd9ee-f8df-42e5-996a-a3afa712908c/istio-proxy/0.log"
Jul 09 01:35:33.696538 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:33.696441    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-59b7486ffc-xdjvw_569c1037-0058-4b97-9ebf-3fd77e9f72c3/router/0.log"
Jul 09 01:35:34.386291 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:34.386259    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7bwv9_4f1d4fff-34fd-47cf-a632-07d976f8beec/serve-healthcheck-canary/0.log"
Jul 09 01:35:34.878385 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:34.878348    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-zbnc6_17f6664f-1f4d-4e8d-ad1d-da46c799b51d/insights-operator/0.log"
Jul 09 01:35:34.879447 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:34.879423    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-zbnc6_17f6664f-1f4d-4e8d-ad1d-da46c799b51d/insights-operator/1.log"
Jul 09 01:35:34.906486 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:34.906451    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6p4b2_195a8fee-b2b7-45f7-96be-7bb884ae0db1/kube-rbac-proxy/0.log"
Jul 09 01:35:34.925321 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:34.925286    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6p4b2_195a8fee-b2b7-45f7-96be-7bb884ae0db1/exporter/0.log"
Jul 09 01:35:34.946197 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:34.946160    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6p4b2_195a8fee-b2b7-45f7-96be-7bb884ae0db1/extractor/0.log"
Jul 09 01:35:36.294769 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:36.294742    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6bs7j/perf-node-gather-daemonset-wvdx9"
Jul 09 01:35:37.127382 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:37.127347    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-q59pq_75807a4c-1321-4666-9f1d-7de6dc9b3e35/manager/0.log"
Jul 09 01:35:37.383015 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:37.382912    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-54976_076ac464-8772-4d50-b7bd-36ec5a6dae57/manager/0.log"
Jul 09 01:35:37.825125 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:37.825080    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85699f56b9-hcz4l_a69b915e-86c3-4650-9f13-a1afea3a1d1b/manager/0.log"
Jul 09 01:35:37.841079 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:37.841053    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85699f56b9-hcz4l_a69b915e-86c3-4650-9f13-a1afea3a1d1b/copy-manifests/0.log"
Jul 09 01:35:39.322982 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:39.322948    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-75764c764c-ktwd5_35951e9e-1cba-45f4-917c-e8283cc5332a/manager/0.log"
Jul 09 01:35:39.957314 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:39.957227    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678fwkbp_ed6bd9ee-f8df-42e5-996a-a3afa712908c/istio-proxy/0.log"
Jul 09 01:35:40.285302 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:40.285261    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-59b7486ffc-xdjvw_569c1037-0058-4b97-9ebf-3fd77e9f72c3/router/0.log"
Jul 09 01:35:41.563833 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:41.563803    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678fwkbp_ed6bd9ee-f8df-42e5-996a-a3afa712908c/istio-proxy/0.log"
Jul 09 01:35:41.953870 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:41.953828    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-59b7486ffc-xdjvw_569c1037-0058-4b97-9ebf-3fd77e9f72c3/router/0.log"
Jul 09 01:35:44.396504 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:44.396467    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-n2dk7_4f6d7535-7152-4fa0-a3c8-71cd2e9f7b8c/migrator/0.log"
Jul 09 01:35:44.417605 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:44.417579    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-n2dk7_4f6d7535-7152-4fa0-a3c8-71cd2e9f7b8c/graceful-termination/0.log"
Jul 09 01:35:44.757965 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:44.757933    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-jkklf_37664234-8f03-4849-b53b-ec22d49b8e31/kube-storage-version-migrator-operator/1.log"
Jul 09 01:35:44.759867 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:44.759836    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-jkklf_37664234-8f03-4849-b53b-ec22d49b8e31/kube-storage-version-migrator-operator/0.log"
Jul 09 01:35:45.710428 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:45.710394    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7wcz6_8efa0274-9674-4514-812d-ca9d8e004993/kube-multus/0.log"
Jul 09 01:35:45.758422 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:45.758389    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dhpcm_f4dbea2c-28f9-4405-b905-f740dbe64a09/kube-multus-additional-cni-plugins/0.log"
Jul 09 01:35:45.778264 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:45.778229    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dhpcm_f4dbea2c-28f9-4405-b905-f740dbe64a09/egress-router-binary-copy/0.log"
Jul 09 01:35:45.797174 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:45.797142    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dhpcm_f4dbea2c-28f9-4405-b905-f740dbe64a09/cni-plugins/0.log"
Jul 09 01:35:45.816055 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:45.816030    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dhpcm_f4dbea2c-28f9-4405-b905-f740dbe64a09/bond-cni-plugin/0.log"
Jul 09 01:35:45.834926 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:45.834895    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dhpcm_f4dbea2c-28f9-4405-b905-f740dbe64a09/routeoverride-cni/0.log"
Jul 09 01:35:45.855454 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:45.855427    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dhpcm_f4dbea2c-28f9-4405-b905-f740dbe64a09/whereabouts-cni-bincopy/0.log"
Jul 09 01:35:45.875068 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:45.875043    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dhpcm_f4dbea2c-28f9-4405-b905-f740dbe64a09/whereabouts-cni/0.log"
Jul 09 01:35:46.332111 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:46.332083    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dgrzs_518d8542-a147-4718-9ae0-eda6710ea1a4/network-metrics-daemon/0.log"
Jul 09 01:35:46.347922 ip-10-0-133-31 kubenswrapper[2557]: I0709 01:35:46.347898    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dgrzs_518d8542-a147-4718-9ae0-eda6710ea1a4/kube-rbac-proxy/0.log"